Skip to main content
International Journal of Environmental Research and Public Health logoLink to International Journal of Environmental Research and Public Health
. 2022 Mar 24;19(7):3876. doi: 10.3390/ijerph19073876

The Utility of Ambulance Dispatch Call Syndromic Surveillance for Detecting and Assessing the Health Impact of Extreme Weather Events in England

Simon Packer 1,2,*, Paul Loveridge 3, Ana Soriano 3, Roger Morbey 3, Dan Todkill 3,4, Ross Thompson 5, Tracy Rayment-Bishop 6, Cathryn James 7, Hilary Pillin 7, Gillian Smith 3, Alex J Elliot 3
Editor: Gabriel Gulis
PMCID: PMC8997786  PMID: 35409559

Abstract

Extreme weather events present significant global threats to health. The National Ambulance Syndromic Surveillance System collects data on 18 syndromes through chief presenting complaint (CPC) codes. We aimed to determine the utility of ambulance data to monitor extreme temperature events for action. Daily total calls were observed between 01/01/2018–30/04/2019. Median daily ’Heat/Cold’ CPC calls during “known extreme temperature” (identified a priori), “extreme temperature”; (within 5th or 95th temperature percentiles for central England) and meteorological alert periods were compared to all other days using Wilcoxon signed-rank test. During the study period, 12,585,084 calls were recorded. In 2018, median daily “Heat/Cold” calls were higher during periods of known extreme temperature: heatwave (16/day, 736 total) and extreme cold weather events (28/day, 339 total) compared to all other days in 2018 (6/day, 1672 total). Median daily “Heat/Cold” calls during extreme temperature periods (16/day) were significantly higher than non-extreme temperature periods (5/day, p < 0.001). Ambulance data can be used to identify adverse impacts during periods of extreme temperature. Ambulance data are a low resource, rapid and flexible option providing real-time data on a range of indicators. We recommend ambulance data are used for the surveillance of presentations to healthcare related to extreme temperature events.

Keywords: weather, emergency medical dispatch, hot temperature, cold temperature, climate change, ambulance, public health, surveillance

1. Introduction

Extreme weather events, such as sudden or gradual increases or decreases in temperature, snow, ice, and flooding, have a serious impact on health worldwide [1]. Global climate change is predicted to increase the frequency and intensity of extreme weather, and areas previously less affected will be put at greater risk [1,2] Extreme weather is increasingly recognized as an emerging health threat in the UK, with climate change models showing an increase in the likelihood of heatwave events in the future [3].

Globally, the impact of heatwaves on health has been well documented: 514 heat-related deaths and 3300 excess emergency admissions following the 1995 heatwave in Chicago; 3000 deaths associated with the 1994 heatwave in South Korea; and 71,000 deaths as a result of a European heat wave in 2003 [4,5,6,7]. Similar increases in mortality have been found during extreme cold weather events. A study in China found a 28% increase in the cumulative excess risk associated with non-accidental mortality on cold compared to non-cold-spell days [8]. Extreme weather events have a disproportionate effect on the vulnerable within society and persons with pre-existing health conditions; the very old and young are particularly at risk [1,7].

The heatwave and cold weather plans for England outline surveillance as a key part of the response to extreme weather events [9,10]. The UK and other nations need a diverse range of health data sources and surveillance systems to measure the impact and provide early warning of adverse health outcomes associated with extreme weather events. Syndromic surveillance has been shown to be able to monitor a wide range of health events and provide intelligence on infectious and environmental threats [11,12,13].

Ambulance dispatch data has the potential to provide near real-time and low-cost surveillance of infectious and non-communicable disease [14,15]. Ambulance services provide a first point of contact or access point to persons seeking urgent medical care [14]. We aimed to determine the utility of the National Ambulance Syndromic Surveillance System (NASS), established in England during 2018 [16] to monitor the health impact, provide situational awareness, and provide alerts for when we might observe health effects as a result of extreme and known temperature events in England.

2. Materials and Methods

The NASS collects anonymized daily data from all ten ambulance services in England. Services passively submit information to the UK Health Security Agency (UKHSA) which is used daily to monitor 18 syndromes. Syndromes are based on chief presenting complaint (CPC) codes, which are generated in the trust electronic patient management system during an ambulance call. Chief presenting complaint codes are high level triage codes identifying the main clinical problem from information given during an emergency call. The codes enable prioritization of calls so that ambulance services can be dispatched and respond appropriately. The ‘Heat/cold exposure’ CPC calls were identified as an indicator for assessing the impact and health burden of extreme weather events. The ‘heat/cold exposure’ CPC call code related to calls regarding heat or cold exposure problems including hypothermia, heat exhaustion, heat stroke and frostbite; however, the aggregated nature of the CPC means heat and cold problems cannot be disentangled.

Daily ‘heat/cold exposure’ CPC calls were extracted from NASS for the period 01/01/2018–30/04/2019. More recent data were not considered due to the significant impact of COVID-19 on ambulance syndromic calls [17]. Data on daily mean, min, and max central England temperatures, ‘known temperature events’ (KTE; identified a priori), Heat-Health and Cold Weather Alerts, and key syndromic indicators from other UKHSA systems (telehealth (NHS 111)), emergency department (EDSSS), GP in hours (GPIH), and GP out of hours’ (GPOOH)) were obtained and linked to NASS call data by date of report [9,10].

‘Extreme temperature days’ (ETD) were defined as those with a temperature outside the 5th or 95th percentiles for the total study period. KTE identified a priori were as follows: two periods of severe cold weather (“beast from the east” 24/02/2018 to 04/03/2018 and “mini beast from the east” 17/03/2018 to 18/03/2018) and a heatwave during 2018 (22/06/2018 to 07/08/2018). UKHSA ‘Heat Health and Cold Weather Alert’ data were only calculated from 1 November to 31 March (cold weather alert period) and 1 June to 15 September (heat health alert period) each year and analysis was restricted accordingly [9,10]. There are three levels of alert: level 1, ‘summer/winter preparedness’; level 2, hot or cold weather above normal thresholds is forecast; and level 3, hot or cold weather above normal thresholds is currently being experienced. The levels do not indicate severity of conditions and are not based solely on temperature levels. NASS statistical alarms were calculated using a multi-level hierarchical mixed effect model (RAMMIE). RAMMIE is used daily to produce daily alarms across all English syndromic surveillance systems. In this instance it was used to calculate expected baselines and statistical alarms at the national level [18].

Data were analyzed at England level with daily call data analyzed using median, mean, interquartile range (IQR), minimum, and maximum. Daily heat/cold exposure CPC calls and seven day moving averages were plotted and visually compared to daily temperature data and UKHSA Heat Health and Cold Weather Alerts. The number of heat/cold exposure CPC calls were compared between ETD, KTE, and UKHSA Heat Health and Cold Weather Alerts level (level 1 to 3) days using notched box and whisker plots and Wilcoxon signed-rank test. Regional UKHSA Heat Health and Cold Weather Alerts levels were aggregated to the national level. Aggregation used a hierarchy where the presence of any regional level 3 alert defined that day as “level 3”, followed by any level 2 alerts. For a day to be classified as level 1 (normal reporting) all regions needed to be classified as level 1 on that day. The concordance between NASS alarms generated by RAMMIE (as described above) and UKHSA Heat Health and Cold Weather Alerts was determined by calculating the inter-rater reliability and Cohen’s kappa with 95% confidence interval.

The corrplot and Hmisc packages were used to examine the correlation between the daily NASS call count and corresponding ‘heatwave’ indicator counts from other UKHSA syndromic surveillance systems (NHS 111 ‘heat and sunstroke’, NHS 111 ‘insect bites’, EDSSS ‘heat/sunstroke’, GPOOH ‘sunstroke’, GPIH ‘insect bite’ and GPIH ‘heat stroke’) were calculated using Spearman rank correlation coefficients, mid ranks were used for ties and p-values approximated using F distributions. A correlation matrix was produced to show the relationship between indicators [19,20]. As all comparable syndromic indicators were related to heat exposure the analysis was restricted to the period when the Heat Health alerts are in operation in England (1 June to 15 September). All analyses were undertaken using R version 4.0.2 (2020-06-22) “Taking Off Again” [21].

3. Results

3.1. System Description

The study period consisted of 484 days from 01/01/2018 to 30/04/2019. Data were available from ten ambulance trusts that mapped to nine UKHSA regions in England. During the study period, NASS received 12,585,084 syndromic calls in total. When looking at heat/cold exposure CPC calls, there was a median of 5 in England per day (interquartile range: 3 to 8) and ranging from 0 to 54 calls.

For the majority of the study period, calls relating to heat/cold exposure CPC calls stayed between 0–10 calls per day. However, spikes in the number of calls were observed, particularly during sudden drops or prolonged increases in temperature resulting in corresponding spikes in the number of heat/cold exposure CPC calls (Figure 1). There was a heightened number of calls during the three KTE, two cold weather and one heat wave, with sudden spike in call numbers during the event followed by a drop when the heat wave or cold weather subsided. Furthermore, spikes in heat/cold exposure CPC calls were frequently concordant with the presence of UKHSA Heat Health and Cold Weather Alerts (Figure 1). A substantial spike in heat/cold exposure CPC calls was observed outside a UKHSA Heat Health and Cold Weather alerting period and was not associated with a KTE, however, it corresponded with an increase in temperature (Figure 1).

Figure 1.

Figure 1

(A) mean (blue line), min and max (grey area) central England (CE) temperature (top panel) over time, (B) PHE Heat Health and Cold Weather Alerts (middle panel), and (C) Number of Heat/cold exposure CPC calls (bottom panel) with extreme weather events identified a priori marked on graph in grey boxes.

3.2. NASS Heat and Cold Exposure CPC Relationship with Extreme Temperature

There was a median of 16 (IQR: 11 to 28) heat/cold exposure CPC calls per day during ETD (days within 5th and 95th temperature percentile) compared to 5 calls/day (IQR: 3 to 7) during normal temperature days, p < 0.001 (Figure 2). While the median was greater in ETD compared to normal days, we observed several days where a high number of calls (max = 42) were received even though temperatures were within the ‘normal’ range. We observed the same significant elevation in the number of daily heat/cold exposure CPC calls during the three KTE (indicated in the grey boxes marked on Figure 1). The large peak observed on the 7 May 2018 relates to the May Bank Holiday.

Figure 2.

Figure 2

Box-whisker plot describing the (A + B) number of heat/cold exposure CPC calls observed between extreme and normal temperature days (top left) and KTE, non-temperature event (top right), and (C) across different PHE Heat Health and Cold Weather Alert levels (bottom).

For analysis of UKHSA Heat Health and Cold Weather Alerts, data were restricted to the 348 days in the study period where these were issued (alerts issued between 1 November to 31 March and 1 June to 15 September). There was a significantly higher median daily number of heat/cold exposure CPC calls on days when a level 2 (median 10, IQR: 6 to 16 daily calls) or level 3 (median 12, IQR: 8 to 22 daily calls) alert was issued compared to level 1 (median 4, IQR: 3 to 6) days (level 1 compared to level 2 or 3 both p < 0.001; Figure 2).

The concordance between the presence of a NASS system RAMMIE alarm and a UKHSA Heat Health and Cold Weather level 2 and 3 alert in any UKHSA region had an inter-rater agreement of 82% and Cohen’s kappa 0.47 (95% CI: 0.37 to 0.57), indicating moderate agreement between the two systems. On the majority (67%) of days where a NASS statistical alarm was identified there was a corresponding UKHSA Heat Health and Cold Weather level 3 alert. However, when looking at the 10% of the days when there was no NASS statistical alarm, there was a UKHSA Heat Health and Cold Weather level 3 or 2 alert, respectively (Table 1).

Table 1.

Number of a NASS heat/cold exposure CPC statistical alarms by whether at least one region experiencing PHE Heat Health and Cold Weather Alerts.

Level 1 Percentage Level 2 Percentage Level 3 Percentage Total
No NASS Alarm 245 80% 30 10% 31 10% 306
NASS Alarm 2 5% 12 29% 28 67% 42
Total 247 71% 42 12% 59 17% 348

3.3. NASS Heat and Cold Exposure CPC Relationship with Other Syndromic Surveillance Systems

Comparable extreme weather syndromic indicators from other UKHSA systems were all heat-related and, therefore, data were restricted to 1 June to 15 September (Heat Health watch period). We found a significant positive correlation between the number of NASS heat cold exposure calls and NHS 111 heat/sunstroke (r = 0.78), NHS 111 insect bites (r = 0.61), EDSSS heat stroke (r = 0.76), GPOOH sunstroke (r = 0.68), and GPIH heat stroke (r = 0.34). NASS heat and cold calls were not significantly correlated with GPIH insect bites (r = 0.19; Figure 3).

Figure 3.

Figure 3

Correlation between NASS heat/cold exposure CPC calls and related syndromic indicators from telehealth (NHS 111), emergency department (EDSSS), GP in hours (GPIH), and GP out of hours’ (GPOOH) systems. Each circle represents a correlation pair (small circles represent a weak and large a strong correlation, respectively), with the color and size dependent on the pairs correlation co-efficient (r). Circles without crosses represent significant correlations and circles with crosses signify non-significant correlation between indicators.

4. Discussion

We aimed to determine the utility of NASS to monitor the health impact of extreme weather events and assess its relationship with related syndromic indicators. The study found that ambulance heat and cold exposure calls had a strong association with severe weather and temperature events occurring in England. The number of daily calls were generally low, but during extreme weather events heat and cold ambulance calls increased exponentially. The analysis shows that, while the heat/cold exposure CPC calls code is infrequently used by ambulance services, it is highly specific and sensitive to days where extreme temperature events were observed. The NASS indicator can be used in real time to quantify and describe serious community onset health effects resulting from extreme weather events. The finding is supported by the significant elevation of NASS heat/cold exposure CPC calls during ETD and on days where a KTE had occurred. NASS heat/cold CPC calls were also significantly elevated during UKHSA Heat Health and Cold Weather Alerts level 2 or 3 alerts. UKHSA Heat Health and Cold Weather Alerts are based on meteorological factors such as forecast temperature and wider contextual factors and are considered together as part of a dynamic risk assessment [9,10]. The concordance between NASS statistical alarms and meteorological alerts shows that the system can probably detect the health impact from multi-modal weather and not just temperature events. The added benefit of NASS is that it provided alerts throughout the whole year, whereas UKHSA Heat Health and Cold Weather Alerts were provided only at specific times of year. The benefit of annual coverall of NASS data is particularly apparent when looking at 7 May, 2018, where a significant spike in calls was observed in relation to the hottest ever recorded May Bank Holiday. The temperature increase was not within the UKHSA Heat Health and Cold Weather alert period; however, ambulance attendances potentially indicate a significant health impact during this weekend.

We found that NASS heat/cold exposure CPC calls showed strong correlation with heat-related syndromic indicators in other UKHSA syndromic surveillance systems. Strongest correlations were found with NHS 111, GPOOH, and EDSSS surveillance data. These findings are expected, as these services provide similar ‘unscheduled’ care, which are more likely to be used by patients in the event of severe heat exposure symptoms [22]. The correlation supports the reliability of NASS system to identify health events related to extreme weather. The evidence presented demonstrates that the NASS heat/cold exposure CPC calls are broad and a ‘catch all’ indicator, they are flexible and responsive, and can be used to trigger action. Actions resulting from NASS system alerts could include targeted health messaging to members of the public and alerting emergency services to increase awareness of the health impact of hot/cold weather. The impact of extreme temperatures on health can vary between and within seasons [22]. In order for appropriate public health action to be taken, intelligence is needed, and NASS provides this in near real time.

Gaps in information have a direct impact on our ability to implement comprehensive and effective public health interventions in response to extreme weather events. Syndromic surveillance systems have been shown to identify potential public health threats and direct the action to mitigate [11,23,24,25]. There have been several ambulance dispatch systems described in the published and grey literature [14]. The majority of current systems report at the regional level, utilize retrospective data analysis, and focus on respiratory infections or harms related to drugs or mental health [14,15,26]. Although syndromic data has been used to monitor the health impact of extreme weather, to our knowledge NASS is the only ambulance-based system that can provide intelligence at a national level and a ‘multi-hazard’ response [27]. Its national prospective data collection ensures timely data to monitor the effects of extreme weather across the whole of the country and supports the identification and management of incidents which might be more severe at certain geographies. NASS provides an added benefit as it captures data associated with the severe end of the health spectrum. These events are potentially not recorded in other systems and, therefore, NASS can provide novel real-time data to describe a range of health impacts during extreme weather events.

There are several strengths to our approach for monitoring ambulance dispatch data. Data are collected using automated daily routines meaning there are no ongoing requirements from the ambulance trusts participating. The surveillance utilizes existing chief complaint codes used in the routine triage of patients and, therefore, does not require trusts to use additional or bespoke codes. There are, however, some limitations. Firstly, the syndromic indicator definitions are non-specific, potentially covering a wide range of disorders, which means that it is sometimes difficult to elucidate the cause of the observed syndromic spikes. In spite of this limitation, we found that NASS heat/cold exposure CPC calls can provide important information to augment and inform situational awareness and alerts for the associated health impact of extreme weather, which can be explored using other data sources. Secondly, due to operational requirements and processes within individual ambulance trusts, there was variation in coding by individual trusts, which means that undertaking the analysis at regional level is challenging. Exploring the regional variation is a key development of the system in the future. Future work would explore regional variation in ambulance call numbers and the impact of regional temperatures, weather patterns, and socio-demographic factors on their distribution. Furthermore, it is important to explore further the utility of other specific chief complaints and how they relate to extreme weather events. The NASS system can be further expanded to cover devolved administrations and make a UK-wide system.

However, NASS is part of a suite of national syndromic systems, and other data streams can inform on regional variations in heat/cold impact.

5. Conclusions

Due to climate change, the negative health effects of extreme weather are likely to grow in magnitude and frequency. We believe that as for any other health event, data collection, analysis, and interpretation are key to understanding and mitigating the adverse effects of extreme weather. We show that NASS heat and cold CPC is a highly specific indicator of the negative health impact of extreme weather events in England. The system alarms correspond to those produced the by multi-modal alerting system developed by the Met office. Finally, NASS data correlate with related indictors from other syndromic surveillance systems. These findings show that NASS can be used effectively for surveillance during extreme weather and be triangulated with other data sources to provide a comprehensive quantification of the health impacts associated with extreme weather. NASS data deliver valuable additional information as it is real time, longitudinal and provides data on conditions at the extreme end of the clinical spectrum. The use of NASS data can be further expanded and improved through the investigation to look at how regional temperature changes impact regional call volumes. Localized information would provide information to support local preparedness and response to health and cold weather events. While monitoring for extreme weather events is a key component of ambulance surveillance, NASS has already demonstrated value to a number of other incidents including during the global COVID-19 pandemic. We recommend that NASS is used in combination with other surveillance systems to monitor and quantify the health impact of extreme weather events on the population in England. Integrating NASS into UKHSA’s multi-hazard surveillance program can enhance early warning and situational awareness during extreme weather events

Acknowledgments

The authors thank the Training Programmes in Epidemiology and Public Health Interventions Network for funding the evaluation through the Non-communicable Disease (NCD) Field Epidemiology Projects Mini-Grant scheme 2018–2019. The authors acknowledge the contribution and support from the ambulance trust clinicians and staff contributing to NASS and the ongoing support of the Association of Ambulance Chief Executives.

Author Contributions

S.P. participated in: Conceptualization, methodology, Data curation, investigation, Formal analysis, Writing—original draft preparation, writing—review and editing. P.L. participated in: Data curation, investigation, Formal analysis, Writing—original draft preparation, writing—review and editing. A.S. participated in: Data curation, investigation, Formal analysis, Writing—original draft preparation, writing—review and editing. R.M. participated in: Conceptualization, methodology, Formal analysis, Writing—original draft preparation, writing—review and editing. D.T. participated in: Conceptualization, methodology, Writing—original draft preparation, writing—review and editing. R.T. participated in: Conceptualization, methodology, Writing—original draft preparation, writing—review and editing. T.R.-B. participated in: Conceptualization, methodology, Data curation, investigation, writing—review and editing. C.J. participated in: Conceptualization, methodology, Data curation, investigation, Writing—original draft preparation, writing—review and editing. H.P. participated in: Conceptualization, methodology, Data curation, investigation, Writing—original draft preparation, writing—review and editing. G.S. participated in: Conceptualization, methodology, Data curation, investigation, Formal analysis, Writing—original draft preparation, writing—review and editing. A.J.E. participated in: Conceptualization, methodology, Data curation, investigation, Formal analysis, Writing—original draft preparation, writing—review and editing. All authors have read and agreed to the published version of the manuscript.

Funding

S.P. received funding for NASS evaluation by a mini-grant from the Non-communicable Disease (NCD) Field Epidemiology Projects Mini-Grant scheme 2018–2019 from the Training Programmes in Epidemiology and Public Health Interventions Network (funding number: TPN-FE-GLBN). Study sponsors were not involved in the collection, analysis, and interpretation of data; in the writing of the manuscript; and in the decision to submit the manuscript for publication. G.S. and A.J.E. are affiliated to the National Institute for Health Research Health Protection Research Unit (NIHR HPRU) in Gastrointestinal Infections at University of Liverpool. R.M., G.S. and A.J.E. are affiliated to the NIHR HPRU in Emergency Preparedness and Response at King’s College London.

Institutional Review Board Statement

Ethical review and approval were waived for this study as it was part of work to improve service provision and delivery.

Informed Consent Statement

Patient consent was waived due to the system only collecting anonymous aggregated data, which is collect as part of routine public health service provision.

Data Availability Statement

The datasets used in this study are not publicly available.

Conflicts of Interest

The authors declare no conflict of interest.

Footnotes

Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

References

  • 1.World Health Organization . Climate Change and Human Health: Risks and Responses. World Health Organization; Geneva, Switzerland: 2003. [Google Scholar]
  • 2.Melillo J.M., Richmond T., Yohe G.W. Climate Change Impacts in the United States: The Third National Climate Assessment. U.S. Global Change Research Program; Washington, DC, USA: 2014. [Google Scholar]
  • 3.Doherty R.M., Heal M.R., Wilkinson P., Pattenden S., Vieno M., Armstrong B., Atkinson R., Chalabi Z., Kovats S., Milojevic A., et al. Current and future climate- and air pollution-mediated impacts on human health. Environ. Health. 2009;8:S8. doi: 10.1186/1476-069X-8-S1-S8. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4.Whitman S., Good G., Donoghue E.R. Mortality in Chicago attributed to the July 1995 heat wave. Am. J. Public Health. 1997;87:1515–1518. doi: 10.2105/AJPH.87.9.1515. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5.Fouillet A., Rey G., Laurent F., Pavillon G., Bellec S., Guihenneuc-Jouyaux C., Clavel J., Jougla E., Hémon D. Excess mortality related to the August 2003 heat wave in France. Int. Arch. Occup. Environ. Health. 2006;80:16–24. doi: 10.1007/s00420-006-0089-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6.Kyselý J., Kim J. Mortality during heat waves in South Korea, 1991 to 2005: How exceptional was the 1994 heat wave? Clim. Res. 2009;38:105–116. [Google Scholar]
  • 7.Johnson H., Kovats R.S., McGregor G., Stedman J., Gibbs M., Walton H. The impact of the 2003 heat wave on daily mortality in England and Wales and the use of rapid weekly mortality estimates. Euro Surveill. 2005;10:168–171. doi: 10.2807/esm.10.07.00558-en. [DOI] [PubMed] [Google Scholar]
  • 8.Wang L., Liu T., Hu M., Zeng W., Zhang Y., Rutherford S., Lin H., Xiao J., Yin P., Liu J., et al. The impact of cold spells on mortality and effect modification by cold spell characteristics. Sci. Rep. 2016;6:38380. doi: 10.1038/srep38380. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9.Public Health England Heatwave Plan for England. [(accessed on 1 December 2021)]; Available online: https://assets.publishing.service.gov.uk/government/uploads/system/uploads/attachment_data/file/888668/Heatwave_plan_for_England_2020.pdf.
  • 10.Public Health England The Cold Weather Plan for England. [(accessed on 1 December 2021)]; Available online: https://assets.publishing.service.gov.uk/government/uploads/system/uploads/attachment_data/file/1031106/UKHSA_Cold_Weather_Plan_for_England.pdf.
  • 11.Elliot A.J., Hughes H.E., Hughes T.C., Locker T.E., Shannon T., Heyworth J., Wapling A., Catchpole M., Ibbotson S., McCloskey B., et al. Establishing an emergency department syndromic surveillance system to support the London 2012 Olympic and Paralympic Games. Emerg. Med. J. 2012;29:954–960. doi: 10.1136/emermed-2011-200684. [DOI] [PubMed] [Google Scholar]
  • 12.Elliot A.J., Hughes H.E., Hughes T.C., Locker T.E., Brown R., Sarran C., Clewlow Y., Murray V., Bone A., Catchpole M., et al. The impact of thunderstorm asthma on emergency department attendances across London during July 2013. Emerg. Med. J. 2014;31:675–678. doi: 10.1136/emermed-2013-203122. [DOI] [PubMed] [Google Scholar]
  • 13.Paterson B.J., Durrheim D.N. The remarkable adaptability of syndromic surveillance to meet public health needs. J. Epidemiol. Glob. Health. 2013;3:41–47. doi: 10.1016/j.jegh.2012.12.005. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.Duijster J.W., Doreleijers S.D.A., Pilot E., van der Hoek W., Kommer G.J., van der Sande M.A.B., Krafft T., van Asten L.C.H.I. Utility of emergency call centre, dispatch and ambulance data for syndromic surveillance of infectious diseases: A scoping review. Eur. J. Public Health. 2020;30:639–647. doi: 10.1093/eurpub/ckz177. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15.Lubman D.I., Matthews S., Heilbronn C., Killian J.J., Ogeil R.P., Lloyd B., Witt K., Crossin R., Smith K., Bosley E., et al. The National Ambulance Surveillance System: A novel method for monitoring acute alcohol, illicit and pharmaceutical drug related-harms using coded Australian ambulance clinical records. PLoS ONE. 2020;15:e0228316. doi: 10.1371/journal.pone.0228316. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16.Todkill D., Loveridge P., Elliot A.J., Morbey R.A., Edeghere O., Rayment-Bishop T., Rayment-Bishop C., Thornes J.E., Smith G. Utility of Ambulance Data for Real-Time Syndromic Surveillance: A Pilot in the West Midlands Region, United Kingdom. Prehosp. Disaster Med. 2017;32:667–672. doi: 10.1017/S1049023X17006690. [DOI] [PubMed] [Google Scholar]
  • 17.Elliot A.J., Harcourt S.E., Hughes H.E., Loveridge P., Morbey R.A., Smith S., Soriano A., Bains A., Smith G.E., Edeghere O., et al. The COVID-19 pandemic: A new challenge for syndromic surveillance. Epidemiol. Infect. 2020;148:e122. doi: 10.1017/S0950268820001314. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18.Morbey R.A., Elliot A.J., Charlett A., Verlander N.Q., Andrews N., Smith G.E. The application of a novel “rising activity, multi-level mixed effects, indicator emphasis” (RAMMIE) method for syndromic surveillance in England. Bioinformatics. 2015;31:3660–3665. doi: 10.1093/bioinformatics/btv418. [DOI] [PubMed] [Google Scholar]
  • 19.Wei T., Simko V. R Package “corrplot”: Visualization of a Correlation Matrix. R Core Team; Vienna, Austria: 2021. [Google Scholar]
  • 20.Harrell F.E. [R] Hmisc: Harrell Miscellaneous. [(accessed on 1 December 2021)]. Available online: https://cran.r-project.org/package=Hmisc.
  • 21.R Core Team R. A Language and Environment for Statistical Computing. [(accessed on 1 December 2021)]. Available online: https://www.r-project.org/
  • 22.Curtis S., Fair A., Wistow J., Val D.V., Oven K. Impact of extreme weather events and climate change for health and social care systems. Environ. Health. 2017;16:128. doi: 10.1186/s12940-017-0324-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 23.Harcourt S.E., Morbey R.A., Loveridge P., Carrilho L., Baynham D., Povey E., Fox P., Rutter J., Moores P., Tiffen J., et al. Developing and validating a new national remote health advice syndromic surveillance system in England. J. Public Health. 2016;39:fdw013. doi: 10.1093/pubmed/fdw013. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24.Harcourt S.E., Fletcher J., Loveridge P., Bains A., Morbey R., Yeates A., McCloskey B., Smyth B., Ibbotson S., Smith G.E., et al. Developing a new syndromic surveillance system for the London 2012 Olympic and Paralympic Games. Epidemiol. Infect. 2012;140:2152–2156. doi: 10.1017/S0950268812001781. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 25.Smith G.E., Elliot A.J., Ibbotson S., Morbey R., Edeghere O., Hawker J., Catchpole M., Endericks T., Fisher P., McCloskey B. Novel public health risk assessment process developed to support syndromic surveillance for the 2012 Olympic and Paralympic Games. J. Public Health. 2017;39:e111–e117. doi: 10.1093/pubmed/fdw054. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 26.Lubman D.I., Heilbronn C., Ogeil R.P., Killian J.J., Matthews S., Smith K., Bosley E., Carney R., McLaughlin K., Wilson A., et al. National Ambulance Surveillance System: A novel method using coded Australian ambulance clinical records to monitor self-harm and mental health-related morbidity. PLoS ONE. 2020;15:e0236344. doi: 10.1371/journal.pone.0236344. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 27.Dirmyer V.F. Using Real-Time Syndromic Surveillance to Analyze the Impact of a Cold Weather Event in New Mexico. J. Environ. Public Health. 2018;2018:2185704. doi: 10.1155/2018/2185704. [DOI] [PMC free article] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Data Availability Statement

The datasets used in this study are not publicly available.


Articles from International Journal of Environmental Research and Public Health are provided here courtesy of Multidisciplinary Digital Publishing Institute (MDPI)

RESOURCES