Skip to main content
Epidemiology and Infection logoLink to Epidemiology and Infection
. 2014 Jul 18;143(6):1166–1174. doi: 10.1017/S0950268814001733

Under-reporting of notifiable infectious disease hospitalizations: significant improvements in the Irish context

E D BRABAZON 1,*, A SHERIDAN 1, P FINNEGAN 1, M W CARTON 1,2, D BEDFORD 1
PMCID: PMC9507160  PMID: 25035904

SUMMARY

Notification of infectious disease is essential for prompt public health action and epidemiological analysis. The aim of this study was to compare national hospitalization data to national notification data in order to assess if there was significant under-reporting of hospitalized notifiable infectious diseases in recent years in Ireland. All in-patient discharges from public hospitals in the Republic of Ireland from 2006 to 2011 with a principal diagnosis of a notifiable disease were compared with national notification data. It was found that only a potential 1·8% of extra notifications could have arisen due to these hospitalization events and would represent a tenfold reduction on a previous estimate of under-reporting in the Irish context. Viral meningitis, viral encephalitis, bacterial meningitis not otherwise specified and malaria were the most common diseases for which there were more hospitalizations than notifications reported. The results of this study support the conclusion that the reduction in under-reporting can mainly be accounted for by the introduction of laboratories as notifiers in conjunction with the roll out of the Computerized Infectious Disease Reporting system (CIDR). However, for the diseases highlighted, the notification data underestimates the true burden of disease and this has implications for understanding the epidemiology of these diseases.

Key words: Notifiable infectious diseases, health statistics, surveillance

INTRODUCTION

Rapid notification of infectious diseases is the cornerstone of prompt public health action and provides essential information on local, regional and national disease epidemiology. Furthermore, the notification process provides an early warning system for the detection of outbreaks and for the surveillance of unusual clusters of infectious disease. However, under-reporting of notifiable diseases has been demonstrated in many countries for a variety of infectious diseases [14]. Low clinician reporting has been associated with a large number of factors including excessive workload, lack of time, lack of motivation and lack of familiarity with the list of statutory notifiable diseases. Measures to tackle this problem focus on continuing medical education for clinicians to emphasize the importance of the notification process and the development of surveillance systems that are flexible and that can support the collection and management of infectious disease data.

The Hospital In-Patient Enquiry System (HIPE), which is maintained by the Healthcare Pricing Office (HPO), is the only source of standardized national morbidity data routinely collected for acute public hospitals in Ireland [5]. Each episode of patient care is coded according to the International Classification of Diseases 10th Revision – Australian Modification (ICD-10-AM) [6]. Between 2006 and 2011, the HIPE system captured data from 57 Irish acute public hospitals (>1·25 million discharges) representing a comprehensive coverage of discharges from acute public hospitals in Ireland. Therefore, the HIPE dataset offers an opportunity to identify and analyse notifiable infectious disease hospitalizations in Ireland.

In an Irish context, under-reporting has been well documented [711]. In particular, a study conducted between 1997 and 2002 in a health board region in Ireland demonstrated that under-reporting by hospital clinicans was a significant issue [10]. A conservative estimate of 18% for under-reporting by hospital clinicians was estimated during this time-frame. Viral meningitis and viral encephalitis cases were significantly under-reported, so much so, that the trends over time for hospitalized cases were markedly different than the trends reported for corresponding notified cases. However, in 2004, major changes to the Irish infectious disease legislation and surveillance systems were introduced. These changes included an updated list of notifiable diseases [12], the introduction of laboratories as notifiers and the development of the Computerized Infectious Disease Reporting (CIDR) system [13] which facilitates rapid transfer and analysis of regional and national information on notifable diseases in a secure electronic environment.

The aim of this study was to compare hospitalizations due to notifiable diseases as identified through the HIPE system with national notification data reported to the Departments of Public Health and the Health Protection Surveillance Centre (HPSC) between 2006 and 2011. This analysis will assess if there has been under-reporting of hospitalized notifiable diseases by clinicians in recent years and explore the impact of changes to the infectious disease surveillance methods and regulations which were introduced in 2004.

METHODS

Data on notifiable infectious diseases as specified by the 1981 Irish Infectious Disease Regulations [14] are collected through a number of surveillance systems in Ireland. For the purposes of this study only those notifications that are collected through the CIDR system and the Tuberculosis (TB) Surveillance System maintained by the regional Departments of Public Health and the HPSC were included for analysis. Notification data from 2006 to 2011 on notifiable infectious diseases for the Republic of Ireland were extracted from CIDR on 13 November 2013. Aggregate data on national TB cases were kindly provided by HPSC.

Acute infectious gastroenteritis (AIG) was defined in the 2004 Irish case definitions for notifiable diseases as an acute onset of diarrhoea and vomiting with no known non-infectious cause or a laboratory-confirmed case of rotavirus. In practice, the majority of these AIG notifications at the time were rotavirus cases. On 4 May 2008, the AIG case definition was updated to include Clostridium difficile-associated disease. In late 2011, rotavirus and C. difficile became notifiable in their own right. Therefore, for the purposes of this study and to simplify the comparison of data between HIPE and CIDR, the term AIG was used to signify C. difficile and rotavirus notifications only.

The HIPE datasets for the years from 2006 to 2011 were provided by the HPO through Health Atlas Ireland (HAI) [15]. Ireland updated to an ICD-10-AM-based clinical coding classification for all discharges from 1 January 2005. Therefore to eliminate any effect of this changeover, data were analysed for this study for a 6-year period from 2006 to 2011. All in-patient discharges from public hospitals in the Republic of Ireland participating in HIPE for the years 2006–2011, with a principal diagnosis relating to a notifiable infectious disease (Table 1) were extracted from HAI. This was achieved by identifying the relevant ICD-10-AM codes for all notifiable infectious diseases, based on the 1981 Infectious Disease Regulations (SI No. 390 of 1981 with subsequent amendments; see Table 1 for individual codes for each disease). These ICD-10-AM codes were inputted as ‘sub-selections’ into HAI to extract the relevant data. Only the principal diagnosis (the primary reason for admission) was selected in order to best represent new incident cases of disease and in order to eliminate co-existing or historical conditions from the analysis. In cases where patients had more than one hospitalization for the same condition over the 6-year period all duplicates were removed based on a first occurrence per patient basis using medical record numbers, gender and area of residence. This was done in order to assess the number of notifications that should have arisen due to hospitalization events.

Table 1.

ICD-10-AM corresponding codes for notifiable diseases

Disease ICD-10-AM codes Comments Disease ICD-10-AM codes Comments
Acute anterior poliomyelitis A800, A801, A802, A803, A809 Mumps B26
Acute infectious gastroenteritis A080, A047 C. difficile and rotavirus only Noroviral infection A081
Anthrax A22 Paratyphoid A011, A012, A013, A014
Bacillus cereus foodborne infection A054 Pertussis A37
Bacterial meningitis (not otherwise specified) G002, G003, G009, G008 Plague A20
Botulism A051 Q Fever A78
Brucellosis A23 Rabies A82
Campylobacter infection A045 Rubella B06
Cholera A00 Salmonellosis A02
Clostridium perfringens (type A) foodborne disease A052 Severe acute respiratory syndrome (SARS) U049
Creutzfeldt–Jakob disease (CJD) A810 Includes CJD and nvCDJ Shigellosis A03
Cryptosporidiosis A072 Smallpox B03
Diphtheria A36 Staphylococcal food poisoning A050
Echinococcosis B67 Streptococcus group A infection (invasive) A400 No specific codes for pneumoniae, meningitis, etc.
Enterohaemorrhagic Escherichia coli A040, A041, A042, A043, A044, D59·3 While, A043 is the most appropriate code, it is likely that related codes A040-A044 are used. D59·3 codes for haemolytic uremic syndrome (HUS) Streptococcus pneumoniae infection (invasive) A403, G001, J13 Includes sepsis, meningitis and pneumoniae
Giardiasis A071 Tetanus A33, A34, A35
Haemophilus influenzae disease (invasive) A413, G000, J14 Includes sepsis, meningitis and pneumoniae Toxoplasmosis B58
Hepatitis A (acute) B150, B159 Trichinosis B75
Hepatitis B (acute and chronic) B16, B180, B181, Z2251 Tuberculosis A15, A16, A17, A18, A19
Hepatitis C B171, B182, Z2252 Tularemia A21
Influenza J09, J10, J11 Typhoid A010
Legionellosis A481 Typhus A75
Leptospirosis A27 Viral encephalitis A83, A84, A85, A86, B004, B011, B020 Also includes herpes, varicella and zoster encephalitis
Listeriosis A32 Viral meningitis A87, B003, B010, B021 Also includes herpes, varicella and zoster meningitis
Malaria B50, B51, B52, B53, B54 Viral haemorrhagic fevers A962, A983, A984, A980
Measles B05 Yellow fever A95
Meningococcal disease A39 Yersiniosis A046, A282

All data were analysed in the statistical package JMP (SAS institute Inc., USA). In order to protect the privacy of patients, where there were fewer than five cases, the data were aggregated into a category designated ‘Others’.

RESULTS

During the 6-year period between 2006 and 2011 there were 22 079 hospitalizations with a principal diagnosis of a notifiable disease (Table 1). These notifiable disease hospitalizations represented 0·62% of all hospitalizations for this 6-year period. When duplicates were removed, there were 20 826 hospitalizations. The most common notifiable disease hospitalization was for AIG: C. difficile and rotavirus only (29·6%, n = 6153); followed by influenza (10·1%, n = 2095) and TB (10·1%, n = 2094). Unsurprisingly, the majority of these hospitalizations were recorded as emergency admissions (90·5%, n = 18 844).

A total of 182 456 bed-days were taken up by this cohort of patients with a notifiable disease as principal diagnosis. Overall, TB and AIG (C. difficile and rotavirus) hospitalizations took up the highest number of bed-days (42 007 and 40 585 days, respectively). However, Creutzfeldt–Jakob disease and listerosis hospitalizations had the highest average length of stay (58 and 25·9 days, respectively). The total number of days spent by these notifiable infectious disease patients in an intensive care unit (ICU) was 13 384 days or 7·3% of the total hospital stay for this cohort of patients. Invasive pneumonococcal disease (IPD) hospitalizations took up the highest number of ICU days (24·5%, n = 3282), followed by influenza (22·2%, n = 2975) and meningococcal disease (10·1%, n = 1347). The total and average ICU length of stay for IPD and meningococcal disease remained relatively stable over the 6-year period; however, there was a large increase in total and average ICU length of stay for influenza during 2009, 2010 and 2011 (Fig. 1). Overall, botulism and Legionella hospitalizations had the highest average length of stay in ICUs (9 and 4·3 days, respectively).

Fig. 1.

Fig. 1.

Intensive care unit average length of stay (ICU ALOS) over time for influenza, meningococcal disease and invasive pneumococcal disease (IPD).

There were 477 deaths recorded among these hospitalizations due to notifiable diseases. The highest number of deaths occurred in AIG cases (34%, n = 162), almost all of which were recorded as C. difficile infections. The next most common diseases for which deaths were recorded was IPD (20·3%, n = 97) and TB (11·7%, n = 56).

Between 2006 and 2011, there were 86 571 cases of notifiable diseases reported in Ireland (Table 2). When hospitalization and notification data were compared, there were four diseases for which substantial surplus hospitalizations were evident: viral meningitis, viral encephalitis, bacterial meningitis (not otherwise specified) and malaria. Viral meningitis and viral encephalitis demonstrated the largest discrepancies between the hospitalized and notified data with a difference of 912 and 416 incidences, respectively. These two diseases accounted for a large proportion of the overall length of stay (20839 bed-days, 11·4%) for all notifiable diseases, took up 1439 days in ICUs (10·8% of total) and had 31 deaths recorded over the 6-year period. For the third disease, bacterial meningitis not otherwise specified, for which there were more hospitalizations than notifications (difference = 147), an overall length of stay of 4935 bed-days was recorded, of which 558 days were spent in ICUs. There were smaller numbers of overall and ICU days taken up by malaria hospitalizations.

Table 2.

Hospitalizations vs. notifications (2006–2011) Ireland

Notifiable infectious disease Hospitalizations (n) Notified cases (n) Surplus hospitalizations* Percentage potential under-reporting Mean LOS (days) Total LOS (days) Mean ICU LOS (days) Total ICU LOS (days)
Acute infectious gastroenteritis (AIG) 6153 21 111 6·6 40 858 0·09 559
Bacterial meningitis (not otherwise specified) 383 236 147 38·4% 12·9 4935 1·46 558
Botulism 6 9 21·5 129 9·00 54
Brucellosis 8 56 13·8 110 0·00 0
Campylobacter infection 941 11 320 4·1 3881 0·02 21
Creutzfeldt–Jakob disease 21 27 58·0 1218 0·00 0
Cryptosporidiosis 360 2559 3·1 1123 0·02 8
Enterohaemorrhagic Escherichia coli 329 1276 7·7 2546 0·73 240
Giardiasis 27 372 5·2 140 0·00 0
Haemophilus influenzae disease (invasive) 204 206 14·1 2885 3·83 782
Hepatitis A (acute) 94 228 4·5 426 0·06 6
Hepatitis B (acute and chronic) 318 4491 4·5 1436 0·02 6
Hepatitis C 883 7971 2·7 2377 0·01 6
Influenza 2095 8433 6·3 13 118 1·42 2975
Legionellosis 46 103 14·2 651 4·30 198
Leptospirosis 104 128 10·3 1074 2·37 246
Listeriosis 22 68 25·9 570 0·91 20
Malaria 553 482 71 12·8% 3·6 2004 0·23 129
Measles 184 1023 2·8 523 0·01 1
Meningococcal disease 901 911 9·2 8332 1·50 1347
Mumps 291 6024 3·4 1001 0·03 9
Noroviral infection 334 9260 9·3 3118 0·07 22
Paratyphoid 16 30 9·9 158 0·00 0
Pertussis 452 664 6·0 2726 0·18 80
Q fever 7 73 11·4 80 0·00 0
Salmonellosis 398 2325 6·2 2485 0·08 31
Shigellosis 31 343 3·7 115 0·00 0
Streptococcus group A infection (invasive) 53 383 14·2 750 2·21 117
Invasive pneumococcal disease (IPD) 1146 2366 16·2 18 554 2·86 3282
Toxoplasmosis 58 247 21·1 1225 0·45 26
Tuberculosis (TB)§ 2094 2736 20·1 42 007 0·55 1159
Typhoid 35 54 10·6 371 0·00 0
Viral encephalitis 495 79 416 84·0% 20·2 10 014 1·54 763
Viral meningitis 1732 820 912 52·7% 6·3 10 825 0·39 676
Others (<5 cases each) 52 157 39·0 691 2·74 63
Total 20 826 86 571 1546 1·8% 8·8 182 456 0·640 13 384

LOS, Length of stay; ICU, intensive care unit.

See Table 1 for explanation of hospitalization codes corresponding to each notifiable infectious disease.

*

The surplus hospitalizations are calculated by subtracting the number of notified cases from the number of hospitalizations.

The percentage of hospitalizations potentially under-reported is calculated by dividing the number of surplus hospitalizations by the number of notified cases plus the number of surplus hospitalizations.

For the purposes of this study AIG only includes C. difficile and rotavirus cases. C. difficile only became notifiable on 4 May 2008; however, hospitalization data includes C. difficile infection from 2006 to 2011.

§

TB notification data obtained from annual reports published by the Health Protection Surveillance Centre.

Further breakdown of figures could not be given due to data protection reasons.

Comparison of the notification data with hospitalization data over time (Fig. 2) demonstrates that for viral encephalitis, in particular, the distribution over time is quite different for the hospitalization and notification data. In the cases of viral meningitis, bacterial meningitis and malaria, the distribution over time follows a broadly similar pattern in both datasets. However, in the case of viral meningitis and malaria in 2010 and 2011, the gap between the CIDR and HIPE datasets narrows suggesting that reporting for these diseases may be improving over time.

Fig. 2.

Fig. 2.

Hospitalizations and notifications for (a) viral meningitis, (b) bacterial meningitis, not otherwise specified, (c) viral encephalitis and (d) malaria between 2006 and 2011.

In total, these viral meningitis, viral encephalitis, bacterial meningitis (not otherwise specified) and malaria incidents accounted for 1546 surplus hosptalizations and if all were potential extra notifications would bring the total number of notifications for this period to 88 117 or add an extra 1·8% to the notification data.

DISCUSSION

To the best of our knowledge, this is the first time that the list of notifiable diseases for Ireland has been coded according to the ICD-10-AM international classification of diseases as a comprehensive set and been compared to the national HIPE (hospitalization) dataset.

During the 6-year period between 2006 and 2011, this study has estimated that only a potential 1·8% of extra notifications could have arisen due to hospitalized cases. A similar study over a 6-year period (1997–2002) in a health board region in Ireland [10] produced a conservative estimate of under-reporting of hospitalized notifiable infectious disease cases of 18%. If we assume that this estimate was also indicative of under-reporting at the national level at the time then, there has been a substantial reduction (>tenfold) in under-reporting in recent years in Ireland. This reduction can mainly be accounted for by the introduction of laboratories as notifiers in 2004 and also the use of the CIDR system [13] which facilities laboratories and public health personnel to process cases of notifiable diseases. Our data supports the view that these changes have substantially improved under-reporting rates in Ireland and therefore had a significant impact on the quality and completeness of the Irish notification data overall.

However, for some diseases, particularly viral meningitis and viral encephalitis, there are still discrepancies between numbers hospitalized and numbers notified. This gap in clinician reporting has been highlighted in a number of studies since 1997 [911]. The fact that these particular diseases are mainly diagnosed clinically, means that the numbers notified nationally will continue to underestimate the true burden of disease unless significant efforts are made to engage with clinicians. The underestimation of these diseases and of bacterial meningitis (not otherwise specified) is concerning in light of the fact that viral meningitis cases take up a large number of bed-days, that there are high numbers of deaths among viral encephalitis cases, and the severity of bacterial meningitis cases. For these three diseases in particular, the notification data underestimates the true burden of disease and for viral encephalitis the pattern of hospitalized cases over time is also not reflected in the notification data. This has implications for understanding the epidemiology and transmission of these infections in an Irish context. Interestingly, during 2010 and 2011 some improvements in under-reporting for viral meningitis and malaria were demonstrated. These improvements may in part be due to the increased numbers of laboratories utilizing CIDR to discharge their notification obligation and/or an increase in samples referred to laboratories for testing. Overall, this study has highlighted four main diseases that account for the majority of all under-reported hospitalized cases and provided a set of target diseases for which education sessions or other interventions might aid in encouraging clinician reporting.

The ICU length of stay for influenza was shown to increase significantly between 2009, 2010 and 2011. This increase is not surprising as it coincides with the circulation of the H1N1 pandemic strain of influenza which saw a large increase in the requirement for intensive care in influenza patients. Clearly, analysis of this sort of data could provide a foundation for planning how the acute service responds to the changes in the epidemiology of infectious diseases.

Review of hospital discharge data has been shown to be a useful tool for evaluating notifiable disease surveillance systems and under-reporting rates in a number of countries, including the USA [16, 17], Greece [18, 3], Spain [19], England [2] and Ireland [9, 10, 11]. Rates of under-reporting for specific diseases vary widely both between countries (e.g. a 75% under-reporting rate for viral encephalitis in England [2] compared to >80% underreporting rate for Ireland [10, 11]), within countries (8% under-reporting rate for salmonellosis in western Greece [3] compared to a national Greek under-reporting rate of 52·8% [18]) and over time (3·8–22·8% under-reporting for pertussis in Spain depending on year of study [19]). This variation in under-reporting levels suggests that a number of factors influence under-reporting rates including differing surveillance systems, case definitions and reporting procedures between countries. In fact, Gibbons et al. [20] suggest that multiplication factors could be used to adjust for underestimation to provide a more accurate estimate of incidence and these should be disease, country, age and sex specific. Therefore, it is essential that studies on disease under-reporting to surveillance systems are performed regularly so that the true epidemiological burden of disease is understood within a population.

The main limitation of this study was the inability to remove hospital transfers from the HIPE dataset which is, in the main, due to discrepancies between hospitals in coding for such transfers. Therefore, it is possible that some cases may have more than one episode of hospital in-patient care recorded. However, the discrepancies in numbers between the hospitalized and notified cases are so large for some diseases that they cannot solely be attributed to over-representation by hospital transfers and clearly represent a large cohort of under-notified patients. The introduction of a unique patient identifier for the Irish health system would eliminate many such issues in the analysis of this and other health data.

The HIPE dataset is a very useful research tool; however, due to the volume of records to be processed and validated, it will never be a routinely used data source for current information on notifiable diseases. Therefore the notification process is an important system for the collection of real-time clinical and laboratory infectious disease data on an ongoing basis. The CIDR environment provides a flexible way for laboratories to discharge their notification obligations and these developments have made a huge impact on the quality of surveillance data in Ireland.

Any support that can be given to hospital clinicians to improve their understanding of the notification process and to encourage their participation will be beneficial in the long term.

ACKNOWLEDGEMENTS

This report would not have been possible without the HIPE system provided by the Healthcare Pricing Office and the web-based facilities of Health Atlas Ireland. We are also grateful for notification data supplied through CIDR and the TB surveillance system by the Health Protection Surveillance Centre

This research received no specific grant from any funding agency, commercial or not-for-profit sectors.

DECLARATION OF INTEREST

None.

REFERENCES

  • 1.Harvey I. Infectious disease notification – a neglected legal requirement. Health Trends 1991; 23: 73–74. [PubMed] [Google Scholar]
  • 2.Davidson KL, et al. Viral encephalitis in England, 1989–1998: what did we miss? Emerging Infectious Diseases 2003; 9: 234–240. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3.Jelastopulu E, Merekoulias G, Alexopoulos EC. Under-reporting of communicable diseases in the prefecture of Achaia, Western Greece, 1999–2004: missed opportunities for early intervention. Eurosurveillance 2010; 15(21). [DOI] [PubMed] [Google Scholar]
  • 4.Doyle TJ, Glynn MK, Groseclose SL. Completeness of notifiable infectious disease reporting in the United States: an analytical literature review. American Journal of Epidemiology 2002; 155: 866–874. [DOI] [PubMed] [Google Scholar]
  • 5.Healthcare Pricing Office. Activity in acute public hospitals in Ireland, Annual Report, 2010. The Healthcare Pricing Office, Dublin, Ireland, December 2011 (http://www.hpo.ie/). [Google Scholar]
  • 6.ICD-10-AM. Tabular list of disease. Volume 1 of the International Statistical Classification of Diseases and Related Health Problems, Tenth Revision, Australian Modification (ICD-10-AM). National Centre for Classification in Health, Australia, 2004.
  • 7.Health Protection Surveillance Centre. Review of Notifiable Diseases and the Process of Notification, Notifiable Diseases Sub-Committee of the Scientific Advisory Committee, National Disease Surveillance Centre, February 2001 (http://www.hpsc.ie).
  • 8.Smith A, et al. Legionnaires’ disease in Ireland – a cause for concern? Irish Medical Journal 2002; 95: 308–310. [PubMed] [Google Scholar]
  • 9.Brabazon ED, et al. (2004) Trends in viral meningitis hospitalizations and notifications in the North Eastern Health Board (1997–2001): a cause for concern? Irish Medical Journal 2004; 97: 306–308. [PubMed] [Google Scholar]
  • 10.Brabazon ED, et al. ‘Under-reporting of notifiable infectious disease in a Health Board Region in Ireland: Room for Improvement?’ Epidemiology and Infection 2008; 136: 241–247. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11.Kelly T, et al. Underreporting of viral encephalitis and viral meningitis, Ireland, 2005–2008. Emerging Infectious Diseases 2013; 19(9). [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12.National Disease Surveillance Centre. Case definitions for notifiable diseases, version 1.1, 2003 (http://www.lenus.ie/hse/bitstream/10147/43672/1/3892).
  • 13.Computerised Infectious Disease Reporting System (CIDR). Health Protection Surveillance Centre, Annual Report 2005, p. 70 (http://www.hpsc.ie/hpsc/CIDR/AnnualReports/File,12701,en.pdf).
  • 14.Infectious Disease Regulations, 1981. SI No 390 of 1981 (amended by SI No. 268 of 1985, SI No. 288 of 1988, SI No. 384 of 1996, SI No. 151 of 2000, SI No. 707 of 2003, SI No. 559 of 2007, SI No. 452 of 2011).
  • 15.Health Atlas Ireland (HAI). Health Intelligence Unit, HSE, Dr Steevens Hospital, Dublin 8 (https://www.healthatlasireland.ie/).
  • 16.Mor SM, DeMaria A, Naumova EN. Hospitalisation records as a tool for evaluating performance of food- and water-borne disease surveillance systems: a Massachuetts Case Study. PLoS ONE 2014; 9: e93744. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.Boehmer TK, et al. Use of hospital discharge data to evaluate notifiable disease reporting to Colorado's Electronic Disease Reporting System. Public Health Reports 2011; 126: 100–126. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18.Mellou K, et al. Evaluation of under-reporting of salmonellosis and shigellosis hospitalised cases in Greece, 2011: results of a capture-recapture study and a hospital registry review. BMC Public Health 2013; 13: 875. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19.Fernandez-Cano MI, et al. Incidence of whooping cough in Spain (1997–2010): and under-reported disease. European Journal of Pediatrics 2014; 173: 721–726. [DOI] [PubMed] [Google Scholar]
  • 20.Gibbons CL, et al. Measuring underreporting and under-ascertainment in infectious disease datasets: a comparison of methods. BMC Public Health 2014; 14: 147. [DOI] [PMC free article] [PubMed] [Google Scholar]

Articles from Epidemiology and Infection are provided here courtesy of Cambridge University Press

RESOURCES