Abstract
Background
Enteric infections and their chronic sequelae are a major cause of disability and death. Despite the increasing use of administrative health data in measuring the burden of chronic diseases in the population, there is a lack of validated International Classification of Disease (ICD) code-based case definitions, particularly in the Canadian context. Our objective was to validate ICD code definitions for sequelae of enteric infections in Canada: acute kidney injury (AKI); hemolytic uremic syndrome (HUS); thrombotic thrombocytopenic purpura (TTP); Guillain-Barré syndrome/Miller-Fisher syndrome (GBS/MFS); chronic inflammatory demyelinating polyneuropathy (CIDP); ankylosing spondylitis (AS); reactive arthritis; anterior uveitis; Crohn’s disease, ulcerative colitis, celiac disease, erythema nodosum (EN); neonatal listeriosis (NL); and Graves’ disease (GD).
Methods
We used a multi-step approach by conducting a literature review to identify existing validated definitions, a clinician assessment of the validated definitions, a chart review to verify proposed definitions and a final clinician review. We measured the sensitivity and positive predictive value (PPV) of proposed definitions.
Results
Forty studies met inclusion criteria. We identified validated definitions for 12 sequelae; clinicians developed three (EN, NL, GD). We reviewed 181 charts for 6 sequelae (AKI, HUS, TTP, GBS/MFS, CIDP, AS). Sensitivity (42.8%–100%) and PPV (63.6%–100%) of ICD code definitions varied. Six definitions were modified by clinicians following the chart review (AKI, TTP, GBS/MFS, CIDP, AS, reactive arthritis) to reflect coding practices, increase specificity or sensitivity, and address logistical constraints.
Conclusion
The multi-step design to derive ICD code definitions provided flexibility to identify existing definitions, to improve their sensitivity and PPV and adapt them to the Canadian context.
Keywords: enteric infections, sequelae, administrative data, case definition
Introduction
Enteric infections are a major cause of disability and death globally and in Canada ((1–3)). In addition to the acute gastrointestinal manifestations, enteric infections can also lead to sequelae such as hemolytic uremic syndrome (HUS), inflammatory bowel disease, and Guillain-Barré Syndrome (GBS) ((4–6)). In separate but related work, we are conducting a retrospective population-based cohort study to determine the likelihood of developing sequelae following enteric infections, as well as their burden of illness and cost, in British Columbia (BC), Canada ((7)). To do so, we require International Classification of Diseases (ICD) code definitions for the sequelae of interest.
Despite the increasing use of administrative health data in epidemiological research, there is a lack of verified ICD code-based case definitions broadly ((8)), and a lack of validated definitions for most enteric infection sequelae in the Canadian context. Our objective here was to identify, or develop and validate, ICD code-based case definitions for 15 sequelae of enteric infections (Table 1).
Table 1. Administrative case definitions for sequelae of enteric infections, showing International Classification of Diseases codes identified by study stage.
| Sequela | ICD codes identified, by study stagea | Final definitiona | |||
|---|---|---|---|---|---|
| Literature review | Recommendation by clinical experts | Chart review | ICD codes | Timeframe | |
| Acute kidney injury | ICD-9: 584 ICD-10: N17, Z99.2 |
ICD-9: 584 ICD-10: N17.9 |
ICD-9: N/A ICD-10: N17.9, N17.8, N17.0 |
ICD-9: 584 ICD-10: N17.0, N17.8, N17.9 |
One or more hospitalizations |
| Hemolytic uremic syndrome | ICD-9: 283.11 ICD-10: D59.3 |
ICD-9: 283.11 ICD-10: D59.3 |
ICD-9: N/A ICD-10: D59.3 |
ICD-9: 283.11 ICD-10: D59.3 |
Either (or both of): (a) one or more hospitalizations OR (b) more than two physician claims within a span of two years |
| Thrombotic thrombocytopenic purpura (misdiagnosed hemolytic uremic syndrome)b | ICD-9: 287.31, 287.33 ICD-10: M31.1, N08.5 |
ICD-9: 287.3 ICD-10: M31.1, N08.5 |
ICD-9: N/A ICD-10: M31.1, N08.5 |
ICD-9: 287, 287.3 ICD-10: M31.1, N08.5 Together with: ICD-9: 584 ICD-10: N17.0, N17.8, N17.9 |
Either (or both of): (a) one or more hospitalizations OR (b) one or more physician claims Together with: one or more hospitalizations or physician claims with an ICD code for acute kidney injury (see above) in the week before or after |
| Guillain-Barré syndrome/Miller Fisher syndrome | ICD-9: 357 ICD-10: G61.0 |
ICD-9: 357, 356+IVIG ICD-10: G61.0 |
ICD-9: 356 ICD-10: G61.0 |
ICD-9: 356, 357 ICD-10: G61.0 |
Either (or both of): (a) one or more hospitalizations OR (b) two or more physician claims within a span of fewer than three months |
| Chronic inflammatory demyelinating polyneuropathy | ICD-9: 357.81 ICD-10: G61.8 |
ICD-9: 357.81, 356+IVIG ICD-10: G61.8 |
ICD-9: 357, 356+IVIG ICD-10: G61.8 |
ICD-9: 356, 357.81 ICD-10: G61.8 |
Either (or both of): (a) one or more hospitalizations OR (b) two or more physician claims occurring three or more months apart |
| Ankylosing spondylitis | ICD-9: 720 ICD-10: M45 |
ICD-9: 720, 720.0, 720.8, 720.9 ICD-10: M45 |
ICD-9: 720, 720.0 ICD-10: M45 |
ICD-9: 720, 720.0 ICD-10: M45 |
Either (or both of): (a) one or more hospitalizations OR (b) two or more physician claims within a span of two or fewer years |
| Reactive arthritis | ICD-9: 711 ICD-10: N/A |
ICD-9: 711, 696, 714 ICD-10: M02 |
N/A | ICD-9: 711, 696, 714 ICD-10: M02 |
Two or more physician claims that are both: (a) two or more months apart AND (b) within a span of five or fewer years |
| Anterior uveitis | ICD-9: 364 ICD-10: H20.0 |
ICD-9: 364 ICD-10: H20.0 |
N/A | ICD-9: 364 ICD-10: H20.0 |
Either (or both of): (a) one or more hospitalizations OR (b) one or more physician claims |
| Crohn’s disease | ICD-9: 555 ICD-10: K50 |
ICD-9: 555 ICD-10: K50 |
N/A | ICD-9: 555 ICD-10: K50 |
Either (or both of): (a) two or more hospitalizations OR (b) four or more physician claims within a span of two years |
| Ulcerative colitis | ICD-9: 556 ICD-10: K51 |
ICD-9: 556 ICD-10: K51 |
N/A | ICD-9: 556 ICD-10: K51 |
Either (or both of): (a) two or more hospitalizations OR (b) four or more physician claims within a span of two years |
| Irritable bowel syndrome | ICD-9: 564.1 ICD-10: K58.0, K58.9, F45.3 |
ICD-9: 564.1 ICD-10: K58.0, K58.9, F45.3 |
N/A | ICD-9: 564.1 ICD-10: K58.0, K58.9, F45.3 |
One or more physician claims or hospitalizations AND Either: (a) no Crohn’s disease, ulcerative colitis or celiac disease OR (b) a second claim more than six months apart |
| Celiac disease | ICD-9: 579 ICD-10: K90.0 |
ICD-9: 579 ICD-10: K90.0 |
N/A | ICD-9: 579 ICD-10: K90.0 |
Either (or both of): (a) one or more hospitalizations OR (b) one or more physician claims |
| Erythema nodosum | - | ICD-9: 695.2, 729.3 ICD-10: L52, M79.3 |
N/A | ICD-9: 695.2, 729.3 ICD-10: L52, M79.3 |
Either (or both of): (a) one or more hospitalizations OR (b) one or more physician claims |
| Neonatal listeriosis | - | ICD-9: 771.2 ICD-10: P37.2 |
N/A | ICD-9: 771.2 ICD-10: P37.2 |
One or more hospitalizations |
| Graves’ disease | - | ICD-9: 242.0, 242.01, 242.91, 242.9 ICD-10: E05.0, E05.90, E05.91 |
N/A | ICD-9: 242.0, 242.01, 242.91 ICD-10: E05.0 |
Either (or both of): (a) one or more hospitalizations OR (b) one or more physician claims |
Abbreviations: ICD, International Classification of Diseases; N/A, not applicable
a Bolded text shows additions/changes at each stage of case definition development
b Thrombotic thrombocytopenic purpura is not a sequela of enteric infection; this definition was developed to capture historical misdiagnosis of hemolytic uremic syndrome as thrombotic thrombocytopenic purpura
Methods
We used a multi-step process to identify case definitions for the 15 sequelae (Table 1).
Literature review, clinician assessment
We searched MEDLINE (1946–July 2018) and EMBASE (1974–July 2018) databases for peer-reviewed studies published in English or French using the following terms: [([administrative OR hospital discharge OR health service OR physician] AND [data OR claim* OR record* OR database*]) OR (case definition* OR ICD-9 OR ICD-10 OR international classification of diseases)]; AND [(validity OR validate* OR validation OR agreement OR accuracy OR sensitivity OR specificity or predictive value)] AND [(search terms for sequelae of interest, as listed in Supplemental material, Table S1)].
We included studies with a case definition based on ICD-9 or ICD-10 coding of one or more of the sequelae validated against a gold standard that revealed at least one measure of validity (sensitivity, specificity, positive predictive value [PPV], or negative predictive value). Studies were evaluated for eligibility, independently through title and abstract screening, and those that met the eligibility criteria underwent full text review. Disagreements were resolved by discussion and consensus. Where we identified multiple case definitions for a sequela, we selected those that were validated in Canada to ensure comparable coding practices or, if Canadian studies were not available, those with the highest measures of validity. Where we identified no relevant studies, clinicians proposed ICD-based case definitions based on expert opinion.
We invited clinician specialists in rheumatology, neurology, nephrology and gastroenterology with expertise in the sequelae of interest and based in BC or Alberta to participate in the study. They reviewed the case definitions from the literature review and revised them to reflect BC or Canadian coding practices.
Medical chart review
Setting, data sources, and ethics
We reviewed patients’ charts from four tertiary care centres in Vancouver, BC, during the fall of 2018. Centres were selected based on the following criteria: most likely to see patients with sequelae of interest and sufficient numbers to meet sample size. Centres most likely to see the sequelae were selected based on whether the condition was more likely to be assessed in inpatient (e.g. acute kidney injury, AKI) or outpatient (e.g. ankylosing spondylitis, AS) settings and the age at which the condition is most likely to occur (e.g. thrombotic thrombocytopenic purpura [TTP] occurs mainly in adults and HUS, mainly in children). Vancouver Coastal Health and the British Columbia Children’s Hospital granted operational approvals to access and review patient charts.
We conducted chart reviews for the following six sequelae: AKI, HUS, TTP, GBS/Miller-Fisher syndrome (MFS), AS, and chronic inflammatory demyelinating polyneuropathy (CIDP). Eligible charts included those for patients with at least one admission or visit between January 1, 2003, and December 31, 2016. We tailored our chart sampling strategy by sequelae and centre (Table 2), to accommodate facility differences. Chart reviews were not conducted for the other nine sequelae for the following reasons: 1) validated Canadian case definitions already existed (for Crohn’s disease and ulcerative colitis); 2) clinical experts deemed further data were not required (for neonatal listeriosis [NL]); or 3) charts were not readily available (all other sequelae).
Table 2. Patient charts and sequelae reviewed, by medical centre.
| Centre | Number of charts reviewed (% of all charts reviewed) |
Sequelae assessed (Number of charts reviewed) |
Patient registry | Type of charts reviewed | Source of ICD codes |
|---|---|---|---|---|---|
| Paediatric tertiary care hospital | 20 (11%) | AKI (n=11) HUS (n=9) |
Yes | Both electronic and paper | Hospital health records database |
| Adult tertiary care hospital | 107 (59%) | AKI (n=31) HUS (n=11) TTP (n=14) GBS (n=26) MFS (n=3) CIDP (n=11) AS (n=11) |
No | Both electronic and paper | Hospital health records database |
| Adult neurology referral clinic | 27 (15%) | GBS (n=9) MFS (n=5) CIDP (n=13) |
Yes | Electronic only | Electronic medical record |
| Adult rheumatology referral clinic | 27 (15%) | AS (n=27) | Yes | Electronic only | Electronic medical record |
Abbreviations: AKI, acute kidney injury; AS, ankylosing spondylitis; CIDP, chronic inflammatory demyelinating polyneuropathy; GBS, Guillain-Barré syndrome; HUS, hemolytic uremic syndrome; ICD, International Classification of Diseases; MFS, Miller-Fischer syndrome; TTP, thrombotic thrombocytopenic purpura
In the paediatric hospital, a randomized sample of patients with AKI and HUS were selected from a registry maintained by the nephrology department. Charts were reviewed, and ICD codes were retrieved from the health records database (Table 2). In the adult hospital, the Health Records Department converted the list of sequelae into ICD codes; a random sample of charts with one of these ICD codes for a given admission was reviewed. In the neurology clinic, charts were identified by the neurology co-author; we reviewed all MFS patients’ charts, and a convenience sample of charts for patients with GBS or CIPD. In the rheumatology clinic, a convenience sample of charts from patients with AS was selected and reviewed from a registry maintained by the rheumatology co-author.
Diagnosis verification and data abstraction
We compared each ICD code against clinical criteria and/or the physician diagnosis. For AS, we used rheumatologist diagnosis as the gold standard as no diagnostic criteria existed. We developed clinical criteria (see Supplemental material, Table S2) using a literature review and clinical expert opinion, and created data abstraction forms for renal (AKI, TTP, HUS), neurological (GBS/MFS, CIDP), and rheumatologic (AS) sequelae. We piloted the forms with 4–5 charts each and included the pilot data in the final analysis.
A medical chart abstractor reviewed the first visit/admission for each ICD code of interest. If the criteria were not met or diagnosis was not confirmed, the next visit/admission was reviewed. The abstractor evaluated all visits/admissions with the same ICD code or sequelae and abstracted all ICD codes recorded for the visit/admission and the diagnosis made by the attending physician on the discharge and/or consult note.
Analysis
We assessed agreement between the ICD codes and clinical criteria or physician diagnosis by calculating sensitivity (for the two clinics and paediatric hospital, where patients were identified based on diagnosis), and PPV (for the adult hospital, where patients were identified by ICD code), with 95% confidence intervals.
We developed case definitions using ICD-9 and ICD-10 codes given that during the study period (2005–2014) in BC, ICD-9 codes were used for physician billings and ICD-10 codes were used by hospitals.
Finalizing the case definitions
Clinicians with expertise in rheumatology, neurology, nephrology, gastroenterology and hematology reviewed the definitions resulting from the above steps to generate final definitions.
Results
Literature review and clinician assessment
Our search returned 1,414 articles; of which 39 met the inclusion criteria ((9–47)). One additional article, not uncovered through the search but meeting our eligibility criteria, was identified by a co-author for a total of 40 articles ((48)). For three sequelae (erythema nodosum [EN], NL and Graves’ disease [GD]), no articles met our search criteria. Of the 40 articles, there were six from Canada, covering AS, ulcerative colitis, Crohn’s disease, and celiac disease. Details on the 40 articles are in the Supplemental material, Table S3.
From these 40 articles, we derived initial case definitions for 12 sequelae (Table 1). Clinicians reviewed these and made minor changes to AKI, TTP, GBS/MFS, CIDP, AS and reactive arthritis to represent coding practices in BC. The use of intravenous immunoglobulin therapy was added to help identify cases of GBS/MFS and CIDP. For the three sequelae for which no articles were identified (EN, NL, GD), case definitions were proposed by clinicians (Table 1).
Medical chart review
We reviewed 181 charts from four medical centres (Table 2).
The agreement between the clinical criteria and physician diagnosis and the corresponding ICD codes is presented in Table 3. Sensitivity of the proposed AKI ICD codes was low (42.8%–44.4%), while sensitivity of the proposed ICD codes for HUS, GBS, MFS, CIDP and AS was high (85.7%–100%). The PPV varied by sequelae and reference standard, from 63.6% for AS to 100% for HUS, TTP and MFS.
Table 3. Sensitivities and positive predictive values (with 95% confidence intervals) of International Classification of Diseases codes.
| Sequela | Sensitivity | Positive predictive value | ||||||
|---|---|---|---|---|---|---|---|---|
| ICD codes | Number of charts with sequela | Reference standard | ICD codes | Number of charts with ICD codes | Reference standard | |||
| Clinical criteria (95% CI) |
Physician diagnosis (95% CI) |
Clinical criteria (95% CI) |
Physician diagnosis (95% CI) |
|||||
| Acute kidney injury | N17.0, N17.8, N17.9 | 11 | 44.4% (13.7–78.8) |
42.9% (9.9–81.6) |
N17.0, N17.8, N17.9 | 31 | 100.0% (89.0–100.0) |
80.6% (63.7–90.8) |
| Hemolytic uremic syndrome | D593 | 9 | 100.0% (54.1–100.0) |
85.7% (42.1–99.6) |
D593 | 11 | 90.9% (62.3–98.4) |
100% (74.1–100.0) |
| Thrombotic thrombocytopenic purpura | M31.1, N08.5 | 0 | -a | -a | M31.1 | 14 | 100% (78.5–100.0) |
100% (78.5–100.0) |
| Guillain-Barré syndrome | 356 | 9 | 100.0% (63.4–100.0) |
100.0% (63.4–100.0) |
G610 | 26 | 68.0% (48.4–82.8) |
92.5% (75.0–97.8) |
| Miller Fisher syndrome | 356 | 5 | 100.0% (39.8–100.0) |
100% (39.8–100.0) |
G610 | 3 | 33.3% (6.1–79.2) |
100% (43.9–100.0) |
| Chronic inflammatory demyelinating polyneuropathy | 356, 357 | 13 | 100.0% (71.5–100.0) |
100% (71.5–100.0) |
G618 | 11 | 70% (39.7–89.2) |
80% (49.0–94.3) |
| Ankylosing spondylitis | 720 | 27 | -a | 92.5% (75.7–99.1) |
M45 | 11 | -a | 63.6% (35.4–84.8) |
Abbreviations: CI, confidence interval; ICD, International Classification of Diseases; -, no results are presented
a Charts identified using ICD codes, thus only positive predictive value could be calculated
Final administrative case definitions
Clinicians reviewed the chart review findings and provided final revisions and approval of case definitions (Table 1). Given that TTP was included in the study as a proxy for HUS, we combined codes for TTP and AKI to increase PPV. Given that the subsequent cohort study does not have access to intravenous immunoglobulin data, this was dropped from the GBS/MFS and CIDP definitions.
Discussion
This study identified, developed and validated ICD-based case definitions for 15 sequelae of enteric infections. These are now being used in a population-wide cohort study to determine the likelihood of developing sequelae following enteric infections and their burden in terms of illness and cost ((7)).
We used a multi-method approach that combined 1) a literature review, 2) clinician consultation, 3) chart reviews and 4) final clinician consultation to generate valid case definitions relevant to our study context, and we documented how each of these methods affected the final case definitions. This multi-method explicit approach is not common; most studies derive case definitions solely using medical chart reviews.
Six (HUS, AKI, TTP, GBS/MFS, CIDP, AS) conditions underwent all four steps (Table 1). Only the HUS definition underwent no changes from the initial literature review. Of the remaining five, all were slightly modified based on clinician input and three (AKI, GBS/MFS, CIDP) were further amended following the chart review. Of the nine conditions that did not undergo a chart review, only the reactive arthritis definition was modified based on clinician input. Five case definitions identified in the literature (anterior uveitis, Crohn’s disease, ulcerative colitis, irritable bowel syndrome, celiac disease) remained unchanged throughout and three (EN, NL, GD) were entirely developed by clinicians.
Some of the clinician changes were made to reflect coding practices by hospitals (e.g. use of M79.3 for EN) or clinicians (e.g. use of 287 rather than 287.31 for TTP) in BC. Other changes were made to increase PPV (e.g. change from N17 to N17.0/8/9 for AKI) or sensitivity (e.g. add 696 and 714 for reactive arthritis). A final review addressed logistical constraints (e.g. the planned cohort study cannot assess intravenous immunoglobulin administration).
The findings from our chart review were varied. Sensitivity of the proposed case definitions was generally as high as, or higher than, that reported by others for the same or similar ICD codes ((12,15,16,18,24–27)). Exceptionally, we found low sensitivity (42.8%–44.4%) for AKI. Given that all our patients were selected from an AKI registry, we believe that they had AKI but were missing an AKI ICD code. Among those without an AKI code, five patients were admitted for other reasons and developed AKI while in hospital and two patients were coded as having chronic kidney injury rather than AKI. Interestingly, others also found low sensitivity for AKI-related ICD codes ((9)).
The PPV of our proposed case definitions was also generally as high as, or higher than the PPV reported by others ((9,15,16)). The chart review identified the use of two additional codes for AKI in hospitalized adults: N17.0, N17.9. The addition of these codes increased the PPV from 60.0% to 80.6%. The PPV of AS (63.6%) was lower than the one found by other studies ((24,25,28)); we found that four of 11 hospitalizations coded as M45 were for patients diagnosed with rheumatoid arthritis, not AS. The PPV of code G610 for MFS based on clinical criteria was low (33.3%) due to the lack of nerve conduction study results in two patient charts; however, all three patients were clinically diagnosed with MFS.
The main challenge in planning the chart review was determining the sample size to accurately estimate sensitivity and specificity and be representative of local coding practices. The literature on the ideal sample size to assess sensitivity and PPV is limited; authors typically review all charts within a period or at a given site ((16)). We decided to treat this as an exploratory or descriptive study where authors suggest 10–20 charts per question or variable of interest ((49)). We aimed for a minimum of 10 charts per sequelae, which seemed reasonable given the rarity of some of the conditions, the resources we had and the homogeneity of ICD coding in most instances.
Strengths and limitations
We conducted a chart review for only six of the 15 enteric infection sequelae. These six were selected based on clinician recommendations and because charts for these conditions were readily available. This convenience sample may not be entirely representative of coding practices across our entire study area; however, patients from BC who have the reviewed conditions are mostly cared for in the tertiary care centres included in the study. The sensitivity and PPV calculations were limited by a number of factors. For patients identified through a registry, if only a subset of their charts was reviewed, the code of interest may not be apparent. Clinical data to confirm a diagnosis may be incomplete or absent because patients were transferred from other hospitals or assessed in other settings. For some conditions (e.g. irritable bowel syndrome), the wide spectrum of illness and the large number of health care providers who encountered these patients likely lead to ICD-coding variability. For some conditions, multiple validated case definitions exist (e.g. inflammatory bowel disease) and we had to select among them ((30,33,35,50)).
Despite these limitations, there was relatively good concordance in ICD codes between the four methods used—the changes we made to our case definitions were minor and the final definitions were very similar to those validated and used by other researchers. The main concern is the low PPV for ICD code M45, which will identify a substantial number of non-AS hospitalizations, and the low sensitivity of AKI codes, which will underestimate the number of AKI events. These issues need to be accounted for in our future analyses. Our approach allowed us to verify codes identified in the literature with local practices and local chart review validation and benefited from the knowledge of local clinicians.
Conclusion
The multi-step design to derive ICD-code based case definitions allowed us to identify previously validated definitions to adapt them to our study context, and to develop and validate definitions using clinical expertise and medical chart reviews. These findings will support future analyses to determine the likelihood, burden and cost of developing sequelae following enteric infections. They also provide Canadian researchers with validated ICD code definitions for 15 chronic conditions.
Supplemental material
These documents can be accessed on the Supplemental material file.
Table S1: Search terms used in the literature review to identify International Classification of Diseases code-based case definitions for enteric infection sequelae
Table S2: Sequelae assessed during the chart review and their clinical criteria
Table S3: Results of the literature review to identify International Classification of Diseases code-based case definitions for enteric infection sequelae
Acknowledgements
The authors thank J Stapleton (Librarian, University of Waterloo) for helping refine the literature review search strategy, and D Tuori for assisting with the literature search and article review. The authors thank the clinicians consulted during the development of case definitions including Dr. P Yenson (hematology; University of British Columbia), Dr. S Holland (ophthalmology; University of British Columbia), Dr. S Au (dermatology; University of British Columbia), Dr. K Shojania (rheumatology; University of British Columbia) and Dr. J Kong (endocrinology; University of British Columbia). This work is part of a larger study and the authors thank the other team experts for their input into the overall study: A Chaurasia, RJ Cook, MR Gohari, S Horton, and ST Leatherdale (University of Waterloo); S Ethelberg (Statens Serum Institut and University of Copenhagen); and SM Pires (Technical University of Denmark). Finally, the authors thank A Ilic (Research Assistant, University of Waterloo) for her assistance with formatting and submission.
Competing interests
Ethics approval was received from the University of British Columbia Clinical Review Ethics Board (H18-01664). EG and SEM report funding for this study as per the funding statement. At the time of the study, EG’s spouse worked for an electronic medical records’ company; this interest was not related to, or used in, this study. SEM reports other relationships though these interests were not used in this study: she has served as a paid expert on behalf of the Attorney General of Canada in legal proceedings, providing evidence on the public health risks and benefits of unpasteurised milk; she is an expert on the Joint FAO/WHO Expert Meetings on Microbiological Risk Assessment (JEMRA) Roster of Experts; she is a Member of the WHO Foodborne Disease Burden Epidemiology Reference Group. GK reports honoraria for speaking from AbbVie, Janssen, Pfizer, Amgen, Sandoz, and Pendophram; research support from Ferring; shared ownership of a patent: treatment of inflammatory disorders, autoimmune disease, and PBC. UTI Limited Partnership, assignee. Patent WO2019046959A1. PCT/CA2018/051098. 7 Sept. 2018; these interests were not related to, or used in, this study. JC reports research support from Pfizer and UCB for unrelated research; advisory board consulting fees from Abbvie, Organon, UCB, Novartis, Eli Lilly, Sandoz, Jansen, Pfizer, Roche, Merck, Viatris, and Fresenius Kabi; paid lectures from Eli Lilly, Viatris, Abbvie, Pfizer, Novartis, Fresenius Kabi, and UCB; support for attending ACR 2021 meeting from Jansen; unpaid leadership roles at Spondyloarthritis Research Consortium of Canada, Spondyloarthritis Research and Treatment Network, Group for Research and Assessment of Psoriasis and Psoriatic arthritis, and Assessment of Spondyloarthritis International Society; these interests were not related to, or used in, this study. KC reports board membership at CIDP Foundation of Canada, though this interest was not related to this study. All other authors declare no competing interests.
Funding
This work is supported by the Canadian Institutes of Health Research (CIHR), Project Grant program, grant number 156385 (Principal Investigator, PI: SEM) and also received seed funding from the University of Waterloo’s Research Incentive Fund (PI: SEM) and the BCCDC Foundation for Public Health’s Open Award Program (PI: EG). The funders had no role in study design, the collection, analysis and interpretation of data, the writing of the manuscript, nor in the decision to submit the article for publication.
References
- 1.Havelaar AH, Kirk MD, Torgerson PR, Gibb HJ, Hald T, Lake RJ, Praet N, Bellinger DC, de Silva NR, Gargouri N, Speybroeck N, Cawthorne A, Mathers C, Stein C, Angulo FJ, Devleesschauwer B, Devleesschauwer B; World Health Organization Foodborne Disease Burden Epidemiology Reference Group . World Health Organization Global Estimates and Regional Comparisons of the Burden of Foodborne Disease in 2010. PLoS Med 2015;12(12):e1001923. 10.1371/journal.pmed.1001923 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Thomas MK, Murray R, Flockhart L, Pintar K, Pollari F, Fazil A, Nesbitt A, Marshall B. Estimates of the burden of foodborne illness in Canada for 30 specified pathogens and unspecified agents, circa 2006. Foodborne Pathog Dis 2013;10(7):639–48. 10.1089/fpd.2012.1389 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.Thomas MK, Murray R, Flockhart L, Pintar K, Fazil A, Nesbitt A, Marshall B, Tataryn J, Pollari F. Estimates of foodborne illness-related hospitalizations and deaths in Canada for 30 specified pathogens and unspecified agents. Foodborne Pathog Dis 2015;12(10):820–7. 10.1089/fpd.2015.1966 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Gould LH, Demma L, Jones TF, Hurd S, Vugia DJ, Smith K, Shiferaw B, Segler S, Palmer A, Zansky S, Griffin PM. Hemolytic uremic syndrome and death in persons with Escherichia coli O157:H7 infection, foodborne diseases active surveillance network sites, 2000-2006. Clin Infect Dis 2009;49(10):1480–5. 10.1086/644621 [DOI] [PubMed] [Google Scholar]
- 5.García Rodríguez LA, Ruigómez A, Panés J. Acute gastroenteritis is followed by an increased risk of inflammatory bowel disease. Gastroenterology 2006;130(6):1588–94. 10.1053/j.gastro.2006.02.004 [DOI] [PubMed] [Google Scholar]
- 6.Tam CC, Rodrigues LC, Petersen I, Islam A, Hayward A, O’Brien SJ. Incidence of Guillain-Barré syndrome among patients with Campylobacter infection: a general practice research database study. J Infect Dis 2006;194(1):95–7. 10.1086/504294 [DOI] [PubMed] [Google Scholar]
- 7.Majowicz SE, Panagiotoglou D, Taylor M, Gohari MR, Kaplan GG, Chaurasia A, Leatherdale ST, Cook RJ, Patrick DM, Ethelberg S, Galanis E. Determining the long-term health burden and risk of sequelae for 14 foodborne infections in British Columbia, Canada: protocol for a retrospective population-based cohort study. BMJ Open 2020;10(8):e036560. 10.1136/bmjopen-2019-036560 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.van Walraven C, Bennett C, Forster AJ. Administrative database research infrequently used validated diagnostic or procedural codes. J Clin Epidemiol 2011;64(10):1054–9. 10.1016/j.jclinepi.2011.01.001 [DOI] [PubMed] [Google Scholar]
- 9.Waikar SS, Wald R, Chertow GM, Curhan GC, Winkelmayer WC, Liangos O, Sosa MA, Jaber BL. Validity of International Classification of Diseases, Ninth Revision, Clinical Modification Codes for Acute Renal Failure. J Am Soc Nephrol 2006;17(6):1688–94. 10.1681/ASN.2006010073 [DOI] [PubMed] [Google Scholar]
- 10.Winkelmayer WC, Schneeweiss S, Mogun H, Patrick AR, Avorn J, Solomon DH. Identification of individuals with CKD from Medicare claims data: a validation study. Am J Kidney Dis 2005;46(2):225–32. 10.1053/j.ajkd.2005.04.029 [DOI] [PubMed] [Google Scholar]
- 11.Sickbert-Bennett EE, Weber DJ, Poole C, MacDonald PD, Maillard JM. Utility of International Classification of Diseases, Ninth Revision, Clinical Modification codes for communicable disease surveillance. Am J Epidemiol 2010;172(11):1299–305. 10.1093/aje/kwq285 [DOI] [PubMed] [Google Scholar]
- 12.Chang HG, Tserenpuntsag B, Kacica M, Smith PF, Morse DL. Hemolytic uremic syndrome incidence in New York. Emerg Infect Dis 2004;10(5):928–31. 10.3201/eid1005.030456 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Wahl PM, Terrell DR, George JN, Rodgers JK, Uhl L, Cataland S, Bohn RL. Validation of claims-based diagnostic codes for idiopathic thrombotic thrombocytopenic purpura in a commercially-insured population. Thromb Haemost 2010;103(6):1203–9. 10.1160/TH09-08-0595 [DOI] [PubMed] [Google Scholar]
- 14.Military Health System. Surveillance Case Definitions. 2015. 2023. https://www.health.mil/Military-Health-Topics/Health-Readiness/AFHSD/Epidemiology-and-Analysis/Surveillance-Case-Definitions
- 15.Bogliun G, Beghi E; Guillain-Barrè Syndrome Registry Study Group . Validity of hospital discharge diagnoses for public health surveillance of the Guillain-Barrè syndrome. Neurol Sci 2002;23(3):113–7. 10.1007/s100720200036 [DOI] [PubMed] [Google Scholar]
- 16.Koobatian TJ, Birkhead GS, Schramm MM, Vogt RL. The use of hospital discharge data for public health surveillance of Guillain-Barré syndrome. Ann Neurol 1991;30(4):618–21. 10.1002/ana.410300418 [DOI] [PubMed] [Google Scholar]
- 17.Jiang GX, de Pedro-Cuesta J, Fredrikson S. Guillain-Barré syndrome in south-west Stockholm, 1973-1991, 1. Quality of registered hospital diagnoses and incidence. Acta Neurol Scand 1995;91(2):109–17. 10.1111/j.1600-0404.1995.tb00416.x [DOI] [PubMed] [Google Scholar]
- 18.Lee CD, Jones TF. Hospital discharge database optimization in Guillain-Barré syndrome surveillance. Muscle Nerve 2012;46(1):60–2. 10.1002/mus.23261 [DOI] [PubMed] [Google Scholar]
- 19.Polakowski LL, Sandhu SK, Martin DB, Ball R, Macurdy TE, Franks RL, Gibbs JM, Kropp GF, Avagyan A, Kelman JA, Worrall CM, Sun G, Kliman RE, Burwen DR. Chart-confirmed guillain-barre syndrome after 2009 H1N1 influenza vaccination among the Medicare population, 2009-2010. Am J Epidemiol 2013;178(6):962–73. 10.1093/aje/kwt051 [DOI] [PubMed] [Google Scholar]
- 20.Burwen DR, Ball R, Bryan WW, Izurieta HS, La Voie L, Gibbs NA, Kliman R, Braun MM. Evaluation of Guillain-Barré Syndrome among recipients of influenza vaccine in 2000 and 2001. Am J Prev Med 2010;39(4):296–304. 10.1016/j.amepre.2010.05.022 [DOI] [PubMed] [Google Scholar]
- 21.Funch D, Holick C, Velentgas P, Clifford R, Wahl PM, McMahill-Walraven C, Gladowski P, Platt R, Amato A, Chan KA. Algorithms for identification of Guillain-Barré Syndrome among adolescents in claims databases. Vaccine 2013;31(16):2075–9. 10.1016/j.vaccine.2013.02.009 [DOI] [PubMed] [Google Scholar]
- 22.Alcalde-Cabero E, Almazán-Isla J, García López FJ, Ara-Callizo JR, Avellanal F, Casasnovas C, Cemillán C, Cuadrado JI, Duarte J, Fernández-Pérez MD, Fernández Ó, Merino JA, Montero RG, Montero D, Pardo J, Rodríguez-Rivera FJ, Ruiz-Tovar M, de Pedro-Cuesta J; Spanish GBS Epidemiology Study Group . Guillain-Barré syndrome following the 2009 pandemic monovalent and seasonal trivalent influenza vaccination campaigns in Spain from 2009 to 2011: outcomes from active surveillance by a neurologist network, and records from a country-wide hospital discharge database. BMC Neurol 2016;16:75. 10.1186/s12883-016-0598-z [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Crump N, Cartwright M. S139. A retrospective study of patients with chronic inflammatory demyelinating polyneuropathy (CIDP): identifying ultrasonographic features for diagnosis and prognosis. Clin Neurophysiol 2018;129 Suppl 1:e193–4. 10.1016/j.clinph.2018.04.499 [DOI] [Google Scholar]
- 24.Singh JA, Holmgren AR, Krug H, Noorbaloochi S. Accuracy of the diagnoses of spondylarthritides in veterans affairs medical center databases. Arthritis Rheum 2007;57(4):648–55. 10.1002/art.22682 [DOI] [PubMed] [Google Scholar]
- 25.Dubreuil M, Peloquin C, Zhang Y, Choi HK, Inman RD, Neogi T. Validity of ankylosing spondylitis diagnoses in The Health Improvement Network. Pharmacoepidemiol Drug Saf 2016;25(4):399–404. 10.1002/pds.3952 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Shiff NJ, Oen K, Rabbani R, Lix LM. Validation of administrative case ascertainment algorithms for chronic childhood arthritis in Manitoba, Canada. Rheumatol Int 2017;37(9):1575–84. 10.1007/s00296-017-3734-1 [DOI] [PubMed] [Google Scholar]
- 27.Curtis JR, Harrold LR, Asgari MM, Deodhar A, Salman C, Gelfand JM, Wu JJ, Herrinton LJ. Diagnostic prevalence of ankylosing spondylitis using computerized health care data, 1996 to 2009: underrecognition in a US health care setting. Perm J 2016;20(4):15–151. 10.7812/TPP/15-151 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.Lindström U, Exarchou S, Sigurdardottir V, Sundström B, Askling J, Eriksson JK, Forsblad-d’Elia H, Turesson C, Kristensen LE, Jacobsson L. Validity of ankylosing spondylitis and undifferentiated spondyloarthritis diagnoses in the Swedish National Patient Register. Scand J Rheumatol 2015;44(5):369–76. 10.3109/03009742.2015.1010572 [DOI] [PubMed] [Google Scholar]
- 29.Pimentel MA, Browne EN, Janardhana PM, Borkar DS, Tham VM, Uchida A, Vinoya AC, Acharya NR. Assessment of the accuracy of using ICD-9 codes to identify uveitis, herpes zoster ophthalmicus, scleritis, and episcleritis. JAMA Ophthalmol 2016;134(9):1001–6. 10.1001/jamaophthalmol.2016.2166 [DOI] [PubMed] [Google Scholar]
- 30.Bernstein CN, Blanchard JF, Rawsthorne P, Wajda A. Epidemiology of Crohn’s disease and ulcerative colitis in a central Canadian province: a population-based study. Am J Epidemiol 1999;149(10):916–24. 10.1093/oxfordjournals.aje.a009735 [DOI] [PubMed] [Google Scholar]
- 31.Ananthakrishnan AN, Cai T, Savova G, Cheng SC, Chen P, Perez RG, Gainer VS, Murphy SN, Szolovits P, Xia Z, Shaw S, Churchill S, Karlson EW, Kohane I, Plenge RM, Liao KP. Improving case definition of Crohn’s disease and ulcerative colitis in electronic medical records using natural language processing: a novel informatics approach. Inflamm Bowel Dis 2013;19(7):1411–20. 10.1097/MIB.0b013e31828133fd [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32.Hou JK, Tan M, Stidham RW, Colozzi J, Adams D, El-Serag H, Waljee AK. Accuracy of diagnostic codes for identifying patients with ulcerative colitis and Crohn’s disease in the Veterans Affairs Health Care System. Dig Dis Sci 2014;59(10):2406–10. 10.1007/s10620-014-3174-7 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33.Rezaie A, Quan H, Fedorak RN, Panaccione R, Hilsden RJ. Development and validation of an administrative case definition for inflammatory bowel diseases. Can J Gastroenterol 2012;26(10):711–7. 10.1155/2012/278495 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34.Marrie RA, Fisk JD, Stadnyk KJ, Tremlett H, Wolfson C, Warren S, Bhan V, Yu BN; CIHR Team in the Epidemiology and Impact of Comorbidity on Multiple Sclerosis . Performance of administrative case definitions for comorbidity in multiple sclerosis in Manitoba and Nova Scotia. Chronic Dis Inj Can 2014;34(2-3):145–53. 10.24095/hpcdp.34.2/3.09 [DOI] [PubMed] [Google Scholar]
- 35.Benchimol EI, Guttmann A, Griffiths AM, Rabeneck L, Mack DR, Brill H, Howard J, Guan J, To T. Increasing incidence of paediatric inflammatory bowel disease in Ontario, Canada: evidence from health administrative data. Gut 2009;58(11):1490–7. 10.1136/gut.2009.188383 [DOI] [PubMed] [Google Scholar]
- 36.Herrinton LJ, Liu L, Lafata JE, Allison JE, Andrade SE, Korner EJ, Chan KA, Platt R, Hiatt D, O’Connor S. Estimation of the period prevalence of inflammatory bowel disease among nine health plans using computerized diagnoses and outpatient pharmacy dispensings. Inflamm Bowel Dis 2007;13(4):451–61. 10.1002/ibd.20021 [DOI] [PubMed] [Google Scholar]
- 37.Thirumurthi S, Chowdhury R, Richardson P, Abraham NS. Validation of ICD-9-CM diagnostic codes for inflammatory bowel disease among veterans. Dig Dis Sci 2010;55(9):2592–8. 10.1007/s10620-009-1074-z [DOI] [PubMed] [Google Scholar]
- 38.Liu L, Allison JE, Herrinton LJ. Validity of computerized diagnoses, procedures, and drugs for inflammatory bowel disease in a northern California managed care organization. Pharmacoepidemiol Drug Saf 2009;18(11):1086–93. 10.1002/pds.1824 [DOI] [PubMed] [Google Scholar]
- 39.Sands BE, Duh MS, Cali C, Ajene A, Bohn RL, Miller D, Cole JA, Cook SF, Walker AM. Algorithms to identify colonic ischemia, complications of constipation and irritable bowel syndrome in medical claims data: development and validation. Pharmacoepidemiol Drug Saf 2006;15(1):47–56. 10.1002/pds.1118 [DOI] [PubMed] [Google Scholar]
- 40.Yale SH, Musana AK, Kieke A, Hayes J, Glurich I, Chyou PH. Applying case definition criteria to irritable bowel syndrome. Clin Med Res 2008;6(1):9–16. 10.3121/cmr.2008.788 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 41.Jossan N, Backman AS, Linder M, Altman M, Simren M, Olen O, Törnblom H. Su2089 Validation of the Use of the ICD-10 Diagnostic Code for Irritable Bowel Syndrome in the Swedish National Patient Register. Gastroenterology 2014;146(5 Suppl 1):S-543. 10.1016/S0016-5085(14)61967-3 [DOI] [Google Scholar]
- 42.Goff SL, Feld A, Andrade SE, Mahoney L, Beaton SJ, Boudreau DM, Davis RL, Goodman M, Hartsfield CL, Platt R, Roblin D, Smith D, Yood MU, Dodd K, Gurwitz JH. Administrative data used to identify patients with irritable bowel syndrome. J Clin Epidemiol 2008;61(6):617–21. 10.1016/j.jclinepi.2007.07.013 [DOI] [PubMed] [Google Scholar]
- 43.Legorreta AP, Ricci JF, Markowitz M, Jhingran P. Patients diagnosed with irritable bowel syndrome. Dis Manag Health Outcomes 2002;10(11):715–22. 10.2165/00115677-200210110-00005 [DOI] [Google Scholar]
- 44.Chan J, Mack DR, Manuel DG, Mojaverian N, de Nanassy J, Benchimol EI. Validation of an algorithm to identify children with biopsy-proven celiac disease from within health administrative data: an assessment of health services utilization patterns in Ontario, Canada. PLoS One 2017;12(6):e0180338. 10.1371/journal.pone.0180338 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 45.Hall N, Alcala AN, Burman M, Moawad F, Cash B, Murray J, Porter C. A Validation Study on the Diagnosis of Celiac Disease in Military Service Members: 1063. Am J Gastroenterol 2016;111:S462. 10.14309/00000434-201610001-01063 [DOI] [Google Scholar]
- 46.Tanpowpong P, Broder-Fingert S, Obuch JC, Rahni DO, Katz AJ, Leffler DA, Kelly CP, Camargo CA Jr. Multicenter study on the value of ICD-9-CM codes for case identification of celiac disease. Ann Epidemiol 2013;23(3):136–42. 10.1016/j.annepidem.2012.12.009 [DOI] [PubMed] [Google Scholar]
- 47.Dydensborg Sander S, Størdal K, Plato Hansen T, Nybo Andersen AM, Murray JA, Lillevang ST, Husby S. Validation of celiac disease diagnoses recorded in the Danish National Patient Register using duodenal biopsies, celiac disease-specific antibodies, and human leukocyte-antigen genotypes. Clin Epidemiol 2016;8:789–99. 10.2147/CLEP.S122300 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 48.Cohen E, Fuller G, Bolus R, Modi R, Vu M, Shahedi K, Shah R, Atia M, Kurzbard N, Sheen V, Agarwal N, Kaneshiro M, Yen L, Hodgkins P, Erder MH, Spiegel B. Increased risk for irritable bowel syndrome after acute diverticulitis. Clin Gastroenterol Hepatol 2013;11(12):1614–9. 10.1016/j.cgh.2013.03.007 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 49.Gearing RE, Mian IA, Barber J, Ickowicz A. A methodology for conducting retrospective chart review research in child and adolescent psychiatry. J Can Acad Child Adolesc Psychiatry 2006;15(3):126–34. [PMC free article] [PubMed] [Google Scholar]
- 50.Coward S, Clement F, Benchimol EI, Bernstein CN, Avina-Zubieta JA, Bitton A, Carroll MW, Hazlewood G, Jacobson K, Jelinski S, Deardon R, Jones JL, Kuenzig ME, Leddin D, McBrien KA, Murthy SK, Nguyen GC, Otley AR, Panaccione R, Rezaie A, Rosenfeld G, Peña-Sánchez JN, Singh H, Targownik LE, Kaplan GG. Past and Future Burden of Inflammatory Bowel Diseases Based on Modeling of Population-Based Data. Gastroenterology 2019;156(5):1345–1353.e4. 10.1053/j.gastro.2019.01.002 [DOI] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
These documents can be accessed on the Supplemental material file.
Table S1: Search terms used in the literature review to identify International Classification of Diseases code-based case definitions for enteric infection sequelae
Table S2: Sequelae assessed during the chart review and their clinical criteria
Table S3: Results of the literature review to identify International Classification of Diseases code-based case definitions for enteric infection sequelae