Abstract
Composite major congenital malformation (MCM) outcomes are commonly used to assess teratogenic effects of prenatal medication exposure, but this approach dilutes effect estimates when the risk is confined to a specific MCM. Tree-based scan statistics address this by screening outcomes using a hierarchical tree, enabling detection of specific risks without predefined hypotheses. To apply this method across ICD-9-CM and ICD-10-CM eras, we developed a unified hierarchical outcomes tree for MCM. We selected ICD-9-CM and ICD-10-CM codes classified as congenital anomalies, removing minor malformations, chromosomal anomalies, and single-gene conditions. A multi-level tree was built based on the Multilevel Clinical Classification Software, General Equivalence Mappings, and expert review. We validated the tree using birth cohorts from MarketScan and Medicaid databases (2011–2013; 2016–2018), assessing balance of MCM prevalences within one year of birth via standardized mean differences (SMDs). The final tree included 1,023 codes, organized into 244 clinical MCM groups at the most granular level. We identified 572,107 (2011–2013) and 360,167 infants (2016–2018) in MarketScan and 362,820 and 3,500,589 infants in Medicaid. All SMDs were below 0.1, indicating consistency across coding eras. This hierarchical MCM tree bridges ICD-9-CM and ICD-10-CM, enabling consistent outcome definitions and enhancing detection of specific teratogenic risks.
Keywords: tree-based scan, ICD-9-CM, ICD-10-CM, congenital anomaly, malformation
Plain language summary
Researchers often group major birth defects together in studies to increase the number of cases, but this can hide risks linked to specific defects. Tree-based scan statistics help by looking at outcomes in a detailed, structured way without needing to guess which defects might be affected. To use this method across multiple years, we created and tested a single, unified definition for major birth defects. This structure makes it easier to evaluate birth defects across coding systems and improves the ability to find risks linked to specific defects. Overall, this approach helps detect important risks that might be missed when using broad groupings of birth defects.
Introduction
Almost 98% of medications have undetermined teratogenicity risk at the time of approval,1 with evidence relying largely on animal data as pregnant women are commonly excluded from clinical trials.2 As a result, post-marketing observational studies have become key sources for evaluating medication safety during pregnancy.1,3 However, despite significant advances in pregnancy research, it can still take decades after a medication’s approval until a reasonably accurate and precise classification of teratogenic risk is available.1
Research on medications during pregnancy faces multiple challenges including low exposure prevalence, difficulty in accurately measuring teratogenic outcomes, and the rarity of such outcomes.3 Major congenital malformations (MCM) are among the key outcomes used to assess teratogenicity risk due to their surgical, medical, or serious cosmetic importance.4 There are nine main classifications of MCM (central nervous system, eye, ear, cardiovascular, orofacial, gastrointestinal, genitourinary, musculoskeletal, and chromosomal defects), which are commonly grouped into 30-50 categories,5,6 as aggregate occurring in about 3-4% of all deliveries.7 To address small case numbers of specific MCMs, pregnancy studies often use composites,3,8,9 which are routinely dominated by cardiac malformations due to their higher prevalence. Use of composite outcomes, many of which might be unrelated to the targeted drug effect, might introduce noise in outcome ascertainment, mask a true excess risk of a specific MCM, and lead to false negative results. In absence of animal studies or other prior evidence that might guide the specific selection of MCMs for evaluation, researchers are therefore facing a choice between maximizing power with larger MCM aggregates or greater outcome specificity and detectable relative differences in frequency.
An alternative solution is to employ tree-based scan statistics, a data mining method that uses a hierarchical tree structure to screen thousands of outcomes at varying levels of aggregation while adjusting for multiplicity.10,11 This approach is particularly valuable in medication safety assessments where no prior information on types of specific adverse outcomes is available and has been routinely used by the U.S. Food and Drug Administration (FDA) and Centers for Disease Control and Prevention (CDC) for post-marketing surveillance activities.12-18 Because tree-based scan statistics assess outcomes frequencies at various levels of aggregation, tree-based scan statistics optimize detection of unknown safety outcomes, simultaneously maximizing case numbers and specificity.
Implementation of tree-based scan statistics requires organizing thousands of outcomes into a hierarchical tree. Top levels (closer to the “root” in tree parlance) represent broad categories (e.g., congenital anomalies), which are progressively divided into more specific concepts at lower levels until the “leaf level” that contains the most detailed outcomes, such as individual diagnoses (e.g., anencephaly). Previous studies have used Multi-Level Clinical Classification Software (MLCCS) from the Agency for Healthcare Research and Quality to build five-level trees based on International Classification of Disease, Ninth Revision, Clinical Modification (ICD-9-CM) codes.12,19-21 However, MLCCS is available for ICD-9 coding but not its successor, ICD-10-CM.19
In October 2015, the U.S. transitioned from the ICD-9-CM coding system to ICD-10-CM for diagnosis and procedure codes used in clinical settings, expanding from over 14,000 diagnosis codes to over 70,000 codes. This shift introduced challenges in translating clinical concepts across eras. A crosswalk between ICD-9-CM and ICD-10-CM coding systems exists but requires careful review to ensure consistency in clinical meaning of individual codes and in aligning diagnosis groups representing the same clinical construct.
When applying tree-based scan statistics across both eras, it is essential not only to maintain consistency in the meaning of individual clinical diagnostic concepts but also to preserve their hierarchical organization so risks can be detected for specific MCMs or groupings. A unified structure enables continuous medication safety monitoring and thereby increases sample size and statistical power across ICD eras.
Here, we report development of a unified hierarchical structure (an outcome tree) for MCMs across ICD-9-CM and ICD-10-CM eras as a new tool to accommodate ongoing medication safety studies in pregnancy.
Methods
Major congenital malformation outcome tree development
To obtain all relevant MCMs, we selected 444 ICD-9 codes classified under “Congenital anomalies” at level 1 in the 2015 MLCCS19 and 839 ICD-10 codes under the same category in the 2018 Beta Clinical Classifications Software (Beta-CCS).22 Since these lists exclude header codes which, despite being non-billable, are used frequently on medical claims, we manually added relevant headers and included new codes introduced after 2018 (as of May 1, 2025). We then mapped all ICD-9 codes to ICD-10 codes and vice versa using the 2018 general equivalence mappings (GEMS),23 merged the bidirectional mappings and removed duplicated pairs. To ensure clinical relevance of outcomes and focus on possible iatrogenic etiologies, we excluded codes related to chromosomal anomalies or single-gene conditions (Table S1), exogenous causes unrelated to medication exposure, or codes referring to personal history. These exclusions were reviewed and curated by a clinical geneticist (SAR).
To facilitate clinical review, we grouped the ICD code mappings into five categories based on the complexity of the matches. Category 1 included simple one-to-one matches, where a single ICD-9 code mapped to a single ICD-10 code and vice versa. Category 2 included one-to-many matches, where one ICD-9 code mapped to several ICD-10 codes, but those ICD-10 codes did not map to any other ICD-9 codes. Category 3 was the reverse; one ICD-10 code mapped to several ICD-9 codes, with no overlap to other ICD-10 codes. Category 4 captured more complex, chained mappings where codes looped back and forth between ICD-9 and ICD-10, creating interconnected chains (Figure 1). Finally, category 5 included codes that could not be mapped, often because they were general or header codes. We addressed these by manually adding each header code to an existing clinical concept that includes their sub-codes (e.g., adding ICD-10 header code Q03 with its sub-codes Q03.0, Q03.1, Q03.8, Q03.9).
Figure 1. Examples of the complex mappings between ICD-9 and ICD-10 codes mapping category 4.

Our outcome tree has a total of five hierarchical levels (levels 1-5) which were developed based on the MLCCS structure. At the broadest concept level (level 1), MLCCS organizes congenital malformations into five main groups: “ Cardiac and circulatory congenital anomalies”, “Digestive congenital anomalies”, “Genitourinary congenital anomalies”, “Nervous system congenital anomalies”, and “Other congenital anomalies”. To make the “other” group more specific, we sub-divided it into five smaller groups including facial anomalies, respiratory system anomalies, musculoskeletal anomalies, skin-related anomalies, and a remaining “other” group. Levels 2 to 4 were based on the MLCCS hierarchy of the mapped ICD-9 codes. Table 1 gives examples of how codes were assigned using these grouping strategies and structured into hierarchical levels.
Table 1.
Examples of the hierarchical tree structure for both ICD-9 and ICD-10 codes
| Level | Level code | Level description | Level 5 code ICD era |
ICD code |
ICD description | |
|---|---|---|---|---|---|---|
| Example of mapping category 1 (1:1 map) | 1 | 14 | Congenital anomalies | |||
| 2 | 14.04 | Nervous system congenital anomalies | ||||
| 3 | 14.04.05 | Other nervous system congenital anomalies | ||||
| 4 | 14.04.05.00 | Other nervous system congenital anomalies | ||||
| 5 | 14.04.05.00.01 | Anencephaly | ICD-9 | 740 | Anencephalous | |
| ICD-10 | Q00.0 | Anencephaly | ||||
| Example of mapping category 2 (1:n map) | 1 | 14 | Congenital anomalies | |||
| 2 | 14.04 | Nervous system congenital anomalies | ||||
| 3 | 14.04.01 | Spina bifida | ||||
| 4 | 14.04.01.00 | Spina bifida | ||||
| 5 | 14.04.01.00.06 | Spina bifida lumbar region with hydrocephalus | ICD-9 | 741.03 | Spina bifida lumbar region with hydrocephalus | |
| ICD-10 | Q05.2 | Lumbar spina bifida with hydrocephalus | ||||
| ICD-10 | Q05.3 | Sacral spina bifida with hydrocephalus | ||||
| Example of mapping category 3 (n:1 map) | 1 | 14 | Congenital anomalies | |||
| 2 | 14.05 | Facial anomalies | ||||
| 3 | 14.05.01 | Congenital anomalies of the eye | ||||
| 4 | 14.05.01.02 | Microphthalmos | ||||
| 5 | 14.05.01.02.00 | Microphthalmos | ICD-9 | 743.06 | Cryptophthalmos | |
| ICD-9 | 743.1 | Microphthalmos unspecified | ||||
| ICD-9 | 743.11 | Simple microphthalmos | ||||
| ICD-9 | 743.12 | Microphthalmos associated with other anomalies of eye and adnexa | ||||
| ICD-10 | Q11.2 | Microphthalmos | ||||
| Example of mapping category 4 (chain map) | 1 | 14 | Congenital anomalies | |||
| 2 | 14.04 | Nervous system congenital anomalies | ||||
| 3 | 14.04.01 | Spina bifida | ||||
| 4 | 14.04.01.00 | Spina bifida | ||||
| 5 | 14.04.01.00.07 | Spina bifida unspecified region with/without hydrocephalus | ICD-9 | 741.00 | Spina bifida unspecified region with hydrocephalus | |
| ICD-9 | 741.90 | Spina bifida unspecified region without hydrocephalus | ||||
| ICD-10 | Q05.4 | Unspecified spina bifida with hydrocephalus | ||||
| ICD-10 | Q07.02 | Arnold-Chiari syndrome with hydrocephalus | ||||
| ICD-10 | Q07.03 | Arnold-Chiari syndrome with spina bifida and hydrocephalus | ||||
| ICD-10 | Q05.9 | Spina bifida, unspecified | ||||
| Example of mapping category 5 (rescuing unmapped codes) | 1 | 14 | Congenital anomalies | |||
| 2 | 14.04 | Nervous system congenital anomalies | ||||
| 3 | 14.04.05 | Other nervous system congenital anomalies | ||||
| 4 | 14.04.05.00 | Other nervous system congenital anomalies | ||||
| 5 | 14.04.05.00.11 | Congenital hydrocephalus | ICD-9 | 742.3 | Congenital hydrocephalus | |
| ICD-10 | Q03 | Congenital hydrocephalus | ||||
| ICD-10 | Q030 | Malformations of aqueduct of Sylvius | ||||
| ICD-10 | Q031 | Atresia of foramina of Magendie and Luschka | ||||
| ICD-10 | Q03.8 | Other congenital hydrocephalus | ||||
| ICD-10 | Q03.9 | Congenital hydrocephalus, unspecified |
After establishing the initial tree structure, we removed all minor malformations to support parsimonious models that are confined to clinically highly relevant outcomes. We defined major malformations as defects that require surgery or medical treatment, or those that have serious cosmetic impact,4 consistent with the focus of epidemiologic studies by the Metropolitan Atlanta Congenital Defects Program, the National Birth Defects Prevention Study, and the National Birth Defects Prevention Network.4,6,7,24 If both ICD-9 and ICD-10 codes in a mapped pair indicated minor anomalies, the pair was removed. In cases of discrepancies, decisions were based on the more specific code. For example, if a nonspecific ICD-9 code was mapped to both minor and major ICD-10 codes, only the minor ICD-10 codes were excluded, preserving the mapped pair(s) between the unspecific ICD-9 code and the major malformation ICD-10 code(s). All decisions about code removal and reconciliation of complex or inconsistent mapping were made by a clinical geneticist (SAR). The final hierarchical tree is captured in the Table S2.
Tree validation - Evaluation of major congenital malformation prevalence across ICD-9 and ICD-10 eras
To evaluate the mapping between the ICD-9 and ICD-10 eras, we compared the prevalence of MCMs at various aggregate group levels using birth cohorts from Merative™ MarketScan® Research Databases and U.S. Medicaid databases. The cohorts included infants born in 2011-2013 (ICD-9 era) and 2016-2018 (ICD-10 era) with continuous medical and prescription coverage within 45 days of birth through 1 year. MCMs were identified if an infant had at least one inpatient diagnosis or diagnoses on two separate days in outpatient settings within the first year of life.
MCM groupings with absolute standardized mean differences (SMDs) > 0.1 were manually reviewed to determine whether differences were due to removal of minor malformations or changes in code specificity across ICD eras. To comply with small cell reporting policies and compare prevalences with sufficient precision, we only reported nodes with at least 30 events across both eras and no cell count smaller than 11 per era per database.25
This study was approved by the Institutional Review and Privacy Boards of the University of Florida, the Centers for Medicare and Medicaid Services, and the Harvard Pilgrim Health Care Institute.
Results
The final tree included 1,023 codes (669 from the ICD-10 era), organized into 244 distinct clinical MCM groups at the most granular level, 96 aggregated groups at level 4 and 45 aggregate groupings at level 3 (Figure 2).
Figure 2. Attrition flow chart describing the tree development process.

To validate the tree, we identified 572,107 (2011-2013) and 360,167 infants (2016-2018) in the MarketScan database, and 362,820 and 3,500,589 infants in the Medicaid database for the same period. The substantial difference in the number of eligible infants in the Medicaid database between the two eras was primarily due to more states failing to meet data quality metrics26 - either for Fee-for-Service or Comprehensive Managed Care - during the ICD-9 era.
Two out of 45 aggregate groups at level 3 with fewer than 30 total events (“All other congenital anomalies” and “Gastrointestinal vessel congenital anomalies”) were excluded from analysis. The most common level 3 groups with on average at least 7 events per 1000 infants in MarketScan and Medicaid were atrial septal defect (24 vs. 28), ventricular septal defect (8 vs. 8), congenital anomalies of urinary system (9 vs. 8), other congenital musculoskeletal anomalies (9 vs. 7) and congenital anomalies of respiratory system (7 vs. 8), respectively (Table 2). All level 3 groups had SMD ≤ 0.05 when comparing prevalences from the two ICD eras in both databases, indicating good balance (Table 2). We observed consistent results when the prevalence balance was evaluated at the most granular level 5 with adequate balance across all 244 MCM groups (Table S3).
Table 2.
Comparison of prevalences of major congenital malformations at aggregated levels by the ICD-9 and ICD-10 eras and databases
| Level 3 node* | MarketScan Database | Medicaid Database | ||||
|---|---|---|---|---|---|---|
| Events per 1000 infants: ICD-9 (2011- 2013 birth cohort) |
Events per 1000 infants: ICD-10 (2016-2018 birth cohort) |
Absolute standardized mean difference (aSMD) |
Events per 1000 infants: ICD-9 (2011-2013 birth cohort) |
Events per 1000 infants: ICD-10 (2016-2018 birth cohort) |
Absolute standardized mean difference (aSMD) |
|
| Total eligible infants | 572,107 | 360,167 | 362,820 | 3,500,589 | ||
| Atrial septal defect | 12181 (21.29) | 10591 (29.41) | 0.052 | 8852 (24.40) | 101136 (28.89) | 0.028 |
| Ventricular septal defect | 4578 (8.00) | 3306 (9.18) | 0.013 | 2938 (8.10) | 29622 (8.46) | 0.004 |
| Congenital anomalies of urinary system | 4298 (7.51) | 3666 (10.18) | 0.028 | 2406 (6.63) | 26870 (7.68) | 0.012 |
| Other congenital musculoskeletal anomalies | 5527 (9.66) | 3251 (9.03) | 0.007 | 3227 (8.89) | 24830 (7.09) | 0.020 |
| Congenital anomalies of respiratory system | 3518 (6.15) | 3129 (8.69) | 0.030 | 2410 (6.64) | 26581 (7.59) | 0.011 |
| Congenital anomalies of genital organs | 4903 (8.57) | 3657 (10.15) | 0.016 | 2223 (6.13) | 22712 (6.49) | 0.005 |
| Certain congenital musculoskeletal deformities | 3729 (6.52) | 3181 (8.83) | 0.027 | 1640 (4.52) | 15897 (4.54) | 0.000 |
| Congenital anomalies of limbs | 2887 (5.05) | 1614 (4.48) | 0.008 | 2730 (7.52) | 15694 (4.48) | 0.039 |
| Pulmonary artery anomalies | 1342 (2.35) | 1561 (4.33) | 0.034 | 1211 (3.34) | 15500 (4.43) | 0.018 |
| Congenital anomalies of ear face and neck | 1478 (2.58) | 1595 (4.43) | 0.031 | 1042 (2.87) | 12284 (3.51) | 0.011 |
| Other nervous system congenital anomalies | 1628 (2.85) | 1235 (3.43) | 0.010 | 1252 (3.45) | 11860 (3.39) | 0.001 |
| Persistent fetal circulation | 1336 (2.34) | 1077 (2.99) | 0.013 | 962 (2.65) | 11306 (3.23) | 0.011 |
| Other congenital anomalies | 1637 (2.86) | 1019 (2.83) | 0.001 | 991 (2.73) | 7620 (2.18) | 0.011 |
| Microcephalus | 429 (0.75) | 549 (1.52) | 0.023 | 609 (1.68) | 8877 (2.54) | 0.019 |
| Pulmonary valve atresia and stenosis | 1252 (2.19) | 735 (2.04) | 0.003 | 898 (2.48) | 6821 (1.95) | 0.011 |
| Pyloric stenosis | 1019 (1.78) | 476 (1.32) | 0.012 | 932 (2.57) | 6819 (1.95) | 0.013 |
| Cleft palate and/or cleft lip | 928 (1.62) | 559 (1.55) | 0.002 | 632 (1.74) | 6121 (1.75) | 0.000 |
| Congenital anomalies of the eye | 968 (1.69) | 763 (2.12) | 0.01 | 558 (1.54) | 5157 (1.47) | 0.002 |
| Other circulatory congenital anomalies | 1063 (1.86) | 782 (2.17) | 0.007 | 697 (1.92) | 4666 (1.33) | 0.015 |
| Other heart valve congenital anomalies | 258 (0.45) | 583 (1.62) | 0.036 | 110 (0.30) | 6040 (1.73) | 0.045 |
| Other lower gastrointestinal congenital anomalies | 632 (1.10) | 398 (1.11) | 0.000 | 399 (1.10) | 4199 (1.20) | 0.003 |
| Other congenital anomalies of aorta | 476 (0.83) | 352 (0.98) | 0.005 | 234 (0.64) | 3940 (1.13) | 0.016 |
| Coarctation of aorta | 530 (0.93) | 335 (0.93) | 0.000 | 304 (0.84) | 3121 (0.89) | 0.002 |
| Congenital anomalies of the integument | 141 (0.25) | 332 (0.92) | 0.028 | 158 (0.44) | 3101 (0.89) | 0.018 |
| Endocardial cushion defects | 443 (0.77) | 279 (0.77) | 0.000 | 228 (0.63) | 2083 (0.60) | 0.001 |
| Rectal and large intestine atresia/stenosis | 362 (0.63) | 198 (0.55) | 0.003 | 243 (0.67) | 2097 (0.60) | 0.003 |
| Other congenital anomalies of the heart | 323 (0.56) | 244 (0.68) | 0.005 | 201 (0.55) | 2118 (0.61) | 0.002 |
| Other spinal cord congenital anomalies | 364 (0.64) | 284 (0.79) | 0.006 | 154 (0.42) | 2044 (0.58) | 0.007 |
| Tetralogy of Fallot | 352 (0.62) | 239 (0.66) | 0.002 | 226 (0.62) | 1955 (0.56) | 0.003 |
| Atresia and stenosis of small intestine | 343 (0.60) | 165 (0.46) | 0.006 | 244 (0.67) | 2003 (0.57) | 0.004 |
| Other upper gastrointestinal congenital anomalies | 229 (0.40) | 282 (0.78) | 0.016 | 145 (0.40) | 1623 (0.46) | 0.003 |
| Anomalies of intestinal fixation | 290 (0.51) | 159 (0.44) | 0.003 | 180 (0.50) | 1460 (0.42) | 0.004 |
| Other anomalies of bulbus cordis and cardiac septal closure | 360 (0.63) | 192 (0.53) | 0.004 | 171 (0.47) | 1303 (0.37) | 0.005 |
| Spina bifida | 224 (0.39) | 149 (0.41) | 0.001 | 150 (0.41) | 1497 (0.43) | 0.001 |
| Hirshsprungs disease | 235 (0.41) | 121 (0.34) | 0.004 | 137 (0.38) | 1250 (0.36) | 0.001 |
| Hypoplastic left heart syndrome | 211 (0.37) | 119 (0.33) | 0.002 | 126 (0.35) | 1260 (0.36) | 0.001 |
| Transposition of great vessels | 219 (0.38) | 112 (0.31) | 0.004 | 102 (0.28) | 1223 (0.35) | 0.004 |
| Double outlet right ventricle | 175 (0.31) | 94 (0.26) | 0.003 | 119 (0.33) | 1069 (0.31) | 0.001 |
| Esophageal atresia/tracheoesophageal fistula | 195 (0.34) | 112 (0.31) | 0.002 | 79 (0.22) | 929 (0.27) | 0.003 |
| Aortic valve stenosis | 159 (0.28) | 154 (0.43) | 0.008 | 92 (0.25) | 893 (0.26) | 0.000 |
| Common ventricle | 142 (0.25) | 79 (0.22) | 0.002 | 84 (0.23) | 929 (0.27) | 0.002 |
| Anomalies of adrenal gland | 70 (0.12) | 33 (0.09) | 0.003 | 50 (0.14) | 617 (0.18) | 0.003 |
| Cerebrovascular anomalies | 102 (0.18) | 37 (0.10) | 0.006 | 29 (0.08) | 234 (0.07) | 0.002 |
Level 3 nodes are sorted in descending order based on the total number of events across ICD-9/ICD-10 codes and databases.
Discussion
We created a hierarchical MCM tree that can be used to screen for safety signals of medications, biologics and other exposures across ICD eras, using tree-based scan statistics. The tree captures 244 distinct MCMs at the most granular level and offers several higher-level groupings of MCMs that might share similar etiology and hence might present appropriate composites that can enhance statistical power when evaluating rare events. MCMs were curated to include only major anomalies to focus on the most clinically relevant outcomes and optimize statistical power when employing tree-based scan statistics across all leaves and branches. We removed genetic syndromes (chromosomal anomalies and single-gene conditions) to remove noise in inferential analyses because these conditions are present at conception and thus could not possibly be due to exposures to medications or biologics during pregnancy. The trend analyses showed that prevalence estimates at all grouping levels were comparable across ICD cohorts in both MarketScan and Medicaid databases with all SMDs below 0.1, reducing risk of measurement biases when evaluating exposures over longer study periods. While optimized to use as a tree, investigators may also want to select one or several MCM groups when evaluating hypotheses about specific teratogenic pathways, which is feasible given validated crosswalks between ICD eras on all group levels.
Due to the rarity of specific MCMs and the uncertainty around which specific MCM to target for evaluation when teratogenic pathways are unclear, investigators commonly use composite outcomes to increase proportion case numbers and statistical power.3 However, counts of cases are driven by more frequent MCMs, e.g., septal defects among cardiac anomalies or cardiac anomalies when evaluating all MCMs.6,27 Thus, if the teratogenic effect lies within rarer MCMs, elevated risks might be masked when evaluating large composites.3,28 Using a tree structure with multiplicity adjustment is a potential solution, maximizing power by testing MCM groups at various levels of prevalence and specificity.
Although tree-based scan statistics can improve statistical power to detect rare MCMs, small sample sizes of medication exposure during pregnancy remain a major challenge. According to the Slone Epidemiology Center Birth Defects Study over a 33-year period from 1997-2003, all medications other than the 20 most common had exposure prevalences less than 0.5% during the first trimester.29 Similarly, an analysis of 120 medical products with pregnancy-related labeling changes among 7.1 million livebirth pregnancies within 13 Sentinel Data Partners in the US (2008 to 2023) found that 80% had less than 0.1% use during the first trimester.30 A previous simulation study showed that Poisson tree-based scan statistics require 4,000 exposed pregnancies to detect a two-fold increased risk for an outcome occurring at 8 events per 1,000 births with 85% power, while Bernoulli tree-based scan statistics require twice that sample size.16 Given these constraints, our harmonized tree allows researchers to pool data across ICD eras, further improving statistical power for tree-based scan analyses.
While we removed chromosomal anomalies and single-gene conditions that arise at conception from the outcome tree, we did not remove infants that experienced these codes from our trend evaluation as we were looking to generate more inclusive rates of MCM. We typically do remove these infants when we perform pharmacoepidemiology studies as these infants may present additional structural anomalies that are due to the underlying genetic etiology. For example, atrioventricular septal defects are commonly associated with trisomy 21.31 To support appropriate cohort definition in future studies, we provide a comprehensive list of chromosomal anomalies and single-gene disorders that researchers may use to identify and exclude affected deliveries when evaluating medication-related risks.
There are several limitations to our study. First, it is not always possible to establish exact mappings between ICD-9 and ICD-10 codes due to inherent differences in definitions between the two coding systems. In some instances, we accepted approximate mappings to preserve the number of outcomes represented on the tree. Additionally, because of complex mapping relationships (e.g., one-to-many, many-to-one, or many-to-many), codes within a particular granular clinical concept (level 5 groups) should be interpreted as approximate. Second, the mapping process, including code review and decision on whether a code represents a major or minor MCM or how different codes were grouped, was based on the best judgment of a clinical reviewer with 28 years of experience working on epidemiologic studies of congenital malformations. As such, the tree should be used and interpreted with this subjectivity in mind.
Third, the database sizes varied across years, particularly within the Medicaid population. This variation is unavoidable due to differences in data quality across states and within Fee-for-Service and Comprehensive Managed Care plans, which vary by state and year.26,32-34 Specifically, with the introduction of managed care in Medicaid, data quality dropped initially because encounter detail was not submitted by managed care plans for reimbursement. Hence, because we required infants to have at least one year of continuous enrollment, most eligible infants came from states that met data quality standards for two consecutive years. As managed care encounter capture improved over the last decade, more children met enrollment criteria, contributing to substantial differences in cohort sizes within the Medicaid database. However, it is unlikely that exclusion of state Medicaid programs, especially in the earlier study period, yielded different MCM prevalences.
Lastly, the tree was developed based on MLCCS, which organizes MCMs based on organ systems. It is possible that MCMs might be better organized based on specific teratological or genetic pathways that might result in clusters of anomalies across several organ systems, such as the VATER syndrome. The hierarchical structure of the MCM tree is designed to support evaluation at varying levels of specificity, but this system is not intended to imply that all conditions grouped together share a common etiology. Although we attempted to cluster MCMs with similar etiologies wherever possible, it is unavoidable that some groups, particularly the “Other” categories, include conditions with heterogeneous causes. These “Other” groups often arise from the need to reconcile non-specific ICD codes across the two coding eras. Therefore, when a signal is observed in an “Other” category, it is important to review the specific ICD-9 and ICD-10 codes contributing to that grouping and consider whether any biologically plausible mechanism could explain the observed association. Future research on defining such clusters might create more targeted groupings for safety studies and could be incorporated into the current tree structure.
To conclude, we successfully developed and evaluated an MCM tree that spans ICD-9-CM and ICD-10-CM coding eras. Overall, there was good agreement between ICD-9-CM and ICD-10-CM-based groups at various levels. This tree structure facilitates use of tree-based scan statistics, allowing for the detection of specific MCM signals that may be obscured in composite outcome evaluation. By allowing both broad and granular outcome assessments, our approach enhances the ability to identify potential teratogenic risks with greater specificity and clinical relevance.
Supplementary Material
Take home messages.
Teratogenicity studies may commonly assess major congenital malformations (MCM) as composites to maximize case numbers, but this approach may dilute effect estimates when the risk is confined to a specific MCM.
We structured MCM outcomes into a hierarchical tree with varying clinical granularity using ICD-9 and ICD-10 codes to facilitate assessments across coding eras.
By removing minor MCMs, chromosomal anomalies and single-gene conditions, we optimized the tree to focus on clinically highly relevant outcomes in assessments of teratogenic medications and other prenatal exposures.
The optimized tree supports tree-based scan statistics, which enhances the ability to detect specific teratogenic risks that may be missed when using composite outcomes.
By enabling both broad and granular outcome evaluation, our optimized tree enhances the ability to identify potential teratogenic risks with greater specificity.
Study funding
This study was supported by R01HD110107 from the National Institute of Child Health and Human Development (NICHD).
Footnotes
Conflict of Interest Statement
NES owns stock through inheritance in Baxter, Cardinal Health, CVS Health, Edwards Lifesciences, and Takeda. SAR receives consulting fees from pharmaceutical companies (i.e., Pfizer, Axsome Therapeutics, Harmony Biosciences, Myovant, and Novo Nordisk) for work on scientific advisory committees for pregnancy registries. JCM has received research funding from Pfizer, FDA, and CDC. AGW has received research funding from Merck, Sharpe and Dohme, NIH, AHRQ, PCORI, FDA, the Bill and Melinda Gates Foundation and the state of Florida and received consulting fees from Arbor Pharmaceuticals, Bayer, Ipsen, Novo Nordisk, Lykos, Syneos and Genentech Inc, none of which is related to this work.
Reference
- 1.Adam MP, Polifka JE, Friedman JM. Evolving knowledge of the teratogenicity of medications in human pregnancy. Am J Med Genet C Semin Med Genet. 2011;157C(3):175–182. doi: 10.1002/ajmg.c.30313 [DOI] [PubMed] [Google Scholar]
- 2.Blehar MC, Spong C, Grady C, Goldkind SF, Sahin L, Clayton JA. Enrolling pregnant women: issues in clinical research. Womens Health Issues Off Publ Jacobs Inst Womens Health. 2013;23(1):e39–45. doi: 10.1016/j.whi.2012.10.003 [DOI] [Google Scholar]
- 3.Huybrechts KF, Bateman BT, Hernández-Díaz S. Use of real-world evidence from healthcare utilization data to evaluate drug safety during pregnancy. Pharmacoepidemiol Drug Saf. 2019;28(7):906–922. doi: 10.1002/pds.4789 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Rasmussen SA, Olney RS, Holmes LB, et al. Guidelines for case classification for the National Birth Defects Prevention Study. Birt Defects Res A Clin Mol Teratol. 2003;67(3):193–201. doi: 10.1002/bdra.10012 [DOI] [Google Scholar]
- 5.Lupo PJ, Isenburg JL, Salemi JL, et al. Population-based birth defects data in the United States, 2010-2014: A focus on gastrointestinal defects. Birth Defects Res. 2017;109(18):1504–1514. doi: 10.1002/bdr2.1145 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Stallings EB, Isenburg JL, Rutkowski RE, et al. National population-based estimates for major birth defects, 2016-2020. Birth Defects Res. 2024;116(1):e2301. doi: 10.1002/bdr2.2301 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Centers for Disease Control and Prevention (CDC). Update on overall prevalence of major birth defects--Atlanta, Georgia, 1978-2005. MMWR Morb Mortal Wkly Rep. 2008;57(1):1–5. [PubMed] [Google Scholar]
- 8.Hernandez-Diaz S, Huybrechts KF, Desai RJ, et al. Topiramate use early in pregnancy and the risk of oral clefts. Neurology. 2018;90(4):e342–e351. doi: 10.1212/WNL.0000000000004857 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Straub L, Bateman BT, Hernández-Díaz S, et al. Comparative Safety of In Utero Exposure to Buprenorphine Combined With Naloxone vs Buprenorphine Alone. JAMA. 2024;332(10):805–816. doi: 10.1001/jama.2024.11501 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Kulldorff M, Dashevsky I, Avery TR, et al. Drug safety data mining with a tree-based scan statistic. Pharmacoepidemiol Drug Saf. 2013;22(5):517–523. doi: 10.1002/pds.3423 [DOI] [PubMed] [Google Scholar]
- 11.Kulldorff M. TreeScan Sofware for the Tree-Based Scan Statistic. https://www.treescan.org/ [Google Scholar]
- 12.Yih WK, Maro JC, Nguyen M, et al. Assessment of Quadrivalent Human Papillomavirus Vaccine Safety Using the Self-Controlled Tree-Temporal Scan Statistic Signal-Detection Method in the Sentinel System. Am J Epidemiol. 2018;187(6):1269–1276. doi: 10.1093/aje/kwy023 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Yih WK, Daley MF, Duffy J, et al. A broad assessment of covid-19 vaccine safety using tree-based data-mining in the vaccine safety datalink. Vaccine. 2023;41(3):826–835. doi: 10.1016/j.vaccine.2022.12.026 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Yih WK, Kulldorff M, Dashevsky I, Maro JC. Using the Self-Controlled Tree-Temporal Scan Statistic to Assess the Safety of Live Attenuated Herpes Zoster Vaccine. Am J Epidemiol. 2019;188(7):1383–1388. doi: 10.1093/aje/kwz104 [DOI] [PubMed] [Google Scholar]
- 15.Yih WK, Duffy J, Su JR, et al. Tinnitus after COVID-19 vaccination: Findings from the vaccine adverse event reporting system and the vaccine safety datalink. Am J Otolaryngol. 2024;45(6):104448. doi: 10.1016/j.amjoto.2024.104448 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Suarez EA, Nguyen M, Zhang D, et al. Novel methods for pregnancy drug safety surveillance in the FDA Sentinel System. Pharmacoepidemiol Drug Saf. 2023;32(2):126–136. doi: 10.1002/pds.5512 [DOI] [PubMed] [Google Scholar]
- 17.Sentinel. Tremfya (Guselkumab) & Signal Identification. Published online June 17, 2025. https://www.sentinelinitiative.org/studies/drugs/tremfya-guselkumab-0
- 18.Sentinel. Dupixent (Dupilumab) & Signal Identification. Published online January 13, 2025. https://www.sentinelinitiative.org/studies/drugs/dupixent-dupilumab
- 19.Agency for Healthcare Research and Quality. Clinical Classifications Software (CCS) for ICD-9-CM. Published online March 6, 2017. Accessed September 20, 2024. https://hcup-us.ahrq.gov/toolssoftware/ccs/ccs.jsp
- 20.Maro JC, Nguyen MD, Dashevsky I, Baker MA, Kulldorff M. Statistical Power for Postlicensure Medical Product Safety Data Mining. EGEMS Wash DC. 2017;5(1):6. doi: 10.5334/egems.225 [DOI] [Google Scholar]
- 21.Wang SV, Maro JC, Gagne JJ, et al. A General Propensity Score for Signal Identification Using Tree-Based Scan Statistics. Am J Epidemiol. 2021;190(7):1424–1433. doi: 10.1093/aje/kwab034 [DOI] [PubMed] [Google Scholar]
- 22.Agency for Healthcare Research and Quality. Tools Archive for Clinical Classifications Software Refined. Published online November 13, 2024. https://hcup-us.ahrq.gov/toolssoftware/ccsr/ccsr_archive.jsp#ccsr
- 23.Centers for Medicare & Medicaid Services. ICD-10 Files & News Archive. Published online September 24, 2024. https://www.cms.gov/medicare/coding-billing/icd-10-codes/icd-10-cm-icd-10-pcs-gem-archive
- 24.Major Birth Defects Data from Population-based Birth Defects Surveillance Programs in the United States, 2016-2020. https://nbdpn.org/wp-content/uploads/2024/07/Birth_Defects_Data_and_Directory_Jan2024.pdf
- 25.Research Data Assistance Center. CMS Cell Size Suppression Policy. Published online January 26, 2024. https://resdac.org/articles/cms-cell-size-suppression-policy
- 26.Maro JC. Chapter 4: Data Quality Metrics in US Medicaid Data: Results from Sentinel’s Medicaid Data Mart. https://www.youtube.com/watch?v=OWSr9JQ9l3w [Google Scholar]
- 27.Kharbanda EO, Vazquez-Benitez G, DeSilva MB, et al. Developing algorithms for identifying major structural birth defects using automated electronic health data. Pharmacoepidemiol Drug Saf. 2021;30(2):266–274. doi: 10.1002/pds.5177 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.Honein M, Rasmussen SA. Chapter 24 - Epidemiological Studies of Congenital Heart Defects: Congenital Heart Defects: Challenges and Opportunities. In: Congenital Heart Defect From Origin to Treatment. Oxford University Press; 2010. [Google Scholar]
- 29.Mitchell AA, Gilboa SM, Werler MM, Kelley KE, Louik C, Hernández-Díaz S. Medication Use During Pregnancy, With Particular Focus On Prescription Drugs: 1976-2008. Am J Obstet Gynecol. 2011;205(1):51.e1–51.e8. doi: 10.1016/j.ajog.2011.02.029 [DOI] [Google Scholar]
- 30.Sentinel. Utilization of Products with Labeling Changes Related to Pregnancy Among Mothers with Live-Birth Deliveries: A Descriptive Analysis. Published online October 2, 2024. https://www.sentinelinitiative.org/studies/drugs/individual-drug-analyses/utilization-products-labeling-changes-related-pregnancy
- 31.Nordklev CB, Gjesdal O, Gunnes N, et al. Down syndrome and associated atrioventricular septal defects in a nationwide Norwegian cohort: Prevalence, time trends, and outcomes. Acta Obstet Gynecol Scand. 2024;103(10):2024–2030. doi: 10.1111/aogs.14932 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32.Li Y, Zhu Y, Chen C, et al. Internal validation of Medicaid Analytic eXtract (MAX) data capture for comprehensive managed care plan enrollees from 2007 to 2010. Pharmacoepidemiol Drug Saf. 2018;27(10):1067–1076. doi: 10.1002/pds.4365 [DOI] [PubMed] [Google Scholar]
- 33.Samples H, Lloyd K, Ryali R, et al. Completeness and quality of comprehensive managed care data compared with fee-for-service data in national Medicaid claims from 2001 to 2019. Health Serv Res. 2025;60(3):e14429. doi: 10.1111/1475-6773.14429 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34.Lloyd K, Rege S, Crystal S, Olfson M, Horton DB, Samples H. Completeness and Quality of Data for Children in Medicaid Comprehensive Managed Care Compared to Fee-for-Service, 2001-2019. Health Serv Res. Published online June 4, 2025:e14651. doi: 10.1111/1475-6773.14651 [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
