Skip to main content
BMC Pediatrics logoLink to BMC Pediatrics
. 2017 Jul 11;17:163. doi: 10.1186/s12887-017-0910-0

Early characteristics of infants with pulmonary hypertension in a referral neonatal intensive care unit

Shilpa Vyas-Read 1,5,, Usama Kanaan 1,2, Prabhu Shankar 1, Jane Stremming 3, Curtis Travers 4, David P Carlton 1, Anne Fitzpatrick 1
PMCID: PMC5506674  PMID: 28697724

Abstract

Background

Approximately 8–23% of premature infants develop pulmonary hypertension (PH), and this diagnosis confers a higher possibility of mortality. As a result, professional societies recommend PH screening in premature infants. However, the risk factors for and the outcomes of PH may differ depending on the timing of its diagnosis, and little evidence is available to determine at-risk infants in the referral neonatal population. The objective of this study was to define clinical and echocardiographic characteristics of infants with pulmonary hypertension during the neonatal hospital course and at or near-term.

Methods

Infants who had the following billing codes: < 32 weeks, birth weight < 1500 g, neonatal unit, and echocardiograph had records abstracted from a data warehouse at Children’s Healthcare of Atlanta. The outcome was defined as late PH on the final echocardiogram for all patients, and, separately, for patients with multiple studies. Descriptive statistics, univariable, and multivariable models were evaluated, and odds ratios and 95% confidence intervals are expressed below as (OR, CI).

Results

556 infants were included in the overall study, 59 had PH on their final echocardiogram (11%). In multivariable analyses, atrial septal defect (2.9, 1.4–6.1), and intrauterine growth restriction (2.7, 1.2–6.3) increased the odds of late PH, whereas caffeine therapy decreased PH (0.4, 0.2–0.8). When the analyses were restricted to 32 infants who had multiple echocardiograms during their hospitalization, the association between atrial septal defect (5.9, 2.0–16.5) and growth restriction (3.7, 1.3–10.7) and late PH was strengthened, but the effect of caffeine therapy was no longer significant. In this smaller subgroup, infants with late PH had their final echocardiogram at a median of 116 days of life, and 42–74% of them had right ventricular pathology.

Conclusions

Early clinical variables are associated with PH persistence in a referral neonatal population. Identification of early clinical factors may help guide the ascertainment of infant risk for late PH, and may aid in targeting sub-groups that are most likely to benefit from PH screening.

Keywords: Very low birth weight, Growth restriction, Caffeine, Pulmonary hypertension, Atrial septal defect

Background

For infants who are born early in the third trimester of pregnancy or before, fetal factors coupled with prematurity and postnatal injury may combine to result in pulmonary vascular disease, a process which manifests clinically as pulmonary hypertension (PH) [14]. The incidence of PH in very low birth weight infants is estimated to range between 16 and 43% [58], and infants with bronchopulmonary dysplasia and PH have been suggested to have up to a 4.6-fold higher odds of mortality than those infants with bronchopulmonary dysplasia without PH [57, 9]. Further, infants who were born prematurely continue to have an increased risk for PH that persists into childhood and adolescence [10].

Given the potential for neonatal and post-neonatal mortality, professional societies’ such as the American Heart Association and the American Thoracic Society recommend screening premature infants for the development of PH [11]. Unfortunately, few predictors for the development of PH are known. The most widely studied predictor for PH is bronchopulmonary dysplasia (BPD). Among infants with the most severe form of BPD, 29 to 53% also had a diagnosis of PH, and infants with severe BPD have over a 6-fold increased odds of PH when compared to infants with less severe lung disease [1, 1215]. Intrauterine growth restriction has also been associated with PH, suggesting that fetal vascular programming may play a role in the development of hypertension [5, 1618]. Few other potential predictors have been identified other than these, postnatal infection, and possibly illicit drugs [14, 19, 20].

In this study, we utilized observational data from very low birth weight, premature infants within our referral population to determine if early clinical factors are associated with pulmonary hypertension. To our knowledge, this cohort is the largest sample of neonates who received echocardiograms to be studied for PH. Because factors that contribute to the development of PH, such as infant growth and mortality, may differ in Identification of early clinical factors that are associated with neonatal PH may aid in identifying an “at risk” population that may require more echocardiographic surveillance during the hospital stay or more formal follow-up after hospital discharge.

Methods

Study design

This study was approved by the Institutional Review Board at Emory University and at Children’s Healthcare of Atlanta. The study population was a retrospective, observational cohort of patients at two hospitals in Atlanta (Children’s Healthcare of Atlanta, Egleston or Scottish Rite campus) from January 2010 to September 2014. Infants who were less than 32 weeks gestational age at birth, had a birth weight of less than 1500 g, were in the neonatal intensive care unit, and had an echocardiogram were identified using ICD-9 codes and were included. Patients were excluded if medical records were missing or if they had multiple anomalies/aneuploidy, congenital heart disease (other than atrial septal defect, ventricular septal defect, or patent ductus arteriosus), or congenital lung disease.

Definitions of exposures and outcomes

Outcomes

The primary outcome was late pulmonary hypertension (late PH) on the final echocardiograph prior to death or discharge from the neonatal intensive care unit. Pulmonary hypertension (PH) was defined as an echocardiogram that showed: 1) a moderate-to-large patent ductus arteriosus (PDA) with bidirectional or right-to-left shunting; 2) a tricuspid regurgitation jet gradient of ≥32 mmHg with septal flattening, right ventricular hypertrophy, or right ventricular dilation; or 3) a tricuspid regurgitation jet velocity of ≥45 mmHg [16, 19, 21]. Echocardiographs were ordered at the discretion of the attending neonatologist and interpreted by pediatric cardiologists.

Clinical variables

The following variables were abstracted from the infant medical record: 1) maternal drug use, the use of tobacco and/or alcohol; 2) illicit drug use, including the use of illegal drugs such as cannabis, amphetamines, or other substances; 3) infant race and gender; and 4) prenatal and intrapartum complications. The following discrete variables were abstracted from the clinical data warehouse using ICD-9 codes: 1) intraventricular hemorrhage; 2) necrotizing enterocolitis; 3) retinopathy of prematurity; 4) medication use; 5) respiratory support; and 6) positive blood culture. Death was defined as mortality from any cause during the hospital course.

Echocardiographic variables

The echocardiographic characteristics of infants with late PH were determined by the final echocardiogram of the hospital stay. For infants with only one study, the final echocardiogram was the infant’s first study in our neonatal hospital system. For infants with more than one study, the final echocardiogram was the infant’s last study in our neonatal hospital system. Directionality of the shunt through an ASD, ventricular septal defect, or patent ductus arteriosus (PDA) was determined by the pediatric cardiologist at the time of the echocardiogram as 1) left-to-right or none 2) bidirectional or 3) right-to-left. The tricuspid regurgitation jet velocity (TRJV) was graded as 1) normal, < 32 mmHg 2) mild, 32–44 mmHg 3) moderate 45–60 mmHg and 4) severe ≥60 mmHg at that time. Septal flattening was defined subjectively as none, any, or severe by the pediatric cardiologist performing the echocardiogram. Right ventricular dilatation, hypertrophy, and dysfunction were defined as either present or absent. Atrial septal defects were categorized as 1) none or patent foramen ovale (PFO), 2) patent foramen ovale versus atrial septal defect (PFO vs. ASD), or 3) atrial septal defect (ASD). PDA was defined as 1) none or small or ligated versus 2) moderate-to-large on the first study echocardiogram. Ventricular septal defects were defined as 1) intact, tiny, and small or 2) moderate-to-large or multiple.

Descriptive statistics

Two-sample t-tests for normally distributed variables, and Wilcoxon rank sum tests for skewed distributions were utilized. For categorical variables, chi-square tests of proportion were used to compare outcome groups unless the cell frequency was ≤5, in which case the Fisher’s exact test was used.

Univariable and multivariable analyses

To determine the effect of echocardiographic and early hospital characteristics on the outcome of late PH, univariable logistic regression was used to arrive at odds ratios, and 95% confidence intervals.

A multivariable model was constructed by the manual addition of each significant variable to the intercept and gestational age variable. The -2Log likelihood values were determined, and the value of each additional variable was determined using a likelihood ratio test with p ≥ 0.05 as a stopping rule. A final model that included gestational age, atrial septal defect (ASD vs. None or PFO), intrauterine growth restriction (yes or no), caffeine (yes or no), and positive-pressure ventilation at 28 days (yes vs. no) was derived. Although gestational age and positive-pressure ventilation were not statistically significantly different between groups, they were forced into the model as important risk factors for the development of late PH. Additionally, the defined multivariable model was evaluated again in infants who had more than one echocardiogram performed, and who had evidence of late PH on this final study. Odds ratios and 95% confidence intervals were constructed. All statistical procedures were performed using SAS 9.4 statistical software and the level of significance for comparisons was a p-value <0.05.

Results

Patient selection

An initial search of the electronic health record (Clarity) database from January 2010 to January 2015 yielded 586 infants that met the inclusion criteria of having a gestational age of less than 32 weeks at birth, having a birthweight less than 1500 g at birth, being admitted to the neonatal intensive care unit, and having an echocardiographic procedure (Fig. 1). Of these, 25 infants were excluded from the study population due to multiple anomalies or aneuploidy (8 infants), congenital heart disease other than PDA, ASD or VSD (11 infants), congenital lung disease (2 infants), or missing medical information (4 infants). Five patients were excluded due to missing outcome data, and 556 infants were included in the study cohort. Ninety-two infants (16%) in the overall cohort had at least one echocardiogram that met criteria for pulmonary hypertension (PH) during the hospital course. Infants who had echocardiographic evidence of pulmonary hypertension on their last neonatal study were defined as having late pulmonary hypertension (late PH). If an infant had only one study, then the first study determined the infant’s classification into outcome groups. If an infant had more than one study, then the final echocardiogram result determined whether he/she was classified as having late PH. The majority of infants with and without late PH had an echocardiogram after 30 days of life, and 29–31% of infants had early echocardiograms before 30 days of life (Fig. 2). The median day of life for infants with over one study was 116 days for infants with late PH, and 101 for infants without late PH, indicating that PH on the final echocardiogram was detected beyond 3 months of life for this group (Fig. 2, panel B). All infants in both groups received at least one echocardiogram. Twenty-five percent of infants with late PH, and 27% of infants without late PH also had a second echocardiogram. A higher proportion of infants in the late PH group had over 2 echocardiograms when compared with infants without late PH (29% vs. 19%). Forty-six percent of infants in the late PH group had evidence of PH on their first and only echocardiogram, and 54% of infants had over one study and the final echocardiogram showed PH.

Fig. 1.

Fig. 1

Flowchart of study patient selection. An electronic health record database query was performed for <32 weeks gestation at birth, < 1500 g birthweight, neonatal intensive care unit, and echocardiographic procedure. 586 infants were identified, and 25 of these met exclusion criteria. 556 patients were included in the study, and 92 (16%) had PH on any one echocardiogram while in the neonatal intensive care unit. Of the 92 infants with PH, 59 (64%) also had PH on their final echocardiogram of the hospital stay. Of these 59 infants, 32 had more than one echocardiogram and the last study during the neonatal stay showed PH

Fig. 2.

Fig. 2

Description of the timing and number of echocardiograms in infants with and without late PH. Infants were categorized as having late pulmonary hypertension (late PH) if their final echocardiogram in the hospital showed PH. For infants with only one echocardiogram, the final study was their first echocardiogram. For infants with more than one study, the final echocardiogram of the neonatal course was captured. Echocardiograms were performed by clinical pediatric cardiologists and quantitative variables (tricuspid regurgitation jet velocity) and qualitative variables (shunt directions, septal flattening, degree of right ventricular dysfunction/dilation/hypertrophy) were measured. Panel a shows the distribution of the day of life for the first and final echocardiogram of the infants in the entire cohort. Panel b shows the day of life that the echocardiograms were obtained, the number of studies by group, and the day of life and sequence of the first and final echocardiogram. * missing day of life information in the late PH group (n = 8), and in the without late PH group (n = 53). #2 infants had missing study number information in both groups

Echocardiographic characteristics of infants with late PH

Of the 556 infants evaluated, 59 patients had late PH on their final echocardiogram (10.6% of the total cohort, 64% of the infants with an initial diagnosis of PH), and 497 infants did not (Table 1). The median timing of the echocardiogram was 77 days of life for infants in the late PH group, and 41 days of life for infants without late PH. Infants who had an atrial septal defect (ASD) had 4.6-fold higher odds of late PH, when compared with infants without an ASD. The association between patent ductus arteriosus size and late PH was not significant. Forty-three percent of infants with late PH had an ASD with bidirectional or right-to-left shunting, indicating that patients in our PH group had poor right ventricular compliance likely due to the effect of chronically elevated pulmonary pressure. Eighty-one percent of infants with late PH had tricuspid jet velocities of ≥32 mmHg, compared with 2% of patients without late PH. The 11 infants with “normal” tricuspid regurgitation in the late PH group also had a patent ductus arteriosus, making interpretation of the jet gradient difficult. The majority of infants with late PH had some evidence of either right ventricular dilation (55% vs. 8%) or right ventricular hypertrophy (56% vs. 10%), and one-third had right-ventricular dysfunction (33% vs 3%), respectively, when compared with those without late PH. Ventricular septal defects and left ventricular dysfunction did not differ between the late PH groups.

Table 1.

Echocardiographic characteristics of infants with late pulmonary hypertension

Echocardiographic parameters Infants with Late PH, n = 59 Infants without Late PH, n = 497 Odd ratio (95% CI) p - value
Timing of final echo
Median (IQR)
77 (13–136) 41 (21–105) 1.0 (1.0–1.0) 0.39
Atrial septal defects
 None/PFO 43, 73% 434, 87% ref
 PFO vs. ASD 4, 7% 24, 5% 1.7 (0.6–5.1) 0.68
 ASD 10, 17% 22, 4% 4.6 (2.0–10.3) <0.01*
Atrial shunt direction (n, %)
 None or left-to-right 29, 57% 312, 87% ref
 Bidirectional/Right-to-Left 22, 43% 47, 13% 5.0 (2.7–9.5) <0.01*
Patent Ductus Arteriosus
 None 16, 36% 217, 54% ref
 Small 11, 24% 69, 17% 2.2 (1.0–4.9) 0.28
 Moderate/Large 18, 40% 116, 29% 2.1 (1.0–4.3) 0.27
Patent ductus arteriosus shunt direction (n, %)
 None or left-to-right 12, 43% 177, 99% ref
 Bidirectional/Right-to-Left 16, 57% 1, < 1% 236.0 (29–1933) <0.01*
Tricuspid regurgitation jet velocity (n, %)
 Normal, < 32 mmHg 11, 19% 474, 98% ref
 Mild, 32–44 mmHg 23, 39% 12, 2% 83.0 (33–207) < 0.01*
 Mod, 45–60 mmHg 15, 25% 0, 0% ________ ____
 Severe, > 60 mmHg 10, 17% 0, 0% ________ ____
Septal flattening (n, %)
 None 1, 2% 96, 43% ref
 Any 48, 98% 126, 57% 36.6 (5.0–269.7) < 0.01*
Right ventricular dilation (n, %)
 None 25, 45% 436, 92% ref
 Any 31, 55% 36, 8% 15.0 (8.0–28.1) < 0.01*
Right ventricular hypertrophy (n, %)
 None 22, 44% 427, 90% ref
 Any 28, 56% 50, 10% 10.9 (5.8–20.4) < 0.01*
Right ventricular dysfunction (n, %)
 None 38, 67% 472, 97% ref
 Any 19, 33% 14, 3% 16.9 (7.8–36.2) < 0.01*
Ventricular Septal Defect
 None/Small 51, 96% 421, 97% ref
 Mod/Large 2, 4% 11, 3% 1.5 (0.3–6.9) 0.60
Left ventricular dysfunction (n, %) 7, 12% 31, 6% 2 (0.8–4.8) 0.11

Infants were categorized as having late pulmonary hypertension (late PH) if their final echocardiogram in the hospital showed PH. Echocardiograms were performed by clinical pediatric cardiologists and quantitative variables (tricuspid regurgitation jet velocity) and qualitative variables (shunt directions, septal flattening, degree of right ventricular dysfunction/dilation/hypertrophy) were measured. Odds ratios were defined using univariable logistic regression, *p < 0.05 is significant

Associations between neonatal characteristics and late PH

In univariable analysis, infants with late PH overall had lower birthweight than infants who did not have PH persistence (0.75 ± 0.24 kg vs. 0.83 ± 0.25 kg, p = 0.02) (Table 2). For each kilogram increase in an infant’s birthweight, the odds of PH dropped significantly (OR 0.2, 95% CI 0.1–0.7), and infants with intrauterine growth restriction had higher odds of developing late PH than normally grown infants (OR 2.9; 95% CI 1.3–6.2). Interestingly, an association between caffeine and late PH was also seen. Fifty-one percent of infants with late PH received caffeine, compared with 69% of infants without late PH (OR 0.5; 95% CI 0.3–0.8). Despite this discrepancy in caffeine use, we did not detect a difference in the level of respiratory support at 28 days of life or at 36 weeks corrected gestational age between groups. Nineteen percent of infants with late PH were treated with sildenafil, and 3% also were treated with bosentan. Other birth variables and early hospital characteristics did not differ between the comparison groups.

Table 2.

Evaluation of birth and early hospital characteristics of infants with late PH

Birth/early hospital characteristics Infants with Late PH, n = 59 Infants without Late PH, n = 497 Odds ratio (95% CI) p - value
Apgar 1 min.
Mean ± SD
3.5 ± 2.8 4.1 ± 2.6 0.9 (0.8–1.0) 0.10
Apgar 5 min.
Mean ± SD
6.3 ± 2.4 6.5 ± 2.2 1.0 (0.8–1.1) 0.44
Birthweight (kg)
Mean ± SD
0.75 ± 0.24 0.83 ± 0.25 0.2 (0.1–0.7) 0.02*
Gestational age (wks)
Mean ± SD
26.1 ± 2.4 26.1 ± 2.2 1.0 (0.9–1.1) 0.99
Mode of Delivery (n, %)
 C/S 44, 77% 327, 66% 1.7 (0.9–3.3) 0.10
 Vaginal 13, 23% 166, 34% ref
Gender (n, %)
 Male 33, 56% 289, 42% 0.9 (0.5–1.6) 0.71
 Female 26, 44% 205, 42% ref
Intrauterine growth restriction (n, %) 10, 18% 35, 7% 2.9 (1.3–6.2) < 0.01*
Placental abruption (n, %) 9, 16% 49, 10% 1.7 (0.8–3.7) 0.17
Chorioamnionitis (n, %) 3, 5% 50, 10% 0.5 (0.2–1.7) 0.27
Maternal betamethasone (n, %)
 2 or more doses 27, 57% 267, 62% 0.8 (0.4–1.5) 0.52
 0–1 doses 20, 43% 162, 38% ref
Race (n, %)
 Black 36, 61% 290, 60% 1.1 (0.6–1.8) 0.84
 White/Asian/Hispanic 23, 39% 196, 40% ref
Illicit drug use (n, %) 3, 6% 41, 9% 0.6 (0.2–2.2) 0.47
Multiples (n, %) 12, 21% 91, 18% 1.2 (0.6–2.3) 0.68
Maternal drug use 5, 10% 39, 9% 1.2 (0.4–3.1) 0.76
Caffeine (n, %) 29, 51% 341, 69% 0.5 (0.3–0.8) < 0.01*
Any respiratory support, 28 days (n, %) 26, 44% 212, 43% 1.0 (0.6–1.8) 0.87
Positive pressure ventilation, 28 days (n,%) 26, 44% 203, 41% 1.1 (0.7–2.0) 0.63
Any respiratory support, 36 weeks (n, %) 26, 44% 199, 40% 1.2 (0.7–2.2) 0.45
Sildenafil (n, %) 11, 19% 19, 4% 5.8 (2.6–12.8) < 0.01*
Bosentan 2, 3% 0, 0% __________ _____

The birth and early hospital characteristics of infants who had late PH were compared to those infants who did not have late PH using univariable logistic regression. Odds ratios were defined using univariable logistic regression, *p < 0.05 is significant

Because outcomes and predictors may differ based on the timing of PH diagnosis, we then evaluated early clinical and echocardiographic factors in infants who had multiple studies and had an echocardiogram showing PH on their final study [21]. This subgroup of 32 infants had their final echocardiogram between 101 days (infants without late PH) and 116 days (infants with late PH) (Table 3). The gestational age of infants with multiple studies ranged from 25.7 to 25.9 weeks in both groups, placing the final echocardiogram between 39 and 41 weeks corrected gestational age. Infants in this subgroup with late PH had an Apgar score that was significantly lower than their counterparts who did not have late PH (3.0 vs. 4.3, p = 0.01). More than double the infants with multiple studies and late PH had a history of intrauterine growth restriction, when compared with infants without late PH (23% vs. 9%, p = 0.03). In this subgroup that was evaluated later in the neonatal course, caffeine therapy was not associated with the outcome of late PH (63% vs. 68%, p = 0.55). Interestingly, the use of respiratory support at 28 days or 36 weeks again did not differ between groups. Four times the proportion of infants with multiple studies and late PH had atrial septal defects, when compared with those without late PH (28% vs. 7%, p < 0.001). Although death rates during the neonatal hospitalization were similar in late PH groups, the proportion of infants with bidirectional or right-to-left shunts through an ASD or PDA was much higher in infants who had late PH on their final echocardiogram (46% vs. 12% and 57% vs. 0%, respectively). Further, a large proportion of infants with multiple studies and late PH had some degree of septal flattening (97% vs. 53%, p < 0.001), right ventricular dilation (69% vs. 11%, p < 0.001), right ventricular hypertrophy (74% vs. 17%, p < 0.001), or right ventricular dysfunction (42% vs. 5%, p < 0.001) on their final echocardiogram, indicating this that this subgroup was a very high-risk and high-acuity group within a sick, referral neonatal population.

Table 3.

Comparison of characteristics between infants who had multiple studies by late PH status

Birth/early hospital characteristics Infants with multiple studies and late PH n = 32 Infants with multiple studies without late PH n = 224 p - value
Apgar 1 min.
Mean ± SD
3.0 ± 2.4 4.3 ± 2.5 0.01*
Apgar 5 min.
Mean ± SD
6.0 ± 2.3 6.5 ± 2.2 0.27
Birthweight (kg)
Mean ± SD
0.68 ± 0.19 0.80 ± 0.24 <0.01*
Gestational age (wks)
Mean ± SD
25.7 ± 2.3 25.9 ± 2.2 0.73
Mode of Delivery – C/S (n, %) 23, 72% 145, 65% 0.44
Gender -- Male (n, %) 16, 50% 129, 58% 0.42
Intrauterine growth restriction (n, %)# 7, 23% 20, 9% 0.03*
Placental abruption (n, %)# 4, 13% 24, 11% 0.76
Chorioamnionitis (n, %)# 2, 6% 22, 10% 0.75
Maternal betamethasone (n, %) 16, 59% 122, 63% 0.72
Multiples (n, %)# 3, 9% 46, 21% 0.16
Caffeine (n, %) 20, 63% 152, 68% 0.55
Any respiratory support, 28 days (n, %) 17, 53% 113, 51% 0.81
Any respiratory support, 36 weeks (n, %) 21, 66% 117, 52% 0.35
Death (n, %) 12, 20% 86, 17% 0.56
Day of life, death or discharge
Mean ± SD
113 ± 81 126 ± 74 0.61
Race (n, %) 0.52
 Black 21, 66% 132, 60%
 Other 11, 34% 89, 40%
Atrial septal defects (n, %) 9, 28% 16, 7% <0.001*
 Bidirectional/right-to-left atrial shunt (n, %) 12, 46% 18, 12% <0.001*
Patent Ductus Arteriosus (n, %)
 Moderate/Large# 4, 19% 22, 14% 0.51
 Bidirectional/R-to-L# 4, 57% 0, 0% < 0.001*
Septal flattening (n, %) 29, 97% 79, 53% <0.001*
Right ventricular dilation (n, %) 20, 69% 23, 11% <0.001*
Right ventricular hypertrophy (n, %) 20, 74% 36, 17% <0.001*
Right ventricular dysfunction (n, %) 13, 42% 11, 5% <0.001*
Ventricular Septal Defect – Mod/Lgt# (n, %) 1, 4% 2, 1% 0.35
Left ventricular dysfunction (n, %)# 3, 9% 16, 7% 0.67

For infants who had more than one study in the neonatal intensive care unit, clinical characteristics were compared between late PH groups. Two-sample t-tests or Wilcoxon rank sum test for continuous variables, or Chi-square/Fisher’s exact test for categorical variables were used. *p < 0.05 for comparison groups. #Fisher’s Exact Test used

Multivariable model for the outcome of late PH

To assess how each co-variate found to be significant in our univariable model affected the outcome of late PH when other early characteristics were adjusted for, we generated a multivariable model that evaluated gestational age, atrial septal defect, intrauterine growth restriction, caffeine therapy, and positive-pressure ventilation at 28 days on late PH (Table 4, A). Gestational age, instead of birth weight, was utilized as a co-variate because of potential collinearity between birth weight and intrauterine growth restriction. When other factors were controlled, infants with ASD had a 2.9-fold higher odds of late PH, compared to infants with no significant atrial shunts (95% CI 1.4–6.1). In this cohort, gestational age did not significantly increase the odds of late PH. However, infants with intrauterine growth restriction continued to have a 2.7-fold higher odds for late PH, even when other significant variables were controlled (95% CI 1.2–6.3). Infants receiving caffeine therapy had a lower probability of late PH than those who did not receive caffeine (OR 0.4; 95% CI 0.2–0.8). Positive-pressure ventilation was not significantly associated with late PH, when other factors were controlled (OR 1.5, 95% CI 0.8–2.9).

Table 4.

Multivariable model for the outcome of late PH in all infants and in infants with multiple studies

Variable Odds ratio 95% CI p-value
Overall multivariable model for the outcome of late PH
 Gestational age 0.9 0.8–1.1 0.22
 Atrial septal defect (ASD vs. None) 2.9 1.4–6.1 <0.01*
 Growth restriction 2.7 1.2–6.3 0.02*
 Caffeine 0.4 0.2–0.8 0.01*
 Positive-pressure ventilation 1.5 0.8–2.9 0.16
Multivariable model for the outcome of late PH, among infants with multiple studies
 Gestational age 0.9 0.7–1.1 0.18
 Atrial septal defect (ASD vs. None) 5.9 2.0–16.5 <0.001*
 Growth restriction 3.7 1.3–10.7 0.01*
 Caffeine 0.8 0.3–1.8 0.53
 Positive-pressure ventilation 1.4 0.6–3.3 0.38

A) The association between significant co-variates and the outcome of late pulmonary hypertension was evaluated. B) The association between significant co-variates and the outcome of late pulmonary hypertension in infants with multiple studies was evaluated. Gestational age and positive-pressure ventilation were forced into the model. Multivariable logistic regression was used to derive odds ratios and 95% confidence intervals. *p ≤ 0.05 was significant

When the model was evaluated in the sicker subgroup of infants who had multiple studies, infants with an ASD had even higher odds of late PH than those who did not have significant ASD, with other variables being held constant (OR 5.9, 95% CI 2.0–16.5). Similarly, infants with multiple studies who had growth restriction had a 3.7-fold increase in the odds of late PH, when compared with normally grown infants (95% CI 1.3–10.7). Interestingly, the effect of caffeine on late PH was no longer significant in this small subgroup of infants, when gestational age, ASD, growth restriction and positive-pressure ventilation were controlled (OR 0.8, 0.3–1.8).

Discussion

In this study, we identify important risk factors for PH in a referral neonatal population including birthweight, the presence of an atrial septal defect, intrauterine growth restriction, and caffeine therapy. Further, we have shown that atrial septal defect and intrauterine growth restriction are significantly associated with late PH in infants who are at or near-term gestation.

In our multivariable model, the presence of an atrial septal defect increased the odds of late PH significantly, even when gestational age, growth restriction, caffeine use, and positive-pressure ventilation were controlled. Further, this association was strengthened in a subgroup of infants who had their final echocardiogram showing PH at or near term. Supporting these findings, other investigators have also found an association between the presence of an ASD and the development of PH in infants with BPD, a diagnosis that conferred an increased risk of mortality [22, 23]. Animal models of chronic left-to-right shunting have increased pulmonary vascular resistance and arteriolar medial thickness, implying biologic plausibility to the association between ASD and PH [24, 25]. Epidemiologically, ASDs account for 8–10% of congenital heart defects, though the majority of these close spontaneously in the first year of life [26]. For those with persistent defects, small studies have suggested that infants with BPD may have improved respiratory outcome following transcatheter closure of left-to-right shunts at approximately 6 months of age [27, 28]. Unfortunately, our finding that ASDs were associated with PH development is difficult to interpret causally. ASDs may cause right heart enlargement and diastolic septal flattening due to volume load, which may be confused with systolic septal flattening due to PH. In a similar manner, the presence of a large PDA may complicate the diagnosis of PH by echocardiography by elevating the right ventricular pressure due to transmission of aortic pressure to the pulmonary artery in the absence of elevated pulmonary resistance. However, 43–57% of infants in our analyses had bidirectional or right-to-left shunts, offering some reassurance that our findings are the result of elevated pulmonary resistance and not echocardiographic detection bias due to left-to-right shunting. Further, over half of the infants with late PH also had either right ventricular dilation or hypertrophy, supporting our hypotheses that these infants suffered from chronically elevated pulmonary resistance.

Intrauterine growth restriction was associated with pulmonary hypertension in descriptive analyses in our investigation, and it continued to be associated with PH when other clinical factors were controlled. Infants who had intrauterine growth restriction had a 2.9-fold higher odds of late PH when compared to normally grown infants, and this association was enhanced in our subgroup of infants who had late PH near term (OR 5.9 for late PH). In a single center study by Check et al., infants with BPD, who had a birth weight for gestational-age ratio percentile of less than 25%, had a 3.9-fold increase in the odds of PH at 36 weeks’ gestation. When this model was further controlled for gestational age, multiple gestation, gender and race, the odds of PH for growth-restricted infants were increased to 5.9, similar to our findings [16]. Our population differed slightly from that in the prior study, in that we did not restrict our cohort only to infants with BPD, and the overall proportion of infants with intrauterine growth restriction was only 8% (compared with 30%). Because evidence suggests that fetal factors potentially influence the propensity for disease in childhood and adulthood, the association between intrauterine growth restriction and PH should likely be interrogated further [2931].

Interestingly, caffeine therapy strongly decreased the odds of late PH in our study overall. When gestational age, ASD status, growth restriction, and positive-pressure ventilation were controlled, the potentially protective effect of caffeine therapy on late PH was significant (OR 0.4, 95% CI 0.2–0.8). However, when the cohort was restricted to infants who had late PH later in life (the multiple studies group), the effect of caffeine on the outcome was no longer significant (OR 0.8, 95% CI 0.3–1.8). This differential effect in the association between caffeine therapy and the outcome of late PH may be secondary to the smaller numbers and potentially inadequate power in our subgroup analysis. Alternatively, it is possible that the effect of caffeine therapy on PH during the neonatal hospitalization is mediated through bronchopulmonary dysplasia. In support of this possibility, others have shown that caffeine therapy, particularly when initiated early in life, is associated with a reduction in bronchopulmonary dysplasia and ventilation time for premature neonates [3234]. Additionally, it is possible that infants who are corrected to near-term and continue to have late PH are a different population than their younger counterparts, and the neonatal predictors of pulmonary hypertension at differing points during the postnatal hospital stay should continue to be carefully characterized.

We acknowledge that pulmonary hypertension based on echocardiographic parameters is challenging to define due to difficulty in obtaining a measurable tricuspid regurgitation jet velocity, and poor sensitivity and specificity for the detection of PH [35]. However, echocardiography is widely used in neonatal intensive care units because safety considerations prohibit the use of cardiac catheterization as a screening tool and clinical decisions are often made based on echocardiographic findings [36]. Further, the definitions of PH applied in our study are comparable to those used in other investigations, and studies have shown strong agreement between clinical and research echocardiograms for the detection of PH [7, 8, 12, 37]. In our cohort, infants were defined as having PH if they had a bidirectional or right-to-left patent ductus arteriosus shunt (indicating systemic or supra-systemic pulmonary vascular resistance), or a mildly elevated tricuspid regurgitation jet velocity with septal flattening, right ventricular hypertrophy or dilation, or a tricuspid regurgitation jet velocity of over 45 mmHg. Although a discrete number for the tricuspid regurgitation jet velocity may be difficult to obtain, we were able to group infants into having a tricuspid regurgitation jet that was “normal” (< 32 mmHg) or “abnormal” (> 32 mmHg). In other investigations, a measurable tricuspid jet velocity in combination with septal flattening, right ventricular hypertrophy, or right ventricular dilation had a positive predictive value of 89–100% [35]. Given these values, our patients who were classified as having PH echocardiographically would also be likely to have PH if they underwent catheterization. Longer-term follow-up and serial echocardiography may be useful to increase the positive prediction of echocardiogram for the development of PH. Additionally, although the optimal echocardiographic parameters for infants at risk of PH is not known, algorithms to detect the disease in a systematic manner are now being developed based on available literature [36].

The strengths of our study include its evaluation of a referral population of high-acuity neonates at particular risk for PH. To our knowledge, this is the largest sample of premature neonates who have received echocardiograms to be studied for pulmonary hypertension. Additionally, we included objective clinical variables in our models that would be readily available early in the neonatal hospital course, and steered away from variables that have traditionally been associated with PH but are present later in the neonatal course. We focused on utilizing these variables to begin to assess if early clinical factors can be utilized to determine infant risk for PH. Further, we have found strong associations between ASD and late PH and growth restriction and late PH, raising the question of whether premature infants with these particular risk factors should be evaluated earlier or more frequently for pulmonary hypertension, than those without these risks.

In summary, in this study, we have confirmed clinical variables that were known to be associated with the development of PH in premature infants, such as intrauterine growth restriction, and we have identified new factors that are associated with PH persistence, such as caffeine use and atrial septal defect. Our multivariable model for persistence of PH utilizes only readily available clinical variables, rather than solely relying on echocardiographic or respiratory characteristics, to establish risk for PH. Echocardiographic and respiratory variables may vary by clinician judgement, and utilizing these variables for prediction of PH may prove to be challenging and difficult to generalize. Our study utilized only fixed and demographic variables that can be validated in larger, prospective studies to define infant risk for PH during the neonatal course. In this way, clinicians could target serial echocardiography to higher-risk infants, and potentially impact postnatal PH surveillance and management in a timely manner.

Conclusions

The presence of an atrial septal defect and intrauterine growth restriction strongly increased the odds of pulmonary hypertension that persists at or near-term in very low birthweight premature infants. Premature infants in referral neonatal intensive care units with these risk factors should potentially have PH evaluations performed earlier or more frequently in their hospital course.

Acknowledgments

The authors would like to acknowledge Karen Parker for her aid in the submission of this manuscript.

Funding

Supported by the National Center for Advancing Translational Sciences of the National Institutes of Health under Award Number UL1 TROOO454. The content is solely the responsibility of the authors and does not necessarily represent the official views o/the National Institutes of Health.

Availability of data and materials

The datasets used and/or analyzed during the current study available from the corresponding author on reasonable request. Public sharing of patient data in this study has not been approved by the Institutional Review Board, and a review of that request may need to occur prior to data sharing.

Abbreviations

BPD

Bronchopulmonary dysplasia

late PH

Late pulmonary hypertension

Authors’ contributions

SVR: conception and design, acquisition of data, interpretation of data, drafting of the manuscript, final approval of the manuscript, and accountability ensuring accuracy and integrity of the work; UK: echocardiographic parameter selection and interpretation, critical revision of the manuscript, final approval of the manuscript, and accountability ensuring accuracy and integrity of the work; PS: abstraction of data from clinical data warehouse, final approval of the manuscript, and accountability ensuring accuracy and integrity of the work; JS: acquisition of data, final approval of the manuscript, and accountability ensuring accuracy and integrity of the work; CT: database creation, interpretation of the data, final approval of the manuscript, and accountability ensuring accuracy and integrity of the work; DPC: interpretation of data, critical revision of the manuscript, final approval of the manuscript, and accountability ensuring accuracy and integrity of the work; AF: conception and design, interpretation of data, critical revision of the manuscript, final approval of the manuscript, and accountability ensuring accuracy and integrity of the work.

Ethics approval and consent to participate

This study was approved by the Institutional Review Boards at Emory University (IRB00074604) and at Children’s Healthcare of Atlanta. The need for informed consent was waived by the Institutional Review Board due to a determination of no more than minimal risk to the subjects secondary to secure storage and de-identification of patient information, and no contact between the investigators in this study and patient families.

Consent for publication

Not applicable.

Competing interests

The authors have no competing interests in the design, implementation, analysis or preparation of this manuscript. The NIH was not involved in the 1) study design; 2) the collection, analysis, and interpretation of data; 3) the writing of the report; and 4) the decision to submit the manuscript for publication. Shilpa Vyas-Read wrote the first draft of the manuscript and no form of payment was given to anyone to produce the manuscript.

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

References

  • 1.Mourani PM, Abman SH. Pulmonary hypertension and vascular abnormalities in bronchopulmonary dysplasia. Clin Perinatol. 2015;42:839–855. doi: 10.1016/j.clp.2015.08.010. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 2.Berkelhamer SK, Mestan KK, Steinhorn RH. Pulmonary hypertension in bronchopulmonary dysplasia. Semin Perinatol. 2013;37:124–131. doi: 10.1053/j.semperi.2013.01.009. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3.Baker CD, Abman SH. Impaired pulmonary vascular development in bronchopulmonary dysplasia. Neonatology. 2015;107:344–351. doi: 10.1159/000381129. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4.Abman SH. Bronchopulmonary dysplasia: "a vascular hypothesis". Am J Respir Crit Care Med. 2001;164:1755–1756. doi: 10.1164/ajrccm.164.10.2109111c. [DOI] [PubMed] [Google Scholar]
  • 5.An HS, Bae EJ, Kim GB, Kwon BS, Beak JS, Kim EK, et al. Pulmonary hypertension in preterm infants with bronchopulmonary dysplasia. Korean Circ J. 2010;40:131–136. doi: 10.4070/kcj.2010.40.3.131. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6.Khemani E, McElhinney DB, Rhein L, Andrade O, Lacro RV, Thomas KC, et al. Pulmonary artery hypertension in formerly premature infants with bronchopulmonary dysplasia: clinical features and outcomes in the surfactant era. Pediatrics American Academy of Pediatrics. 2007;120:1260–1269. doi: 10.1542/peds.2007-0971. [DOI] [PubMed] [Google Scholar]
  • 7.Slaughter JL, Pakrashi T, Jones DE, South AP, Shah TA. Echocardiographic detection of pulmonary hypertension in extremely low birth weight infants with bronchopulmonary dysplasia requiring prolonged positive pressure ventilation. J Perinatol. 2011;31:635–640. doi: 10.1038/jp.2010.213. [DOI] [PubMed] [Google Scholar]
  • 8.Bhat R, Salas AA, Foster C, Carlo WA, Ambalavanan N. Prospective analysis of pulmonary hypertension in extremely low birth weight infants. Pediatrics. 2012;129:e682–e689. doi: 10.1542/peds.2011-1827. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9.Murthy K, Savani RC, Lagatta JM, Zaniletti I, Wadhawan R, Truog W, et al. Predicting death or tracheostomy placement in infants with severe bronchopulmonary dysplasia. J Perinatol. 2014;34:543–548. doi: 10.1038/jp.2014.35. [DOI] [PubMed] [Google Scholar]
  • 10.Naumburg E, Soderstrom L, Huber D, Axelsson I. Risk factors for pulmonary arterial hypertension in children and young adults. Pediatr Pulmonol. 2017;52:636–641. doi: 10.1002/ppul.23633. [DOI] [PubMed] [Google Scholar]
  • 11.Abman SH, Hansmann G, Archer SL, Ivy DD, Adatia I, Chung WK, et al. Pediatric pulmonary hypertension: guidelines from the American Heart Association and American Thoracic Society. Circulation. 2015;132:2037–2099. doi: 10.1161/CIR.0000000000000329. [DOI] [PubMed] [Google Scholar]
  • 12.Kim D-H, Kim HS, Choi CW, Kim EK, Kim BI, Choi J-H. Risk factors for pulmonary artery hypertension in preterm infants with moderate or severe bronchopulmonary dysplasia. Neonatology. 2012;101:40–46. doi: 10.1159/000327891. [DOI] [PubMed] [Google Scholar]
  • 13.Mirza H, Ziegler J, Ford S, Padbury J, Tucker R, Laptook A. Pulmonary hypertension in preterm infants: prevalence and association with bronchopulmonary dysplasia. J Pediatr. 2014;165:909–14.e1. [DOI] [PubMed]
  • 14.Ali Z, Schmidt P, Dodd J, Jeppesen DL. Predictors of bronchopulmonary dysplasia and pulmonary hypertension in newborn children. Dan Med J. 2013;60:A4688. [PubMed] [Google Scholar]
  • 15.Al-Ghanem G, Shah P, Thomas S, Banfield L, Helou El S, Fusch C, et al. Bronchopulmonary dysplasia and pulmonary hypertension: a meta-analysis. J Perinatol. 2017;37:414–419. doi: 10.1038/jp.2016.250. [DOI] [PubMed] [Google Scholar]
  • 16.Check J, Gotteiner N, Liu X, Su E, Porta N, Steinhorn R, et al. Fetal growth restriction and pulmonary hypertension in premature infants with bronchopulmonary dysplasia. J Perinatol. 2013;33:553–557. doi: 10.1038/jp.2012.164. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.Mestan KK, Check J, Minturn L, Yallapragada S, Farrow KN, Liu X, et al. Placental pathologic changes of maternal vascular underperfusion in bronchopulmonary dysplasia and pulmonary hypertension. Placenta. 2014;35:570–574. doi: 10.1016/j.placenta.2014.05.003. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18.Farrow KN, Steinhorn RH. Pulmonary hypertension in premature infants. Sharpening the tools of detection. Am J Respir Crit Care Med. 2015;191:12–14. doi: 10.1164/rccm.201411-2112ED. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19.Waruingi W, Mhanna MJ. Pulmonary hypertension in extremely low birth weight infants: characteristics and outcomes. World J Pediatr. 2014;10:46–52. doi: 10.1007/s12519-014-0464-2. [DOI] [PubMed] [Google Scholar]
  • 20.Nagiub M, Kanaan U, Simon D, Guglani L. Risk factors for development of pulmonary hypertension in infants with bronchopulmonary dysplasia: systematic review and meta-analysis. Paediatr Respir Rev. 2017;23:27–32. [DOI] [PubMed]
  • 21.Mourani PM, Sontag MK, Younoszai A, Miller JI, Kinsella JP, Baker CD, et al. Early pulmonary vascular disease in preterm infants at risk for bronchopulmonary dysplasia. Am J Respir Crit Care Med. 2015;191:87–95. doi: 10.1164/rccm.201409-1594OC. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22.Choi EK, Jung YH, Kim HS, Shin SH, Choi CW, Kim EK, et al. The impact of atrial left-to-right shunt on pulmonary hypertension in preterm infants with moderate or severe bronchopulmonary dysplasia. Pediatr Neonatol. 2015;56:317–323. doi: 10.1016/j.pedneo.2014.12.006. [DOI] [PubMed] [Google Scholar]
  • 23.Weismann CG, Asnes JD, Bazzy-Asaad A, Tolomeo C, Ehrenkranz RA, Bizzarro MJ. Pulmonary hypertension in preterm infants: results of a prospective screening program. J Perinatol. 2017;37:572–577. doi: 10.1038/jp.2016.255. [DOI] [PubMed] [Google Scholar]
  • 24.Rondelet B, Kerbaul F, Van Beneden R, Hubloue I, Huez S, Fesler P, et al. Prevention of pulmonary vascular remodeling and of decreased BMPR-2 expression by losartan therapy in shunt-induced pulmonary hypertension. Am J Physiol Heart Circ Physiol. 2005;289:H2319–H2324. doi: 10.1152/ajpheart.00518.2005. [DOI] [PubMed] [Google Scholar]
  • 25.Lam C-F, Peterson TE, Croatt AJ, Nath KA, Katusic ZS. Functional adaptation and remodeling of pulmonary artery in flow-induced pulmonary hypertension. Am J Physiol Heart Circ Physiol. 2005;289:H2334–H2341. doi: 10.1152/ajpheart.00375.2005. [DOI] [PubMed] [Google Scholar]
  • 26.Schwerzmann M, Pfammatter J-P. Approaching atrial septal defects in pulmonary hypertension. Expert Rev Cardiovasc Ther. 2015;13:693–701. doi: 10.1586/14779072.2015.1047763. [DOI] [PubMed] [Google Scholar]
  • 27.Wood AM, Holzer RJ, Texter KM, Hill SL, Gest AL, Welty SE, et al. Transcatheter elimination of left-to-right shunts in infants with bronchopulmonary dysplasia is feasible and safe. Congenit Heart Dis. 2011;6:330–337. doi: 10.1111/j.1747-0803.2011.00540.x. [DOI] [PubMed] [Google Scholar]
  • 28.Thomas VC, Vincent R, Raviele A, Diehl H, Qian H, Kim D. Transcatheter closure of secundum atrial septal defect in infants less than 12 months of age improves symptoms of chronic lung disease. Congenit Heart Dis. 2012;7:204–211. doi: 10.1111/j.1747-0803.2010.00442.x. [DOI] [PubMed] [Google Scholar]
  • 29.Bassareo PP, Marras AR, Cugusi L, Zedda AM, Mercuro G. The reasons why cardiologists should consider prematurity at birth and intrauterine growth retardation among risk factors. J Cardiovasc Med (Hagerstown). 2016;17(5):323–9. [DOI] [PubMed]
  • 30.Cruz-Lemini M, Crispi F, Valenzuela-Alcaraz B, Figueras F, Sitges M, Bijnens B, et al. Fetal cardiovascular remodelling persists at 6 months of life in infants with intrauterine growth restriction. Ultrasound Obstet Gynecol. 2016;48(3):349–56. [DOI] [PubMed]
  • 31.Jayet P-Y, Rimoldi SF, Stuber T, Salmon CS, Hutter D, Rexhaj E, et al. Pulmonary and systemic vascular dysfunction in young offspring of mothers with preeclampsia. Circulation. 2010;122:488–494. doi: 10.1161/CIRCULATIONAHA.110.941203. [DOI] [PubMed] [Google Scholar]
  • 32.Taha D, Kirkby S, Nawab U, Dysart KC, Genen L, Greenspan JS, et al. Early caffeine therapy for prevention of bronchopulmonary dysplasia in preterm infants. J Matern Fetal Neonatal Med. 2014;27:1698–1702. doi: 10.3109/14767058.2014.885941. [DOI] [PubMed] [Google Scholar]
  • 33.Dobson NR, Patel RM, Smith PB, Kuehn DR, Clark J, Vyas-Read S, et al. Trends in caffeine use and association between clinical outcomes and timing of therapy in very low birth weight infants. J Pediatr. 2014;164:992–993. doi: 10.1016/j.jpeds.2013.12.025. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 34.Davis PG, Schmidt B, Roberts RS, Doyle LW, Asztalos E, Haslam R, et al. Caffeine for apnea of prematurity trial: benefits may vary in subgroups. J Pediatr. 2010;156:382–387. doi: 10.1016/j.jpeds.2009.09.069. [DOI] [PubMed] [Google Scholar]
  • 35.Mourani PM, Sontag MK, Younoszai A, Ivy DD, Abman SH. Clinical utility of echocardiography for the diagnosis and management of pulmonary vascular disease in young children with chronic lung disease. Pediatrics. 2008;121:317–325. doi: 10.1542/peds.2007-1583. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 36.Nagiub M, Lee S, Guglani L. Echocardiographic assessment of pulmonary hypertension in infants with bronchopulmonary dysplasia: systematic review of literature and a proposed algorithm for assessment. Echocardiography. 2015;32:819–833. doi: 10.1111/echo.12738. [DOI] [PubMed] [Google Scholar]
  • 37.Carlton EF, Sontag MK, Younoszai A, DiMaria MV, Miller JI, Poindexter BB, et al. Reliability of Echocardiographic Indicators of Pulmonary Vascular Disease in Preterm Infants at Risk for Bronchopulmonary Dysplasia. J Pediatr. 2017;186:29–33. [DOI] [PMC free article] [PubMed]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Data Availability Statement

The datasets used and/or analyzed during the current study available from the corresponding author on reasonable request. Public sharing of patient data in this study has not been approved by the Institutional Review Board, and a review of that request may need to occur prior to data sharing.


Articles from BMC Pediatrics are provided here courtesy of BMC

RESOURCES