Skip to main content
NIHPA Author Manuscripts logoLink to NIHPA Author Manuscripts
. Author manuscript; available in PMC: 2021 Nov 1.
Published in final edited form as: Med Sci Sports Exerc. 2020 Nov;52(11):2310–2319. doi: 10.1249/MSS.0000000000002378

Pitfalls in Expiratory Flow Limitation Assessment at Peak Exercise in Children: Role of Thoracic Gas Compression

Danielle Strozza 1, Daniel P Wilhite 2, Tony G Babb 2, Dharini M Bhammar 2,3
PMCID: PMC7573195  NIHMSID: NIHMS1583375  PMID: 33064406

Abstract

Purpose:

Thoracic gas compression and exercise-induced bronchodilation can influence the assessment of expiratory flow limitation (EFL) during cardiopulmonary exercise tests. The purpose of this study was to examine the effect of thoracic gas compression and exercise-induced bronchodilation on assessment of EFL in children with and without obesity.

Methods:

Forty children (10.7±1.0 years; 27 obese; 15 with EFL) completed pulmonary function tests and incremental exercise tests. Inspiratory capacity maneuvers were performed during the incremental exercise test for placement of tidal flow volume loops within the maximal expiratory flow volume (MEFV) loops and EFL was calculated as the overlap between the tidal and MEFV loops. MEFV loops were plotted with volume measured at the lung using plethysmography (MEFVp), volume measured at the mouth using spirometry concurrent with measurements in the plethysmograph (MEFVm) as well as from spirometry before (MEFVpre) and after (MEFVpost) the incremental exercise test. Only the MEFVp loops were corrected for thoracic gas compression.

Results:

Not correcting for thoracic gas compression resulted in incorrect diagnosis of EFL in 23% of children at peak exercise. EFL was 26±15%VT higher for MEFVm compared with MEFVp (p<0.001), with no differences between children with and without obesity (p=0.833). The difference in EFL estimation using MEFVpre (37±30%VT) and MEFVpost (31±26%VT) did not reach statistical significance (p=0.346).

Conclusions:

Not correcting the MEFV loops for thoracic gas compression leads to overdiagnosis and overestimation of EFL. Since most commercially available metabolic measurement systems do not correct for thoracic gas compression during spirometry, there may be significant overdiagnosis of expiratory flow limitation in cardiopulmonary exercise testing. Therefore, clinicians must exercise caution while interpreting expiratory flow limitation when the MEFV loop is derived through spirometry.

Keywords: pediatric, gas compression, bronchodilation, flow volume curve, ventilatory constraint, breathing mechanics

Introduction:

Fry et. al first noted in 1954 in emphysematous patients that, regardless of the effort exerted by the individual, patients were unable to exceed a certain expiratory flow rate at a given lung volume (1). Based on this observation, expiratory flow limitation (EFL) occurs when tidal expiratory flow reaches maximal expiratory flow and compensatory respiratory muscle effort is unable to increase expiratory flow, thus imposing a mechanical ventilatory constraint (2, 3). During exercise, greater ventilatory requirements can exacerbate EFL, especially in individuals with reduced expiratory flow reserve and those breathing at low lung volumes such as individuals with obesity (4, 5). In addition, when complete expiration is curtailed too early, end-expiratory lung volume (EELV) starts to increase leading to dynamic hyperinflation (4). Since EFL and dynamic hyperinflation can provoke dyspnea, respiratory muscle fatigue, and exercise intolerance (5, 6), they have become important assessments in routine cardiopulmonary exercise testing.

EFL is calculated as the percent overlap between the tidal exercise flow volume and maximal expiratory flow volume (MEFV) loops (7). The MEFV loop is most commonly constructed from expiratory volume measured at the mouth (MEFVm). However, MEFVm loops do not correct for gas compression artifact (8), which is the reduction in lung volume due to pressures applied by static elastic recoil, airway resistance, and increasing expiratory effort (8, 9). As a result, MEFVm loops can underestimate mid flow rates (8) and overestimate EFL (10). Gas compression artifact can be corrected by measuring MEFV loops with a volume displacement plethysmograph (MEFVp) where volumes are measured at the lung instead of at the mouth (8, 10, 11).

Although the link between overestimated EFL with MEFVm has been shown in healthy adults (1012), it has never before been investigated in children, who experience a high prevalence of EFL (13). In addition, children have lower lung volumes, less elastic recoil (14), and exert less maximum expiratory pressure (15) compared with adults, potentially leading to less thoracic gas compression. Children also have a higher ventilatory demand when compared with adults (16), which increases the risk of EFL. Furthermore, in children with obesity, the mechanical load imposed by adipose tissue exerts an unfavorable burden on the respiratory system leading to low functional residual capacity at rest (17, 18). During exercise, increased metabolic demands combined with expiratory muscle recruitment to increase tidal volume could further lower end-expiratory lung volume and increase the risk of EFL in children with obesity (17, 18). Finally, since EFL is a routinely reported as an indicator of ventilatory constraint during cardiopulmonary exercise testing studies in healthy and diseased children (13, 1821), it is critical to estimate the effect of thoracic gas compression on the assessment of EFL in children with and without obesity.

Another factor that can affect the assessment of EFL during exercise is the phenomenon of exercise-induced bronchodilation. Bronchodilation increases forced expiratory flow at 25–75% of forced vital capacity (FEF25–75) in prepubescent children without obesity (13) and may be as important as thoracic gas compression in the assessment of EFL (12). Post-exercise MEFV (MEFVpost) measurements can account for exercise-induced bronchodilation. However, it is unclear whether assessment of EFL is affected by bronchodilation in children with and without obesity.

The first purpose of this study was to compare EFL measured at peak exercise from tidal exercise flow volume loops plotted within MEFVm (i.e., not corrected for gas compression artifact) with MEFVp (i.e., corrected for gas compression artifact) in children with and without obesity. We hypothesized that MEFVm would overestimate EFL at peak exercise compared with MEFVp in children with and without obesity. The second purpose of this study was to compare EFL from MEFV measurements taken pre- and post-exercise in children with and without obesity. We hypothesized that MEFVpre, which does not account for bronchodilation induced by exercise, will overestimate EFL compared with MEFVpost in those children with and without obesity who experience bronchodilation. As is typical for most exercise stations, the MEFVpre and MEFVpost measurements were not corrected for thoracic gas compression. These data were part of a larger study designed to examine the respiratory effects of obesity in children.

Methods:

The child’s parent or guardian provided written, informed consent, and all children provided written assent. The protocol was approved by the UT Southwestern Institutional Review Board (approval #052012–076). Participants were 8 – 12 years old with no history of cardiovascular, metabolic or renal disease. BMI percentile was calculated for each participant using age and sex-specific BMI tables from the Centers for Disease and Control and Prevention (22); obesity was classified as BMI ≥ 95th percentile and without obesity was classified as BMI between the 16 and 84th percentile. Participants completed a Tanner pubertal stage self-assessment (23) and those Tanner stage 4 or higher were excluded. Participants that showed evidence of pulmonary disease (forced expiratory volume in 1 s [FEV1], FVC, or total lung capacity (TLC) < 80% predicted) or bronchodilator response (increase in FEV1 ≥ 12% with a minimum volume improvement of 200 mL after 360 mcg of albuterol) were excluded.

Pulmonary Function

Standard spirometry and lung volume determinations were performed according to the guidelines of the American Thoracic Society (24). Predicted values for spirometry and lung volumes were based on the norms from NHANES (25) and Goldman and Becklake (26), respectively. Maximal flow-volume loops (MEFVm and MEFVp) were measured in a pressure-corrected volume-displacement body plethysmograph to correct for thoracic gas compression (SensorMedics model 6200, Yorba Linda, CA). Volume (mouth and lung) and flow (mouth) were exported as text files and graphed using Spike 2 software (Cambridge Electronic Design Limited, Cambridge, England) for overlays with exercise tidal flow volume loops. Volume of gas compressed was assessed by measuring the difference in volume at peak expiratory flow between MEFVm and MEFVp (Figure 1). Percent difference in isovolume FEF50 (isoFEF50) between MEFVm and MEFVp was assessed at 50% of FVC from the MEFVp loop (Figure 1).

Figure 1:

Figure 1:

Maximal expiratory flow volume (MEFV) loops with volume assessed at the lung with a plethysmograph MEFVp (dashed line), volume assessed at the mouth with spirometry MEFVm (solid line), and peak exercise tidal flow volume loop (dotted line) for a single participant. Illustrations of assessment of thoracic gas compression, difference in isovolume forced expiratory flow at 50% of forced vital capacity (isoFEF50), and expiratory flow limitation (EFL) are provided.

Incremental Exercise Test

The incremental exercise test was performed on a cycle ergometer. The initial work rate was 20W and work rate was increased by 15W or 10W increments every minute until volitional exhaustion, with no differences between the two increments for eliciting V̇O2peak as described previously (27). The protocol included a verification test at 105% of peak work rate as described previously (27). Participants breathed through a mouthpiece connected to a Hans Rudolph valve (Model 2700). Total body O2 uptake (V̇O2), carbon dioxide production (V̇CO2), and minute ventilation (V̇E) were measured using the Douglas bag technique where expired gases were collected in polyurethane bags. Gas fractions were analyzed by a mass spectrometer (Marquette Electronics, model 1100) and ventilatory volume was measured with a 200L Tissot spirometer.

Expiratory and inspiratory flows were measured at rest and continuously during exercise to obtain tidal volume (VT), breathing frequency, and exercise tidal flow-volume. Inspiratory flow was measured using a pneumotachograph (Hans Rudolph, Model 4813) and expiratory flows were measured using a heated pneumotachograph (Hans Rudolph, model 3850A). Flow signals were combined into a single bidirectional flow signal (Validyne Buffer Amplifier, model BA112) and digitally integrated to yield volume. Data were collected using the Spike 2 data acquisition and analysis package. Inspiratory capacity (IC) maneuvers were performed at rest and during the last 20 s of each exercise increment by having participants inhale maximally to TLC or a little sooner if the child appeared to be struggling to maintain cadence at the peak exercise stage. Participants performed multiple IC maneuvers during the pulmonary function test and before starting the incremental exercise test. Firm encouragement was provided during each IC maneuver.

MEFV loops were also obtained pre-exercise (i.e., MEFVpre) and within 5 min of terminating exercise (MEFVpost; Mean ± SD: 2.35 ± 1.20 min; 95% confidence interval: 1.89 – 2.82 min) while the subjects were seated on the cycle ergometer with the same data acquisition system as the one used during exercise. Since this system also measured volume at the mouth, the MEFVpre and post loops were not corrected for thoracic gas compression. Comparisons of the MEFVm and MEFVpre loops were completed to assess any differences between the SensorMedics system and the custom data acquisition system used for exercise testing, respectively. We report no significant differences in EFL estimation between MEFVm and MEFVpre methods (P= 0.705), suggesting that the two systems offer similar estimates of EFL.

Data processing

Each file was processed in Spike 2 for drift correction and plotting of MEFV and tidal flow volume loops. First, BTPS correction was applied to the ATPS flow signal to derive BTPS volume and flow. Drift correction was completed by selecting ranges of breaths from start to finish and interpolating between two known volumes (i.e., two consecutive IC’s). Each range was usually 60 – 90 s long. If the peak stage IC was the only remaining IC, the file was reprocessed to include the peak stage and the stage prior for the drift correction. If either of the IC’s did not reach TLC as noted by inspiratory or expiratory drift, a user-defined drift correction was completed using the best IC. Breaths were marked next using a volume change of 0.1L, minimum interval of 0.2s, and transitions were marked at zero flow. Breath by breath analyses was completed and a report was generated with respiratory parameters including tidal volume, peak flow, IC (i.e., volume from end of each breath to TLC), and duty cycle for each breath in the range. 8 – 12 breaths that were preceding the IC at peak exercise were selected and respiratory parameters were averaged for these breaths. A typical breath was selected and plotted based on duty cycle, VT, peak flow, extrapolated V̇E, and IC being the most similar to the average of the 8 – 12 breaths. End-expiratory lung volume (EELV) was calculated as TLC – IC.

Expiratory flow limitation

The typical breath was plotted within the MEFV loops and EFL was calculated for each participant and method. EFL was defined as the percentage of VT (%VT) where tidal expiratory flow at peak exercise impinged on maximal expiratory flow (7) as shown in Figure 1. Four MEFV loops were compared with typical peak exercise tidal flow volume loops:

  1. MEFVp: lung volume obtained from plethysmography; corrected for thoracic gas compression.

  2. MEFVm: mouth volume obtained concurrently during plethysmography; not corrected for thoracic gas compression.

  3. MEFVpre: mouth volume obtained before the incremental exercise test; not corrected for thoracic gas compression.

  4. MEFVpost: mouth volume obtained within 5min of ending the incremental exercise test; not corrected for thoracic gas compression.

The flow volume loop overlay in Spike 2 contained all four MEFV loops (i.e., MEFVm, p, pre, and post) along with the peak exercise tidal flow volume loop. Each MEFV loop was displayed with the peak exercise tidal flow volume loop for assessment of EFL by each method. The traditionally definitive overlay technique for measuring EFL used in this study (28) is very common in most cardiopulmonary exercise testing laboratories (29). It produces reliable and qualitatively similar estimates of expiratory flow limitation when compared with maximal effective pleural pressure (30) and the negative expiratory pressure (31, 32) techniques at high exercise intensities.

Exercise-related bronchodilation

Percent difference in isoFEF50 between MEFVpre and MEFVpost was assessed at 50% of FVC from the MEFVpre loop. Percent change in FEV1 was also calculated between MEFVpre and MEFVpost. No children experienced bronchoconstriction (i.e., decrease in FEV1 of greater than 10%) and one child experienced bronchodilation (i.e., increase in FEV1 of greater than 12%) after the incremental exercise test (33, 34).

Statistical analysis

All values are expressed as mean ± SD unless otherwise specified. Data were checked for normality using the Shapiro Wilk test; data were normally distributed. Differences in variables between children with vs. without EFL as well as with vs. without obesity were assessed with a two-way ANOVA. A general linear model with repeated measures was used to detect differences in EFL (%VT) by method (MEFVp, MEFVm, MEFVpre, and MEFVpost) and group (with and without obesity), and to examine a group × method interaction. Posthoc differences by method were determined after applying a Bonferroni correction. Bland-Altman plots were used to examine the agreement between the methods for measurement of EFL (35). Pearson correlations were used to examine associations between variables. Chi square tests were used to detect frequency differences in categorical variables. A P value of 0.05, two tailed, was considered significant. SPSS 20 (IBM, Armonk, NY) was used for analyses.

Based on published data in adults (12), a sample size of 9 individuals would allow detection of a significant difference in EFL estimation between methods that correct vs. don’t correct for thoracic gas compression with a power of 0.82 and type 1 error of 0.05 (two dependent samples t-test). Based on published data in adults (12), a sample size of 7 individuals would allow detection of a significant difference in EFL estimation between pre and post-exercise MEFV loops that were not corrected for thoracic gas compression with a power of 0.86 and type 1 error of 0.05 (two dependent samples t-test). A total sample of 11 individuals would allow detection of a significant group × method interaction with a power of 0.80 and type 1 error of 0.05 for a moderate effect size (Cohen’s f = 0.25) and assuming strong correlation between repeated measures (r = 0.79) based on published data in adults (12).

Results:

Forty children were included in the analyses after exclusions (Figure 2), 13 without obesity and 27 with obesity. After correcting the MEFV loop for thoracic gas compression (i.e., MEFVp), 15 children experienced EFL at peak exercise (true positives) and 25 children experienced no EFL (Table 1). FEF25–75 and FEV1/FVC were lower in children with EFL compared with those without EFL (Table 1). There were no statistically significant differences in the age, BMI z-score, and other pulmonary function variables between participants with and without EFL (Table 1). Children with obesity had a lower functional residual capacity as a % of total lung capacity when compared with children without obesity (Table 1). V̇E and VT were higher in those children without obesity who experienced EFL when compared with those children without obesity who did not experience EFL (Table 1).

Figure 2:

Figure 2:

Participant flowchart. PFT: pulmonary function test, INCR: incremental exercise test, MEFV: maximal expiratory flow volume loop, MEFVm: volume measured at the mouth, MEFVp: volume measured with a volume displacement plethysmograph, MEFVpre: pre-exercise, MEFVpost: post-exercise.

Table 1:

Participant characteristics presented for children with and without obesity as well as with and without expiratory flow limitation (EFL). EFL status was based on overlap between peak exercise tidal volume loop and maximal expiratory flow volume loop measured by the plethysmograph (MEFVp).

Without Obesity With Obesity P Value
Without EFL (N=10) With EFL (N=3) Without EFL (N=15) With EFL (N=12) Obesity Status EFL Status Interaction
Boys/ Girls (N) 4/6 3/0 7/8 8/4 0.071 0.919
Tanner Stage (1, 2, 3; N) 2/6/2 0/1/2 3/6/6 3/4/5 0.603 0.600
Age (year) 10.5 ± 0.7 11.3 ± 1.4 10.5 ± 1 10.7 ± 1.2 0.220 0.447 0.436
Height (cm) 142.0 ± 6.1 153.9 ± 8.9 146.5 ± 6.8 148.0 ± 8.2 0.813 0.021 0.067
Weight (kg) 34.4 ± 2.8 42.4 ± 7.6 58.6 ± 14.7 64.9 ± 19.2 <0.001 0.195 0.876
BMI (kg·m−2) 17.1 ± 1.0 17.8 ± 1.2 26.9 ± 4.5 29.1 ± 6.0 <0.001 0.396 0.663
BMI % of the 95%ile 74 ± 6 76 ± 3 117 ± 17 126 ± 22 <0.001 0.404 0.586
BMI z-score −0.02 ± 0.59 0.15 ± 0.28 2.02 ± 0.45 2.19 ± 0.35 <0.001 0.320 0.999
Pulmonary Function
FVC (L) 2.52 ± 0.39 3.05 ± 0.73 2.73 ± 0.52 2.89 ± 0.66 0.915 0.109 0.391
FVC (% Predicted) 104 ± 10 102 ± 2 107 ± 8 109 ± 12 0.190 0.951 0.575
FEV1 (L) 2.22 ± 0.32 2.45 ± 0.62 2.33 ± 0.47 2.34 ± 0.53 0.999 0.520 0.545
FEV1 (% Predicted) 104 ± 8 95 ± 7 106 ± 10 101 ± 12 0.355 0.105 0.557
FEV1/FVC 89 ± 5 80 ± 3 87 ± 4 81 ± 3 0.683 <0.001 0.398
FEF25–75 (L/s) 2.72 ± 0.57 2.28 ± 0.7 2.73 ± 0.64 2.30 ± 0.58 0.957 0.070 0.989
FEF25–75 (% Predicted) 107 ± 21 82 ± 16 107 ± 22 86 ± 17 0.778 0.005 0.821
TLC (L) 3.11 ± 0.48 3.69 ± 0.72 3.35 ± 0.59 3.68 ± 0.86 0.642 0.084 0.621
TLC (% Predicted) 95 ± 8 96 ± 5 97 ± 8 104 ± 15 0.161 0.278 0.467
IC (L) 1.68 ± 0.41 1.91 ± 0.42 2.13 ± 0.53 2.21 ± 0.58 0.067 0.435 0.716
FRC (% TLC) 46 ± 8 48 ± 7 37 ± 8 40 ± 7 0.005 0.423 0.861
Maximal Exercise Test
E (L/min) 54.7 ± 10.8 78.5 ± 9.9 58.5 ± 9.5 60.6 ± 14.7 0.122 0.006 0.020
fB (bpm) 58 ± 12 60 ± 15 61 ± 15 58 ± 12 0.901 0.902 0.681
VT (L) 0.96 ± 0.17 1.37 ± 0.39 1.01 ± 0.25 1.05 ± 0.20 0.132 0.013 0.042
VT (%FVC) 38 ± 6 45 ± 4 37 ± 5 37 ± 4 0.018 0.098 0.108
IC (L) 1.61 ± 0.3 2.03 ± 0.67 1.86 ± 0.38 2.08 ± 0.53 0.376 0.061 0.526
EELV (%TLC) 48 ± 4 46 ± 9 45 ± 4 44 ± 5 0.110 0.349 0.660
EFL (%VT) 0 ± 0 30.5 ± 22.6 0 ± 0 33.8 ± 25.0 0.771
Thoracic gas compression (MEFVp vs. MEFVm)
Volume difference at peak flow (mL) 223 ± 102 281 ± 140 241 ± 91 259 ± 135 0.949 0.377 0.642
isoFEF50 difference (%) 12.7 ± 5.5 10.3 ± 10.2 13.6 ± 6.3 15.1 ± 6.7 0.260 0.875 0.445
Pre to Post exercise*
ΔisoFEF50 (%) −9.5 ± 24.7 8.2 ± 6.0 2.8 ± 11.5 0.5 ± 9.5 0.700 0.205 0.102
ΔFEV1 (%) 0.72 ± 3.71 −1.40 ± 6.28 0.20 ± 4.41 0.59 ± 5.42 0.724 0.677 0.547

BMI: body mass index, FVC: forced vital capacity, FEV1: forced expiratory volume in 1s, isoFEF: isovolume forced expiratory flow, V̇E: minute ventilation, fB: breathing frequency, VT: tidal volume, MEFVp: maximal expiratory flow volume curve where volume was measured at the lung with a plethysmograph, MEFVm: MEFV curve where volume was measured at the mouth with a spirometer.

*

n=5 (without obesity and without EFL),

n=3 (without obesity and with EFL), n=13 (with obesity and without EFL), n=8 (with obesity and with EFL)

Effect of thoracic gas compression on EFL estimation

There were no significant differences between children without and with obesity in volume of thoracic gas compression (237 ± 108 vs. 248 ± 111mL, respectively; P = 0.949) or difference in isoFEF50 between MEFVm and MEFVp (without obesity: 12.1 ± 6.4, with obesity: 14.3 ± 6.4%; P = 0.260). There were no significant differences between children without and with obesity from pre to post exercise in isoFEF50 (–2.8 ± 21.1 vs. 1.9 ± 10.6%; P = 0.700) and FEV1 (–0.08 ± 4.5 vs. 0.35 ± 4.7%; P = 0.724). Table 1 also shows that there were no differences in thoracic gas compression or bronchodilation from pre to post exercise between children with vs. without EFL and no obesity × EFL status interaction.

We did not detect statistical differences for the volume of gas compressed between MEFVm and MEFVp between children who were false positives (N=9) and children who were true positives (N=15; 293 ± 94mL and 263 ± 131mL, respectively; P = 0.572). We also did not detect statistical differences in ΔisoFEF50 between MEFVm and MEFVp between children who were false positives vs. true positives (16.9 ± 4.8 and 14.2 ± 7.4%, respectively; P = 0.332). However, the difference in EFL between the MEFVm and MEFVp methods was associated with volume of gas compression (r = 0.407; P = 0.049; N=24).

There were no statistical differences in the magnitude of EFL between children with and without obesity at peak exercise (Table 1). Table 2 shows individual data for EFL estimation by each method. There was no significant main effect of group (i.e., with vs. without obesity) and no significant group × method (i.e., MEFVp, m, pre, and post) interaction in EFL estimation. 60% (N=24) of children experienced EFL (i.e., tidal flow-volume overlap with MEFV loop at peak exercise) as measured by MEFVm and 37% (N=15) as measured by MEFVp, showing that 23% of children were falsely diagnosed with EFL using MEFVm.

Table 2:

Individual data showing expiratory flow limitation measurements as a percent of tidal volume calculated from four different maximal expiratory flow volume (MEFV) loops with peak exercise tidal flow volume loop overlays. The four MEFV loops were: m = volume at the mouth during the pulmonary function test, p = volume at the lung using a plethysmograph during the pulmonary function test, pre = volume at the mouth before starting the incremental exercise test, and post = volume at the mouth after completing the incremental exercise test.

Subject Group Sex MEFVm MEFVp MEFVpre* MEFVpost*
1 Nonobese F 0 0 - -
2 Nonobese F 0 0 0 0
3 Nonobese F 0 0 0 0
4 Nonobese F 0 0 - 18.6
5 Nonobese F 0 0 0 -
6 Nonobese F 0 0 0 0
7 Nonobese M 0 0 12.3 1.1
8 Nonobese M 0 0 - -
9 Nonobese M 12.8 0 0 0
10 Nonobese M 24.8 0 50.5 -
11 Nonobese M 59.7 47.7 37.4 0.0
12 Nonobese M 62.2 38.8 57.0 55.1
13 Nonobese M 65.2 4.9 64.8 20.0
14 Obese F 0 0 0 -
15 Obese F 0 0 4.2 23.1
16 Obese F 0 0 0 0
17 Obese F 0 0 0 0
18 Obese F 25.5 5.5 8.1 7.2
19 Obese F 30.8 0 22.9 26.1
20 Obese F 31.2 0 0 0
21 Obese F 51.5 34.5 0 33.0
22 Obese F 53.0 0 0 0
23 Obese F 58.1 32.7 53.2 50.0
24 Obese F 85.5 72.7 83.5 82.5
25 Obese M 0 0 0.5 0
26 Obese M 0 0 0 0
27 Obese M 0 0 0 2.8
28 Obese M 0 0 0 0
29 Obese M 5.2 0 0 0
30 Obese M 17.6 8.1 - -
31 Obese M 26.1 16.7 20.6 26.2
32 Obese M 33.8 0 60.3 40.6
33 Obese M 34.4 0 0 -
34 Obese M 37.3 15.8 49.9 -
35 Obese M 38.1 0 0 0
36 Obese M 52.1 22.7 42.1 54.2
37 Obese M 72.7 16.3 81.0 35.5
38 Obese M 73.1 55.4 75.3 80.6
39 Obese M 75.6 43.1 - -
40 Obese M 88.5 81.7 - 88.3

F = female, M = male;

*

six pre and nine post MEFV loops were excluded because of poor effort and are denoted by “-”

Posthoc differences between the four methods of EFL estimation were assessed and reported in Figure 3. MEFVm, which does not correct for thoracic gas compression, overestimated the degree of EFL by 26 ± 15%VT when compared with MEFVp, which does correct for thoracic gas compression (P < 0.001). Figure 3A shows average and individual data for differences between MEFVm and MEFVp for true positives (N=15) and Figure 3B shows data only from MEFVm for false positives (N=9; MEFVp = 0 in these cases). Differences between MEFVp and MEFVpre (pre-exercise; not corrected for thoracic gas compression; 20 ± 25%VT) did not reach statistical significance (P = 0.215; Figure 3C).

Figure 3:

Figure 3:

Differences in expiratory flow limitation (EFL) assessed using (A) Maximal expiratory flow volume (MEFV) loops with volume assessed at the lung with a plethysmograph MEFVp and volume assessed at the mouth with spirometry MEFVm for “true positives”, (B) MEFVm for “false positives” (i.e., zero EFL for MEFVp), (C) MEFVp and pre-exercise MEFVpre, and (D) MEFVpre and post-exercise MEFVpost. Plus sign represents mean, top and bottom of box represent interquartile range, error bars represent minimum to maximum, and individual data are plotted as symbols. *indicates statistical difference p < 0.05.

Effect of exercise-induced bronchodilation on EFL estimation

Complete data for MEFVpre and MEFVpost were available in 29 children (Figure 2). 17 of 29 children experienced EFL in either MEFVpre or MEFVpost overlays. MEFVpre and MEFVpost methods did not differ statistically in their measurement of EFL (P = 0.280; Figure 3D). The difference in isoFEF50 between MEFVpre and MEFVpost was inversely and moderately correlated with the difference in EFL between these two methods (r = −0.494; P = 0.044; N = 17).

Bland-Altman analysis

Bland-Altman analysis showed an overestimation bias and wide limits of agreement for assessment of EFL with MEFVm compared with MEFVp with no proportional bias (Figure 4A). Figures 3B and 4B show that, when MEFV loops are not corrected for thoracic gas compression, most false positives occur below an EFL threshold of 40%VT. Only one false positive case had an EFL estimation above 40%VT. Similarly, MEFVpre and MEFVpost, which were both not corrected for thoracic gas compression, demonstrated an overestimation bias compared with MEFVp for assessment of EFL (Figure 4C and 4D); overestimation error from MEFVpre was higher than MEFVpost likely due to bronchodilation after exercise in some participants.

Figure 4:

Figure 4:

Bland Altman plots with different symbols for children correctly diagnosed (true positives) and misdiagnosed (false positive): (A) comparing expiratory flow limitation (EFL) assessed using maximal expiratory flow volume (MEFV) loops with volume assessed at the lung with a plethysmograph MEFVp and volume assessed at the mouth with spirometry MEFVm, (B) MEFVm plotted on the X axis to demonstrate individual data from false positive cases that could help detect an EFL threshold above which an EFL diagnosis can be made with confidence if correction for thoracic gas compression is not possible. (C) comparing EFL assessed using MEFVp and pre-exercise MEFVpre, and (D) comparing EFL assessed using MEFVp and pre-exercise MEFVpost. Difference between methods plotted on the Y axis and average of methods plotted on the X axis.

Discussion:

To the best of our knowledge, this is the first study to show that EFL can be significantly overestimated when the MEFV loop is not corrected for thoracic gas compression in children with and without obesity. EFL is a mechanical ventilatory constraint, potentially associated with dynamic hyperinflation, dyspnea, and exercise tolerance (36). Since EFL has been the focus of numerous studies in children (13, 1821), accurate assessment of EFL is critical during cardiopulmonary exercise testing. Although it has been long established that thoracic gas compression can affect the measurement of EFL in children and young adults (11), previous studies examining EFL in children have not corrected for thoracic gas compression (13, 1821). We show that EFL can be overestimated by ≈26% in children, when the MEFV loop is not corrected for thoracic gas compression. This magnitude of overestimation can significantly affect the interpretation of clinical exercise tests. Furthermore, we showed that the change in EFL from pre to post exercise was inversely associated with change in isoFEF50, suggesting that exercise-induced bronchodilation may also play a role in the determination of EFL in children.

Thoracic gas compression

Coates et. al (11) investigated the difference in thoracic gas compression on mid flows in children and young adults with and without airflow obstruction. The largest errors in FEF50 between MEFV loops not corrected vs. corrected for gas compression artifact were noted in individuals who were able to generate the highest pleural pressures and had the lowest FEF50 (i.e., those with airflow limitation) (11). The authors suggested that MEFVm could offer valid volume related flow rates only in individuals with no significant airflow limitation. In the current study, isoFEF50 was 14% higher after correction for gas compression artifact in children without airflow limitation. As a result, EFL was overestimated by ≈26%VT and misdiagnosed in 23% of children when MEFVm loops were utilized. In addition, there was a moderate association between the overestimation of EFL by MEFVm compared with EFL by MEFVp and the volume of gas compression observed during the MEFV maneuver.

The effect of thoracic gas compression on EFL was greater in children (i.e., 26% VT difference between MEFVm and MEFVp methods) than previously demonstrated in adults (i.e., 19%VT) (12). The study in adults (12) attempted to correct for thoracic gas compression by using graded effort loops. This method is performed by having participants complete maximal expirations at different volumes from total lung capacity to residual volume. The current study utilized a volume displacement plethysmograph, which directly corrects for thoracic gas compression and thus offers a more accurate assessment for the effect of thoracic gas compression on EFL. The largest difference in the current study was seen in one child who showed a 60% overestimation of EFL by MEFVm (65%) when compared with MEFVp (5%).

There is no consensus regarding a specific threshold for “significant” EFL during pediatric cardiopulmonary exercise testing. In adults, Johnson et al defined EFL as “significant” when overlap between tidal flow-volume and MEFV loops was 40 – 50% VT, while also suggesting correction for thoracic gas compression (37). In children, Swain et al (13) and Pianosi and Smith (21) have used a “threshold” of ≥ 5% VT overlap between tidal flow-volume and MEFV loops for defining EFL without correcting for thoracic gas compression. The current study, which did not use a specific EFL threshold but rather dichotomized presence or absence of EFL and reported the magnitude of EFL as %VT for each method, showed that the average overestimation of EFL using MEFVm was ≈26%VT. These data suggest that a threshold of 5% VT is certainly too low when using MEFVm loops and could lead to overdiagnoses of ventilatory limitations. We also show that false positives occurred at an EFL of less than 40%VT in all but one case. Therefore, in a clinical setting, an EFL of greater than 40% could be a more conservative and appropriate threshold rather than ≥5%VT when it is not possible to correct the MEFV loop for thoracic gas compression. It should be noted that this proposed threshold is based on exercise tidal volume loop overlap with the resting MEFVm loop. Therefore, this threshold may not apply for children who experience significant exercise-induced bronchodilation, which could theoretically affect both thoracic gas compression and the magnitude of EFL assessed using post-exercise compression corrected or uncorrected MEFV loops.

Exercise-related Bronchodilation

In adults, Guenette et al. (12) reported a difference in EFL of 23%VT between MEFVpre and MEFVpost methods, with both methods not corrected for thoracic gas compression. MEFVpost loops were completed approximately 1 – 2 min after the incremental exercise test in Guenette et al (12). When graded effort MEFV loops were used in an attempt to correct for thoracic gas compression, they determined that the overestimation of EFL was 28%VT (12). Although there was no significant decrease in EFL (%VT) from MEFVpre to MEFVpost in the current study, the decrease in EFL (%VT) from MEFVpre to MEFVpost was correlated with the increase in isoFEF50, suggesting that exercise-induced bronchodilation can influence the measurement and interpretation of EFL in children.

The time course of exercise-induced bronchodilation in non-asthmatic children who exhibit low bronchial lability (38) is unclear. Previous studies have reported improvements in mid flows (i.e., FEF50) during (39) or immediately after (30) an incremental exercise test in non-asthmatic adults. In contrast, Johnson et al (40) reported no change in MEFV loops from pre-exercise to immediately and 5 min after exercise in non-asthmatic adults. MEFVpost loops in the current study were completed 2.35 ± 1.20 min after volitional exhaustion during the incremental exercise test, with 80% of MEFVpost loops completed within 3 min of ending the test. In some cases, the need for repeated efforts increased the time between ending the test and acquiring an MEFVpost loop. We cannot exclude the possibility that our timing of MEFVpost loops could have missed bronchodilation that resolved very rapidly with the cessation of exercise. Furthermore, exercise-induced bronchoconstriction could occur anytime from 2 – 30 min post exercise in children (34). Our ability to detect exercise-induced bronchoconstriction, if any, was also limited, but this should not affect the measurement of EFL during exercise. Future studies are needed to clarify the time course of exercise-induced bronchodilation or bronchoconstriction and the optimal timing, number, and feasibility of post-exercise MEFV loops in non-asthmatic children with and without obesity.

EFL and Obesity

EFL has been reported in 55 – 90% of pre-pubescent children without obesity (13, 20). Mendelson et al reported EFL in 50% of children with obesity at peak exercise compared with no prevalence of EFL in children without obesity (17). In the current study, 44% of children with obesity experienced EFL at peak exercise compared with 23% of children without obesity, with no statistical differences observed in the magnitude of EFL (%VT) between children with and without obesity. Previous studies in children (13, 17, 20) did not correct for thoracic gas compression, which could have led to overestimation of EFL. In addition, changes in lung size (41) and ventilatory responses to exercise (42) with growth and development could explain differences in EFL noted between children of different ages.

Methodological considerations

Most commercially available pulmonary and metabolic measurement systems do not plot MEFV loops with volumes measured at the lung (i.e., MEFVp). In addition, even when a plethysmograph is available and it is able to plot MEFV loops with volumes measured at the lung, there are often limited options for overlaying these MEFVp loops with exercise tidal flow volume loops for accurate EFL assessment. The current study is novel because of the ability to measure volumes at the lung and to overlay MEFV loops from the plethysmograph with flow-volume loops before, during, and after exercise. Although MEFVm and MEFVpre measurements were completed on two different systems, they offered fairly similar “over” estimates of EFL. In clinical settings where spirometry is easily available for MEFV loops pre- and post-exercise, considering the influence of thoracic gas compression on EFL assessment during interpretation of mechanical ventilatory constraints is recommended.

Limitations

The study was limited by its sample size (N=40), specifically in the sample of children who experienced “true” EFL (N=15). Our small sample size was, in part, due to the exclusion of 32 children from the initial sample because they had taken 360μg of albuterol prior to the incremental exercise test. To eliminate confounding in the measurement of EFL due to the increase in mid-flow rates after albuterol, all children who were given albuterol prior to the incremental exercise test were excluded from the study.

Previous reports showed no significant change in TLC with exercise in adults (4345) and therefore, in the current study, we placed tidal volume loops within MEFV loops based on changes in IC during peak exercise. However, whether TLC changes significantly during exercise in children with and without obesity remains unknown and should be studied.

Although we were unable to explore sex differences due to the sample size, we did find that the volume of thoracic gas compression was greater in boys compared with girls (296 ± 99 vs. 191 ± 91mL, P = 0.001). This could be attributable to higher expiratory pressures that boys are able to generate (predicted maximal expiratory pressure boys: 96 ± 4 vs. girls: 74 ± 7mmHg; P < 0.001). We did not find differences in isoFEF50 between MEFVm and MEFVp loops between boys and girls (P = 0.979). Thus, sex differences in estimation of EFL using compression corrected vs. uncorrected MEFV loops need to be explored further in children. Despite these limitations, the results from this study could be useful for assessment and interpretation of EFL during routine cardiopulmonary exercise testing in 8 – 12-year-old children with and without obesity.

Conclusions

EFL is significantly overestimated and misdiagnosed when thoracic gas compression is not corrected for in children. There are moderate associations between the volume of thoracic gas compression as well as the increase in mid-flows with exercise-induced bronchodilation and the overestimation of EFL. If pre-exercise MEFV loops are utilized for assessment of EFL during routine cardiopulmonary exercise testing and the MEFV loops cannot be corrected for thoracic gas compression, EFL > 40%VT may be used as a reasonable clinical threshold for “true” EFL in children, assuming that there is no significant exercise-induced bronchodilation. Since correction for thoracic gas compression and exercise-induced bronchodilation would be ideal in cardiopulmonary exercise tests, clinical interpretation of EFL assessments without these corrections should be made with caution in children.

Acknowledgements:

This research was supported by NIH R01 HL136643, Texas Health Presbyterian Hospital Dallas, King Charitable Foundation Trust, and unrestricted funds from Dr. Pepper Snapple.

The authors wish to thank Benjamin Levine, Satyam Sarma, Tanya Martinez-Fernandez, and Olga Gupta for their clinical support and Yulun Liu for statistical support. The authors also wish to thank Rubria Marines-Price, Jonathon Stickford, Vipa Bernhardt, J. Todd Bassett, Raksa Moran, Jessica Alcala, Maria Roman, Joseph Genovese, Andreas Kreutzer, Ashley Peck, Marcus Payne, and Anastasia Pyz for their assistance with data collection at various stages of data collection.

Footnotes

Conflict of Interest:

Authors declare no conflict of interest. The results of this study are presented clearly, honestly, and without fabrication, falsification, or inappropriate data manipulation. The results of the present study do not constitute endorsement by ACSM.

References:

  • 1.Fry DL, Ebert RV, Stead WW, Brown CC. The mechanics of pulmonary ventilation in normal subjects and in patients with emphysema. Am J Med. 1954;16(1):80–97. [DOI] [PubMed] [Google Scholar]
  • 2.Pedersen OF, Butler JP. Expiratory flow limitation. Compr Physiol. 2011;1(4):1861–82. [DOI] [PubMed] [Google Scholar]
  • 3.Babb TG, Rodarte JR. Estimation of Ventilatory Capacity during Submaximal Exercise. J Appl Physiol. 1993;74(4):2016–22. [DOI] [PubMed] [Google Scholar]
  • 4.Pellegrino R, Brusasco V, Rodarte JR, Babb TG. Expiratory Flow Limitation and Regulation of End-Expiratory Lung-Volume During Exercise. J Appl Physiol. 1993;74(5):2552–8. [DOI] [PubMed] [Google Scholar]
  • 5.Babb TG. Exercise ventilatory limitation: the role of expiratory flow limitation. Exerc Sport Sci Rev. 2013;41(1):11–8. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6.Ferguson GT. Why Does the Lung Hyperinflate? Proc Am Thorac Soc. 2006;3(2):176–9. [DOI] [PubMed] [Google Scholar]
  • 7.American Thoracic S ATS/ACCP Statement on Cardiopulmonary Exercise Testing. Am J Respir Crit Care Med. 2003;167(2):211–77. [DOI] [PubMed] [Google Scholar]
  • 8.Ingram RH, Jr., Schilder DP. Effect of gas compression on pulmonary pressure, flow, and volume relationship. J Appl Physiol. 1966;21:1821–6. [DOI] [PubMed] [Google Scholar]
  • 9.Jaeger M, Otis A. Effects of compressibility of alveolar gas on dynamics and work of breathing. J Appl Physiol. 1964;19(1):83–91. [DOI] [PubMed] [Google Scholar]
  • 10.Grimby G, Stiksa J. Flow-volume curves and breathing patterns during exercise in patients with obstructive lung disease. Scand J Clin Lab Invest. 1970;25:303–13. [DOI] [PubMed] [Google Scholar]
  • 11.Coates AL, Desmond KJ, Demizio D, Allen P, Beaudry PH. Sources of error in flow-volume curves. Effect of expired volume measured at the mouth vs that measured in a body plethysmograph. Chest. 1988;94:976–82. [DOI] [PubMed] [Google Scholar]
  • 12.Guenette JA, Dominelli PB, Reeve SS, Durkin CM, Eves ND, Sheel AW. Effect of thoracic gas compression and bronchodilation on the assessment of expiratory flow limitation during exercise in healthy humans. Respir Physiol Neurobiol. 2010;170(3):279–86. [DOI] [PubMed] [Google Scholar]
  • 13.Swain KE, Rosenkranz SK, Beckman B, Harms CA. Expiratory flow limitation during exercise in prepubescent boys and girls: prevalence and implications. J Appl Physiol. 2010;108(5):1267–74. [DOI] [PubMed] [Google Scholar]
  • 14.De Troyer A, Yernault JC, Englert M, Baran D, Paiva M. Evolution of intrathoracic airway mechanics during lung growth. J Appl Physiol. 1978;44(4):521–7. [DOI] [PubMed] [Google Scholar]
  • 15.Wilson SH, Cooke NT, Edwards RH, Spiro SG. Predicted normal values for maximal respiratory pressures in caucasian adults and children. Thorax. 1984;39(7):535–8. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16.Gratas-Delamarche A, Mercier J, Ramonatxo M, Dassonville J, Prefaut C. Ventilatory response of prepubertal boys and adults to carbon dioxide at rest and during exercise. Eur.J Appl.Physiol Occup.Physiol 1993;66:25–30. [DOI] [PubMed] [Google Scholar]
  • 17.Mendelson M, Michallet A-S, Estève F et al. Ventilatory responses to exercise training in obese adolescents. Respir Physiol Neurobiol. 2012;184(1):73–9. [DOI] [PubMed] [Google Scholar]
  • 18.Gibson N, Johnston K, Bear N, Stick S, Logie K, Hall G. Expiratory flow limitation and breathing strategies in overweight adolescents during submaximal exercise. Int J Obes. 2013. [DOI] [PubMed] [Google Scholar]
  • 19.Nourry C, Deruelle F, Fabre C et al. Exercise flow-volume loops in prepubescent aerobically trained children. J Appl Physiol. 2005;99:1912–21. [DOI] [PubMed] [Google Scholar]
  • 20.Nourry C, Deruelle F, Fabre C et al. Evidence of ventilatory constraints in healthy exercising prepubescent children. Pediatr Pulmonol. 2006;41(2):133–40. [DOI] [PubMed] [Google Scholar]
  • 21.Pianosi PT, Smith J. Ventilatory Limitation of Exercise in Pediatric Subjects Evaluated for Exertional Dyspnea. Front Physiol 2019;10:20. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22.Kuczmarski RJ, Ogden CL, Grummer-Strawn LM et al. CDC growth charts: United States. Adv Data. 2000;(314):1–27. [PubMed] [Google Scholar]
  • 23.Morris NM, Udry JR. Validation of a self-administered instrument to assess stage of adolescent development. J Youth Adolesc. 1980;9(3):271–80. [DOI] [PubMed] [Google Scholar]
  • 24.American Thoracic S Standardization of spirometry (1994 update). Am J Respir Crit Care Med. 1995;152:1107–36. [DOI] [PubMed] [Google Scholar]
  • 25.Hankinson JL, Odencrantz JR, Fedan KB. Spirometric reference values from a sample of the general u.s. population. Am J Respir Crit Care Med. 1999;159:179–87. [DOI] [PubMed] [Google Scholar]
  • 26.Goldman HI, Becklake MR. Respiratory Function Tests: Normal Values at Median Altitudes and the Prediction of Normal Results. Am Rev Tuberc. 1959;79(4):457–67. [DOI] [PubMed] [Google Scholar]
  • 27.Bhammar DM, Stickford JL, Bernhardt V, Babb TG. Verification of maximal oxygen uptake in obese and nonobese children. Med Sci Sports Exerc. 2017;49(4):702–10. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28.Hyatt RE. The Interrelationships of Pressure, Flow, and Volume During Various Respiratory maneuvers in Normal and Emphysematous Subjects. Am Rev Respir Dis. 1961;83:676–83. [DOI] [PubMed] [Google Scholar]
  • 29.Milic-Emili J Expiratory flow limitation: Detection and clinical implications: Roger S. Mitchell lecture. Chest. 2000;117(5):S219. [DOI] [PubMed] [Google Scholar]
  • 30.Johnson BD, Saupe KW, Dempsey JA. Mechanical constraints on exercise hyperpnea in endurance athletes. J Appl Physiol Respir Environ Exerc Physiol. 1992;73:874–86. [DOI] [PubMed] [Google Scholar]
  • 31.Koulouris N, Valta P, Lavoie A et al. A simple method to detect expiratory flow limitation during spontaneous breathing. Eur Respir J. 1995;8(2):306–13. [DOI] [PubMed] [Google Scholar]
  • 32.Koulouris NG, Dimopoulou I, Valta P, Finkelstein R, Cosio MG, Milic-Emili J. Detection of expiratory flow limitation during exercise in COPD patients. J Appl Physiol Respir Environ Exerc Physiol. 1997;82:723–31. [DOI] [PubMed] [Google Scholar]
  • 33.American Thoracic S. Lung function testing: Selection of reference values and interpretive strategies. Am Rev Respir Dis. 1991;144:1202–18. [DOI] [PubMed] [Google Scholar]
  • 34.Parsons JP, Hallstrand TS, Mastronarde JG et al. An official American Thoracic Society clinical practice guideline: exercise-induced bronchoconstriction. Am J Respir Crit Care Med. 2013;187(9):1016–27. [DOI] [PubMed] [Google Scholar]
  • 35.Bland JM, Altman DG. Statistical methods for assessing agreement between two methods of clinical measurement. Lancet. 1986;1:307–10. [PubMed] [Google Scholar]
  • 36.Varga J, Casaburi R, Ma S et al. Relation of concavity in the expiratory flow-volume loop to dynamic hyperinflation during exercise in COPD. Respir Physiol Neurobiol. 2016;234:79–84. [DOI] [PubMed] [Google Scholar]
  • 37.Johnson BD, Weisman IM, Zeballos RJ, Beck KC. Emerging concepts in the evaluation of ventilatory limitation during exercise: the exercise tidal flow-volume loop. Chest. 1999;116(2):488–503. [DOI] [PubMed] [Google Scholar]
  • 38.Godfrey S Exercise-induced asthma—clinical, physiological, and therapeutic implications. J Allergy Clin Immunol. 1975;56(1):1–17. [DOI] [PubMed] [Google Scholar]
  • 39.Jensen JI, Lyager S, Pedersen OF. The relationship between maximal ventilation, breathing pattern and mechanical limitation of ventilation. J Physiol. 1980;309:521–32. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 40.Johnson BD, Scanlon PD, Beck KC. Regulation of ventilatory capacity during exercise in asthmatics. J Appl Physiol Respir Environ Exerc Physiol. 1995;79:892–901. [DOI] [PubMed] [Google Scholar]
  • 41.Mead J Dysanapsis in normal lungs assessed by the relationship between maximal flow, static recoil, and vital capacity. Am Rev Respir Dis. 1980;121:339–42. [DOI] [PubMed] [Google Scholar]
  • 42.Cooper DM, Kaplan MR, Baumgarten L, Weiler-Ravell D, Whipp BJ, Wasserman K. Coupling of ventilation and CO2 production during exercise in children. Pediatr Res. 1987;21:568–72. [DOI] [PubMed] [Google Scholar]
  • 43.Stubbing DG, Pengelly LD, Morse JL, Jones NL. Pulmonary mechanics during exercise in normal males. J Appl Physiol Respir Environ Exerc Physiol. 1980;49:506–10. [DOI] [PubMed] [Google Scholar]
  • 44.Babb TG, Rodarte JR. Lung-Volumes during Low-Intensity Steady-State Cycling. J Appl Physiol. 1991;70(2):934–7. [DOI] [PubMed] [Google Scholar]
  • 45.Younes M, Kivinen G. Respiratory mechanics and breathing pattern during and following maximal exercise. J Appl Physiol Respir Environ Exerc Physiol. 1984;57:1773–82. [DOI] [PubMed] [Google Scholar]

RESOURCES