Abstract
Background:
Pulmonary hypertension (PH) restricts the ability to engage in physical activity and decreases longevity. We examined the impact of aerobic exercise training on function and quality of life in patients with World Health Organization group 1 PH.
Methods:
Patients were randomized to a 10-week education only (EDU) or education/exercise combined (EXE) group. The exercise program consisted of 24-30 sessions of treadmill walking for 30-45 min per session at 70% to 80% of heart rate reserve. Outcome variables included changes in 6-min walk test (6MWT) distance, time to exercise intolerance, peak work rate (WR) from a cardiopulmonary treadmill test, and quality-of-life measures, including the Short Form Health Survey, version 2 (SF-36v2) and Cambridge Pulmonary Hypertension Outcome Review (CAMPHOR).
Results:
Data are presented as mean ± SD. Twenty-three women (age, 54 ± 11 years; BMI, 31 ± 7 kg/m2) were randomized to the EDU (n = 13) or EXE (n = 10) groups. Following 10 weeks of intervention, patients in the EXE group demonstrated an improvement in 6MWT distance (56 ± 45 m; P = .002), increased time to exercise intolerance (1.9 ± 1.3 min; P = .001), and peak WR (26 ± 23 W; P = .004). Additionally, the EXE group scored significantly (P < .050) better on six of the eight scales on SF-36v2, and five of the six scales on CAMPHOR. In contrast, no significant improvement was observed for any of the outcome measures following EDU. No adverse events were noted in either group.
Conclusion:
Ten weeks of brisk treadmill walking improved 6MWT distance, cardiorespiratory function, and patient-reported quality of life in female patients with group 1 PH.
Trial registry:
ClinicalTrials.gov; No.: NCT00678821; URL: clinicaltrials.gov
Pulmonary hypertension (PH) is mediated through severe microvascular dysfunction, which restricts pulmonary circulation1 and attenuates cardiorespiratory function,2,3 ultimately resulting in right-sided heart failure and decreased longevity.4‐6 Patients with PH frequently experience poor health-related quality of life (HRQoL)7‐9 and limitations in their ability to engage in physical activity.10,11 There are currently nine US Food and Drug Administration-approved medications available for the treatment of PH. While PH-specific therapies have improved longevity,12‐15 prognosis is still poor,16 and the impact of these therapies on HRQoL is still not well characterized.6,17,18 All but one of these medications were approved for use based, at least in part, on moderate improvements on the 6-min walk test (6MWT), which is often used as a surrogate measure of exercise capacity,11,19 HRQoL,18 and longevity.11,19
Regular participation in an aerobic exercise training program is well recognized to improve both cardiorespiratory function20 and overall HRQoL21 in the general population. This includes subsets of patients with illnesses that severely impair cardiorespiratory function.21,22 The importance of improving cardiorespiratory function through physical activity is further highlighted by the negative association between exercise capacity and mortality in patients with cardiovascular disease.23,24 In fact, medically supervised aerobic exercise is often encouraged for patients with cardiovascular diseases,22,25 chronic heart failure,26,27 COPD,28 and asthma,29 with very few adverse events.25,30‐32 Conversely, patients with PH are often advised to limit their participation in exercise and strenuous activities due to concerns over precipitous rises in the pulmonary pressures and the possibility of right-sided heart failure.10 There is also some uncertainty regarding the ability of patients who have PH to actually obtain clinically important cardiorespiratory benefits from participation in aerobic exercise. Several recent studies, however, have provided evidence that exercise training may be safe for many of these patients.9,33‐37 Two of these studies9,33 reported clinically important improvements in 6MWT distance, peak oxygen uptake (O2) during supine cardiopulmonary exercise tests, and patient-reported HRQoL following intensive, inpatient, aerobic exercise programs. Despite the encouraging findings of these studies, uncertainty persists regarding the applicability of their interventional methods to current outpatient pulmonary and cardiac rehabilitation standards of care.
We have undertaken a phase 2b, randomized clinical trial aimed at examining safety, clinical outcomes, and mechanisms of adaptation associated with participation in vigorous, medically supervised, aerobic exercise training in patients with PH. We hypothesized that vigorous treadmill walking as a rehabilitation program would be safe and beneficial in this population. The outcomes were achieved using an outpatient, treadmill exercise training protocol that can be easily adopted by most pulmonary and cardiac rehabilitation programs.
Materials and Methods
Patients
Patients with World Health Organization (WHO) group 1 PH were recruited from local outpatient clinics and enrolled between September 2009 and October 2011. Men and women were eligible if they were between 21 and 82 years of age, had PH diagnosed by a resting mean pulmonary arterial pressure ≥ 25 mm Hg as measured by right-sided heart catheterization, were on stable PH therapies for at least 3 months, were sedentary, and had no pulmonary rehabilitation for 6 months prior to enrollment. To avoid “ceiling” or “floor” effects, patients were excluded if they were classified as WHO and New York Heart Association (NYHA) functional class I and could walk > 400 m during a 6MWT, or classified as functional class IV and could not walk > 50 m during a 6MWT. Additional exclusion criteria included FEV1/FVC ratio ≤ 65%; history of ischemic heart disease; ejection fraction < 40%; documented pulmonary capillary wedge pressure ≥ 18 mm Hg; significant hepatic, renal, or mitochondrial dysfunctions; severe psychiatric disease; use of medications that may limit exercise capacity or ability to adapt to exercise training; antiretroviral therapies; illicit drugs; tobacco use; or pregnancy. Signed informed consent was obtained from the patients prior to any study procedures and data collection. Patients were also told to refrain from engaging in additional exercise not related to the protocol and/or activities that deviated from their regular routine. This protocol was approved by the respective institutional review boards (US National Institutes of Health: number 08-CC-0133; Inova Fairfax Hospital: number 08.129; and George Mason University: number 6057) before recruitment of patients or implementation of procedures.
Study Design
Patients’ study eligibility was determined through medical history and physical examination. Afterward, patients completed a symptom-limited, baseline cardiopulmonary exercise test (CPET) on a treadmill; the 6MWT; and HRQoL questionnaires to determine their cardiorespiratory function, functional capacity, and patient-reported HRQoL, respectively. The CPET was a modified Naughton protocol that increased the speed or grade of the treadmill every 2 min (e-Table 1 (323.9KB, pdf) ). The first three stages were increased gradually so that the metabolic equivalent (MET) requirements would be small.38 This allowed patients with severe exercise intolerance to complete at least two to three stages prior to the introduction of a grade component. The rest of the protocol increased speed or grade to approximate one MET increment per stage. This protocol is similar to previous studies38,39; however, walking at 2 miles per h was extended (stage 6) by increasing grade rather than speed. A standardized 6MWT was conducted around a circular “course” measuring 80 m, rather than a hallway, as described in the American Thoracic Society Guidelines.40 Investigators administering the CPET, 6MWT, and questionnaires were blind to randomization at baseline. Patients using supplemental oxygen (O2) at the baseline visit performed the CPET breathing a hyperoxic gas mixture (fraction of inspired O2 of 40%). During the subsequent 6MWT, the O2 flow rate was set at 6 L/min. Follow-up visits for these patients were performed using the same concentration of supplemental O2. Patients were then randomized to either an aerobic exercise training (AET) plus education intervention (education/exercise combined [EXE]) group or an education-only (EDU) control group. Identical educational lectures were given to both groups over 10 weeks. The education sessions consisted of weekly 1-hour lectures on anatomy and physiology, lung disease processes, medication use, oxygen therapy, sleep disorders, preventing infection, airway clearance, interpreting pulmonary function tests, energy conservation, panic control, relaxation techniques, breathing retraining, community resources, advance directives, social well being, nutrition, and benefits of exercise. Only patients in the EXE group participated in 24-30 additional sessions of medically supervised treadmill walking for 30-45 min per session over the same 10-week period. A target exercise intensity of 70% to 80% of each patient’s heart rate (HR) reserve obtained from the baseline CPET was used to guide each exercise session. Target HR range was calculated as: 0.7 and 0.8 × (peak HR − resting HR) + (resting HR), in accordance with the method of Karvonen.41 Treadmill speed and/or grade were continuously adjusted to keep each patient within or as close as possible to their target HR range. Perceived dyspnea, and exertion, O2 saturation, and HR were continuously monitored throughout the sessions. The CPET, 6MWT, and HRQoL questionnaires were repeated following the 10-week intervention period in both groups.
Outcome Measures
The primary outcome for this study was the change in 6MWT distance. Secondary outcomes included measures obtained from CPET, such as time to exercise intolerance, O2, time at anaerobic threshold (AT), peak work rate (WR), peak MET as calculated from the speed and grade of the final CPET stage achieved, peak ventilatory efficiency for CO2 (E/CO2), and peak end-tidal CO2 (PETCO2). Gas exchange data were obtained using the MedGraphics CardiO2 Ultima CPET system (Medical Graphics Corp). Peak O2 was determined as an average of the last eight breaths during the last completed stage of the modified Naughton, or the patients’ point of maximal exertion, whichever was higher. The AT was identified by V-slope 42 of continuous breath-by-breath O2 and expired minute volume measurements. Other secondary outcome measures included changes in patients’ stroke volume (SV), cardiac output (Qt), and cardiac index (QI), as measured by bioimpedance cardiography (PhysioFlow PF-05; Manatec Biomedical). Arteriovenous O2 difference was calculated in volume-percent units as the quotient of O2 and Qt. General HRQoL was assessed quantitatively using the Short Form 36 Health Survey, version 2 (SF-36v2), and disease-specific HRQoL was assessed by the Cambridge Pulmonary Hypertension Outcome Review (CAMPHOR), which has been validated in the United States.43
Statistical Analysis
Baseline characteristics of EXE and EDU groups were compared using two-sample t tests; categorical variables were examined by χ2 tests. Paired t tests were used to compare within-group differences, and two-sample t tests were used for determination of between-group differences. If the test for normality (Shapiro-Wilke) was not met, a Wilcoxon signed-rank test and Mann-Whitney rank sum test was performed instead. A subsequent intention-to-treat analysis was conducted in which the preintervention scores were imputed as the postintervention scores when data were missing at follow-up. Values of P ≤ .05 (one-tailed) were accepted as statistically significant. All analyses were performed using SigmaPlot, version 12 (Systat Software, Inc). Central tendencies are presented as mean ± SD.
Results
Of 302 potential patients screened, 26 patients performed baseline testing and were randomly assigned to EXE or EDU (Fig 1). Two of the 26 patients enrolled were subsequently excluded due to medication changes that occurred during participation in the study, and one patient failed to complete the minimum number of training sessions. Therefore, data from the 23 patients in the EXE and EDU groups (Table 1) were included in the analyses. By chance, all study participants were women: 48% were black, and 39% were white. The most common etiology was PH associated with connective tissue diseases (74%), followed by idiopathic PH (22%). Almost all patients were treated with PH medications prescribed as triple- (39%), dual- (26%), or monotherapy (30%). The majority of patients were classified as WHO/NYHA functional class II and III (91%). Baseline cardiac hemodynamics and lung function (as measured in the most recent cardiac catheterization and pulmonary function test before enrollment) were not statistically different between groups. Groups were also similar in terms of 6MWT distance and cardiorespiratory function at baseline.
Figure 1.
Participant flow through the stages of the randomized trial.
Table 1.
—Baseline Characteristics of Study Patients
Randomized Group |
|||
Characteristics | EXE Group (n = 10) | EDU Group (n = 13) | P Value |
Age, y | 53.0 (13.0) | 55.5 (8.5) | .295 |
Female patient, No. (%) | 10 (100.0) | 13 (100.0) | 1.00 |
Race/ethnicity, No. (%) | .195 | ||
White | 6 (60.0) | 3 (23.1) | |
Black | 3 (30.0) | 8 (61.5) | |
Other | 1 (10.0) | 2 (15.4) | |
BMI, kg/m2 | 30.2 (7.0) | 31.8 (7.4) | .307 |
Supplemental O2, No. (%) | 4 (40.0) | 4 (30.8) | .685 |
WHO group 1 PH etiology, No. (%) | .643 | ||
Idiopathic | 2 (20.0) | 3 (23.1) | |
Drug-induced | 0 | 1 (7.7) | |
Associated with connective tissue diseases | |||
Scleroderma | 5 (50.0) | 5 (38.5) | |
Lupus | 1 (10.0) | 1 (7.7) | |
Sjögren syndrome | 1 (10.0) | 1 (7.7) | |
Rheumatoid arthritis | 0 | 1 (7.7) | |
Mixed connective tissue disorder | 1 (10.0) | 1 (7.7) | |
NYHA/WHO functional classification, No. (%) | .376 | ||
Class I | 1 (10.0) | 0 | |
Class II | 4 (40.0) | 8 (61.5) | |
Class III | 4 (40.0) | 5 (38.5) | |
Class IV | 1 (10.0) | 0 | |
Drug combination therapy, No. (%) | .191 | ||
None | 0 | 1 (7.7) | |
Monotherapy | 5 (50.0) | 2 (15.4) | |
Dual therapy | 1 (10.0) | 5 (38.5) | |
Triple therapy | 4 (40.0) | 5 (38.5) | |
Cardiac catheterization | |||
Mean pulmonary artery pressure, mm Hg | 40.3 (13.8) | 43.8 (14.2) | .281 |
Right atrial pressure, mm Hg | 8.6 (7.2) | 9.0 (6.4) | .298 |
Pulmonary capillary wedge pressure, mm Hg | 9.9 (2.8) | 9.4 (2.9) | .348 |
Pulmonary vascular resistance, dynes/s/cm5 | 508 (293) | 583 (409) | .299 |
Cardiac index, L/min/m2 | 3.3 (1.6) | 2.9 (0.7) | .402 |
Pulmonary function test | |||
FVC, % predicted | 74.3 (17.4) | 65.6 (11.3) | .080 |
FEV1, % predicted | 72.4 (15.8) | 63.5 (13.1) | .050 |
Ratio FEV1/FVC, % | 81.5 (13.6) | 75.8 (7.7) | .107 |
Performance measures | |||
6MWT distance, m | 411 (73) | 377 (97) | .183 |
CPET variables | |||
Time to exercise intolerance, min | 11.1 (3.1) | 9.7 (3.3) | .151 |
Peak O2, mL/kg/min | 17.6 (5.7) | 14.7 (5.1) | .111 |
Peak WR, W | 102 (41) | 87 (50) | .229 |
Peak MET | 5.3 (1.3) | 4.8 (1.6) | .247 |
Time at AT, min | 4.4 (2.2) | 4.2 (2.3) | .396 |
Data given as mean (SD) unless otherwise indicated. 6MWT = 6-min walk test; AT = anaerobic threshold; CPET = cardiopulmonary exercise test; EDU = education only; EXE = education/exercise combined; MET = metabolic equivalent calculated from speed and grade at peak exercise; NYHA = New York Heart Association; O2 = oxygen uptake; WHO = World Health Organization; WR = work rate.
Patients’ level of activity was determined from the self-reported International Physical Activity Questionnaire that records the amount of physical activity performed within 7 days of pretesting and posttesting visits. Analysis of the questionnaire confirmed that patients in the EDU group did not engage in extra activity during the 10-week period, with similar total MET-min/wk being reported at baseline and 10 weeks in this group (1,335 ± 1,297 vs 1,633 ± 1,418 MET-min, P = .247). In contrast, the EXE group reported significantly more activity being performed after AET (1,137 ± 1,226 vs 3,009 ± 1,799 MET-min, P = .002). A summary of the training intensity achieved by EXE during 10 weeks of treadmill AET is shown in Table 2. Patients attended 28 ± 2 sessions and exercised for 1,081 ± 92 min over the course of 10 weeks. Seven of the 10 patients in the EXE group achieved and maintained their target HR in each of the AET sessions. The three remaining patients achieved 52% to 63% of their HR reserve, approximating 63% to 74% of their peak O2 at baseline. There were no serious adverse events related to the AET sessions.
Table 2.
—Training Summary of Patients in the EXE Group
Target Training HR (70%-80% HR Reserve) |
Training HR |
||||||||
Patient | Total Sessions | Total Time, min | Lower | Upper | Lower | Upper | Mean | % HR Reserve | Maximum RPE |
1 | 30 | 1,030 | 122 | 127 | 108 | 139 | 127 | 80 | 3 |
2 | 24 | 931 | 135 | 141 | 132 | 144 | 137 | 73 | 5 |
3 | 30 | 1,155 | 116 | 122 | 114 | 125 | 120 | 77 | 4 |
4 | 28 | 1,109 | 124 | 129 | 120 | 135 | 125 | 72 | 3 |
5 | 28 | 1,118 | 139 | 146 | 133 | 152 | 144 | 77 | 4 |
6 | 30 | 1,200 | 137 | 144 | 126 | 159 | 140 | 74 | 8 |
7 | 27 | 1,065 | 115 | 120 | 110 | 124 | 118 | 76 | 5 |
8 | 30 | 1,200 | 111 | 116 | 79 | 120 | 102 | 52 | 3 |
9 | 26 | 1,023 | 126 | 133 | 95 | 135 | 121 | 63 | 3 |
10 | 25 | 977 | 143 | 151 | 99 | 151 | 130 | 54 | 7 |
Mean | 27.8 | 1,080.8 | 126.8 | 132.9 | 111.6 | 138.4 | 126.4 | 69.8 | 4.5 |
SD | 2.3 | 91.6 | 11.2 | 12.1 | 17.2 | 13.1 | 12.3 | 10.0 | 1.8 |
HR = heart rate (beats/min); RPE = Modified Borg rating of perceived exertion. See Table 1 legend for expansion of other abbreviation.
Outcome Measures
Ninety percent of patients in the EXE group demonstrated an increase in 6MWT distance. Sixty percent increased their distance by ≥ 40 m (Fig 2). Overall, exercise training resulted in a significant (P = .002) improvement in 6MWT distance in EXE, whereas no significant change in 6MWT was observed for EDU (Table 3). Large postintervention increases in CPET time to exercise intolerance (P = .001), time to AT(P = .053), peak WR (P = .004), peak METs (P = .004), and peak PETCO2 (P = .020) were also observed in the EXE group. No significant changes in peak HR, SV, Qt, arteriovenous O2 difference, and QI were observed in either group (Table 3). Three patients in the EXE group were excluded, resulting in an uneven comparison between the EXE and EDU groups (Fig 1). However, the intention-to-treat analysis revealed that increases in 6MWT distance (43 ± 46 m), time to exercise intolerance (1.5 ± 1.4 min), and peak WR (20 ± 23 W) remained significant in the EXE group.
Figure 2.
Distribution of the improvement observed in the 6MWT distance for both groups. Black bars represent patients in the education/exercise combined (EXE) group and gray bars represent patients in the education only (EDU) group. Dashed black line represents the minimally important difference for 6MWT distance in patients with pulmonary hypertension.48 6MWT = 6-min walk test.
Table 3.
—Outcome Measures Across Intervention Groups
EXE Group |
EDU Group |
|||||||
Outcome Measures | Preintervention | Postintervention | P Value | Preintervention | Postintervention | P Value | Between-Group Difference, Mean (95% CI) | P Value |
6MWT distance, m | 411 (73) | 467 (86) | .002 | 377 (97) | 389 (107) | .134 | 45 (9-80) | .008 |
Time to exercise intolerance, min | 11.1 (2.0) | 13.0 (3.1) | <.001 | 9.7 (3.3) | 10.1 (3.7) | .132 | 1.5 (0.4-2.6) | .004 |
Peak O2, mL/kg/min | 17.5 (5.7) | 18.9 (10.3) | .348 | 14.7 (5.1) | 15.1 (5.7) | .318 | 0.9 (−3.2 to 5.0) | .463 |
Time at AT, min | 4.4 (2.2) | 5.6 (2.3) | .053 | 4.2 (2.3) | 4.4 (2.6) | .301 | 0.9 (−0.5 to 2.4) | .097 |
Peak WR, W | 102 (41) | 127 (54) | .004 | 87 (50) | 97 (56) | .084 | 16 (−6 to 37) | .071 |
Peak MET | 5.3 (1.3) | 6.3 (1.8) | .004 | 4.8 (1.6) | 5.2 (1.8) | .110 | 0.7 (0.0-1.5) | .027 |
E/CO2 slope at peak O2 | 40.7 (8.8) | 40.6 (9.5) | .462 | 35.9 (6.5) | 35.2 (6.1) | .218 | 0.6 (−1.9 to 2.1) | .315 |
PETCO2 at peak O2, mm Hg | 31.7 (6.5) | 33.4 (7.0) | .020 | 36.8 (6.8) | 37.6 (6.6) | .170 | 0.8 (−1.5 to 3.2) | .230 |
HR at peak O2, bpm | 140 (13) | 139 (24) | .467 | 133 (17) | 135 (12) | .191 | −3.1 (−13.8 to 7.7) | .279 |
SV at peak O2, mLab | 108 (28) | 98 (24) | .134 | 98 (28) | 98 (26) | .464 | 11 (−11 to 32) | .151 |
Qt at peak O2, L/minab | 15.6 (4.7) | 14.4 (4.4) | .238 | 13.2 (3.9) | 13.7 (2.8) | .251 | 1.7 (−1.9 to 5.3) | .162 |
a-vO2 Diff at peak O2ab | 8.7 (3.9) | 9.3 (2.4) | .274 | 10.2 (3.8) | 9.9 (2.9) | .367 | 1.0 (−4.7 to 6.6) | .361 |
QI at peak O2, L/min/m2ab | 8.3 (2.0) | 7.8 (2.0) | .282 | 6.8 (1.5) | 7.0 (1.0) | .233 | 0.8 (−1.1 to 2.6) | .191 |
Data given as mean (SD). a-vO2 Diff = arteriovenous oxygen difference; PETCO2 = expired end-tidal CO2; QI = cardiac index Qt = cardiac output; CO2 = expired CO2; Ve = ventilation; E/CO2 = ventilatory efficiency for CO2; SV = stroke volume. See Table 1 and 2 legends for expansion of other abbreviations.
Due to equipment malfunction, n = 8 for EXE.
Due to equipment malfunction, n = 9 for EDU.
Figure 3 displays the results from the SF-36v2 and CAMPHOR, where higher scores on SF-36v2 are indicative of better HRQoL and lower scores on CAMPHOR signify better HRQoL. Significant improvements in physical functioning, role limitations due to physical problems, general health perception, vitality, social functioning, and mental health categories of the SF-36v2 were observed in the EXE group. Significant changes in the SF-36v2 domains were not observed in the EDU group. CAMPHOR scores also improved following AET, when patients reported better HRQoL and reduction in symptoms experienced in all subdomains, including improved mood, increased energy, and less breathlessness. Only the function domain was unchanged in the EXE group; significant changes were not observed in the CAMPHOR for any domains in the EDU group. An intention-to-treat analysis in the EXE group still revealed significant improvements in the same domains of SF-36v2 and CAMPHOR as the per-protocol analysis.
Figure 3.
Health-related quality-of-life scores (SF-36v2 and CAMPHOR) for patients in the EXE group (left side) and EDU group (right side). White bars represent preintervention scores and black bars represent postintervention scores. Upright triangle symbols represent scores of SF-36v2 for the United States population.57 P values are given for all domains and * denotes significant difference (P < .05) from preintervention scores. CAMPHOR = Cambridge Pulmonary Hypertension Outcome Review; Gen Health = general health; Phys Func = physical functioning; SF-36v2 = Short Form 36 Health Survey, version 2; Social Func = social functioning. See Figure 2 legend for expansion of other abbreviations.
Discussion
Our results revealed significant improvements in functional capacity, cardiorespiratory function, and HRQoL following 10 weeks of medically supervised, outpatient, treadmill walking in patients with group 1 PH. The control group failed to demonstrate any improvements across these outcome variables. Our study confirms the finding of a clinically relevant improvement in 6MWT distance following AET. Further, the expression of METs based on the last stage attained in the CPET39 suggest that the higher METs attained by the EXE group following AET may be an indicator of improved hemodynamic parameters and lower mortality rate44 in these patients. A mean improvement of one MET following AET suggests that the risk of death for patients in the EXE group may have been reduced by as much as 17%.45 Findings of the current study suggest that supervised AET of relatively high intensity is safe and effective as a therapeutic adjunct for improving functional capacity, cardiorespiratory function, HRQoL, and possibly survival in patients with PH. One factor that differentiates this study from prior work9,33 is that the improvement was achieved in the context of a readily available and accessible outpatient pulmonary rehabilitation program.
The 6MWT distance is commonly used to assess functional capacity in patients with PH because it correlates with peak O2 achieved during CPET46 and may predict mortality.15,46,47 Some have suggested that achieving a 6MWT improvement ≥ 41 m may be an appropriate estimate of the minimally important improvement in distance for clinical significance.48 However, others have suggested that the 6MWT alone may not be robust enough to detect differences in treatment outcomes in certain conditions, for example, chronic heart failure.49 It is important to note that the present study also used CPET measurements. Indeed, CPET has been recommended over 6MWT for assessing cardiorespiratory changes in response to exercise training.50 The results from CPET in the present study mirrors that of the 6MWT findings in that the patients in the EXE group demonstrated significant improvements in both 6MWT distance and indices of cardiorespiratory function following AET, whereas the patients in the EDU group showed no significant difference in either assessment.
Patients with PH experience elevated E/CO2 ratios and lower PETCO2 at rest and at peak exercise compared with normal adults.51‐53 While this may be a result of ventilation/perfusion inequalities at the lung,2 this may also be reflective of increased ventilatory drives in these individuals.54 We did not observe a change in E/CO2 in the EXE group following AET; however, PETCO2 was significantly increased. This likely reflects the higher anaerobic cost and CO2 produced at the higher workloads attained following AET. PH patients are perhaps “used” to high ventilatory drives, and it is possible that AET may have improved their ability to expel CO2, thereby prolonging their time on the treadmill.
Findings of the current study were in agreement with previous studies, which specifically reported improvements in 6MWT distance,9,33,35‐37 peak WR,9,33 and patient-reported HRQoL.9,33,35 In a seminal study by Mereles et al,9 inpatients were randomized to either a nonexercising control group, or a 3-week intervention regimen of high-intensity interval training on a cycle ergometer (10-25 min/d, 7 d/wk) combined with flat or uphill walking (60 min/d; 5 d/wk). Patients in the exercise intervention group achieved clinically important increases in 6MWT distance and improvements in HRQoL, as well as small but significant increases in peak O2, peak WR, and WR at AT. However, CPETs were conducted in the supine position and peak HR was significantly higher after AET,9 making interpretation of the CPET findings difficult. A more recent, uncontrolled study by the same group with a larger sample size corroborated these findings and expanded the ability to generalize results across several WHO groups.33 In both studies, an additional 12-week regimen of cycling and walking appeared to result only in a maintenance effect of the initial intervention. Most patients with PH in the United States cannot be hospitalized for rehabilitation, creating uncertainty regarding the relevance of the findings to current clinical practice.
The approach used in the current study was different from the cited studies.9,33 Aerobic exercise training and education sessions were carried out in existing clinical pulmonary rehabilitation programs. The regimen provided 90-135 min/wk of AET over 10 weeks at an intensity commonly used in outpatient pulmonary and cardiac rehabilitation programs. Overall, patients in the EXE group completed approximately 1,080 min of AET at their training intensity over the 10 weeks compared with 1,110-1,425 min completed over the 3-week, inpatient, AET regimens in the previous reports.9,33 The majority of our patients had an increase in the 6MWT above what has previously been shown to be the minimal important distance.48 Additionally, there were significant improvements in HRQoL, CPET time to exercise intolerance, peak WR, and peak METs following AET. Although not statistically significant, the 1.4 mL/kg/min increase in peak O2 obtained by upright treadmill CPET in the current study was nearly identical to the significant increases in peak O2 obtained during supine CPET in previous reports.9,33 These results were obtained using only treadmill exercise to perform all CPET and AET sessions. Use of this single mode highlights the ease with which training and testing procedures similar to those used in this study can be implemented. Moreover, results of this study further demonstrate that METs calculated from treadmill speed and grade may be used to estimate cardiorespiratory fitness when measures of gas exchange are not available. The finding of neither a decrease in cardiac output nor the occurrence of a serious adverse event provides further evidence supporting the safety of AET for patients who have PH.
Based on significant improvements in the majority of the SF-36v2 domains, the current study suggests that overall HRQoL may be improved following 10 weeks of AET in patients with PH. This finding was again in agreement with previous reports.9,33 The current study expands the existing HRQoL information through a comparison of PH-specific, patient-reported HRQoL based on changes in the CAMPHOR. Patients in the EXE group showed improvements in PH-specific HRQoL, with patients reporting increased energy, improved mood, and less breathlessness following AET. These findings suggest that improved perception of HRQoL in domains specific to PH may accompany the enhanced physical capacity that follows AET.
This study had several limitations. First, our report was limited to patients with WHO group 1 PH of heterogeneous PH etiology, making extension of these results across various WHO clinical classifications difficult. Second, results of this study cannot be generalized across all WHO/NYHA functional classes due to the small sample size and delimitation to patients with functional classes II and III. In addition, by chance, only women met the criteria for inclusion and, thus, our results cannot be generalized to men. Some patients may develop a right-to-left shunt during exercise if a patent foramen ovale is present with greater pressure in the right vs left atrium.55 A persistent exercise-induced right-to-left shunt was recently suggested to predict poorer prognosis among patients with PH.56 The presence of exercise-induced right-to-left shunt could not be determined in this study and patients did not undergo follow-up right-sided heart catheterization. Inclusion of these measurements would provide additional information regarding right-sided heart function and hemodynamic changes that may occur following AET. Last, the current analysis may be underpowered with respect to the ability to observe significant increases in cardiorespiratory variables such as peak O2 and AT.
Conclusions
A vigorous, medically supervised, outpatient, treadmill walking program appears to be sufficient for improving functional capacity, cardiorespiratory function, and general medical and PH specific HRQoL in patients with group 1 PH. It appears that these improvements can be safely achieved at the training intensities, durations, and weekly frequencies that are standard in most pulmonary or cardiac rehabilitation programs. The long-term implications and durability of these improvements are yet to be determined.
Supplementary Material
Online Supplement
Acknowledgments
Author contributions: Drs Chan, Nathan, and Keyser serve as guarantors of the integrity of the manuscript.
Dr Chan: contributed to the initial conceptualization of the protocol, the research design, data analysis, interpretation of the results, and writing in all sections of the manuscript.
Dr Chin: contributed to data collection, analysis, and interpretation; writing and preparation of the results and discussion section of the manuscript; and overall production of the manuscript.
Ms Kennedy: contributed to subject recruitment, management of institutional review board documents, data collection, and writing and preparation of the method section of the manuscript.
Dr Woolstenhulme: contributed to subject recruitment, data collection and analysis, and writing and preparation of the introduction and methods sections of the manuscript.
Dr Nathan: contributed to the initial conceptualization of the protocol, the research design, data interpretation, and critically revised the manuscript.
Dr Weinstein: contributed to design of the health-related quality of life assessment methods, data analysis and interpretation, and critically revised the manuscript.
Ms Connors: contributed to the intervention oversight, data collection, and general feedback on the manuscript.
Dr Weir: contributed to subject recruitment and general feedback on the manuscript.
Mr Drinkard: contributed to data collection, laboratory operations oversight, and general feedback on the manuscript.
Dr Lamberti: contributed to medical oversight of the pulmonary rehabilitation program at Inova Fairfax Hospital and general feedback on the manuscript.
Dr Keyser: contributed to the initial conceptualization of the protocol, study design, data interpretation and analysis, oversight of study operations, and writing in all sections of the manuscript.
Financial/nonfinancial disclosures: The authors have reported to CHEST the following conflicts of interest: Dr Nathan has received research funding, has been a consultant, and is on the speaker’s bureau for Actelion Pharmaceuticals US Inc, Gilead Sciences Inc, and United Therapeutics Corporation. Dr Lamberti is on the speaker’s bureau for GlaxoSmithKline plc and Boehringer Ingelheim GmbH. The remaining authors have reported that no potential conflicts of interest exist with any companies/organizations whose products or services may be discussed in this article.
Role of sponsor: The sponsor had no role in the design of the study, the collection and analysis of the data, or in the preparation of the manuscript.
Other contributions: We would like to thank the pulmonary rehabilitation staff at Inova Fairfax Hospital (Sidnie Hess, RRT; Susan Farrell, RRT; and Jill Baker, MS, RRT) for their help in performing the interventions, and Melissa Zuniga, BSN, for recruitment efforts. We would also like to acknowledge Mary Kim, MD, and Beth Kvochak, MS, for assistance provided during data collection at the US National Institutes of Health.
Additional information: The e-Table can be found in the “Supplemental Materials” area of the online article.
Abbreviations
- 6MWT
6-min walk test
- AET
aerobic exercise training
- AT
anaerobic threshold
- CAMPHOR
Cambridge Pulmonary Hypertension Outcome Review
- CPET
cardiopulmonary exercise test
- EDU
education only
- EXE
education/exercise combined
- HR
heart rate
- HRQoL
health-related quality of life
- IPAQ
International Physical Activity Questionnaire
- MET
metabolic equivalent
- NYHA
New York Heart Association
- O2
oxygen
- PETCO2
end-tidal partial pressure of CO2
- PH
pulmonary hypertension
- QI
cardiac index
- Qt
cardiac output
- RPE
Modified Borg Rating of Perceived Exertion
- SF-36v2
Short Form 36 Health Survey, version 2
- SV
stroke volume
- CO2
CO2 expired
- E
ventilation
- O2
oxygen uptake
- WHO
World Health Organization
Footnotes
Funding/Support: This work was supported by the US National Institutes of Health [Intramural Funds 1 Z01 CL060068-05 CC].
Reproduction of this article is prohibited without written permission from the American College of Chest Physicians. See online for more details.
References
- 1.Frumkin LR. The pharmacological treatment of pulmonary arterial hypertension. Pharmacol Rev. 2012;64(3):583-620 [DOI] [PubMed] [Google Scholar]
- 2.Arena R, Lavie CJ, Milani RV, Myers J, Guazzi M. Cardiopulmonary exercise testing in patients with pulmonary arterial hypertension: an evidence-based review. J Heart Lung Transplant. 2010;29(2):159-173 [DOI] [PubMed] [Google Scholar]
- 3.Arena R. Exercise testing and training in chronic lung disease and pulmonary arterial hypertension. Prog Cardiovasc Dis. 2011;53(6):454-463 [DOI] [PubMed] [Google Scholar]
- 4.Raymond RJ, Hinderliter AL, Willis PW, IV, et al. Echocardiographic predictors of adverse outcomes in primary pulmonary hypertension. J Am Coll Cardiol. 2002;39(7):1214-1219 [DOI] [PubMed] [Google Scholar]
- 5.D’Alonzo GE, Barst RJ, Ayres SM, et al. Survival in patients with primary pulmonary hypertension. Results from a national prospective registry. Ann Intern Med. 1991;115(5):343-349 [DOI] [PubMed] [Google Scholar]
- 6.McLaughlin VV, Archer SL, Badesch DB, et al. ; ACCF/AHA ACCF/AHA 2009 expert consensus document on pulmonary hypertension: a report of the American College of Cardiology Foundation Task Force on expert consensus documents and the American Heart Association developed in collaboration with the American College of Chest Physicians, American Thoracic Society, Inc., and the Pulmonary Hypertension Association. Circulation. 2009;119(16):2250-2294 [DOI] [PubMed] [Google Scholar]
- 7.Taichman DB, Shin J, Hud L, et al. Health-related quality of life in patients with pulmonary arterial hypertension. Respir Res. 2005;6:92. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Shafazand S, Goldstein MK, Doyle RL, Hlatky MA, Gould MK. Health-related quality of life in patients with pulmonary arterial hypertension. Chest. 2004;126(5):1452-1459 [DOI] [PubMed] [Google Scholar]
- 9.Mereles D, Ehlken N, Kreuscher S, et al. Exercise and respiratory training improve exercise capacity and quality of life in patients with severe chronic pulmonary hypertension. Circulation. 2006;114(14):1482-1489 [DOI] [PubMed] [Google Scholar]
- 10.Desai SA, Channick RN. Exercise in patients with pulmonary arterial hypertension. J Cardiopulm Rehabil Prev. 2008;28(1):12-16 [DOI] [PubMed] [Google Scholar]
- 11.Paolillo S, Farina S, Bussotti M, et al. Exercise testing in the clinical management of patients affected by pulmonary arterial hypertension. Eur J Cardiovasc Prev Rehabil. 2012;19(5):960-971 [DOI] [PubMed] [Google Scholar]
- 12.Benza RL, Miller DP, Gomberg-Maitland M, et al. Predicting survival in pulmonary arterial hypertension: insights from the Registry to Evaluate Early and Long-Term Pulmonary Arterial Hypertension Disease Management (REVEAL). Circulation. 2010;122(2):164-172 [DOI] [PubMed] [Google Scholar]
- 13.Thenappan T, Shah SJ, Rich S, Tian L, Archer SL, Gomberg-Maitland M. Survival in pulmonary arterial hypertension: a reappraisal of the NIH risk stratification equation. Eur Respir J. 2010;35(5):1079-1087 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Thenappan T, Glassner C, Gomberg-Maitland M. Validation of the pulmonary hypertension connection equation for survival prediction in pulmonary arterial hypertension. Chest. 2012;141(3):642-650 [DOI] [PubMed] [Google Scholar]
- 15.Humbert M, Sitbon O, Chaouat A, et al. Survival in patients with idiopathic, familial, and anorexigen-associated pulmonary arterial hypertension in the modern management era. Circulation. 2010;122(2):156-163 [DOI] [PubMed] [Google Scholar]
- 16.McLaughlin VV. Looking to the future: a new decade of pulmonary arterial hypertension therapy. Eur Respir Rev. 2011;20(122):262-269 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Taichman DB. Therapy for pulmonary arterial hypertension: the more, the merrier?. Ann Intern Med. 2008;149(8):583-585 [DOI] [PubMed] [Google Scholar]
- 18.Chen H, Taichman DB, Doyle RL. Health-related quality of life and patient-reported outcomes in pulmonary arterial hypertension. Proc Am Thorac Soc. 2008;5(5):623-630 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.McLaughlin VV, Presberg KW, Doyle RL, et al. ; American College of Chest Physicians Prognosis of pulmonary arterial hypertension: ACCP evidence-based clinical practice guidelines. Chest. 2004;126(1 Suppl):78S-92S [DOI] [PubMed] [Google Scholar]
- 20.Jones AM, Carter H. The effect of endurance training on parameters of aerobic fitness. Sports Med. 2000;29(6):373-386 [DOI] [PubMed] [Google Scholar]
- 21.Mitchell T, Barlow CE. Review of the role of exercise in improving quality of life in healthy individuals and in those with chronic diseases. Curr Sports Med Rep. 2011;10(4):211-216 [DOI] [PubMed] [Google Scholar]
- 22.Thompson PD, Buchner D, Piña IL, et al. Exercise and physical activity in the prevention and treatment of atherosclerotic cardiovascular disease. Arterioscler Thromb Vasc Biol. 2003;23(8):1319-1321 [DOI] [PubMed] [Google Scholar]
- 23.Gulati M, Black HR, Shaw LJ, et al. The prognostic value of a nomogram for exercise capacity in women. N Engl J Med. 2005;353(5):468-475 [DOI] [PubMed] [Google Scholar]
- 24.Myers J, Prakash M, Froelicher V, Do D, Partington S, Atwood JE. Exercise capacity and mortality among men referred for exercise testing. N Engl J Med. 2002;346(11):793-801 [DOI] [PubMed] [Google Scholar]
- 25.Perk J, De Backer G, Gohlke H, et al. ; Authors/Task Force Members ; Other experts who contributed to parts of the guidelines ; ESC Committee for Practice Guidelines (CPG) ; Document Reviewers European guidelines on cardiovascular disease prevention in clinical practice (version 2012): The Fifth Joint Task Force of the European Society of Cardiology and Other Societies on Cardiovascular Disease Prevention in Clinical Practice (constituted by representatives of nine societies and by invited experts). Developed with the special contribution of the European Association for Cardiovascular Prevention & Rehabilitation (EACPR). Eur Heart J. 2012;33(13):1635-1701 [DOI] [PubMed] [Google Scholar]
- 26.Piepoli MF, Conraads V, Corrà U, et al. Exercise training in heart failure: from theory to practice. A consensus document of the Heart Failure Association and the European Association for Cardiovascular Prevention and Rehabilitation. Eur J Heart Fail. 2011;13(4):347-357 [DOI] [PubMed] [Google Scholar]
- 27.Hunt SA, Abraham WT, Chin MH, et al. ; American College of Cardiology Foundation ; American Heart Association 2009 Focused update incorporated into the ACC/AHA 2005 Guidelines for the Diagnosis and Management of Heart Failure in Adults A Report of the American College of Cardiology Foundation/American Heart Association Task Force on Practice Guidelines Developed in Collaboration With the International Society for Heart and Lung Transplantation. J Am Coll Cardiol. 2009;53(15):e1-e90 [DOI] [PubMed] [Google Scholar]
- 28.Ries AL, Bauldoff GS, Carlin BW, et al. Pulmonary rehabilitation: Joint ACCP/AACVPR evidence-based clinical practice guidelines. Chest. 2007;131(suppl 5):4S-42S [DOI] [PubMed] [Google Scholar]
- 29.Ram FSF, Robinson S, Black Peter N, Picot J. Physical training for asthma. Cochrane Database Syst Rev. 2005;4:CD001116. [DOI] [PubMed] [Google Scholar]
- 30.Casaburi R, ZuWallack R. Pulmonary rehabilitation for management of chronic obstructive pulmonary disease. N Engl J Med. 2009;360(13):1329-1335 [DOI] [PubMed] [Google Scholar]
- 31.Eves ND, Davidson WJ. Evidence-based risk assessment and recommendations for physical activity clearance: respiratory disease (1) (1) This paper is one of a selection of papers published in the Special Issue entitled Evidence-based risk assessment and recommendations for physical activity clearance, and has undergone the Journal’s usual peer-review process. Appl Physiol Nutr Metab. 2011;36(suppl 1):S80-S100 [DOI] [PubMed] [Google Scholar]
- 32.O’Connor CM, Whellan DJ, Lee KL, et al. ; HF-ACTION Investigators Efficacy and safety of exercise training in patients with chronic heart failure: HF-ACTION randomized controlled trial. JAMA. 2009;301(14):1439-1450 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33.Grünig E, Lichtblau M, Ehlken N, et al. Safety and efficacy of exercise training in various forms of pulmonary hypertension. Eur Respir J. 2012;40(1):84-92 [DOI] [PubMed] [Google Scholar]
- 34.de Man FS, Handoko ML, Groepenhoff H, et al. Effects of exercise training in patients with idiopathic pulmonary arterial hypertension. Eur Respir J. 2009;34(3):669-675 [DOI] [PubMed] [Google Scholar]
- 35.Shoemaker MJ, Wilt JL, Dasgupta R, Oudiz RJ. Exercise training in patients with pulmonary arterial hypertension: a case report. Cardiopulm Phys Ther J. 2009;20(4):12-18 [PMC free article] [PubMed] [Google Scholar]
- 36.Uchi M, Saji T, Harada T. Feasibility of cardiopulmonary rehabilitation in patients with idiopathic pulmonary arterial hypertension treated with intravenous prostacyclin infusion therapy [in Japanese]. J Cardiol. 2005;46(5):183-193 [PubMed] [Google Scholar]
- 37.Mainguy V, Maltais F, Saey D, et al. Effects of a rehabilitation program on skeletal muscle function in idiopathic pulmonary arterial hypertension. J Cardiopulm Rehabil Prev. 2010;30(5):319-323 [DOI] [PubMed] [Google Scholar]
- 38.Patterson JA, Naughton J, Pietras RJ, Gunnar RM. Treadmill exercise in assessment of the functional capacity of patients with cardiac disease. Am J Cardiol. 1972;30(7):757-762 [DOI] [PubMed] [Google Scholar]
- 39.Gomberg-Maitland M, Huo D, Benza RL, McLaughlin VV, Tapson VF, Barst RJ. Creation of a model comparing 6-minute walk test to metabolic equivalent in evaluating treatment effects in pulmonary arterial hypertension. J Heart Lung Transplant. 2007;26(7):732-738 [DOI] [PubMed] [Google Scholar]
- 40.ATS Committee on Proficiency Standards for Clinical Pulmonary Function Laboratories ATS statement: guidelines for the six-minute walk test. Am J Respir Crit Care Med. 2002;166(1):111-117 [DOI] [PubMed] [Google Scholar]
- 41.Karvonen MJ, Kentala E, Mustala O. The effects of training on heart rate; a longitudinal study. Ann Med Exp Biol Fenn. 1957;35(3):307-315 [PubMed] [Google Scholar]
- 42.Beaver WL, Wasserman K, Whipp BJ. A new method for detecting anaerobic threshold by gas exchange. J Appl Physiol. 1986;60(6):2020-2027 [DOI] [PubMed] [Google Scholar]
- 43.Gomberg-Maitland M, Thenappan T, Rizvi K, Chandra S, Meads DM, McKenna SP. United States validation of the Cambridge Pulmonary Hypertension Outcome Review (CAMPHOR). J Heart Lung Transplant. 2008;27(1):124-130 [DOI] [PubMed] [Google Scholar]
- 44.Shah SJ, Thenappan T, Rich S, Sur J, Archer SL, Gomberg-Maitland M. Value of exercise treadmill testing in the risk stratification of patients with pulmonary hypertension. Circ Heart Fail. 2009;2(4):278-286 [DOI] [PubMed] [Google Scholar]
- 45.Gulati M, Pandey DK, Arnsdorf MF, et al. Exercise capacity and the risk of death in women: the St James Women Take Heart Project. Circulation. 2003;108(13):1554-1559 [DOI] [PubMed] [Google Scholar]
- 46.Miyamoto S, Nagaya N, Satoh T, et al. Clinical correlates and prognostic significance of six-minute walk test in patients with primary pulmonary hypertension. Comparison with cardiopulmonary exercise testing. Am J Respir Crit Care Med. 2000;161(2 Pt 1):487-492 [DOI] [PubMed] [Google Scholar]
- 47.Paciocco G, Martinez FJ, Bossone E, Pielsticker E, Gillespie B, Rubenfire M. Oxygen desaturation on the six-minute walk test and mortality in untreated primary pulmonary hypertension. Eur Respir J. 2001;17(4):647-652 [DOI] [PubMed] [Google Scholar]
- 48.Gilbert C, Brown MCJ, Cappelleri JC, Carlsson M, McKenna SP. Estimating a minimally important difference in pulmonary arterial hypertension following treatment with sildenafil. Chest. 2009;135(1):137-142 [DOI] [PubMed] [Google Scholar]
- 49.Olsson LG, Swedberg K, Clark AL, Witte KK, Cleland JGF. Six minute corridor walk test as an outcome measure for the assessment of treatment in randomized, blinded intervention trials of chronic heart failure: a systematic review. Eur Heart J. 2005;26(8):778-793 [DOI] [PubMed] [Google Scholar]
- 50.American Thoracic Society ; American College of Chest Physicians ATS/ACCP Statement on cardiopulmonary exercise testing. Am J Respir Crit Care Med. 2003;167(2):211-277 [DOI] [PubMed] [Google Scholar]
- 51.Yasunobu Y, Oudiz RJ, Sun X-G, Hansen JE, Wasserman K. End-tidal PCO2 abnormality and exercise limitation in patients with primary pulmonary hypertension. Chest. 2005;127(5):1637-1646 [DOI] [PubMed] [Google Scholar]
- 52.D’Alonzo GE, Gianotti LA, Pohil RL, et al. Comparison of progressive exercise performance of normal subjects and patients with primary pulmonary hypertension. Chest. 1987;92(1):57-62 [DOI] [PubMed] [Google Scholar]
- 53.Riley MS, Pórszász J, Engelen MPKJ, Brundage BH, Wasserman K. Gas exchange responses to continuous incremental cycle ergometry exercise in primary pulmonary hypertension in humans. Eur J Appl Physiol. 2000;83(1):63-70 [DOI] [PubMed] [Google Scholar]
- 54.Fowler RM, Gain KR, Gabbay E. Exercise intolerance in pulmonary arterial hypertension. Pulm Med. 2012;2012:359204. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 55.Sun X-G, Hansen JE, Oudiz RJ, Wasserman K. Gas exchange detection of exercise-induced right-to-left shunt in patients with primary pulmonary hypertension. Circulation. 2002;105(1):54-60 [DOI] [PubMed] [Google Scholar]
- 56.Oudiz RJ, Midde R, Hovenesyan A, et al. Usefulness of right-to-left shunting and poor exercise gas exchange for predicting prognosis in patients with pulmonary arterial hypertension. Am J Cardiol. 2010;105(8):1186-1191 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 57.Ware JE, Kosinski M, Bjorner JB, Turner-Bowker DM, Gandek B, Maruish ME. User’s Manual for the SF-36v2 Health Survey. 2nd ed.Lincoln, RI: QualityMetric Incorporated; 2007:85-107 [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
Online Supplement