Abstract
Objective
Few studies targeting obesity in serious mental illness report clinically significant risk reduction, and none have been replicated within community settings or have demonstrated sustained outcomes after intervention withdrawal. This pragmatic clinical trial aims to replicate positive health outcomes demonstrated in a prior randomized effectiveness study of the In SHAPE program across urban community mental health organizations serving an ethnically diverse population.
Methods
Persons with serious mental illness and BMI>25 receiving services in three community mental health organizations were randomized to the 12-month In SHAPE program (health promotion coach and membership to a public fitness club) or to fitness club membership alone. Primary outcomes were weight and cardiorespiratory fitness (measured with the 6-Minute Walk Test) collected at baseline, 3-, 6-, 9-, 12-, and 18-months.
Results
Participants (N=210) were ethnically diverse (46% non-White) with mean baseline BMI=36.8±8.2. At 12-months In SHAPE (n=104) compared to a fitness club membership alone (n=106) contributed to greater reduction in weight and improved fitness. Primary outcomes were maintained at 18-months follow-up. Approximately half of In SHAPE participants (51% at 12-month program completion and 46% at 18-month follow-up) achieved clinically significant cardiovascular risk reduction (≥5% weight loss or >50 meter increase on the 6-Minute Walk Test).
Conclusions
Sustained weight loss and improved fitness can be achieved by community mental health organizations providing health promotion coaching and access to fitness facilities. Health promotion should be integrated into mental health services for persons with serious mental illness at risk for cardiovascular disease and early mortality.
Rates of obesity in persons with serious mental illness are nearly double those observed within the general population (1-3), contributing to reduced life expectancy largely attributable to increased burden of cardiovascular disease (4-6). Persons with serious mental illness experience numerous challenges to achieving and sustaining fitness and weight loss, including metabolic effects of psychoactive medications, the impact of symptoms on motivation, poor diet, difficulty affording healthy foods, physical inactivity, and inadequate access to safe, affordable, and supported options for physical exercise. Systematic reviews of health promotion interventions for persons with serious mental illness have identified at least ten randomized trials reporting statistically significant overall weight loss (7, 8), yet few studies report achieving clinically significant outcomes (9-12). None of these clinically significant trials have been replicated to determine if similar outcomes are achieved when provided by routine community mental health organizations serving ethnically diverse populations, nor if improved outcomes are sustained after the active intervention is withdrawn.
The lack of replication studies in contemporary medicine has been highlighted as a major concern in systematic reviews and in the popular press. A 2011 Wall Street Journal article called the lack of replication in research, “one of medicine’s dirty secrets”, concluding, “most results, including those in top-flight peer reviewed journals, can’t be reproduced” (13). A 2013 article in The Economist titled, “Unreliable Research: Trouble at the Lab”, summarized studies showing that only 11% to 25% of selected pivotal biomedical findings in the basic science of cancer are reproducible (14). The lack of replicated results in medical research has been attributed to a variety of causes, such as “questionable research practices” consisting of exploring multiple dependent variables or covariates and reporting only those that yield significant results (15); conducting studies with inadequate statistical power (16); and pervasive publication bias favoring novel findings over replication studies (17). Of note, within the psychological sciences, 1.6% of published findings mention the term replication, and among actual replication studies only a little over 1% are successful (18).
In a prior randomized controlled trial in a mental health center in New Hampshire we demonstrated the effectiveness of In SHAPE (19), a 12-month program consisting of individual weekly meetings in the community with a health promotion coach, a fitness club (YMCA) membership, and nutrition education adapted for persons with serious mental illness (20). We found that In SHAPE compared to an active control consisting of a fitness club membership contributed to clinically significant reduction in cardiovascular risk (either clinically significant weight loss or improved fitness) in 49% of overweight/obese adults with serious mental illness.
In this report, we present the results of a pragmatic clinical trial (21) of In SHAPE conducted to determine if the primary outcomes of weight loss and improved fitness are replicated when the intervention is delivered by health promotion coaches employed by routine mental health provider organizations serving an ethnically diverse population of overweight/obese adults with serious mental illness. We also evaluate secondary outcomes of BMI, waist circumference, physical activity, diet, blood pressure, and serum lipids. Finally, we evaluate whether our primary outcomes of weight loss and improved fitness persist following withdrawal of the active intervention. We hypothesized that the In SHAPE program (health promotion coaching and a fitness club membership) contributes to greater reduction in weight and improvements in cardiorespiratory fitness when compared to a fitness club membership alone, and that these improvements will be maintained at 18-month follow-up.
Methods
Participants
Inclusion criteria were: age 21 or older; serious mental illness defined by an axis I diagnosis of major depression, bipolar disorder, schizoaffective disorder, or schizophrenia, (based on the Structured Clinical Interview for DSM–IV); and persistent impairment in multiple areas of functioning (e.g., work, school, self-care) (22); body mass index (BMI) greater than 25; and provision of informed consent for participation. Participants were on stable pharmacological treatment defined as receiving the same psychiatric medications over the prior 2 months. Exclusion criteria were: residing in a nursing home or other institution; primary diagnosis of dementia or significant cognitive impairment defined as a Mini Mental Status Exam (23) score<24; inability to walk one city block; pregnant or planning to become pregnant within the next 18 months; inability to speak English; terminal illness with mortality expected within 1 year; or current diagnosis of an active substance dependence disorder (based on the substance abuse module of the Structured Clinical Interview for DSM–IV). The sample size was chosen to obtain 80% power for comparisons of the repeated time points at the two-sided 0.05 significance level, while assuming up to 20 percent attrition from baseline to 12 months. Pilot findings on waist circumference and fitness were used to anticipate effect size in these calculations (20).
Study Procedures
Recruitment occurred between 2007 and 2011 from three non-profit community mental health providers in the Boston area: Vinfen, Massachusetts Mental Health Center, and Bay Cove Human Services. Randomization between In SHAPE and the comparison group was stratified by age (21 to 44 versus 45 and older) and mental health diagnosis (mood disorder versus schizophrenia spectrum disorder). Each combination of stratification categories had its own randomization schedule that was blocked on every fourth assignment to assure balance between treatment arms. Randomization was conducted sequentially across all sites (not within sites).
Committees for the Protection of Human Subjects at Dartmouth College and the Department of Mental Health in Massachusetts approved the study procedures. Informed consent was obtained from all participants. Participants were paid for completing assessments, but not for attending In SHAPE sessions. Blinded assessments were conducted at baseline, 3-, 6-, 9-, 12-, and 18-month follow-up for weight, BMI, waist circumference, and physical activity, and at baseline, 6-, 12-, and 18-month follow-up for fitness, diet, blood pressure, and serum lipids.
Intervention Group
In SHAPE is a health promotion intervention consisting of a fitness club membership and a health promotion coach with basic certification as a fitness trainer, instruction on healthy eating and nutrition, and training in tailoring individual wellness plans to the needs of persons with serious mental illness (19, 20). Prior to enrollment, participants obtain medical clearance from their primary care provider. After conducting lifestyle and fitness evaluations, the health promotion coach develops personalized fitness plans for each participant using shared goal setting. Thereafter, they meet with participants individually each week for 45–60 minutes at a local fitness club (YMCA) and provide fitness coaching, support, and reinforcement for physical activity. The nutrition component consists of individualized instruction during each meeting emphasizing healthy eating.
In SHAPE was delivered by four health promotion coaches who were either mental health case managers with basic certification in fitness training or certified fitness trainers interested in working with individuals with disabilities. All coaches also completed a one-week In SHAPE training consisting of instruction in motivational interviewing, fitness goal setting, healthy nutrition, strategies for health behavior change, and tracking eating and physical activity behaviors. To ensure fidelity to the In SHAPE intervention, the health promotion coaches participated in two 60-minute supervision calls each week with an experienced certified fitness trainer, a clinical psychologist with expertise in behavior change and motivational interviewing, and a dietitian.
Control Group
The comparison condition consisted of a fitness club membership to the same local fitness clubs (YMCAs) with an introduction in safe use of the exercise equipment.
Primary Outcome Measures
Weight
Weight (lbs.) was measured as the change in body weight over time.
Cardiorespiratory Fitness
The 6-Minute Walk Test (6-MWT) (24) measures the distance an individual can walk in six minutes. In obese adults, the 6-MWT is a reliable and valid measure of fitness with favorable test-retest and discriminant validity (25, 26), and has been used in adults with a variety of chronic health conditions (27-36). An increase in distance of >50 meters is associated with clinically significant reduction in risk for cardiovascular disease (37, 38).
Secondary Outcome Measures
Body Mass Index (BMI)
BMI was calculated by the formula: Weight (kg)/Height(m)2. BMI provides a reliable indicator of body fatness for most people (39).
Physical Activity
Physical activity was measured using the short-form International Physical Activity Questionnaire (IPAQ) (40). Summary scores were calculated for vigorous activities obtaining an estimate of weekly metabolic equivalent expenditure (MET) minutes of vigorous physical activity. The IPAQ is reliable and valid for use among persons with serious mental illness (40). Health promotion coaches also collected self-report data on total exercise time per week. Frequency of fitness club visits was tracked using electronic records of membership card swipes at the YMCA.
Diet
Readiness to change eating behaviors was assessed using a scale adapted from the Stages of Change Modified Motivational Interviewing instrument (41) focused on dietary behaviors. Higher scores indicate greater readiness. We calculated an overall dietary behavior score consisting of the mean for the items related to portion control, consumption of fat, and intake of fruits and vegetables. Dietary intake was assessed using the Brief Block Food Frequency Questionnaire (FFQ) (42). The FFQ yields estimates of daily consumption of calories and servings of fruits and vegetables with comparable validity to other measures of diet, and is sensitive to dietary intake over time (43).
Blood Pressure
Blood pressure was measured before (resting heart rate) and after completing the 6-MWT.
Serum Lipids
Lipids were measured using the CardioChek PA Analyzer, a portable testing system that produces reliable values for total cholesterol, LDL, HDL, and triglycerides using a multi-panel test strip and a single drop of blood acquired with a finger prick (44).
Statistical Analysis
Both groups were compared for demographic characteristics, psychiatric history, and outcome measures at baseline using two-tailed t-tests and chi-square tests. Primary outcomes were changes in weight and fitness from randomization to 12-months, and maintenance of outcomes from 12- to 18-months. Treatment effects were evaluated by intent-to-treat analyses, with total values for outcome measures as the dependent measures. To test our main hypotheses, we conducted analyses in two steps. In the first step, we examined group difference in outcome change for treatment period (baseline to 12 month). Rather than fitting parametric curves with random effects, we included baseline as a covariate and fit baseline-adjusted mean response profile models (45), also referred to as covariance pattern models (46). Within-subject correlation over time was modeled by selecting unstructured covariance structures and missing data were accommodated with maximum likelihood estimation (47). The model was also adjusted for by including diagnosis and the interaction of group and diagnosis. Given the outcomes were adjusted for baseline levels, treatment effects were evaluated by group main effects (i.e., differences in group mean response profiles during the treatment period). In the second step, we fitted models with group, time (12 to 18 months), and group-by-time interaction effect. We tested whether or not the results at treatment period sustained at 18-month follow-up by looking at the effect of group-by-time interaction term. Generalized estimating equations (GEE) were used to compare the percentages of participants in the two groups who met clinically significant weight loss and fitness criteria at 12-months and 18-months. We computed Pearson’s correlation coefficients (r) to examine relationships between number of fitness trainer visits and weight loss and fitness.
Results
A total of 210 eligible participants were randomized to the 12-month In SHAPE program (N=104) or to fitness club membership (N=106) (see Consort Diagram in online Supplement). As shown in Table 1, study participants mean age was 43.9±11.2 years, mean BMI was 36.8±8.2 kg/m2, half (51%) were female, and 46% were non-White (see online Supplement for additional baseline characteristics). In SHAPE participants did not differ significantly from those assigned to the fitness club membership comparison group on demographic, diagnostic, use of psychiatric medications with high weight gain propensity, elevated lipid and cholesterol levels, or other baseline measures. Comparable 12-month and 18-month follow-up retention rates were observed across both groups (84% at 12-months and 77% at 18-months in In SHAPE; 77% at 12-months and 78% at 18-months in the comparison group).
Table 1.
Total Sample (N=210) | Fitness Club Membership and Education (N=106) |
In SHAPE (N=104) | ||||
---|---|---|---|---|---|---|
Characteristic | N | % | N | % | N | % |
Age (M±SD) | 43.9±11.2 | 43.5±11.6 | 44.3±10.9 | |||
Weight in lbs (M±SD) | 235.4±54.1 | 238.9±57.9 | 231.8±50.1 | |||
Body Mass Index (M±SD) | 36.8±8.2 | 37.5±8.8 | 36.2±7.5 | |||
Gender | ||||||
Male | 103 | 49 | 48 | 45 | 55 | 53 |
Female | 107 | 51 | 58 | 55 | 49 | 47 |
Ethnicity | ||||||
White | 113 | 54 | 57 | 54 | 56 | 54 |
Black | 71 | 34 | 38 | 36 | 33 | 32 |
American Indian/Alaska Native |
4 | 2 | 2 | 2 | 2 | 2 |
Asian | 7 | 3 | 3 | 3 | 4 | 4 |
Native Hawaiian/Pacific Islander |
5 | 2 | 2 | 2 | 3 | 3 |
More than one race | 10 | 5 | 4 | 3 | 6 | 5 |
Latino | ||||||
Yes | 35 | 17 | 15 | 14 | 20 | 20 |
No | 174 | 83 | 91 | 86 | 83 | 80 |
Diagnosis | ||||||
Schizophrenia | 49 | 23 | 24 | 23 | 25 | 24 |
Schizoaffective | 68 | 32 | 34 | 32 | 34 | 33 |
Bipolar | 60 | 29 | 34 | 32 | 26 | 25 |
Major Depression | 33 | 16 | 14 | 13 | 19 | 18 |
Marital Status | ||||||
Never Married | 153 | 73 | 70 | 66 | 83 | 80 |
Currently Married | 10 | 5 | 7 | 7 | 3 | 3 |
Previously married | 47 | 22 | 29 | 27 | 18 | 17 |
Education | ||||||
Less than high school | 42 | 20 | 21 | 20 | 21 | 20 |
High school graduate | 168 | 80 | 85 | 80 | 83 | 80 |
Residential | ||||||
Living independently | 124 | 59 | 60 | 57 | 64 | 61 |
Supervised/supported housing |
85 | 41 | 45 | 43 | 40 | 39 |
Means were compared by t tests, and proportions were compared by chi square tests.
Results of intent-to-treat analyses at 3-, 6-, 9-, and 12-months for primary and secondary outcomes are shown in Table 2. In SHAPE, compared to fitness club membership, was associated with greater reduction in weight and increased fitness (distance on 6-MWT). For secondary outcomes, In SHAPE participants achieved greater reductions in BMI and waist circumference, and more minutes of physical activity. Secondary diet, blood pressure and serum lipid outcomes are provided in Table 3. There were greater self-reported improvements in eating behaviors, but no between group differences in total calorie consumption, calories from fat or sweets, and consumption of fruits and vegetables. No between group differences were found for blood pressure or lipid outcomes for the total sample, nor for the subgroup with abnormal lipid values at baseline (not shown in table). No differences in outcomes where found with respect to age, gender, psychiatric diagnosis, or use of high vs. low weight gain propensity psychiatric medications.
Table 2.
Outcome | Group | Baseline | 3-Month | 6-Month | 9-Month | 12-Month | Group Main Effect (3-12 Months)a |
|||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
M | SD | M | SD | M | SD | df | F | M | SD | df | F | p | ||
Primary
Outcomes |
||||||||||||||
Weight (lbs.) | In SHAPE | 231.8 | 50.1 | 228.1 | 48.9 | 224.6 | 49.3 | 227.6 | 50.0 | 226.5 | 48.8 | 1, 185 | 4.9 | .029 |
FCME | 238.9 | 57.9 | 240.4 | 60.2 | 239.2 | 61.0 | 236.4 | 580.1 | 239.6 | 61.9 | ||||
Cardiorespiratory Fitness 6 MWT Distance (feet) |
In SHAPE | 1356.8 | 292.7 | - | - | 1382.2 | 291.0 | - | - | 1385.3 | 275.4 | 1, 170 | 4.4 | .037 |
FCME | 1311.4 | 287.4 | - | - | 1308.3 | 307.2 | - | - | 1247.3 | 319.4 | ||||
Secondary
Outcomes |
||||||||||||||
BMI | In SHAPE | 36.2 | 7.6 | 35.8 | 7.3 | 34.9 | 7.3 | 35.4 | 7.3 | 35.0 | 7.1 | 1, 184 | 4.6 | .034 |
FCME | 37.5 | 8.8 | 37.7 | 9.1 | 37.7 | 9.4 | 37.6 | 9.9 | 37.4 | 9.6 | ||||
Waist Circumference (inches) |
In SHAPE | 46.0 | 6.7 | 45.1 | 6.6 | 43.9 | 6.4 | 44.1 | 6.9 | 44.3 | 6.6 | 1, 190 | 5.37 | .022 |
FCME | 47.5 | 7.2 | 47.2 | 7.4 | 46.7 | 7.7 | 46.4 | 7.9 | 46.1 | 7.6 | ||||
Exercise Minutes | In SHAPE | 41.2 | 76.4 | 142.4 | 158.3 | 137.0 | 199.3 | 141.3 | 209.2 | 99.8 | 135.0 | 1, 183 | 6.8 | .01 |
FCME | 79.1 | 236.3 | 125.1 | 190.9 | 117.0 | 176.3 | 91.2 | 158.4 | 148.9 | 224.3 | ||||
IPAQ Total Vigorous Score (Log of MET min) |
In SHAPE | 172.7 | 783.6 | 533.8 | 1331.8 | 529.8 | 1027.4 | 732.0 | 1537.1 | 379.8 | 890.8 | 1, 190 | 7.6 | .006 |
FCME | 238.5 | 1256.2 | 458.3 | 885.3 | 238.2 | 624.1 | 236.4 | 580.1 | 433.7 | 1080.1 |
Means shown in table consist of raw (unadjusted) means. Main effect calculated for 3-12 months adjusted for baseline value as a covariate.
Table 3.
Outcome | Group | Baseline | 6-Month | 12-Month | Group Main Effect (6-12 Months)a |
|||||
---|---|---|---|---|---|---|---|---|---|---|
M | SD | M | SD | M | SD | df | F | p | ||
Secondary Dietary
Behavior Outcomes |
||||||||||
Readiness to Change Dietary Behaviors |
In SHAPE | 3.3 | 0.6 | 3.6 | 0.6 | 3.7 | 0.7 | 1, 191 | 4.9 | .028 |
FCME | 3.3 | 0.6 | 3.5 | 0.6 | 3.4 | 0.6 | ||||
Total caloriesb | In SHAPE | 2226 | 1246 | 1836 | 980 | 1893 | 907 | 1, 168 | .098 | .755 |
FCME | 2085 | 1176 | 1799 | 965 | 1787 | 967 | ||||
% calories fatb | In SHAPE | 39.4 | 7.4 | 36.7 | 8.2 | 37.9 | 7.6 | 1, 159 | .169 | .681 |
FCME | 36.3 | 7.4 | 36.9 | 8.1 | 36.8 | 7.9 | ||||
% calories sweetsb | In SHAPE | 12.4 | 11.5 | 8.8 | 9.2 | 9.7 | 10.8 | 1, 160 | .246 | .621 |
FCME | 11.7 | 10.3 | 9.7 | 8.5 | 9.7 | 10.0 | ||||
Fruit servings/dayb | In SHAPE | 1.1 | 0.9 | 1.2 | 0.9 | 1.3 | 0.9 | 1, 169 | .000 | .986 |
FCME | 1.1 | 1.0 | 1.2 | 1.0 | 1.3 | 1.0 | ||||
Veg. servings/dayb | In SHAPE | 3.1 | 2.8 | 3.0 | 2.6 | 3.6 | 2.8 | 1, 156 | .007 | .932 |
FCME | 3.3 | 2.5 | 3.2 | 2.2 | 3.3 | 3.4 | ||||
Secondary Blood
Pressure and Lipid Outcomes |
||||||||||
Systolic Blood Pressure | In SHAPE | 128.4 | 20.4 | 129.0 | 17.5 | 130.6 | 17.3 | 1, 180 | .404 | .526 |
FCME | 132.0 | 17.7 | 135.6 | 18.7 | 130.3 | 18.2 | ||||
Diastolic Blood Pressure | In SHAPE | 79.7 | 12.7 | 80.9 | 11.3 | 80.0 | 12.2 | 1, 180 | 3.09 | .080 |
FCME | 84.1 | 10.9 | 84.1 | 13.6 | 84.4 | 11.4 | ||||
Total Cholesterol | In SHAPE | 170.6 | 44.0 | 174.4 | 45.3 | 166.3 | 42.8 | 1, 157 | .047 | .828 |
FCME | 179.0 | 48.7 | 178.4 | 44.0 | 172.9 | 42.7 | ||||
HDL | In SHAPE | 42.9 | 15.7 | 46.3 | 16.7 | 49.2 | 17.2 | 1, 116 | .508 | .477 |
FCME | 44.6 | 16.0 | 47.7 | 17.7 | 48.4 | 17.2 | ||||
LDL | In SHAPE | 96.8 | 37.6 | 99.1 | 37.7 | 89.8 | 34.9 | 1, 136 | .173 | .678 |
FCME | 104.9 | 35.8 | 104.7 | 36.2 | 96.8 | 34.8 | ||||
Triglycerides | In SHAPE | 166.1 | 112.0 | 139.1 | 83.0 | 156.1 | 108.0 | 1, 173 | .151 | .698 |
FCME | 161.9 | 113.8 | 149.6 | 90.2 | 158.3 | 103.9 |
Means shown in table consist of raw (unadjusted) means. Main effect calculated for 6-12 months adjusted for baseline value as a covariate.
Block Food Frequency Questionnaire
In addition to observed differences between groups, both In SHAPE and the fitness club membership groups were associated with decreased weight, BMI, and percent weight loss, and increased physical activity over time. For the total sample (regardless of assignment), there were decreases in total calorie consumption, calories from fat or sweets, and consumption of fruits and vegetables. The subgroup of participants across both groups with abnormal baseline lipid values showed significant reductions at 12-months for triglycerides (F=5.88; df=1, 64; p=0.018) and at 18-months for HDL (F=3.93; df=1, 101; p=0.050) and LDL (F=10.55; df=1, 18; p=0.004).
Primary weight and fitness outcomes and secondary outcomes were maintained from 12- to 18-month follow-up as indicated by no group-by-time interactions, with the exception of decreases in readiness to change eating behaviors and increases in systolic blood pressure among In SHAPE participants relative to the comparison group (see online Supplement for 12-18 month outcomes). At 12-months, over half (51%) of In SHAPE participants achieved clinically significant reduction in overall cardiovascular risk (either ≥5% weight loss or increase of >50m on the 6-MWT) compared to fitness club membership (38%). Similar rates were found at 18-month follow-up: 46% of In SHAPE participants compared to 37% of participants receiving a fitness club membership.
Frequency of visits to the gym was associated with weight loss at 12-months across both groups (r=0.284; p<0.01). In SHAPE compared to fitness club membership was associated with over two and one-half times the mean number of gym visits (28.5±36.9 vs. 10.7±2.4; t=−4.1; p<0.0001). In SHAPE participants attended a mean of 21.3±12.6 sessions with their health promotion coach (median=22.5 sessions), of a possible 50 sessions. Attendance at sessions with the health promotion coach was correlated with weight loss (r=0.342; p=0.002) but not improvement in fitness (r=0.050; p=0.670).
At 12-months the gym membership was discontinued for both groups and regularly scheduled sessions with the health promotion coach ended for In SHAPE participants. A transitional support option to facilitate transitioning to community-based fitness activities was provided to In SHAPE participants at the end of the active 12-month intervention upon request. Approximately half of In SHAPE participants (46%, n=44) had at least one additional contact in the first month after the end of the intervention (most consisting of a brief office visit, phone call, or going for a walk with the coach). By 18-month follow-up (6 months following the 12-month intervention) fewer than 16% (N=15) of participants were in contact with their health promotion coach. No differences were observed between In SHAPE participants who elected to have transitional support and those who did not with respect to primary and secondary outcomes at 12-month and 18-month follow-up.
Discussion
In SHAPE compared to a fitness club membership alone is associated with greater weight loss and improved fitness at 12-months, as well as sustained outcomes at 18-month follow-up. This study replicated our prior finding that approximately half of individuals receiving In SHAPE (49% in the first randomized trial and 51% in the current study) achieve reduced cardiovascular risk defined as either clinically significant weight loss (≥5%) or clinically significant improved fitness (>50 meter increase on the 6-MWT).
We applied a pragmatic randomized clinical trial design (21) to determine whether the effectiveness demonstrated in our prior trial (19) would be replicated when delivering the In SHAPE program using health promotion coaches working at multiple urban community mental health organizations serving an ethnically and diagnostically diverse population. Our first randomized study was conducted with an ethnically homogeneous population (92% white) in a single mental health center in New Hampshire with access to a fitness club within the same block, and was intensively supervised by our research team located in offices less than one mile away (19). In contrast, this second study achieved similar effectiveness with remote supervision by our staff in a different state, involving ethnically diverse participants (46% non-White), in an urban setting (Boston, Massachusetts) involving three different mental health organizations, and using multiple YMCA fitness clubs dispersed across the city. Results from this pragmatic trial confirm that comparable outcomes for the In SHAPE program can be achieved among individuals receiving services in community mental health organizations across diverse “real-world” settings.
To our knowledge, this is the first replication study confirming the effectiveness of a health coaching intervention in achieving clinically significant reductions in cardiovascular risk for overweight and obese persons with serious mental illness, and the first study to demonstrate persistent reduction in cardiovascular risk after the active intervention is withdrawn. Half (51%) of In SHAPE participants achieved clinically significant reduction in cardiovascular risk at 12-month completion of the intervention and a similar reduction in risk persisted 6 months later (46% at 18-month follow-up). Participants also continued to demonstrate improved health behaviors, including engaging in three times the amount of exercise at 18-months compared to baseline. We found overall improvement in eating behaviors, though we did not find between group differences with respect to calorie intake (consumption of specific foods and categories of foods). This may reflect the focus of the health promotion coach emphasizing consuming healthier foods, in contrast to focusing on portion control. Almost half of In SHAPE participants made use of optional transitional support to independent health promotion activities in the first month following intervention completion, but only a small subgroup (16%) continued to seek transitional support at 18-months, and no differential benefit was observed for those receiving (versus not receiving) transitional support.
By comparing In SHAPE to an active comparison condition (a fitness club membership), it was possible to test the specific contribution of the health promotion coach. The health promotion coach was associated with over two and one-half times the mean amount of fitness club attendance, which in turn was associated with greater weight loss and improved fitness. Our finding of no difference in lipid reduction between groups (despite overall improvements in HDL and LDL at 18-months for the total sample of at-risk participants) may reflect the benefits of either intervention in risk reduction. Alternatively, improved overall lipid values may be due to factors external to our study, though we did not find any change in prescribing practices of antipsychotics or lipid lowering agents during the period of follow-up assessments.
We replicated findings from our prior trial (19), and also replicated the finding of clinically significant reduction in cardiovascular risk demonstrated in two other randomized trials of lifestyle interventions of a similar duration, sample size, and design, including the ACHIEVE (11) and STRIDE trials (12). The ACHIEVE trial evaluated the effectiveness of an intensive 18-month group intervention within psychiatric rehabilitation day treatment programs. ACHIEVE consisted of two to three weekly intensive group exercise sessions, a weekly group weight management session, and provided two meals each day for participants emphasizing healthy food offerings. ACHIEVE was associated with clinically significant weight loss for 32.5% of participants at 12-months and 37.8% at 18-months (11).
The STRIDE trial also evaluated a group-based weight loss intervention, but in contrast to ACHIEVE (which was provided as a component of a day treatment program), participants traveled to stand-alone group sessions focused on dietary changes in weekly two-hour sessions, complemented by moderate physical activity (primarily consisting of walking). STRIDE resulted in clinically significant weight reduction for 40% of participants at 6 months and 47% of participants at 12 months (12).
In contrast to ACHIEVE and STRIDE, In SHAPE focused on improving overall physical fitness through individually tailored coached exercise in local YMCAs, coupled with individual coaching on healthy food choices. Results from these three studies confirm the effectiveness of lifestyle interventions for overweight and obese persons with serious mental illness in achieving clinically significant reduction in cardiovascular risk either through group or individual coaching, and for different degrees of intensity of dietary and exercise programming. It is likely that maximum benefit might be achieved through a multi-pronged approach combining intensive dietary modification and supported exercise, along with encouraging switching to low-weight gain propensity psychiatric medications (51, 52). In addition, the effectiveness of lifestyle interventions might be enhanced with pharmacological agents associated with weight loss such as metformin (53).
Several limitations warrant consideration when interpreting our results. First, we did not evaluate the effectiveness of In SHAPE or fitness club membership compared to usual care. However, this allowed us to specifically evaluate the impact of the health promotion coach on weight loss and improvement in fitness. Second, the diagnostically and ethnically heterogeneous nature of the study sample has the strength of broad clinical application, but our sample size did not allow for evaluation of potential differences in outcomes that might be associated with psychiatric diagnosis or racial/ethnic subgroups. Finally, although we demonstrated persistence of outcomes six months following the end of the intervention, a longer follow-up period may be necessary to assess long-term cardiovascular risk reduction and to determine if the intervention is associated with reduced health care service use and costs.
Despite these limitations, this study confirms that In SHAPE is associated with weight loss and improved fitness when offered by routine community-based provider organizations serving ethnically diverse participants with serious mental illness. However, numerous barriers exist to broad dissemination of health promotion as a component of community mental health services. Providing health promotion coaches and access to exercise facilities and affordable healthy food will require significant changes in the way that we finance and prioritize community mental health services.
Current efforts to increase the life expectancy for persons with serious mental illness are focused on improving the quality and delivery of primary health care by integrating “health homes” within mental health care (54). These initiatives address inadequate access and poor quality health care experienced by persons with mental illness (55). However, only 10-15% of preventable mortality is estimated to be due to health care (56), in contrast to health behaviors that are estimated to account for the majority (57%) of a population’s health status and 40% of early deaths (57). By also providing health promotion as a core service, it may be possible to further reduce early morality while improving both the psychological and physical wellness of “the whole person” (58).
Supplementary Material
Disclosures and Acknowledgments
Dr. Pratt, Dr. Barre and Mr. Jue have received payments from Ken Jue Consulting to provide training in the In SHAPE program at community mental health centers (non-research sites).
Grant support received from the National Institute of Mental Health (Grant number: NIMH R01 MH078052).
Footnotes
The other authors report no competing interests.
Trial Registration: Clinicaltrials.gov, NCT02090335
References
- 1.Dickerson FB, Brown CH, Kreyenbuhl JA, Fang L, Goldberg RW, Wohlheiter K, Dixon LB. Obesity among individuals with serious mental illness. Acta Psychiatrica Scandinavica. 2006;113:306–13. doi: 10.1111/j.1600-0447.2005.00637.x. [DOI] [PubMed] [Google Scholar]
- 2.Allison DB, Newcomer JW, Dunn AL, Blumenthal JA, Fabricatore AN, Daumit GL, Cope MB, Riley WT, Vreeland B, Hibbeln JR. Obesity among those with mental disorders: a National Institute of Mental Health meeting report. American Journal of Preventive Medicine. 2009;36:341–50. doi: 10.1016/j.amepre.2008.11.020. [DOI] [PubMed] [Google Scholar]
- 3.Daumit GL, Clark JM, Steinwachs DM, Graham CM, Lehman A, Ford DE. Prevalence and correlates of obesity in a community sample of individuals with severe and persistent mental illness. The Journal of Nervous and Mental Disease. 2003;191:799–805. doi: 10.1097/01.nmd.0000100923.20188.2d. [DOI] [PubMed] [Google Scholar]
- 4.Colton CW, Manderscheid RW. Congruencies in increased mortality rates, years of potential life lost, and causes of death among public mental health clients in eight states. Preventing Chronic Disease: Public Health Research, Practice, and Policy. 2006;3:1–14. [PMC free article] [PubMed] [Google Scholar]
- 5.Druss BG, Zhao L, Von Esenwein S, Morrato EH, Marcus SC. Understanding excess mortality in persons with mental illness: 17-year follow up of a nationally representative US survey. Medical Care. 2011;49:599–604. doi: 10.1097/MLR.0b013e31820bf86e. [DOI] [PubMed] [Google Scholar]
- 6.De Hert M, Correll CU, Bobes J, Cetkovich-Bakmas M, Cohen D, Asai I, Detraux J, Gautam S, Möller H-J, Ndetei DM, Newcomer JW, Uwakwe R, Leucht S. Physical illness in patients with severe mental disorders. I. prevalence, impact of medications and disparities in health care. World Psychiatry. 2011;10:52–77. doi: 10.1002/j.2051-5545.2011.tb00014.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Bartels SJ, Desilets RA. Health promotion programs for persons with serious mental illness: what works? a systematic review and analysis of the evidence base in published research literature on exercise and nutrition programs. Prepared for SAMHSAHRSA Center for Integrated Health Solutions. 2012 see http://www.integration.samhsa.gov/health-wellness/wellnesswhitepaper. [Google Scholar]
- 8.Cabassa LJ, Ezell JM, Lewis-Fernandez R. Lifestyle interventions for adults with serious mental illness: a systematic literature review. Psychiatric Services. 2010;61:774–82. doi: 10.1176/appi.ps.61.8.774. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Brar JS, Ganguli R, Pandina G, Turkoz I, Berry S. Mahmoud R: Effects of behavioral therapy on weight loss in overweight and obese patients with schizophrenia or schizoaffective disorder. Journal of Clinical Psychiatry. 2005;66:205–12. doi: 10.4088/jcp.v66n0208. [DOI] [PubMed] [Google Scholar]
- 10.McKibbin CL, Patterson TL, Norman G, Patrick K, Jin H, Roesch S, Mudaliar S, Barrio C, O’Hanlon K, Griver K, Sirkin A, Jeste DV. A lifestyle intervention for older schizophrenia patients with diabetes mellitus: a randomized controlled trial. Schizophrenia Research. 2006;86:36–44. doi: 10.1016/j.schres.2006.05.010. [DOI] [PubMed] [Google Scholar]
- 11.Daumit GL, Dickerson FB, Wang N-Y, Dalcin A, Jerome GJ, Anderson CA, Young DR, Frick KD, Yu A, Gennusa JV., III A behavioral weight-loss intervention in persons with serious mental illness. New England Journal of Medicine. 2013;368:1594–602. doi: 10.1056/NEJMoa1214530. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Green CA, Yarborough BJH, Leo MC, Yarborough MT, Stumbo SP, Janoff SL, Perrin NA, Nichols GA, Stevens VJ. The STRIDE weight loss and lifestyle intervention for individals taking antipsychotic medications: a randomized trial. The American Journal of Psychiatry. doi: 10.1176/appi.ajp.2014.14020173. In Press. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Naik G. Scientists’ elusive goal: reproducing study results. Wall Street Journal. 2011;258:A1. [Google Scholar]
- 14.The Economist . Unreliable research: trouble at the lab. The Economist; 2013. [Google Scholar]
- 15.Simmons JP, Nelson LD, Simonsohn U. False-positive psychology undisclosed flexibility in data collection and analysis allows presenting anything as significant. Psychological Science. 2011;22:1359–66. doi: 10.1177/0956797611417632. [DOI] [PubMed] [Google Scholar]
- 16.Ioannidis JP. Why most published research findings are false. PLoS Medicine. 2005;2:e124. doi: 10.1371/journal.pmed.0020124. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Millard WB. Go back, Jack, and do it again: the underrated art of replication. Annals of Emergency Medicine. 2012;60:A15–A20. doi: 10.1016/j.annemergmed.2012.06.002. [DOI] [PubMed] [Google Scholar]
- 18.Makel MC, Plucker JA, Hegarty B. Replications in psychology research: how often do they really occur? Perspectives on Psychological Science. 2012;7:537–42. doi: 10.1177/1745691612460688. [DOI] [PubMed] [Google Scholar]
- 19.Bartels SJ, Pratt SI, Aschbrenner KA, Barre LK, Jue K, Wolfe RS, Xie H, McHugo G, Santos M, Williams GE, Naslund JA, Mueser KT. Clinically significant improved fitness and weight loss among overweight persons with serious mental illness. Psychiatric Services. 2013;64:729–36. doi: 10.1176/appi.ps.003622012. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Van Citters AD, Pratt SI, Jue K, Williams G, Miller PT, Xie H, Bartels SJ. A pilot evaluation of the In SHAPE individualized health promotion intervention for adults with mental illness. Community Mental Health Journal. 2010;46:540–52. doi: 10.1007/s10597-009-9272-x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Roland M, Torgerson DJ. Understanding controlled trials: what are pragmatic trials? BMJ. 1998;316:285. doi: 10.1136/bmj.316.7127.285. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.First MB, Spitzer RL, Gibbon M, Williams JBW. Structured Clinical Interview for DSM-IV Axis I Disorders - Patient Edition (SCID-I/P, Version 2.0) Biometric Research Department, New York State Psychiatric Institute; New York: 1995. [Google Scholar]
- 23.Folstein MF, Folstein SE, McHugh PR. Mini-mental state: A practical method for grading the cognitive state of patients for the clinician. Journal of Psychiatric Research. 1975;12:189–98. doi: 10.1016/0022-3956(75)90026-6. [DOI] [PubMed] [Google Scholar]
- 24.Balke B. A simple field test for the assessment of physical fitness. Report Civil Aeromedical Research Institute (US) 1963;53:1–8. [PubMed] [Google Scholar]
- 25.Larsson UE, Reynisdottir S. The six-minute walk test in outpatients with obesity: reproducibility and known group validity. Physiotherapy Research International. 2008;13:84–93. doi: 10.1002/pri.398. [DOI] [PubMed] [Google Scholar]
- 26.Beriault K, Carpentier AC, Gagnon C, Menard J, Baillargeon JP, Ardilouze JL, Langlois MF. Reproducibility of the 6-minute walk test in obese adults. International Journal of Sports Medicine. 2009;30:725–7. doi: 10.1055/s-0029-1231043. [DOI] [PubMed] [Google Scholar]
- 27.Bittner V, Weiner DH, Yusuf S, Rogers WJ, McIntyre KM, Bangdiwala SI, Kronenberg MW, Kostis JB, Kohn RM, Guillotte M, Greenberg B, Woods PA, Bourassa MG. SOLVD Investigators: Prediction of mortality and morbidity with a 6-minute walk test in patients with left ventricular dysfunction. JAMA. 1993;270:1702–7. [PubMed] [Google Scholar]
- 28.Cahalin LP, Mathier MA, Semigran MJ, Dec GW, DiSalvo TG. The six-minute walk test predicts peak oxygen uptake and survival in patients with advanced heart failure. Chest. 1996;110:325–32. doi: 10.1378/chest.110.2.325. [DOI] [PubMed] [Google Scholar]
- 29.Chetta A, Aiello M, Foresi A, Marangio E, D’Ippolito R, Castagnaro A, Olivieri D. Relationship between outcome measures of six-minute walk test and baseline lung function in patients with interstitial lung disease. Sarcoidosis, Vasculitis, and Diffuse Lung Diseases. 2001;18:170–5. [PubMed] [Google Scholar]
- 30.Curtis JP, Rathore SS, Wang Y, Krumholz HM. The association of 6-minute walk performance and outcomes in stable outpatients with heart failure. Journal of Cardiac Failure. 2004;10:9–14. [PubMed] [Google Scholar]
- 31.Demers C, McKelvie RS, Negassa A, Yusuf S. Reliability, validity, and responsiveness of the six-minute walk test in patients with heart failure. American Heart Journal. 2001;142:698–703. doi: 10.1067/mhj.2001.118468. [DOI] [PubMed] [Google Scholar]
- 32.Kosak M, Smith T. Comparison of the 2-, 6-, and 12-minute walk tests in patients with stroke. Journal of Rehabilitation Research and Development. 2005;42:103–7. doi: 10.1682/jrrd.2003.11.0171. [DOI] [PubMed] [Google Scholar]
- 33.Miyamoto S, Nagaya N, Satoh T, Kyotani S, Sakamaki F, Fujita M, Nakanishi N, Miyatake K. Clinical correlates and prognostic significance of six-minute walk test in patients with primary pulmonary hypertension. Comparison with cardiopulmonary exercise testing. American Journal of Respiratory and Critical Care Medicine. 2000;161:487–92. doi: 10.1164/ajrccm.161.2.9906015. [DOI] [PubMed] [Google Scholar]
- 34.Pankoff BA, Overend TJ, Lucy SD, White KP. Reliability of the six-minute walk test in people with fibromyalgia. Arthritis Care and Research. 2000;13:291–5. doi: 10.1002/1529-0131(200010)13:5<291::aid-anr8>3.0.co;2-x. [DOI] [PubMed] [Google Scholar]
- 35.Redelmeier DA, Bayoumi AM, Goldstein RS, Guyatt GH. Interpreting small differences in functional status: the six minute walk test in chronic lung disease patients. American Journal of Respiratory and Critical Care Medicine. 1997;155:1278–82. doi: 10.1164/ajrccm.155.4.9105067. [DOI] [PubMed] [Google Scholar]
- 36.Sciurba F, Criner GJ, Lee SM, Mohsenifar Z, Shade D, Slivka W, Wise RA. Six-minute walk distance in chronic obstructive pulmonary disease: reproducibility and effect of walking course layout and length. American Journal of Respiratory and Critical Care Medicine. 2003;167:1522–7. doi: 10.1164/rccm.200203-166OC. [DOI] [PubMed] [Google Scholar]
- 37.Rasekaba T, Lee AL, Naughton MT, Williams TJ, Holland AE. The six-minute walk test: a useful metric for the cardiopulmonary patient. Internal Medicine Journal. 2009;39:495–501. doi: 10.1111/j.1445-5994.2008.01880.x. [DOI] [PubMed] [Google Scholar]
- 38.Wise RA, Brown CD. Minimal clinically important differences in the six-minute walk test and the incremental shuttle walking test. COPD: Journal of Chronic Obstructive Pulmonary Disease. 2005;2:125–9. doi: 10.1081/copd-200050527. [DOI] [PubMed] [Google Scholar]
- 39.Garrow J, Webster J. Quetelets’s index (W/H2) as a measure of fatness. International Journal of Obesity. 1985;9:147–53. [PubMed] [Google Scholar]
- 40.Faulkner G, Cohn T, Remington G. Validation of a physical activity assessment tool for individuals with schizophrenia. Schizophrenia Research. 2006;82:225–31. doi: 10.1016/j.schres.2005.10.020. [DOI] [PubMed] [Google Scholar]
- 41.Foley SP. Psychometric properties of a measure designed to assess stage of change for eating behaviors. University of Illinois at Chicago; 2009. [Google Scholar]
- 42.Block G, Subar AF. Estimates of nutrient intake from a food frequency questionnaire: the 1987 National Health Interview Survey. Journal of the American Dietetic Association. 1992;92:969. [PubMed] [Google Scholar]
- 43.Subar AF, Thompson FE, Kipnis V, Midthune D, Hurwitz P, McNutt S, McIntosh A, Rosenfeld S. Comparative validation of the Block, Willett, and National Cancer Institute food frequency questionnaires the Eating at America’s Table Study. American Journal of Epidemiology. 2001;154:1089–99. doi: 10.1093/aje/154.12.1089. [DOI] [PubMed] [Google Scholar]
- 44.Springer L, Murphy R, Enright M, LaDuca F. CardioChek PA technical bulletin: clinical performance verification of the CardioChek PA test system. Polymer Technology Systems, Inc; Indianapolis, IN: 2010. [Google Scholar]
- 45.Fitzmaurice G, Laird N, Ware J. Applied longitudinal analysis. Wiley; New York: 2004. [Google Scholar]
- 46.Hedeker D, Gibbons RD. Longitudinal data analysis. Wiley; New York: 2006. [Google Scholar]
- 47.Jennrich R, Schluchter M. Unbalanced repeated-measures models with structured covariance matrices. Biometrics. 1986;42:805–20. [PubMed] [Google Scholar]
- 48.Verhaeghe N, De Maeseneer J, Maes L, Van Heeringen C, Annemans L. Effectiveness and cost-effectiveness of lifestyle interventions on physical activity and eating habits in persons with severe mental disorders: a systematic review. International Journal of Behavioral Nutrition and Physical Activity. 2011;8:28. doi: 10.1186/1479-5868-8-28. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 49.Alvarez-Jimenez M, Hetrick SE, Gonzalez-Blanch C, Gleeson JF, McGorry PD. Non-pharmacological management of antipsychotic-induced weight gain: systematic review and meta-analysis of randomised controlled trials. British Journal of Psychiatry. 2008;193:101–7. doi: 10.1192/bjp.bp.107.042853. [DOI] [PubMed] [Google Scholar]
- 50.Goldberg RW, Reeves G, Tapscott S, Medoff D, Dickerson F, Goldberg AP, Ryan AS, Fang LJ, Dixon LB. “MOVE!”: outcomes of a weight loss program modified for veterans with serious mental illness. Psychiatric Services. 2013;64:737–44. doi: 10.1176/appi.ps.201200314. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 51.Weiden PJ, Aquila R, Dalheim L, Standard JM. Switching antipsychotic medications. Journal of Clinical Psychiatry. 1997;58:63–72. [PubMed] [Google Scholar]
- 52.Gupta S, Masand PS, Virk S, Schwartz T, Hameed A, Frank BL, Lockwood K. Weight decline in patients switching from olanzapine to quetiapine. Schizophrenia Research. 2004;70:57–62. doi: 10.1016/j.schres.2003.09.016. [DOI] [PubMed] [Google Scholar]
- 53.Wu R-R, Zhao J-P, Jin H, Shao P, Fang M-S, Guo X-F, He Y-Q, Liu Y-J, Chen JD, Li L-H. Lifestyle intervention and metformin for treatment of antipsychotic-induced weight gain: a randomized controlled trial. Jama. 2008;299:185–93. doi: 10.1001/jama.2007.56-b. [DOI] [PubMed] [Google Scholar]
- 54.Alakeson V, Frank RG, Katz RE. Specialty care medical homes for people with severe, persistent mental disorders. Health Affairs. 2010;29:867–73. doi: 10.1377/hlthaff.2010.0080. [DOI] [PubMed] [Google Scholar]
- 55.Druss BG, Rosenheck RA, Desai MM, Perlin JB. Quality of preventive medical care for patients with mental disorders. Medical Care. 2002;40:129–36. doi: 10.1097/00005650-200202000-00007. [DOI] [PubMed] [Google Scholar]
- 56.McGinnis JM, Williams-Russo P, Knickman JR. The case for more active policy attention to health promotion. Health Affairs. 2002;21:78–93. doi: 10.1377/hlthaff.21.2.78. [DOI] [PubMed] [Google Scholar]
- 57.Booske BC, Athens JK, Kindig DA, Park H, Remington PL. Different perspectives for assigning weights to determinants of health. University of Wisconsin Population Health Institute; Madison, WI: 2010. [Google Scholar]
- 58.Bartels SJ. Caring for the whole person: integrated health care for older adults with severe mental illness and medical comorbidity. Journal of the American Geriatrics Society. 2004;52:S249–S57. doi: 10.1111/j.1532-5415.2004.52601.x. [DOI] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.