Abstract
Objective
Although studies have shown that physical activity (PA) can reduce some treatment-related side-effects of breast cancer, there is a need to offer PA programs outside of research settings to reach more cancer survivors. We partnered with the American Cancer Society's Reach to Recovery program (RTR) to train their volunteers (breast cancer survivors) to deliver a 12-week PA intervention to other breast cancer survivors.
Methods
We conducted a randomized controlled trial to compare the PA intervention delivered by RTR volunteers (PA plus RTR) with contact control (RTR Control). Eighteen RTR volunteers/coaches (mean age=54.9 years, mean years since diagnosis=7.0) delivered the contact control condition or the PA intervention. Seventy-six breast cancer survivors in New England (mean age=55.6 years, mean years since diagnosis=1.1) were randomized to one of the two groups. At baseline, 12 weeks (post-intervention) and at 24 weeks, participants wore an accelerometer for seven days, were interviewed about their PA and reported their motivational readiness for PA.
Results
Adjusted mixed effects longitudinal regression models showed significant group differences favoring the PA plus RTR group in minutes of moderate to vigorous PA at 12 weeks (mean difference=103 minutes/ week, p<.001) and 24 weeks (mean difference=34.7 minutes/week, p=.03). Results were corroborated with significant group differences in accelerometer data favoring the PA plus RTR group at both time-points.
Conclusions
Peer volunteers were able to significantly increase PA among cancer survivors relative to contact control. Partnerships with existing volunteer programs can help to widen the reach of behavioral interventions among cancer survivors.
Keywords: Exercise, peers, breast cancer survivors
Introduction
Physical activity (PA) has been recommended for cancer patients to improve their recovery and functioning (Rock et al., 2012; Schmitz et al., 2010). The recommendations were based on several trials testing the effects of PA adoption among patients treated for various cancers with the majority of these efficacy studies conducted among middle-aged patients with early-stage breast cancer (Brown et al., 2011; Duijts, Faber, Oldenburg, van Beurden & Aaronson, 2011; Ferrer, Hudeo-Medina, Johnson, Ryan & Pescatello, 2011; Schmitz, et al., 2010; Speck, Courneya, Masse, Duval & Schmitz, 2010). With the growing evidence of the role that PA can play in cancer recovery, it is timely to extend the reach of PA interventions into the “real world.” One approach to scaling up an intervention is the training of peer/community volunteers to encourage survivors to become physically active.
There are quasi-experimental studies that support the use of trained peer volunteers providing PA advice by telephone to middle-aged and older adults (Hooker et al., 2005; Wilcox et al., 2006). More recently, in a 12-month randomized controlled trial of 12 volunteer peer mentors and 181 initially inactive adults aged 50 years and older, researchers compared telephone-based advice delivered by professional staff to telephone-based advice delivered by trained volunteers and to an attention control arm of telephone advice for nutrition (Castro, Pruitt, Buman, & King, 2011). Both activity arms significantly increased their PA participation relative to the control group at 12 months, but the peer volunteers showed superior quality in intervention content compared to the professional staff. In another randomized controlled trial, 81 sedentary adults received peer-delivered, theory-based support for exercise in a 16-week group-based program vs. a community-based exercise intervention with health education (Buman et al., 2011). At 16 weeks, both groups showed similar significant improvements in moderate-to vigorous exercise but at 18 months, the group that received peer support reported significantly greater exercise participation. To the best of our knowledge, a peer mentoring approach has not been used to promote exercise among cancer survivors.
We conducted a successful pilot study in collaboration with the American Cancer Society's (ACS) Reach to Recovery (RTR) program in which RTR volunteers offered an evidence-based PA intervention to breast cancer patients (Pinto, Rabin, Abdow & Papandonatos, 2008). The PA intervention had previously been tested in a randomized controlled trial: the Moving Forward study (Pinto, Frierson, Rabin, et al., 2005). The intervention was grounded in the Transtheoretical Model (TTM) (DiClemente et al., 1991; Prochaska & DiClemente, 1983) and Social Cognitive Theory (SCT) (Bandura, 1986). The TTM is based on the stages of adopting a new health behavior and has been adapted to PA (Marcus & Simkin, 1993). RTR volunteers (who are breast cancer survivors themselves) receive intensive training from the ACS and provide emotional and information support (e.g., empathy for anxiety/fear, making patients aware of community resources) to patients and survivors. These services are offered during an in-person meeting and subsequently in one to two follow-up calls. We used this “natural fit” in a single group longitudinal pilot study and found that it was feasible to train these volunteers (n=7) to coach sedentary breast cancer survivors (n=25) over 12 weeks to become more physically active. We also obtained promising results on survivors’ self-reported PA and psychological outcomes at 12 and 24 weeks (Pinto, Rabin, Abdow & Papandonatos, 2008).
In the current study, we extended our pilot work by conducting a randomized controlled trial and increased the reach of the intervention to RTR programs in six New England (NE) states. Our goal was to compare the PA counseling provided by the RTR volunteers (coaches) to a contact control condition also provided by the volunteers. The primary aim was to examine the effects of the intervention vs. contact control on participants’ self-reported (and hence, similar to the pilot study and to other trials of peer mentoring for PA; Castro et al., 2011; Buman et al., 2011) activity of moderate to vigorous- intensity PA (MVPA) at 12 and 24 weeks. Secondary outcomes included effects on objective activity monitoring by accelerometer, the proportion of participants who met or exceeded ACSM exercise guidelines for cancer survivors (i.e., 150 minutes/week) (Schmitz, et al., 2010) and the proportion of participants who showed progression in motivational readiness for exercise. Our hypotheses were that the intervention group (PA plus RTR) would report greater MVPA and improved secondary outcomes compared to control group (RTR Control) participants at 12 and 24 weeks. An exploratory goal was to examine potential moderators of intervention effects on MVPA such as age, body mass index, seasonal effects, NE state of residence, and coach.
Method
Design
This randomized controlled trial compared the effects of a theoretically-based 12 week PA program (PA Plus RTR) vs. contact control (RTR Control) offered by RTR volunteers to breast cancer survivors (participants). Participants’ MV PA and related outcomes were assessed at baseline, 12 weeks and 24 weeks. The study received approval from the Institutional Review Boards at The Miriam Hospital (RI) and Women & Infants Hospital (RI).
Recruitment of ACS RTR Volunteers
ACS offices in 6 NE states (CT, MA, ME, NH, RI, and VT) were contacted to assess their interest in partnering with the researchers in this study (there were seven regional offices across the six states that participated in this trial). Of the 6 states, it was not feasible to recruit volunteers to serve as coaches in two states for reasons such as lack of sufficient volunteer pool, difficulty traveling to the ACS offices for training and lack of internet facilities for training. Eligibility to serve as coaches for the study included: having completed RTR training and been a RTR volunteer for at least a year and, willingness to: a) participate in group training, b) provide coaching to 4-5 participants, c) be supervised by telephone, and d) audiotape telephone contacts with study participants. Volunteer coaches completed informed consent procedures and were asked to complete brief questionnaires at the start of the study, at the end of training and at the end of study participation.
ACS staff in the four states approached 335 Reach volunteers about study participation through email, informational mailings, and personal contact. Thirty one volunteers expressed interest in the study, 28 were screened for eligibility (two were lost to follow-up prior to telephone screen, and one was not available for training sessions during the day). Of the 28, 18 volunteers (hereafter referred to as coaches) completed training (64%)( mean age = 54.89 years, SD=7.76, mean 7.00 years post-diagnosis, mean years volunteering with RTR=4.47 years). The reasons for dropping out prior to training completion were: too busy caring for family members (n=3), time constraints (n=2), not interested (n=2), did not like the questionnaires (n=1), lost to follow-up (n=1), and not available for training (n=1).
Training of Coaches
Coaches were trained in small groups: the training was offered either in person or using video-conferencing. The 4 session training program (approximately 2 hours per session) consisted of didactics on the research program, intervention theory, intervention program, and issues relevant to human subjects certification and HIPAA requirements. Coaches were provided with a training manual and copies of the print materials that participants received. The coaches received training in delivering the RTR Control condition but the majority of the training time was focused on PA counseling. Three sessions focused on role-plays to train skills in PA counseling techniques (e.g., empathy, reflective listening). To ensure safety of participants, the coaches were trained to ask about physical symptoms that may be indicative of a serious medical issue (e.g., chest pain): in these instances, they were instructed to advise participants to seek medical consultation and to contact the research team. The coaches were also trained to review pulse rate and rates of perceived exertion as reported by participants during home exercise to ensure that participants exercised at least at moderate-intensity levels and did not over exert. If participants became distressed, coaches were trained to notify research staff so that appropriate referrals could be made. Training was terminated after coaches completed a successful mock intervention call (PA Plus RTR) and a RTR Control call.
Participants
Women aged ≥21 years with Stage 0-3 breast cancer (diagnosed in the past 5 years) were eligible if they a) had completed surgery (patients receiving on-going chemotherapy, radiation or hormone treatment were eligible); 2) were able to read and speak English; 3) were ambulatory and able to walk half-mile without stopping; 4) were sedentary (i.e., less than 30 minutes/week of vigorous exercise for the past six months or less than 90 minutes per week of moderate-intensity exercise for the past six months); and 5) had access to a telephone and were willing to receive telephone calls. Women with medical or psychiatric problems (e.g., myocardial infarction, stroke, transient ischemic attacks, substance abuse, and orthopedic problems) that might interfere with protocol adherence were excluded. Our goal was to recruit 108 participants.
Our primary analysis was to compare RTR Control and PA Plus RTR groups on the change from baseline to 12 and 24 weeks on MVPA. Sample size (n=108 before attrition) was projected from an anticipated large effect (delta=0.97) at 12 weeks and a moderate effect (delta =0.60) at 24 weeks. The estimates were obtained from the effect sizes in the pilot study (Pinto, Rabin, Abdow & Papandonatos, 2008) and a prior randomized controlled trial (Pinto, Frierson, Rabin, et al., 2005). We anticipated 99% power to detect differential change on MVPA at 12 weeks and 80% power at 24 weeks at a multiplicity-adjusted significance level alpha=0.025. The power estimates were based on the assumption that participant outcomes were independent within each ACS office.
Participant Recruitment
The original recruitment plan was to solicit participants from those who contacted the ACS in New England for RTR services. We found that after 3 months of recruitment in RI, the request for RTR services was very low and we enrolled one participant into the trial. We then used alternative methods of recruitment. Our primary recruitment source was a mailing from the Senior Operations Vice-President for Health Initiatives at the ACS to breast cancer constituents on mailing lists maintained by the ACS in 6 states (n=8111), electronic newsletters sent by the ACS to their constituents in NE, recruitment at ACS sponsored events in RI, and referrals from RTR coordinators (n=26). In addition, we used non-ACS sources of recruitment. These included informational mailings by three hospitals in three states (RI, MA and CT, mailing size = 2425) and three private practices to breast cancer patients in two states (RI and CT) (mailing size = 321), and in-person recruitment at one hospital in RI, health fairs and other events in RI. Recruitment was conducted from January 2010 to April 2012.
Interested participants were asked to contact the study staff to determine eligibility using a toll-free number. Research staff called those patients who provided contact information at the community events. After completing a phone screen for eligibility, obtaining informed consent from participants and physician consent for study participation, research staff conducted baseline assessments. In total, n=595 potential participants were contacted, 304 were ineligible at initial contact or phone screen (51.1%), n=123 were not interested (20.7%) and 168 were eligible at phone screen (28.2%). Reasons for ineligibility can be seen in Figure 1. Of the 168 potential participants, 31 were no longer interested, 61 became ineligible and the remaining 76 were eligible and randomized (76/168=45.2%).
Intervention Delivery
After patients completed baseline assessments, the Intervention Coordinator opened the sealed envelope that contained the randomization status (sample was stratified by age and whether or not they had receiving chemotherapy) and notified the participant by telephone. The group assignments were generated at an off-site location and placed in sequentially numbered and sealed opaque envelopes. The Intervention Coordinator assigned participants to coaches based on scheduling availability and similarity of cancer treatment(s). Each coach was asked to contact her participant in PA Plus RTR or RTR Control once a week over 12 weeks and audio-tape the calls.
PA Plus RTR group
Participants randomized to this group received telephone-based PA counseling, a pedometer (Digiwalker) and a heart rate monitor. The PA intervention was modeled on the “Moving Forward” trial and consisted of PA counseling matched to participants’ motivational readiness plus PA tipsheets (Pinto, Frierson, Rabin, et al., 2005). Counseling focused on building a supportive relationship with participants, assessing motivational readiness, monitoring PA, identifying health concerns, and identifying and problem solving barriers to PA. The goal was to encourage participants to gradually increase the amount of aerobic PA (e.g., brisk walking) over 12 weeks to recommendations of ≥ 30 mins. of moderate-intensity PA on most days of the week (Schmitz, et al., 2010; U.S. Department of Health and Human Services, 1996). All participants received instructions and were provided logs to monitor PA: participants recorded the duration of their exercise, type of exercise, heart rate, rate of perceived exertion and pedometer steps. Coaches reviewed the logs during the telephone calls; the logs were then sent to the research staff for data entry.
During the weekly calls, if participants reported symptoms such as chest pain, they were referred to their physicians. There were instances of participants reporting chest pain and shortness of breath during exercise (n=6), vertigo (n=1), and ankle injury (n=4) that required that we temporarily suspend their study participation until a physician evaluation and consent were obtained.
Participants were also provided RTR informational booklets (available from the ACS) and 12 exercise tipsheets that focused on PA topics (such as exercising safely, staying motivated and the like). Coaches also responded to questions that participants asked about breast cancer and its treatment (similar to the type of information and support provided in the RTR program). Quality control procedures are described in supplementary files. Finally, a feedback report that showed the participant's PA and summarized their barriers to PA and ways to overcome these barriers (as discussed during the calls) was sent to participants at Week 2, 4, 8 and 12.
RTR Control Group
Our aim was to assess the effects of a structured peer mentoring program on MVPA. Hence, participants assigned to the Control group were asked not to join a structured PA program during the 12-week intervention phase. Although the RTR program generally consists of 1-3 contacts with patients who request services, for the purpose of this study, we extended the contact to 12 calls to control for frequency of contact between the two study groups. During each weekly call, the coach administered the Weekly Symptom Questionnaire (Winningham, 1993) that assesses problems such as headaches that people may experience that can affect normal activity of daily life. Participants were also provided RTR informational booklets. Coaches responded to participants’ questions about breast cancer and its treatment and provided support as is typical of the RTR program. The PA tipsheets (identical to those sent to the PA Plus RTR group) were provided to these participants at 24 weeks.
Measures
Coaches
Prior to training, coaches completed a brief demographic form. We recorded the number and duration of calls (from the audio-tapes) delivered to each participant.
Participants
At baseline, participants were asked to provide demographic information (e.g., age, education), height and weight. Information on their cancer diagnosis and treatment was obtained by a form sent to the patients’ physicians’ offices. Participants were given accelerometers (Actigraphs) with instructions to wear the unit for 7 days and a packet of questionnaires assessing stage of motivational readiness and psychosocial variables. Participants were asked to mail back the Actigraph and the completed questionnaires. A Research Assistant (blind to the participant's group assignment) conducted a PA interview (described below) by telephone and was responsible for collecting all data. The same procedure was repeated to collect data at 12 weeks and 24 weeks.
a) Seven Day Physical Activity Recall
(7 Day PAR) (Blair et al., 1985), a widely used, validated measure of PA was administered by telephone at baseline, 12 and 24 weeks. It assesses hours spent in sleep, moderate activity, hard and very hard activity. We obtained the total minutes of MVPA as our key measure. These data were also used to determine the proportion of participants who reported exercising at national recommendations of 150 minutes/week (U.S. Department of Health and Human Services, 2008).
b) Accelerometer
Participants were asked to wear a tri-axis accelerometer (Actigraph GT3X) for seven days at each assessment point. The Actigraph monitors activity counts, energy expenditure and steps taken. Software is available for categorizing the counts into light, moderate, hard or very hard categories. Intensity categories based on monitor data have been developed in a calibration study (Freedson, Melanson, & Sirard, 1998). For analyses, only activity of at least moderate-intensity was considered.
c) Stage of readiness for PA
was measured by a 5-item instrument (Marcus, Rossi, Selby, Niaura, & Abrams, 1992) that was mailed to participants for completion. It is reliable (kappa=.78)(Marcus, et al., 1992), has concurrent validity with the 7 Day PAR and stage progression is significantly associated with fitness improvements (Marcus & Simkin, 1993).
Statistical Analysis
As a preliminary step, between group differences in baseline demographics, medical history and MVPA were tested using t-tests for continuous variables and chi-squared tests for categorical variables. In addition, descriptive statistics were calculated for coach data, including both baseline demographics as well as medical history variables.
Using a mixed effect longitudinal regression model, the effects of group assignment (PA plus RTR versus RTR Control) on minutes/week of MVPA at 12 and 24 weeks were simultaneously assessed, while controlling for baseline values of the outcome, as well as age and chemotherapy use. Although there were no between-group differences in mean age or chemotherapy use, these covariates were included in the model (and chosen apriori), as they are known to be associated with MVPA adoption amongst this population. Models included random intercepts to account for within-subject correlation of repeated measurements over time. In a subsequent step we assessed whether clustering by coach significantly impacted model estimates. Models were run for each of the MVPA outcomes (subjectively collected and objectively measured PA) and results are presented separately for each. In addition, the correlation between MVPA as measured by the 7-day PAR and collected by accelerometer was estimated using Spearman rank order correlations (at each time point). Finally, a series of models to assess moderation were run (which included main effects of the intervention, the potential moderator and the interaction between the two). Moderators included age, body mass index, seasonal effects, NE state of residence, and chemotherapy use.
Unadjusted proportion of participants meeting ACSM guidelines (defined as reporting at least 150 min/week of at least moderate intensity PA) (Schmitz, et al., 2010) were summarized for both groups at each follow-up time (12 and 24 weeks). Using a longitudinal regression model implemented with Generalized Estimating Equations (GEE's) with robust standard errors, we estimated the effect of the intervention on the probability of meeting guidelines at each follow-up, adjusting for age and chemotherapy use. Models included both main effects of time and intervention group, as well as the interaction between them, thus assuming that the slope of the effect changes over time. Models assumed an unstructured working correlation matrix.
In addition, we assessed whether there were between group differences in the probability of increasing stage of motivational readiness from baseline to 12 and 24 weeks respectively. Outcomes were binary (1=increased stage from last follow-up, 0=stayed the same/regressed) and unadjusted proportions were summarized by intervention group. Using a longitudinal regression model implemented with GEE's with robust standard errors, we examined whether the odds of increasing stage of motivational readiness differed over time and by intervention group, after adjusting for age and chemotherapy use. Models assumed an unstructured working correlation matrix.
Finally, we assessed whether there were between group differences in number of calls and length of calls during the intervention period using t-tests. In addition, using models similar to those described for the main outcome (min/week of MVPA from the 7-day PAR), we assessed whether there was a dose effect on MVPA outcomes. Models included a main effect of dose (number of calls and length of calls in two separate models respectively) and adjusted for age and chemotherapy use.
All analysis was carried out using SAS Version 10.0 and significance level was set apriori at alpha=0.05.
Results
On average, participants were 55.6 years of age (SD=9.6) and the majority were married/living with partner (82.9%). The sample identified themselves as predominately Caucasian (98.7%) with 6.6% identifying themselves as Hispanic/Latino. Overall, participants reported 24.6 min/week of MVPA at baseline (SD=30.0) (See Table 1). There were no between group differences in baseline characteristics (p's>0.05) nor in baseline psychosocial constructs (data not shown). The mean age of the coaches was 54.9 years with an average of 7.0 years since diagnosis. The complete description of the coaches is presented in Supplementary Table 1. Retention rates at 12 weeks were 92% in the PA plus RTR group relative to 87% in RTR Control (non-significant between group differences). At 24 weeks, retention rates were 92% vs. 84% for PA plus RTR and RTR Control respectively (non-significant between group differences). Full consort diagram of participant recruitment and retention is presented in Figure 1.
Table 1.
PA plus RTR (N=39) | RTR Control (N=37) | All (N=76) | |
---|---|---|---|
Age, years a | 55.64 (8.59) | 55.59(10.59) | 55.62(9.55) |
Marital Status, married/living with partnerb | 79.49%(31) | 86.49%(32) | 82.89%(64) |
Race, White b | 97.44%(38) | 100%(37) | 98.68%(75) |
Ethnicity, Hispanic/Latino b | 10.26%(4) | 2.70%(1) | 6.58%(5) |
Education, At least Some College b | 94.87%(37) | 83.78%(31) | 89.47%(68) |
Employment Full-time b | 30.77%(12) | 48.65%(18) | 39.47%(30) |
Income, >=40k b | 76.92%(30) | 62.16%(23) | 69.74%(53) |
Stage b | |||
0 | 7.69%(3) | 5.41%(2) | 6.58%(5) |
1 | 41.03%(16) | 35.14%(13) | 38.16%(29) |
2 | 41.03%(16) | 48.65%(18) | 44.74%(34) |
3 | 10.26%(4) | 10.81%(4) | 10.53%(8) |
Years Since Diagnosis a | 1.05 (0.98) | 1.16 (1.14) | 1.11(1.05) |
Treatment b | |||
Lumpectomy | 58.97%(23) | 48.65%(18) | 53.95%(41) |
Mastectomy | 35.90%(14) | 37.84%(14) | 36.84%(28) |
Radiation | 83.78%(31) | 72.97%(27) | 78.38%(58) |
Chemotherapy | 78.38%(29) | 64.86%(24) | 71.62%(53) |
Hormone | 57.89%(22) | 54.05%(20) | 56.00%(42) |
Treatment | 31.77(33.87) | 17.14(23.42) | 24.64(29.98) |
Note. MVPA = moderate-to-vigorous intensity PA; PA = physical activity; RTR = Reach to Recovery.
Values are mean (standard deviation).
Values are n (%)
Self-reported MVPA
Participants randomized to PA plus RTR, increased their self-reported min/week of MVPA from 31.8 min/week at baseline (SD=33.9) to 129.5 at 12 weeks (SD=73.4) and 98.4 at 24 weeks (SD=83.2), whereas RTR Control participants increased from 17.1 min/week at baseline (SD=23.4) to 25.0 at 12 weeks (SD=67.4) and 63.9 at 24 weeks (SD=82.9). Adjusted model results (from the mixed effects models described previously) suggest significant between group differences at both 12 and 24 weeks such that the mean difference in min/week of MVPA between those randomized to PA plus RTR and RTR Control was 103.0 min/week (SD=15.4, p<.001) at 12 weeks and 34.7 min/week (SD=15.5, p=0.03) at 24 weeks (Table 2). Main effects of the intervention from the mixed effects model was 12.60, SE=14.72 and interactions between intervention and follow-up time were 90.35, SE=18.44, p<.01 at 12 weeks and 22.14, SE=18.54, and p=0.23 at 24 weeks. Note that the interaction between intervention and follow-up time represents change in slope at follow-up for those randomized to PA Plus RTR (see Figure 2). Further clustering on coach did not significantly impact the results and thus are not included here. In addition, there were no significant moderators of the intervention effects (p-values for interaction terms >.05).
Table 2.
Time a | Estimate | Standard Error | P-value |
---|---|---|---|
Week 12 | 103.0 | 15.4 | <.001 |
Week 24 | 34.7 | 15.5 | 0.03 |
Note. Estimates are adjusted mean difference between treatment conditions at each follow-up.
MVPA = moderate-to-vigorous intensity PA; PA = physical activity; RTR = Reach to Recovery.
Values are self-reported mean minutes per week of MVPA.
Accelerometer data
Results suggest a significant correlation between self-reported and objectively measured PA at 12 and 24 weeks (rho=0.59, p<.01 at 12 weeks, rho=0.43, p<.01 at 24 weeks). PA plus RTR participants increased their min/week of MVPA from 13.4 (SD=25.0) at baseline to 70.3 (SD=65.9) at 12 weeks and 54.6 (SD=81.6) at 24 weeks. In contrast, RTR Control participants changed from 14.3 (SD=23.6) at baseline to 16.5 (SD=31.9) at 12 weeks and 13.4 (SD=35.2) at 24 weeks. Regression models suggest a significant difference in min/week of MVPA as measured by accelerometer at 12 and 24 weeks (p's<.01) such that the mean difference in MVPA between PA plus RTR and RTR Control was 48.5 min/week at 12 weeks (SE=11.9) and 38.7 min/week (SE=12.0) at 24 weeks, after adjusting for age and chemotherapy use (Table 3). Main effects of intervention from the mixed effects model was -3.52, SE=11.16, p=0.75 and interactions between intervention and follow-up time were 52.05, SE=13.75 p<.01 at 12 weeks and 42.23, SE=13.89, p<.01 at 24 weeks. Note that the interaction between intervention and follow-up time represents change in slope at follow-up for those randomized to PA Plus RTR. Also see Figure 3.
Table 3.
Time a | Estimate | Standard Error | P-value |
---|---|---|---|
Week 12 | 48.5 | 11.9 | <.01 |
Week 24 | 38.7 | 12.0 | <.01 |
Note. Estimates are adjusted mean difference between treatment conditions at each follow-up.
MVPA = moderate-to-vigorous intensity PA; PA = physical activity; RTR = Reach to Recovery.
Values are objectively measured mean minutes per week of MVPA.
Meeting PA guidelines
Amongst those randomized to PA plus RTR, 41.0% met PA guidelines (Schmitz, et al., 2010; U.S. Department of Health and Human Services, 2008) at 12 weeks and 25.6% met guidelines at 24 weeks. Amongst those in RTR Control, these proportions were 5.4% and 16.2% respectively. Regression models suggest a significant intervention effect at 12 weeks (p=0.001) but not at 24 weeks (p=0.29). Specifically, the odds of meeting guidelines was significantly higher amongst PA plus RTR participants, compared to RTR Control (OR=13.1, SE=10.5) at 12 week follow-up. Regression parameters are presented in Supplementary Table 2.
Motivational readiness
Unadjusted proportions of participants increasing their stage of motivational readiness are presented in Table 4 for both groups at both follow-up times. Models suggest a significant intervention effect such that the odds of increasing stage of change was greater amongst PA plus RTR participants compared to RTR Controls at 12 weeks (B=2.76, SE=0.62, OR=15.84, p<.01) but not at 24 weeks (p>.05).
Table 4.
Baseline | 12 weeks | 24 weeks | |
---|---|---|---|
PA plus RTR | |||
Precontemplation | 0 | 0% | 0% |
Contemplation | 51.3% | 5.6% | 22.2% |
Preparation | 48.7% | 8.3% | 27.8% |
Action/Maintenance | 0% | 86.2% | 50.0% |
RTR Control | |||
Precontemplation | 2.7% | 6.3% | 6.7% |
Contemplation | 43.2% | 46.9% | 36.7% |
Preparation | 54.1% | 21.9% | 20.0% |
Action/Maintenance | 0% | 25.0% | 36.7% |
Note. PA = physical activity; RTR = Reach to Recovery.
Intervention delivery
Finally, RTR coaches were able to deliver 92.24% of expected calls; mean number of calls across participants was 11.07 (SD=2.24). There were non-significant group differences in the mean number of calls delivered (PA plus RTR: Mean=11.16, SD=2.24 vs. RTR Control: Mean=10.97, SD=2.27, p>.05). As expected, there was a significant difference in mean duration of calls with PA plus RTR call length exceeding that of RTR Control (PA plus RTR: Mean=18.46 minutes, SD=7.36 vs RTR Control: Mean=12.67, SD=4.04, p<.05). There was no association between number of calls or length of calls and PA outcomes (min/week of MVPA as measured by the 7-Day PAR).
Discussion
The main finding of this trial is that a 12-week telephone-based PA intervention provided by volunteer peer coaches produced significantly greater increases in MVPA in cancer survivors relative to a contact control condition also led by peers. These results are consistent with and extend previous research which indicates that volunteer peer mentors can effectively increase PA among sedentary adults with no history of cancer (Buman, et al., 2011; Castro, et al., 2011). Such findings suggest professional staff-led interventions, which are costly and often not feasible in community settings, are not necessary to achieve desired behavior change and increases in MVPA. Results of our previous pilot study demonstrated that volunteer peer coaches can increase PA in cancer survivors in a single group longitudinal design (Pinto, Rabin, Abdow & Papandonatos, 2008). The current study extends these results by using a randomized clinical trial design. Additionally, we extended the reach of our intervention beyond one state to six NE states. Furthermore, we found that cancer survivors randomized to the peer-led intervention showed significantly greater increases across multiple MVPA outcomes. Specifically, participants in the PA plus RTR arm had increased MVPA at both 12 and 24 weeks on both subjective (7-day PAR) and objective (accelerometer) measures of PA. In addition, those in PA plus RTR condition were more likely to meet ACSM guidelines for PA and to improve their motivational readiness for behavior change at 12 weeks. To our knowledge, this is the first trial to demonstrate a peer coaching intervention can increase PA in cancer survivors.
Our results are noteworthy in that they are likely to have greater “real world” application through the engagement of a large community-based organization (the ACS), which has an established program (RTR) aimed at helping breast cancer survivors navigate the cancer treatment and recovery experience. Previous research has shown that increased PA after cancer can lead to improved physical and emotional health (Schmitz, et al., 2010). Thus, the addition of a PA intervention to an established program could increase both the value of the program to participants as well as its potential to positively impact their long-term health outcomes. Integration of a PA intervention component into community-based programs also represents a potentially efficient and cost-effective method of identifying and recruiting both coaches and participants in PA trials as it builds on existing infrastructure and leverages programs that have established positive reputations in the community. In addition, the mechanisms to communicate with participants and deliver the intervention (via volunteer peer coaches) are already in place. Indeed, in many such programs, including RTR, community-based coaches are trained to understand and address the issues survivors face during their cancer experience. In particular, peer coaches have developed skill sets with regard to talking with cancer survivors about various challenging health concerns, have built rapport with those they provide coaching to, and are in position to deliver an evidence-based intervention with minimal additional training and cost to the program. Such an intervention focused on increasing PA is also consistent with recommendations of the ACS (Rock et al., 2012) and thus the adoption of the intervention into programs is likely to be supported by the organization.
Another strength of this study is in the inclusion of both subjective and objective measures of PA as recommended by Haskell (2012). Other intervention studies have relied solely on self-reported PA (Morey, et al., 2009), which may be subject to overestimation and underestimation of actual engagement (Heckler et al., 2012). In our study, we found concordance between self-reported PAR and objectively measured accelerometer PA data at both 12 and 24 weeks, suggesting the fidelity of our intervention was strong and adding confidence that our results are valid. The correlations between subjective and objective measures of PA in the present study were moderate but higher than those reported in other studies (Heckler, et al., 2012; Shuval et al., 2012). It is clear the self-reported exercise exceeded objectively measured activity at all time-points. This is not an unusual occurrence (Marcus et al., 2007; Marcus et al., in press) because each technique uses different measurement approaches (Dale, Welk & Matthews, 2002). Despite these differences, intervention effects on exercise assessed by both techniques (recall and objective data) were significant at both time-points, thereby increasing confidence in our results.
An important outcome is that 41% of the participants in the PA plus RTR arm met ACSM guidelines for PA at the end of the intervention period. Compared with only 5.4% of the controls meeting the guidelines at 12 weeks, these findings underscore that the intervention not only increased absolute levels of MVPA over time but also raised them to levels that may positive impact overall physical health. Thus, coaches clearly were effective in communicating the importance of meeting guidelines and the potential health benefits of doing so. It is possible that coaching regarding PA may generalize to other health behaviors, potentially having a greater impact on overall health (Prochaska, Spring, & Nigg, 2008).
Although the results of this trial are positive, there are limitations that warrant consideration. First, our study was conducted solely with female breast cancer survivors. Thus, the generalizability of the findings to survivors of other cancers and male cancer survivors are unknown at this point. On the one hand, the intervention is not disease or gender-specific, so it is plausible that this intervention would also benefit male survivors or those with cancers other than breast. Indeed, other PA trials have been shown to be equally effective with both men and women and across different disease sites (Morey, et al., 2009). Secondly, we powered our trial on the effect size obtained in the pilot study (Pinto, Rabin, Abdow & Papandonatos, 2008) which showed a larger effect size (d=0.97) than found in a review of exercise interventions for cancer survivors (Speck et al., 2010). Thirdly, there are limitations to generalizability in that the response to mailed letters inviting women treated for breast cancer to participate was poor suggesting some limitations to the uptake of this intervention. Among those who responded, a subgroup reported exercising with some regularity and were excluded (23.8%). The response to solicitation for coach volunteers was also not as high as expected and may limit intervention implementation (reasons for the non-responses were not obtained). Fourthly, we did not assess fitness. The current study was not designed to impact fitness or other biomedical outcomes; rather we sought a “real world” application of an already tested evidence-based PA intervention delivered to cancer survivors by peer coaches. Another concern is the finding that significant differences in MVPA found at 12 weeks were not maintained to the same extent at 24 weeks. It is plausible that RTR Control participants joined other structured exercise programs after the 12-week assessment and their mean MVPA increased at 24 weeks. The effects may also be attributable to the fact that the weekly telephone calls to both groups ended at 12 weeks. Thus, it is perhaps not surprising that the positive gains in the PA Plus RTR group were attenuated over time. However, this finding does suggest an area of future research as exercise maintenance is critical to the management of cardiovascular disease, and other chronic conditions among cancer survivors as well as potentially for cancer survival (Holmes, Chen, Feskanich, Kroenke, & Colditz, 2005; Irwin et al., 2011). Maintenance of outcomes is also fundamental to inform the transition of evidence-based behavior interventions into practice (Glasgow, Klesges, Dzewaltowski, Bull, & Estabrooks, 2004). Finally, this trial was powered on the effects on self-reported MVPA found in the pilot study (Pinto, Rabin, Abdow & Papandonatos, 2008) and the large effect size that we found in this prior work is higher than the small-to-moderate effect size found in PA interventions for cancer survivors (Speck et al., 2010).
Our goals were not to test peer mentoring for exercise versus other structured exercise programs (e.g., Buman et al., 2011) but to test the effects of peer mentoring on participants’ self-reported MPVA) versus those who did not receive the PA counseling but had equal frequency of contact with the peer mentors. Hence, we instructed the RTR Control group not to join a structured exercise program for the first 12 weeks. It is plausible that these instructions may have led some Control participants to artificially constrain their PA during the 12-week intervention phase.
The present findings underscore the potential for a large scale dissemination project in collaboration with a large, national community-based organization such as the ACS. Such a project may have wider application for difficult to reach populations including those living in rural areas, minorities, those with less education, and the medically-underserved. A telephone-based intervention may also appeal to older or physically-impaired individuals who may find it difficult to travel to more traditional clinic-based PA intervention programs. A recent review has acknowledged that peer-delivered PA interventions are an overlooked opportunity for PA promotion (Ginis, Nigg & Smith, 2013). The authors point out that in the larger healthcare context, PA prescriptions are probably best left to physicians, physiotherapists and fitness professionals, while peers are probably best suited for the delivery of PA interventions in a way that others in the healthcare system may neither have the time nor the training to provide. Before launching a dissemination project, however, future research should explore options for improving efficiency, optimal methods of delivery, and cost effectiveness. For example, while telephone-based interventions may be effective in modifying PA levels, maintenance of this delivery mode over time may not be feasible or cost-effective. However, prompts and reminders have been found to be effective to sustain behavior change (Lombard, Lombard, & Winett, 1995). Thus, other methods of communication that can help survivors maintain gains in MVPA and do not require individual coach's time, such as text messages, emails, etc. should be considered.
In sum, the results suggest that peer coaches identified through existing community-based programs can effectively deliver counseling and increase PA in cancer survivors compared to Control group participants who received equal frequency of contact with peer coaches, RTR print materials and were instructed not to join a structured exercise program for the first 12 weeks. Such peer-led interventions have the potential for large scale dissemination and may positively impact survivors’ health behaviors and overall health, particularly among difficult-to-reach populations. Future research focusing on strategies to maintain gains in PA through existing and emerging technologies and time-saving modes of communication may optimize impact.
Supplementary Material
Acknowledgments
This study was supported by a grant from the National Cancer Institute (R01 CA132854). We thank Debborah Smith, Kathy LeJeune, Alexandra Fiore, and the Vice-Presidents of the American Cancer Society (CT, MA, ME, NH, RI and VT) for their assistance with coach and participant recruitment. We are appreciative of the RTR coaches who provided the exercise counseling. Thanks also to Dr. Michael Goldstein, Dr. George Papandonatos, Dr. Gail Agronick, Lucy Balanca, Marissa Waldemore and Chris Breault for study implementation. This trial was registered in Clinical Trials.gov (NCT00948701).
Biography
Bernardine M. Pinto, Centers for Behavioral and Preventive Medicine, Department of Psychiatry and Human Behavior, The Miriam Hospital and W. Alpert Medical School of Brown University; Kevin Stein, Behavioral Research Center, American Cancer Society; Shira Dunsiger, Centers for Behavioral and Preventive Medicine, Department of Behavioral and Social Sciences, The Miriam Hospital and W. Alpert Medical School of Brown University.
Contributor Information
Bernardine M. Pinto, Centers for Behavioral and Preventive Medicine, The Miriam Hospital and W. Alpert Medical School of Brown University
Kevin Stein, Behavioral Research Center American Cancer Society, Atlanta, GA
Shira Dunsiger, Centers for Behavioral and Preventive Medicine, The Miriam Hospital and W. Alpert Medical School of Brown University
References
- Bandura A. Social foundations of thought and action: A social cognitive theory. Prentice-Hall; Englewood Cliffs, NJ: 1986. [Google Scholar]
- Blair SN, Haskell WL, Ho P, Paffenbarger RS, Jr., Vranizan KM, Farquhar JW, Wood PD. Assessment of habitual physical activity by a seven-day recall in a community survey and controlled experiments. American Journal of Epidemiology. 1985;122(5):794–804. doi: 10.1093/oxfordjournals.aje.a114163. [DOI] [PubMed] [Google Scholar]
- Brown JC, Huedo-Medina TB, Pescatello LS, Pescatello SM, Ferrer RA, Johnson BT. Efficacy of exercise interventions in modulating cancer-related fatigue among adult cancer survivors: a meta-analysis. Cancer Epidemiology, Biomarkers and Prevention. 2011;20(1):123–133. doi: 10.1158/1055-9965.EPI-10-0988. doi: 10.1158/1055-9965.epi-10-0988. [DOI] [PubMed] [Google Scholar]
- Buman MP, Giacobbi PR, Jr., Dzierzewski JM, Aiken Morgan A, McCrae CS, Roberts BL, Marsiske M. Peer volunteers improve long-term maintenance of physical activity with older adults: a randomized controlled trial. Journal of Physical Activity & Health. 2011;8(Suppl 2):S257–266. [PMC free article] [PubMed] [Google Scholar]
- Castro CM, Pruitt LA, Buman MP, King AC. Physical activity program delivery by professionals versus volunteers: the TEAM randomized trial. Health Psychology. 2011;30(3):285–294. doi: 10.1037/a0021980. doi: 10.1037/a00219802011-09497-006 [pii] [DOI] [PMC free article] [PubMed] [Google Scholar]
- Dale D, Welk GJ, Matthews CE. Methods for assessing physical activity and challenges for research. In: Welk GJ, editor. Physical Activity Assessments for Health-Related Research. Human Kinetics; Champaign, IL.: 2002. pp. 19–34. [Google Scholar]
- DiClemente CC, Prochaska JO, Fairhurst SK, Velicer WF, Velasquez MM, Rossi JS. The process of smoking cessation: an analysis of precontemplation, contemplation, and preparation stages of change. Journal of Consulting and Clinical Psychology. 1991;59(2):295–304. doi: 10.1037//0022-006x.59.2.295. [DOI] [PubMed] [Google Scholar]
- Duijts SFA, Faber MM, Oldenburg HSA, van Beurden M, Aaronson NK. Effectiveness of behavioral techniques and physical exercise on psychosocial functioning and health-related quality of life in breast cancer patients and survivors—a meta-analysis. Psychooncology. 2011;20(2):115–126. doi: 10.1002/pon.1728. doi: 10.1002/pon.1728. [DOI] [PubMed] [Google Scholar]
- Ferrer R, Huedo-Medina T, Johnson B, Ryan S, Pescatello L. Exercise interventions for cancer survivors: a meta-analysis of quality of life outcomes. Annals of Behavioral Medicine. 2011;41(1):32–47. doi: 10.1007/s12160-010-9225-1. doi: 10.1007/s12160-010-9225-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Freedson PS, Melanson E, Sirard J. Calibration of the Computer Science and Applications, Inc. accelerometer. Medicine and Science in Sports and Exercise. 1998;30(5):777–781. doi: 10.1097/00005768-199805000-00021. [DOI] [PubMed] [Google Scholar]
- Ginis KA, Nigg CR, Smith AL. Peer-delivered physical activity intervnetions: an overlooked opportunity for physical activity promotion. Translational Behavioral Medicine. 2013;3:434–443. doi: 10.1007/s13142-013-0215-2. Doi:10.1007/s13142-013-0215-2. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Glasgow RE, Klesges LM, Dzewaltowski DA, Bull SS, Estabrooks P. The future of health behavior change research: what is needed to improve translation of research into health promotion practice? Annals of Behavioral Medicine. 2004;27(1):3–12. doi: 10.1207/s15324796abm2701_2. doi: 10.1207/s15324796abm2701_2. [DOI] [PubMed] [Google Scholar]
- Haskell WL. Physical activity by self-report: a brief history and future issues. Journal of Physical Activity & Health. 2012;9(Suppl 1):S5–10. doi: 10.1123/jpah.9.s1.s5. [DOI] [PubMed] [Google Scholar]
- Heckler EB, Bruman MP, Haskell WL, Conway TL, Cain KL, Sallis JF, King AC. Reliability and validity of the CHAMPS self-reported sedentary-to-vigorous intensity physical activity in older adults. Journal of Physical Activity & Health. 2012;9:225–236. doi: 10.1123/jpah.9.2.225. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Holmes MD, Chen WY, Feskanich D, Kroenke CH, Colditz GA. Physical activity and survival after breast cancer diagnosis. Journal of the American Medical Association. 2005;293(20):2479–2486. doi: 10.1001/jama.293.20.2479. doi: 293/20/2479 [pii]10.1001/jama.293.20.2479. [DOI] [PubMed] [Google Scholar]
- Hooker SP, Seavey W, Weidmer CE, Harvey DJ, Stewart AL, Gillis DE, King AC. The California active aging community grant program: translating science into practice to promote physical activity in older adults. Annals of Behavioral Medicine. 2005;29(3):155–165. doi: 10.1207/s15324796abm2903_1. doi: 10.1207/s15324796abm2903_1. [DOI] [PubMed] [Google Scholar]
- Irwin ML, McTiernan A, Manson JE, Thomson CA, Sternfeld B, Stefanick ML, Chlebowski R. Physical activity and survival in postmenopausal women with breast cancer: results from the women's health initiative. Cancer Prevention Research. 2011;4(4):522–529. doi: 10.1158/1940-6207.CAPR-10-0295. doi: 10.1158/1940-6207.CAPR-10-02954/4/522 [pii] [DOI] [PMC free article] [PubMed] [Google Scholar]
- Lombard DN, Lombard TN, Winett RA. Walking to meet health guidelines: the effect of prompting frequency and prompt structure. Health Psychology. 1995;14(2):164–170. doi: 10.1037//0278-6133.14.2.164. [DOI] [PubMed] [Google Scholar]
- Marcus BH, Dunsiger SI, Pekmezi DW, Larsen BA, Bock BC, Gans KM, Marquez B, Morrow KM, Tilkemeier P. The Seamos Saludables Study: A randomized controlled physical activity trial of Latinas. American Journal of Preventive Medicine. 2013 doi: 10.1016/j.amepre.2013.07.006. In Press. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Marcus BH, Napolitano MA, King AC, Lewis BA, Whiteley JA, Albrecht A, Parisi A, Bock B, Pinto BM, Sciamanna C, Jakicic J, Papandonatos GD. Telephone versus print delivery of an individualized motivationally tailored physical activity intervention: Project STRIDE. Health Psychology. 2007;26(4):401–9. doi: 10.1037/0278-6133.26.4.401. [DOI] [PubMed] [Google Scholar]
- Marcus BH, Simkin LR. The stages of exercise behavior. Journal of Sports Medicine and Physical Fitness. 1993;33(1):83–88. [PubMed] [Google Scholar]
- Marcus BH, Rossi JS, Selby VC, Niaura RS, Abrams DB. The stages and processes of exercise adoption and maintenance in a worksite sample. Health Psychology. 1992;11(6):386–395. doi: 10.1037//0278-6133.11.6.386. [DOI] [PubMed] [Google Scholar]
- Morey MC, Snyder DC, Sloane R, Cohen HJ, Peterson B, Hartman TJ, Demark-Wahnefried W. Effects of home-based diet and exercise on functional outcomes among older, overweight long-term cancer survivors: RENEW: a randomized controlled trial. Journal of the American Medical Association. 2009;301(18):1883–1891. doi: 10.1001/jama.2009.643. doi: 10.1001/jama.2009.643301/18/1883 [pii] [DOI] [PMC free article] [PubMed] [Google Scholar]
- Pinto BM, Frierson G, Rabin C, Trunzo J, Marcus B. Home-based physical activity intervention for breast cancer patients. Journal of Clinical Oncology. 2005;23(15):3577–3587. doi: 10.1200/JCO.2005.03.080. doi: 23/15/3577 [pii]10.1200/JCO.2005.03.080. [DOI] [PubMed] [Google Scholar]
- Pinto BM, Rabin C, Abdow S, Papandonatos GD. A pilot study on disseminating physical activity promotion among cancer survivors: a brief report. Psycho-Oncology. 2008;17(5):517–521. doi: 10.1002/pon.1268. doi: 10.1002/pon.1268. [DOI] [PubMed] [Google Scholar]
- Prochaska JJ, Spring B, Nigg CR. Multiple health behavior change research: an introduction and overview. Preventive Medicine. 2008;46(3):181–188. doi: 10.1016/j.ypmed.2008.02.001. doi: 10.1016/j.ypmed.2008.02.001S0091-7435(08)00052-2 [pii] [DOI] [PMC free article] [PubMed] [Google Scholar]
- Prochaska JO, DiClemente CC. Stages and processes of self-change of smoking: toward an integrative model of change. Journal of Consulting and Clinical Psychology. 1983;51(3):390–395. doi: 10.1037//0022-006x.51.3.390. [DOI] [PubMed] [Google Scholar]
- Rock CL, Doyle C, Demark-Wahnefried W, Meyerhardt J, Courneya KS, Schwartz AL, Gansler T. Nutrition and physical activity guidelines for cancer survivors. CA: A Cancer Journal for Clinicians. 2012;62(4):243–274. doi: 10.3322/caac.21142. doi: 10.3322/caac.21142. Epub 2012 Apr 26. Review. Erratum in: CA Cancer J Clin 2013 May; 63(3), 215. [DOI] [PubMed] [Google Scholar]
- Schmitz KH, Courneya KS, Matthews C, Demark-Wahnefried W, Galvao DA, Pinto BM, Schwartz AL. American College of Sports Medicine roundtable on exercise guidelines for cancer survivors. Medicine and Science in Sports and Exercise. 2010;42(7):1409–1426. doi: 10.1249/MSS.0b013e3181e0c112. doi: 10.1249/MSS.0b013e3181e0c11200005768-201007000-00023 [pii] [DOI] [PubMed] [Google Scholar]
- Shuval K, Dipietro L, Skinner CS, Barlow CE, Morrow J, Goldsteen R, Kohl HW., 3rd 'Sedentary behaviour counselling': the next step in lifestyle counselling in primary care; pilot findings from the Rapid Assessment Disuse Index (RADI) study. British Journal of Sports Medicine. 2012 doi: 10.1136/bjsports-2012-091357. doi: bjsports-2012-091357 [pii]10.1136/bjsports-2012-091357. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Speck RM, Courneya KS, Masse LC, Duval S, Schmitz KH. An update of controlled physical activity trials in cancer survivors: a systematic review and meta-analysis. Journal of Cancer Survivship. 2010;4(2):87–100. doi: 10.1007/s11764-009-0110-5. doi: 10.1007/s11764-009-0110-5. [DOI] [PubMed] [Google Scholar]
- U.S. Department of Health and Human Services . Physical activity and health: A report of the Surgeon General. Centers for Disease Control and Prevention, National Center for Chronic Disease Prevention and Health Promotion. U.S. Government Printing Office; Atlanta, GA: 1996. [Google Scholar]
- U.S. Department of Health and Human Services 2008 Physical activity guidelines for Americans. 2008 [Google Scholar]
- Wilcox S, Dowda M, Griffin SF, Rheaume C, Ory MG, Leviton L, Mockenhaupt R. Results of the first year of active for life: translation of 2 evidence-based physical activity programs for older adults into community settings. American Journal of Public Health. 2006;96(7):1201–1209. doi: 10.2105/AJPH.2005.074690. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Winningham M. Developing the Symptom Activity 27: An instrument to evaluate perception of symptom effects on activity. Oncology Nursing Forum. 1993;20:330. [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.