Skip to main content
PLOS One logoLink to PLOS One
. 2023 May 5;18(5):e0268164. doi: 10.1371/journal.pone.0268164

What is the ‘voltage drop’ when an effective health promoting intervention for older adults—Choose to Move (Phase 3)—Is implemented at broad scale?

Heather A McKay 1,2,*, Heather M Macdonald 1,2, Lindsay Nettlefold 1,2, Katie Weatherson 1, Samantha M Gray 1,3, Adrian Bauman 4, Karim M Khan 2,5, Joanie Sims Gould 1,2
Editor: Hugh Cowley6
PMCID: PMC10162521  PMID: 37146002

Abstract

Background

Choose to Move (CTM), an effective health-promoting intervention for older adults, was scaled-up across British Columbia, Canada. Adaptations that enable implementation at scale may lead to ‘voltage drop’—diminished positive effects of the intervention. For CTM Phase 3 we assessed: i. implementation; ii. impact on physical activity, mobility, social isolation, loneliness and health-related quality of life (impact outcomes); iii. whether intervention effects were maintained; iv) voltage drop, compared with previous CTM phases.

Methods

We conducted a type 2 hybrid effectiveness-implementation pre-post study of CTM; older adult participants (n = 1012; mean age 72.9, SD = 6.3 years; 80.6% female) were recruited by community delivery partners. We assessed CTM implementation indicators and impact outcomes via survey at 0 (baseline), 3 (mid-intervention), 6 (end-intervention) and 18 (12-month follow-up) months. We fitted mixed-effects models to describe change in impact outcomes in younger (60–74 years) and older (≥ 75 years) participants. We quantified voltage drop as percent of effect size (change from baseline to 3- and 6-months) retained in Phase 3 compared with Phases 1–2.

Results

Adaptation did not compromise fidelity of CTM Phase 3 as program components were delivered as intended. PA increased during the first 3 months in younger (+1 days/week) and older (+0.9 days/week) participants (p<0.001), and was maintained at 6- and 18-months. In all participants, social isolation and loneliness decreased during the intervention, but increased during follow-up. Mobility improved during the intervention in younger participants only. Health-related quality of life according to EQ-5D-5L score did not change significantly in younger or older participants. However, EQ-5D-5L visual analog scale score increased during the intervention in younger participants (p<0.001), and this increase was maintained during follow-up. Across all outcomes, the median difference in effect size, or voltage drop, between Phase 3 and Phases 1–2 was 52.6%. However, declines in social isolation were almost two times greater in Phase 3, compared with Phases 1–2.

Conclusion

Benefits of health-promoting interventions—like CTM—can be retained when implemented at broad scale. Diminished social isolation in Phase 3 reflects how CTM was adapted to enhance opportunities for older adults to socially connect. Thus, although intervention effects may be reduced at scale-up, voltage drop is not inevitable.

Introduction

Physical activity is associated with myriad social and physical health benefits, yet most older adults fail to meet physical activity guidelines (150 min/week) [1]; 94% report sitting more than 8 hours/day [2]. While many interventions effectively increased older adults’ physical activity [3], fewer than 2% of the 400 unique interventions published in the last three decades were scaled-up to reach a broader population of older adults [4, 5]. Scale-up is defined as “deliberate efforts to increase the impact of successfully tested health innovations so as to benefit more people and to foster policy and programme development on a lasting basis” [6, pg. 9]. We envisage the process of scale-up as a continuum; scale-up may follow typical or atypical pathways from developing the intervention to its dissemination at broader and broader scale [7]. To have population level health impact, physical activity interventions that demonstrated effectiveness in small, controlled settings, must be scaled-up more broadly [8].

To enable widespread implementation, interventions and implementation strategies (i.e., “methods or techniques used to enhance the adoption, implementation, and sustainability of a clinical program or practice” [9, pg. 2]) often need to be adapted [10]. Adaptations may increase as scale up proceeds to reach and engage broader, more diverse populations, to enhance program ‘fit’ or participants or to address delivery partner needs [1113]. Adaptations may counter a decrease in participant-level benefits that occur when an intervention is implemented at broader scale–-a phenomenon referred to as a scale-up penalty [1315] or voltage drop [16, 17]. Effect sizes were, on average, 60% smaller across 10 scaled-up physical activity trials compared with corresponding efficacy trials (pre-scale-up) [14]. Only one of the 10 scaled-up trials (CHAMPS III) targeted older adults; the effect size for physical activity was 69% lower in the scaled-up version of CHAMPS II, compared with the pre-scale trial [18].

In our broad program of implementation research, we address knowledge gaps related to scale-up of health-promoting interventions targeting older adults [5]. Specifically, here we report how we implemented and evaluated a physical activity and social connectedness program for older adults—Choose to Move (CTM Phase 3)—at broad scale. CTM is a flexible, evidence- and choice-based program for older adults in British Columbia (BC), Canada [1921]. Briefly, CTM incorporates foundational elements of the Community Healthy Activities Model Program for Seniors (CHAMPS) [18, 22, 23] including principles of behaviour change [24, 25] (e.g., goal setting, support, feedback) to help older adults to set physical activity goals, address barriers to physical activity, choose among physical and social activities provided in their communities, and interact and share challenges and solutions to being active with their peers. CTM Phases 1 and 2 (initial scale-up; referred to as Phases 1–2 throughout this manuscript) were implemented in 2016–17 [1921]; those phases delivered 56 CTM programs in 22 geographically-distinct communities across BC and reached 534 participants. CTM Phases 1–2 significantly improved physical activity, mobility, and decreased social isolation and loneliness in low active older adult (≥60 years) participants, particularly amongst those aged 60–74 years [20, 26]. Some health benefits were maintained 12 months after the intervention ended [27]. Specifically, among younger participants (60–74 years), intervention-related benefits in mobility, social isolation and loneliness were maintained 12 months after CTM ended, whereas in older participants (≥ 75 years), only decreased loneliness was maintained over 12 months.

From this solid foundation, we incorporated feedback from key stakeholders to systematically adapt CTM and its implementation strategies for CTM Phase 3 for scale-up across more communities in BC (broad scale-up; 2018–2020) [12]. Thus, our CTM Phase 3 intervention study has four objectives:

  1. to describe implementation indicators associated with delivery of CTM Phase 3 intervention at broad scale;

  2. to evaluate whether the CTM Phase 3 intervention increased older adults’ physical activity (primary outcome), mobility and health-related quality of life (secondary outcomes), and reduced feelings of social isolation and loneliness (secondary outcomes);

  3. to assess whether health benefits (if any) were maintained 12 months after the CTM Phase 3 intervention ended; and

  4. to assess the voltage drop (if any) of CTM Phase 3 intervention benefits (compared with Phases 1–2).

Methods

Choose to Move

We describe the implementation and scale-up frameworks that guide us [28, 29], design, community partnership development and implementation of CTM at small scale elsewhere [1921] (ClinicalTrials.gov identifier: NCT05497648; retrospectively registered). We did not prospectively register CTM as a clinical trial because we felt it aligned more closely with the definition of an observational study [30]. Community partners deliver CTM; older adults enrol in the program directly through these organizations and participation in the evaluation is optional. However, we acknowledge the benefits of registering observational trials [31] and we therefore retrospectively registered our study.

At the organization level, CTM is designed to build community capacity to support awareness of, and access to, local health-promoting opportunities. At the individual (participant) level, CTM provides support for older adults to set personalized (based on preference and ability) physical activity goals, and address barriers to physical activity. CTM participants receive social support from fellow participants and their activity coach. We reported the methods for CTM initial scale-up studies elsewhere [20, 27]. This report focuses on CTM Phase 3 (2018–2020) unless we specifically refer to the earlier Phases.

Activity coaches who delivered CTM Phase 3 programs completed self-directed and interactive online training on Moodle™. Training sessions included an overview of CTM intervention components (i.e., one-on-one consultations, group meetings, check-ins) and case studies that illustrated common challenges. During the first 3 months of the 6-month program, activity coaches provided participants: 1) one 60-minute one-on-one consultation, 2) five 60-minute motivational group meetings (up to 15 participants/group; twice in months 1 and 2, once in month 3), and 3) 3 check-ins (15 min, on average; once per month by phone, email or in person). Group meetings took place at local community centres and YMCA facilities. During the last 3 months of the program, coaches provided less support (3 telephone calls). We summarize key differences in the intervention and implementation strategies between CTM Phase 3 and Phases 1–2 in Table 1.

Table 1. Differences between Choose to Move Phases 1 & 2 and Phase 3.

Reproduced from Gray et al. [12] with permission from Springer Nature.

Phases 1 & 2 Phase 3
• Program structure:
 ○ No information session prior to program start
 ○ Initial consultation during same week as 1st group meeting
 ○ 4 group meetings
 ○  ○ 10 check-ins
 ○ Group meetings:
 ○  ○ Health topics covered in group meetings (active travel included in every meeting)
 1 Physical activity & chronic conditions
 ○  2 Chronic disease self-management
 ○  3 Reducing stress & easing anxiety
 ○  4 Review CTM principles & behaviour change
 5 N/A
 ○ No designated movement breaks during meetings
 ○ No formal integration of social connectedness
Check-ins:
 ○ Physical activity action plan and goal setting between activity coach and participant
 ○ Extensive section on pain management
 ○ No questions about future goals or physical activity plans
 ○ No motivational interviewing prompts
 ○ No focus on the CTM as a social ‘community’ of support
Activity coach training:
 ○ Qualification–certified fitness leaders or kinesiologists
 ○ Activity coaches hired by delivery partners
 ○ Training specific to fitness professionals (as described above)
 ○ Training delivered as day-long, in-person session and a hardcopy manual
 ○ Social connectedness not formally integrated into the activity coach training
• Program operations:
 ○ Lead time for program delivery not standardized across delivery sites (often < 3 months)
 ○ No formal communication plans between delivery partners and delivery sites
 ○ No central recruitment resource available to delivery sites
 ○ Delivery site agreements vague; exact roles and responsibilities unclear
 ○ Promotion and recruitment materials lacked emphasis on benefits of CTM to participants
• Program structure:
 ○ Information session 2 weeks prior to program start
 ○ Initial consultation one week prior to 1st group meeting
 ○ 5 group meetings
 ○ 6 check-ins
 ○ Group meetings:
 ○ Health topics covered in group meetings (active travel only in 1st meeting as ‘incidental activity’)
1. Physical activity & social connection
2. Healthy weight management & nutrition
3. Stress & anxiety
4. Brain health & preventing injury
5. Revisit your goals & celebrate!
 ○ Prescribed movement breaks during group meetings
 ○ Group meeting slides prescriptive for group and paired discussions; contact information formally included in each CTM participant group
• Check-ins:
 ○ Physical activity action plan and goal setting between activity coach and participant
 ○ Pain section reduced
 ○ Increased emphasis on compliance to action plan (revisit goals, set new goals, future plans)
 ○ Added prompts for motivational interviewing
 ○ Focus on the CTM as a social ‘community’ of support
• Activity coach training:
 ○ Qualification–anyone with experience in fitness leadership or with older adults
 ○ Activity coaches hired by delivery partners in consultation with recreation coordinators
 ○ Training expanded to encompass knowledge base of activity coaches who may not be fitness professionals
 ○ Training delivered in self-directed online platform and interactive practical component
 ○ Training adapted to emphasize social connections; group meeting presentation slides more prescriptive for group and pair discussion
• Program operations:
 ○ Every delivery site given 3–6 months lead time prior to program start-up
 ○ Each delivery site given site-specific communication plans, which includes: implementation and site activity checklists, as well as regular communication plan
 ○ Central recruitment resource available (www.choosetomove.info)
 ○ Agreements modified to more clearly articulate expectations regarding promotion and recruitment
 ○ Promotion and recruitment materials modified to highlight the benefits of CTM to participants

The CTM central support unit (comprised of highly qualified staff from the Active Aging Research Team [32]) worked with delivery partners and coaches to scale-up CTM in eight cycles with staggered start dates between January 2018 and January 2020 (Fig 1). Each cycle included between 4 and 37 programs for a total of 165 programs across cycles 1–8. In Phase 3, forty-seven coaches delivered CTM; each coach delivered a median of 5 CTM programs (range 1–19).

Fig 1. Choose to Move Phase 3 Timeline.

Fig 1

Overview of the timing of Choose to Move Phase 3 programs delivered between January 2018 and January 2020.

Study design

To evaluate CTM, we used a type 2 hybrid effectiveness-implementation pre-post study design [33]. Data collection occurred at 0 (baseline), 3 (mid-intervention), 6 (post-intervention) and 18 (12 months post-intervention) months. The University of British Columbia Clinical Research Ethics Board (H15–02522) approved all study procedures.

Participants

Delivery partner organizations and activity coaches recruited older adults in their community using a variety of strategies (e.g., local promotions such as program guides, posters, and information sessions; media advertisements (including social media); CTM website - https://www.choosetomove.ca/; word of mouth). Eligible participants were community-dwelling males and females aged ≥60 years, English speaking, and low active (self-reported <150 minutes/week of physical activity) with no contra-indications to physical activity participation (Physical Activity Readiness-Questionnaire+ [34], Get Active questionnaire [35] or physician clearance). Participants aged 50 to 59 years were also eligible to participate in extenuating circumstances following recommendations from coaches (e.g., 58-year-old individual who suffered a stroke and would benefit from participating in CTM); however, delivery partner organizations did not actively attempt to recruit participants in this age group.

Programs delivered in the final cycle of Phase 3 (cycle 8, January-February 2020 start date, n = 26 programs) were significantly impacted by the COVID-19 pandemic. We worked with our delivery partners to adapt the program so that CTM could be delivered online/virtually. The 18-month CTM follow-up evaluation for participants in CTM cycles 4–7 was also conducted during the pandemic (June 2020-April 2021).

For our implementation evaluation, all coaches who delivered programs in Phase 3 (cycles 1 through 7; n = 47) were invited to participate. All provided informed consent.

Data collection–implementation evaluation

To assess implementation of CTM, we invited older adult participants to complete feedback surveys at 3 months (distributed with outcome evaluation questionnaires, described below). Activity Coaches completed a program delivery survey at 3 and 6 months and a participant engagement survey at 6 months. We collected survey data from coaches using REDCap (Research Electronic Data Capture) [36] electronic data capture tools hosted at the University of British Columbia. We emailed survey links to coaches and responses were entered directly into our REDCap database. For the participant engagement surveys, we used the Email Helper application within REDCap and Python (https://realpython.com/) to send coaches unique REDCap links for each participant in their group.

Implementation indicators

We assessed CTM dose delivered and fidelity as implementation indicators [37]. To assess dose delivered (i.e., intended units of each intervention component delivered to participants by the delivery team [38]), we report the number of group meetings and telephone check-ins delivered by coaches. To assess fidelity (i.e., the extent to which the intervention was implemented as it was prescribed in the intervention protocol by the delivery team [39]), we describe the extent to which coaches used and applied intervention materials (e.g., group meeting slides) and core functions (e.g., goal setting, action planning).

We determined dose received (i.e., the extent to which participants engaged or interacted with, are receptive to, or used the intervention [40]) as the number of motivational group meetings and telephone check-ins participants attended (from participant engagement survey). In addition, we describe participant responsiveness (i.e., “the degree to which the program stimulates the interest or holds the attention of participants” [29, pg. 329]) as participant satisfaction with CTM (after the first three months) and coaches’ perception of how interactive, enthusiastic, interested and engaged participants were during group meetings in the first three months of the intervention).

Data collection–impact evaluation

We replicated measurement protocols described in our Phases 1–2 CTM impact evaluation [20, 27]. At baseline, 3, 6 and 18 months, we collected survey-based data from all participants using a paper questionnaire. Participants completed their surveys at group meetings (baseline, 3 months) or at home (6 and 18 months) via mailed surveys; participants who required extra assistance (<1%) at 6 and 18 months completed their survey over the phone with a trained research assistant. For participants in cycle 8 (Winter 2020), post-intervention follow-up data collection occurred 9 months after the intervention ended instead of 12 months as for the other 7 cycles. We made this change to allow for cycle 8 follow-up data to be used as control data for another study being conducted by our research team during the pandemic (NCT04592614).

Demographic characteristics

At baseline only, we asked participants to complete a demographic survey to determine age (years), sex (male, female), self-reported height (cm) and weight (kg) (with which we calculated body mass index (BMI, kg/m2)), educational attainment (secondary school or less, at least some trade/technical school or college, at least some university), number of chronic conditions (0, 1, ≥2) and self-rated health (very poor, poor, fair, good, excellent; single question [41, 42]). Participants also self-reported their ethnic origin (as per Canadian census response options for visible minorities [43]); we then categorised participants as Asian, white or other/mixed ethnicity.

Physical activity and mobility

At each measurement time point, participants completed the single-item physical activity measure [44, 45], and self-reported their physical activity as the number of days in the previous week that they accumulated 30 minutes or more of moderate-to-vigorous physical activity. We recently reported that the single-item measure had acceptable convergent validity and was responsive to change, compared with the 41-item CHAMPS questionnaire [46]. Participants also self-reported their capacity for mobility at each time point; we dichotomized responses as either NO difficulty or ANY difficulty walking 400m and/or climbing one flight of stairs [47].

Social isolation and loneliness

At each measurement time point, we assessed social isolation using a three-item questionnaire [48] adapted from two questions on social contact frequency [49] (social isolation score; range 0–15, where higher scores indicate less social isolation). We assessed loneliness using the UCLA Loneliness Scale (UCLA-3) questionnaire (loneliness score; range 3–9, where higher scores indicate greater loneliness) that shows good internal consistency, discriminant validity, and convergent validity [50].

Health-related quality of life

At each measurement time point, we assessed health-related quality of life using the EQ-5D-5L [51]. The EQ-5D-5L consists of five dimensions (mobility, self-care, usual activities, pain/discomfort and anxiety/depression) and a visual analogue scale (VAS). Participants were asked to indicate their level of functioning (from 1 “no problems” to 5 “extreme problems”) on each of the five dimensions of the EQ-5D-5L. The EQ-5D-5 L describes 3125 distinct health states, with 11111 representing the best and 55555 the worst possible health states. We applied the Canadian EQ-5D-5 L scoring algorithm [52] to generate index scores, which ranged from − 0.148 for the worst (55555) to 0.949 for the best (11111) health states. For the VAS, participants were asked to rate their subjective health perception on the 20 cm VAS with endpoints labeled “the worst health imaginable” (0) and “the best health imaginable” (100).

Statistical analysis

Sample size

We assumed 70% recruitment into the CTM Phase 3 evaluation and 15% attrition across the 6-month intervention. We calculated power using the mean change in physical activity (by the single-item measure) observed in the whole cohort in Phases 1–2 (1.4 ± 2.1 days/week). With alpha = 0.05 (one-tailed) and an estimated sample of 963 participants (1620*70% recruitment*15% attrition), we would have >95% power to detect a meaningful change in physical activity of 1 day/week between baseline and 6 months and >90% power to detect a change of 0.5 day/week.

We performed all analyses using Stata (version 13.1; StataCorp, College Station, TX). As CTM programs in cycle 8 (Winter 2020, 26 programs) were not delivered as planned, we excluded participants (n = 203) in cycle 8 programs from our primary analysis. We therefore first examined whether participants who were lost to follow-up (i.e., withdrew from the program or did not complete the evaluation) or were part of cycle 8 (affected by COVID-19) differed from participants who completed CTM. We used two-tailed chi-squared or Fisher’s exact test for categorical variables (sex, age category, ethnicity, education, chronic conditions, mobility limitations, and subset participation) and analysis of variance for continuous variables (body mass index and impact variables). Next, we used two-sided t-tests (for continuous variables) and chi-squared tests (for categorical variables) to compare socio-demographic characteristics at baseline between age groups (60–74 years, ≥ 75 years) for those participants in cycles 1–7.

To address our first objective (implementation evaluation), we assessed: 1) age- and sex-related differences in program delivery using Wilcoxon rank sum tests and 2) the relationship between program dose received and impact outcomes using Spearman rank correlations.

To address objectives 2 and 3 (impact evaluation; follow-up), we fitted linear mixed effects models for each continuous impact variable [physical activity (primary outcome), social isolation, loneliness, health-related quality of life (secondary outcomes)] with time (0, 3, 6, and 18 months) as a categorical predictor. We first fit an empty means random intercept model and tested whether random slopes improved model fit using likelihood ratio tests. In model 1, we included sex and age category (60–74 years, ≥ 75 years) as fixed effects. Model 2 included additional covariates: delivery partner, program cycle (1–7), baseline mobility limitation (yes/no), number of chronic conditions (0, 1, ≥2), education and BMI. In both models, we added fixed effects sequentially and tested interactions with time after the addition of each fixed effect. With the exception of an age × time interaction, the interactions were retained in the model only if the likelihood ratio test was significant (p < 0.05). We assessed model fit graphically using residual plots; plots indicated acceptable model fit. Adjusted values were calculated at each time point using the margins command in Stata with a Bonferroni adjustment to account for multiple comparisons between and within age groups. We also used chi-squared tests to assess differences in the proportion of participants with mobility limitations over time (0–3, 0–6, 6–18 and 0–18 months; secondary outcome) within each age group. We used a Bonferroni adjustment to account for multiple comparisons (significance at: 0.05/4 = 0.013). We used a per-protocol approach as participants who withdrew from the program also withdrew from the evaluation. As a supplementary exploratory analysis, we fit the same models with data for participants in cycle 8 to examine the potential impact of COVID-19 on our outcomes. Due to the change in timing of the follow-up measurements for this cohort, we only present the baseline, 3- and 6-month data.

To address our fourth objective (voltage drop with scale-up), we used the approach reported by McCrabb et al. [14] for uncontrolled pre-post studies. We first calculated the effect size for each outcome (with the exception of health-related quality of life and VAS, which were not assessed in Phases 1–2) as the change from baseline. We then calculated the voltage drop (i.e., percent of the effect size reported in CTM Phases 1–2 that was retained in Phase 3) as: (Phase 3 effect size / Phases 1–2 effect size)*100 [20]. Values greater than 100% indicate a greater benefit of the intervention in Phase 3 broad scale-up as compared with Phases 1–2; values of 50% indicate Phase 3 was half as effective as in Phases 1–2; and values less than 0% (negative values) indicate that the direction of the intervention effect in Phase 3 was opposite of the direction in Phases 1–2 [20].

Results

Of 1668 participants across 165 programs delivered between January 2018 and June 2020 in 39 BC communities, 1216 older adults (72.9%) consented to participate in the evaluation (Fig 2). Of the 1012 participants from cycles 1–7 who consented to participate in the CTM evaluation, 32.2% (n = 326) were lost to follow-up or withdrew from CTM or the evaluation (Fig 2). For analysis, we included all available data across 4 time points; the number of participants with data at 4, 3, 2 and 1 time points was 531 (52.5%), 190 (18.8%), 149 (14.7%) and 143 (14.1%), respectively. No adverse events were reported by participants. We present baseline characteristics of the CTM Phase 3 cohort in Table 2. Seventy one percent of participants were females of white ethnicity between the ages of 54 and 74 years. Baseline characteristics were similar between participants who completed CTM, those lost to follow-up or those in cycle 8—with the exception of ethnicity (i.e., more participants who completed CTM were white as compared with those lost to follow-up) and education (i.e., fewer participants in cycle 8 had attained a secondary school level of education or less as compared with participants in cycles 1–7 who completed the program) (S1 Table). Only baseline VAS score differed across groups; scores were higher among participants who completed CTM as compared with those lost to follow-up, and those in cycle 8.

Fig 2. Participant flow diagram.

Fig 2

Flow of participants through the Choose to Move Phase 3 study.

Table 2. Baseline participant socio-demographic characteristics by age group in the Phase 3 Choose to Move cohort (cycles 1–7).

Values are n (%) or mean (standard deviation).

Total <75 years (n = 650) ≥ 75 years (n = 362) p-valuea
Participants, n (men / women) 1012 (196/816) 650 (123/527) 362 (73/289) 0.632
 % (men) 19.4% 18.9% 20.2%
Age, mean (SD) 72.9 (6.3) 69.0 (3.4) 79.9 (3.9)
Age category
 54–74 years 650 (64.2%)
 ≥75 years 362 (35.8%)
Delivery partner, n (BCRPA / YMCA) 631 / 381 388 / 262 243 / 119 0.019
BMI, kg/m2
 Men (n = 194) 29.6 (5.5) 30.3 (6.2) 28.2 (3.7) 0.009
 Women (n = 778) 29.3 (6.5) 30.4 (6.8) 27.6 (5.6) <0.001
Ethnicity, n (%)
 White 892 (88.1%) 568 (87.4%) 324 (89.5%)
 Asian 66 (6.5%) 43 (6.6%) 23 (6.4%)
 Other 54 (5.3%) 39 (6.0%) 15 (4.1%) 0.439
Educational attainment, n (%) [N = 1009]b
 Secondary or less 281 (27.8%) 141 (21.7%) 140 (38.9%)
 Some trade, technical school or college 356 (35.3%) 261 (40.2%) 95 (26.3%)
 Some university 372 (36.9%) 247 (38.1%) 125 (34.7%) <0.001
Chronic Conditions, n (%)
 0 150 (14.8%) 99 (15.2%) 51 (14.1%)
 1 372 (36.7%) 242 (37.2%) 130 (35.9%)
 ≥ 2 490 (48.4%) 309 (47.5%) 181 (50.0%) 0.739
Mental Health Conditions, n (%) [N = 868]
 0 652 (75) 395 (71) 257 (82)
 1 135 (16) 97 (17) 38 (12)
 ≥ 2 81 (9) 63 (11) 18 (6) 0.001
Mobility limitations (walk and/or stair), n (%) [N = 1008] b
 Yes 459 (45.5%) 281 (43.4%) 178 (49.4%)
 No 549 (54.5%) 367 (56.6%) 182 (50.6%) 0.063
Self-rated health, n (%) [N = 1008] b
 Very poor, poor or fair for age 461 (45.7%) 346 (53.3%) 115 (32.0%)
 Good or excellent for age 547 (54.2%) 303 (46.7%) 244 (68.0%) <0.001

BCRPA: British Columbia Parks and Recreation Association; YMCA: Young Men’s Christian Association

a p values were calculated using two-sided t-tests for continuous variables and chi-squared tests for categorical variables.

bSample size reduced due to missing data for questions regarding level of education, mobility limitations and self-rated health.

Implementation evaluation–objective 1

Dose delivered: Across the 141 programs in cycles 1–7, the 45 trained coaches delivered 705 (100%) group meetings and 4682 (77.1%) check-ins.

Fidelity: Activity Coaches provided opportunities for participants to interact with each other during all 5 group meetings in 93.3% of programs; led participants through stretches or movement breaks at 3 or more group meetings in 97.8% of programs; and covered the recommended topic for each group meeting in 97.8–100% of programs. For participant check-ins, 96.2% of coaches reported using motivational interview techniques during most or all of the check-ins; 66.7% of coaches reported helping all of their participants to revisit their goals or set new goals and review their action plan during the final check-in. Finally, 98.7% of coaches reported using and following CTM resources most or all of the time.

Dose received: Of the 1012 participants in cycles 1–7, 1004 (99.2%) attended at least one group meeting or check-in. Of those who did not drop out (n = 705), 76.5% attended ≥80% of the group meetings and 79.2% attended ≥80% of the check-ins. Total dose received (check-ins plus group meetings) did not differ between males and females or between age groups.

Relationship between dose received and impact variables: Among impact variables, only social isolation was significantly associated with program dose received at 3 months (rs = 0.081, p = 0.012). This relationship was apparent in older (rs = 0.126, p = 0.021), but not younger, participants (rs = 0.061, p = 0.134).

Participant responsiveness: After the first 3 months of the intervention (period during which all group meetings were held), 90.4% of participants were satisfied with CTM. From the coaches’ perspective, 77.0% of participants were very or extremely interactive at the group meetings, and 97.8% of participants were enthusiastic, interested and engaged with the CTM content and each other at 3 or more of the group meetings.

Impact evaluation and follow-up–objectives 2 and 3

We present results of our impact evaluation in Tables 3 and 4. Results were similar for minimally and fully adjusted models; below we focus on the fully adjusted models for younger (54–74 years) and older (≥75 years) participants. For each impact outcome, we present the results for the intervention period first, and results for the follow-up period second. We present results of our exploratory analysis of participant data from cycle 8 (COVID-19) in S2 Table.

Table 3. Adjusted means (95% confidence interval) for impact outcome measures by time point and age group in the Choose to Move Phase 3 cohort.

Months Sample size:
Full sample / <75 years / > 75 years
Full sample
<75 years
≥ 75 years
p-valuea
Full sample
0–3 mos
0–6 mos
0–18 mos
6–18 mos
p-valuea
<75 yrs
0–3 mos
0–6 mos
0–18 mos
6–18 mos
p-valuea
≥75 yrs
0–3 mos
0–6 mos
0–18 mos
6–18 mos
Physical activity
(# d/wk>30 min)
0 1005 / 647 / 358 2.5 (2.3, 2.6) 2.4 (2.3, 2.6) 2.5 (2.3, 2.7)
3 823 / 536 / 287 3.4 (3.1, 3.7) 3.4 (3.0, 3.8) 3.4 (2.8, 3.9) <0.001 <0.001 0.008
6 703 / 453 / 250 2.9 (2.6, 3.3) 3.0 (2.6, 3.5) 2.8 (2.2, 3.4) 0.026
0.029 >0.99
18 592 / 385 / 207 2.9 (2.5, 3.2) 3.0 (2.6, 3.5) 2.6 (2.0, 3.2) 0.131
>0.99
0.046
>0.99
>0.99
>0.99
Mobility [n, (% reporting any limitation)] 0 1008 / 648 / 360 459 (45.5%) 281 (43.4%) 178 (49.4%)
3 824 / 536 / 288 327 (39.7%) 194 (36.2%) 133 (46.2%) 0.012 0.012 0.409
6 705 / 454 / 251 286 (40.6%) 164 (36.1%) 122 (49.6%) 0.041 0.016 0.838
18 593 / 385 / 208 256 (43.2%) 147 (38.2%) 109 (52.4%) 0.358
0.344
0.102
0.538
0.497
0.418
Social Isolation
(score, 0–15)
0 1006 / 646 / 360 11.0 (10.8, 11.2) 10.9 (10.7, 11.1) 11.1 (10.8, 11.4)
3 823 / 536 / 287 11.7 (11.5, 11.9) 11.7 (11.4, 11.9) 11.6 (11.3, 12.0) <0.001 <0.001 0.008
6 703 / 454 / 249 11.4 (11.2, 11.6) 11.4 (11.1, 11.6) 11.5 (11.1, 11.8) <0.001 <0.001 0.290
18 588 / 382 / 206 9.5 (9.2, 9.7) 9.7 (9.5, 10.0) 8.9 (8.5, 9.3) <0.001
<0.001
0.001
<0.001
<0.001
<0.001
Loneliness
(score, 3–9)
0 1001 / 646 / 355 4.5 (4.4, 4.6) 4.7 (4.5, 4.8) 4.2 (4.0, 4.4)
3 817 / 532 / 285 4.3 (4.2, 4.4) 4.5 (4.3, 4.6) 4.1 (3.9, 4.3) <0.001 <0.001 0.754
6 698 / 451 / 247 4.3 (4.2, 4.4) 4.4 (4.3, 4.5) 4.0 (3.8, 4.2) <0.001 <0.001 0.133
18 569 / 375 / 194 4.7 (4.6, 4.9) 4.8 (4.6, 4.9) 4.6 (4.4, 4.8) 0.003
<0.001
0.765
<0.001
0.001
<0.001
Health status
(EQ-5D-5L)
0 1007 / 646 / 361 0.793 (0.786, 0.800) 0.785 (0.776, 0.795) 0.807 (0.794, 0.820)
3 823 / 536 / 287 0.800 (0.782, 0.817) 0.800 (0.778, 0.822) 0.799 (0.770, 0.828) >0.99 >0.99 >0.99
6 703 / 452 / 251 0.806 (0.788, 0.825) 0.810 (0.786, 0.833) 0.800 (0.770, 0.830) 0.995 0.237 >0.99
18 587 / 383 / 204 0.778 (0.759, 0.800) 0.777 (0.753, 0.802) 0.780 (0.748, 0.817) 0.809
0.074
>0.99
0.121
0.631
>0.99
VAS
(EQ-5D-5L)
0 999 / 644 / 355 69.8 (68.8, 70.9) 67.2 (65.9, 68.5) 74.4 (72.7, 76.2)
3 823 / 536 / 287 74.6 (72.4, 76.8) 74.1 (71.3, 76.9) 75.5 (71.9, 79.1) <0.001 <0.001 >0.99
6 703 / 453 / 250 74.7 (72.4, 77.0) 73.8 (71.4, 77.1) 76.4 (72.6, 80.2) <0.001 <0.001 >0.99
18 587 / 383 / 204 72.9 (70.5, 75.3) 72.4 (69.4, 75.4) 74.5 (70.4, 78.5) 0.064
>0.99
0.009
>0.99
>0.99
>0.99

d/wk: days/week; Social isolation: higher score indicates a larger social network; Loneliness: lower score indicates lower feelings of loneliness; EQ-5D-5L Health Status and Visual Analog Scale (VAS): higher score indicates better health status

a p values for continuous variables were calculated using a fitted linear mixed effects models for each continuous impact variable with time (0, 3, 6, and 18 months) as a categorical predictor. Fixed effects were sex and age category (60–74 years, ≥ 75 years); additional covariates were delivery partner, program cycle (1–7), baseline mobility limitation (yes/no), number of chronic conditions (0, 1, ≥2), education and body mass index. Adjusted values were calculated at each time point using the margins command in Stata with a Bonferroni adjustment to account for multiple comparisons between and within age groups. p values for mobility limitations were calculated using chi-squared tests with Bonferroni adjustment to account for multiple comparisons between time points (significance at: 0.05/4 = 0.013).

Table 4. Comparison of intervention effect sizes (95% confidence interval) for primary outcomes between Choose to Move Phases 1 & 2 and Phase 3.

Phases 1 & 2 Effect sizea Phase 3 Effect size a Proportion (%) of the efficacy trial effect size achieved with scale-up
Month Full cohort <75 yrs ≥75 yrs Full cohort <75 yrs ≥75 yrs Full cohort <75 yrs ≥75 yrs
Physical activity (# d/wk>30 min) 3 1.4 (1.2, 1.7) 1.6 (1.3, 1.9) 1.0 (0.5, 1.4) 0.9 (0.5, 1.4) 1.0 (0.4, 1.5) 0.9 (0.2, 1.6) 63.4 62.5 100
6 1.1 (0.8, 1.3) 1.4 (1.1, 1.7) 0.3 (-0.1, 0.8) 0.5 (0.04, 1.0) 0.6 (0.04, 1.2) 0.3 (-0.5, 1.0) 45.5 42.9 96.7
Mobility (% with any limitation) 3 -14.2% -14.2% -14.1% -5.8% -7.2% -3.2% 40.8 50.7 22.9
6 -11.6% -11.7% -11.2% -4.9% -7.3% 3.0% 42.2 60.8 0
Social Isolation (score, 0–15) 3 0.4 (0.1, 0.7) 0.6 (0.2, 0.9) -0.09 (-0.6, 0.5) 0.7 (0.4, 1.0) 0.8 (0.5, 1.1) 0.5 (0.1, 1.0) 175.0 128.3 530.0
6 0.2 (-0.01, 0.5) 0.4 (0.05, 0.8) -0.2 (-0.7, 0.4) 0.4 (0.2, 0.7) 0.5 (0.1, 0.8) 0.3 (-0.1, 0.8) 200.0 117.5 165.0
Loneliness (score, 3–9) 3 -0.4 (-0.6, -0.3) -0.4 (-0.6, -0.3) -0.5 (-0.7, -0.2) -0.2 (-0.3, -0.1) -0.2 (-0.4, -0.08) -0.1 (-0.3, 0.09) 50.0 55.0 22.0
6 -0.3 (-0.5, -0.2) -0.3 (-0.5, -0.2) -0.4 (-0.6, -0.07) -0.2 (-0.4, -0.1) -0.3 (-0.4, -0.1) -0.2 (-0.4, 0.04) 66.7 90.0 47.5

d/wk: days/week; ND: no difference; Social Isolation: positive effect size indicates the intervention reduced social isolation; Loneliness: negative effect size indicates the intervention reduced feelings of loneliness.

a Effect size calculated as change from baseline as per McCrabb et al.[13]

Physical activity: Among younger participants, physical activity increased from baseline to 3 months (+1.0 days/week; 95% CI: 0.4, 1.5). Gains in physical activity were maintained during the final 3 months of the program; physical activity at 6 months remained significantly higher than at baseline (+0.6; 95% CI: 0.04, 1.2). Among older participants, physical activity increased from baseline to 3 months (+0.9; 95% CI: 0.2, 1.6). Physical activity did not differ between baseline and 6 months.

Among younger participants, physical activity at 18 months (12 months after the CTM intervention ended) did not differ from values at 6 months, but remained significantly higher than at baseline (+0.6; 95% CI: 0.2, 1.6). For older participants, physical activity at 18 months did not differ from values at 6 months, or at baseline.

Mobility: Among younger participants, prevalence of mobility limitations decreased by 7.2% from baseline to 3 months. Prevalence of mobility limitations at 6 months did not differ from baseline. Among older participants, prevalence of mobility limitations did not differ between baseline and 3 or 6 months.

At the 18-month follow-up, prevalence of mobility limitations did not differ from baseline in either the younger or older participants.

Social isolation: Among younger participants, social isolation score increased from baseline to 3 months (+0.8; 95% CI: 0.5, 1.1; indicating decreased feelings of social isolation) and remained higher at 6 months as compared with baseline (+0.5; 95% CI: 0.1, 0.8). Among older participants, social isolation score increased during the first 3 months of the intervention (+0.5; 95% CI: 0.1, 1.0), but was not significantly different between baseline and 6 months.

In both the younger and older groups, social isolation score decreased during the follow-up period such that values at 18 months were significantly lower than at 6 months and baseline (<75 years: -1.6; 95% CI: -2.0, -1.2; ≥75 years: -2.5; 95% CI: -3.1, -2.0).

Loneliness: Among younger participants, loneliness score decreased from baseline to 3 months (-0.2; 95% CI: -0.4, -0.1; reduced feelings of loneliness) and remained lower at 6 months as compared with baseline (-0.3; 95% CI: -0.4, -0.1). Among older participants, loneliness score did not change significantly between baseline and 3 or 6 months.

At the 18-month follow-up, younger participants’ loneliness scores were significantly higher than at the end of the intervention (+0.4; 95% CI: 0.2, 0.6). This resulted in no difference between loneliness scores at baseline and 18 months. Among older participants, loneliness scores also increased between 6- and 18-months (+0.6; 95% CI: 0.4, 0.9), which led to higher values at 18 months as compared with baseline (+0.4; 95% CI: 0.1, 0.7).

Health-related quality of life: Health-related quality of life as measured using the EQ-5D-5L index score did not change significantly over time in either age group. Among younger participants VAS score increased between baseline and 3 months (+6.9; 95% CI, 3.2 to 10.5), 6 months (+7.1; 95% CI, 3.3 to 10.8) and 18 months (+5.2; 95% CI, 1.3, 9.1). VAS score did not change significantly in older participants.

Exploratory analysis of Winter 2020 cohort: Among all participants in cycle 8 (Winter 2020), physical activity and mobility did not change significantly over time. However, social isolation scores decreased (indicating increased feelings of social isolation) between baseline and 3 months in younger (-1.8; 95% CI: -2.6, -1.0) and older participants (-2.5; 95% CI: -3.5, -1.4). Social isolation scores were also lower at the end of the intervention in younger (-1.4; 95% CI: -2.2, -0.5) and older (-1.7; 95% CI: -2.8, -0.6) participants. Although loneliness scores increased in the whole Winter 2020 cohort after 3 months (+0.3; 95% CI: 0.01, 0.6); change in loneliness score after 3 months was not significant in each age group. EQ-5D-5L and VAS scores did not change significantly over time in either age group.

Voltage drop–objective 4

We compared the effect sizes between CTM Phases 1–2 and Phase 3 (Table 4). Among younger participants, the magnitude of the intervention effect dropped in Phase 3 compared with Phases 1–2 for physical activity, mobility and loneliness. However, CTM Phase 3 had a greater positive effect on younger participants’ social isolation than did the smaller scale Phases 1–2 intervention.

Among older participants, the positive impact of CTM on physical activity at 3 months was similar in magnitude between Phase 3 and Phases 1–2. However, we observed a voltage drop for both loneliness and mobility among participants. As per younger participants, after 3 months, the magnitude of the positive impact of CTM Phase 3 on older participants’ social isolation was greater compared with Phases 1–2.

Discussion

As public health researchers, we seek to narrow the “know-do gap” [53] and identify ways to deliver health-promoting interventions at broad scale. Here, we report the effectiveness of CTM Phase 3—a health-promoting intervention delivered at scale across the province of BC. We know of only two other scaled-up health-promoting interventions in older adults [18, 54]. Our study uses implementation science principles to fill knowledge gaps related to; i. CTM implementation and impact on participant-level outcomes after adapting the intervention to achieve ‘best fit’ [55] at scale-up, and ii. assessing the magnitude of ‘voltage drop’ after scale-up. Our hybrid effectiveness-implementation study of CTM Phase 3 builds on our previous reports of the design and community partnership development [19], formative evaluation [56], implementation of CTM at small scale [20, 21] and model adaptation [12]. Thus, this is not an isolated study—the innovation and importance of CTM Phase 3 can be better understood in the context of our earlier work.

  • Fidelity to intervention delivery was maintained following CTM program adaptations in Phase 3

As per central tenets of successful implementation [28, 29], we engaged our key partners during pre-implementation planning, to co-design CTM as a flexible, scalable intervention [19], and to identify appropriate and feasible implementation strategies. For Phase 3 scale-up, we adopted a systematic process [5759] to adapt CTM to meet the needs of older adults who lived in different geographic settings [12]. Such adaptations are often deemed necessary, and potentially inevitable to ensure that interventions are appropriate for new contexts and settings [16] and that scale-up is successful [60]. An opposing view suggests that adaptation is an implementation failure [29, 61]. The fine balance between adaptation and fidelity has been termed ‘a dynamic tension’ [60]—it reflects a potential chasm between what community delivery partners are willing and able to do, and researchers’ goal to deliver the intervention as planned. The need to maintain this balance becomes more critical and more challenging as innovations are implemented at larger and larger scale.

In this third phase of CTM, we focused on adapting program content while retaining fidelity to core intervention components (one-on-one consultation, group meetings, check-ins). Core components are fundamental aspects of the intervention, considered potential drivers of positive health impact [62]. Changing core components risks altering aspects of intervention that are perceived to promote improved participant-level health outcomes. In our study, adaptation did not compromise overall fidelity of the CTM Phase 3 program as Activity Coaches delivered all CTM core components.

  • CTM when adapted and delivered at scale (Phase 3) led to short-term increases in older adults’ physical activity

CTM Phase 3 resulted in a modest increase in physical activity in all participants at 3 months (+1.0 days/week in younger participants; +0.9 days/week in older participants) that may lead to significant health benefits [63]. Whereas physical activity levels returned to baseline levels among older participants during months 4–6 of the intervention, physical activity remained stable (did not drop) in younger participants during this period despite the lower program delivery ‘dose’ (i.e., no group meetings and only 3 telephone check-ins). Intervention-related benefits in physical activity were also maintained in younger participants 12-months after the intervention ended. This is a notable finding for two reasons. First, among older adults aged 74 years and younger, participation in CTM countered the trend that older adults’ physical activity declines, on average, with age [64, 65]. Second, we conducted the latter part of our study during the turbulence of the COVID-19 pandemic when public health measures, such as stay at home directives, generally impacted older adults’ daily routines. For 70.0% of participants, follow-up measurements were conducted during the first and second waves of the pandemic in BC. CTM group sessions were designed to instill long term skills such as goal setting and action planning; these lessons may have helped younger participants to maintain their physical activity during COVID. Although physical activity returned to baseline levels in older participants (≥75 years), it is also reassuring that physical activity did not decline further, particularly given the context of the COVID-19 pandemic. Additional program adaptation is likely required in order to maintain physical activity benefits among participants aged 75 years and older. Currently, we are exploring the efficacy of an extended contact intervention [66] (i.e., monthly or quarterly group meetings following completion of the main CTM intervention) on participant outcomes (NCT04592614).

Among younger participants, improved health outcomes were accompanied by increases in perceived health status—benefits that persisted at the 12-month follow-up. The perceived benefits in health status were within the range of values reported for the minimally important difference (MID) for the VAS. MID is defined as the smallest change in a patient-reported outcome that is perceived by patients as beneficial or that would result in a change in treatment [67] in clinical populations [68, 69]. However, we did not observe an improvement in the EQ-5D-5L index score in younger (or older) participants. Although the EQ-5D-5L demonstrated excellent psychometric properties (i.e., reliability and validity), this instrument may not be sensitive enough to monitor changes over time after participation in a health-promoting intervention such as CTM [70].

Voltage drop is not inevitable–but can reflect program adaptation

Activity coaches and older adults who participated in CTM Phases 1–2, told us that social connectedness was central to program success, and encouraged us to place greater emphasis on opportunities for older adults to connect [12]. Therefore, in the CTM Phase 3 intervention we added a group meeting to promote social interactions among older adults. We also emphasized and formally integrated social connectedness into the activity coach training curriculum (e.g., Activity coaches offered more opportunities for group and pair discussion at group meetings).

Increased opportunities for CTM participants to connect with their peers in group meetings was reflected in diminished feelings of social isolation in Phase 3 as compared with Phases 1–2. What we observed was underscored by the positive association between program dose received (as reported by coaches) and decreased social isolation among older participants. Thus, it seems that voltage drop is not inevitable with program adaptations designed to improve outcomes.

However, unlike CTM Phases 1–2 [27], in CTM Phase 3 diminished social isolation following the intervention was not maintained at 12-month follow-up in younger or older participants. This is not surprising, as participants in four of seven CTM Phase 3 program cycles completed their follow-up during the COVID-19 pandemic. COVID public health ‘stay-at-home’ directives generally impacted older adults’ ability to connect [71, 72]. Strategies to counter the harmful effects of social isolation and loneliness on older adults’ physical and mental health [73], might include effective health-promoting programs delivered at broad scale, such as CTM.

Adaptations to CTM Phase 3 may have reduced intervention-related benefits in physical activity (in younger participants only), mobility and loneliness when compared with CTM Phases 1 and 2. The magnitude of the voltage drop (median of 52.6%) for health outcomes at broad scale-up in CTM Phase 3 was similar to reports in a recent systematic review; across 10 eligible scaled-up physical activity interventions (targeting children, adults or older adults) the median voltage drop for physical activity was 59% [14].

Three factors may have contributed to voltage drop in physical activity, mobility and loneliness. First, some Phase 3 participants were older adults living in more remote areas of northern British Columbia where climate and limitations of the built environment contribute to decreased leisure-time activity options and limited access to active transportation, compared with more urban southern communities [74, 75]. Second, CTM Phase 3 participants had 4 fewer check-ins with their activity coaches. Check-in participation as reported by coaches was high in all CTM Phases, but slightly lower among Phase 3 participants (82.3% attended 70% of check-ins), as compared with Phases 1–2 participants (96.2% attended 70% of check-ins). Coaches were primary motivators for participants to ‘stick with’ their activity plans; reduced contact in Phase 3 may have contributed to lower check-in participation and ultimately to voltage drop in intervention effectiveness.

Third, Phase 3 activity coaches received their CTM training in a self-directed online format, whereas Phases 1–2 coaches were trained in person. Although most activity coaches (93.5%) found the online training useful, 19.6% of activity coaches were not fully confident in their ability to use what they learned in training. The CTM central support unit [32] provided support to activity coaches throughout the program. In future, it may be beneficial to offer activity coaches options to train either in-person or be self-directed, and between online group training sessions in person or on platforms like Zoom™.

Limitations

We acknowledge several limitations. First, our cohort was comprised of mostly female older adults, most of whom self-identified as being white. This limits the external validity of our findings, and highlights the need for continued efforts to adapt health-promoting programs to reach older men, older adults from more diverse cultural and ethnic backgrounds, and people from marginalized groups. For example, to ensure a transgender-inclusive approach in future, we urge researchers to utilize a multidimensional measure to assess gender identity and lived gender [76] in addition to biological sex. Second, despite reasonable retention in Phase 3, those with better perceived health status were more likely to complete the program. The reasons for this must be more fully explored. Third, we did not assess whether intervention benefits were maintained beyond the 12-month follow-up. It will be important in future studies to assess if benefits can be maintained over a longer period of time. Finally, COVID-19 posed challenges for program delivery in the final cycle of Phase 3; the pandemic also affected participant follow-up for those who completed CTM prior to the pandemic. Although program delivery continued in cycle 8, 73.1% of programs pivoted to online delivery for at least one group meeting and 19.2% delivered more than half of group meetings online. Program attendance was similar to that observed in previous cycles; however, in our exploratory subgroup analysis of cycle 8 participants, we found, not surprisingly, that only social isolation scores changed during the 6-month intervention. Both younger and older participants reported feeling increasingly socially isolated whereas we did not observe any benefits of CTM on physical activity, mobility, loneliness or health-related quality of life in this cohort.

Conclusions

Our findings highlight how continued program adaptation and refinement through a Knowledge to Action Cycle [77] are integral parts of the life-cycle of an intervention. Adaptations that accompany scale-up of evidence-based interventions (e.g., degree of fidelity/adaptation required to retain effectiveness), may help to preserve benefits (diminish voltage drop) as intervention are implemented across the scale-up continuum [8]. It seems important, in future, to quantify voltage drop in effective health-promoting interventions over the longer term and as they are implemented at increasing larger scale. Assessing the scale-up penalty may provide a more realistic assessment of intervention benefits at the population level. This may, in turn, reflect scalability of an intervention [8], and guide policy makers toward best investments in health promotion and public health [13]. We continue to advocate for hybrid effectiveness studies as both implementation and impact outcomes help us to understand why interventions do or do not ‘work’, especially at scale-up.

The public health and health promotion landscape may be forever changed, by the COVID-19 pandemic. There is a need for virtual health-promoting programs that can be adapted and delivered effectively, in the home environment. Flexible health-promoting programs–-such as CTM—might be adapted (and evaluated) with community partners to meet the needs of more racially, culturally and gender diverse populations of older adults, who live in diverse settings.

Supporting information

S1 Table. Comparison of descriptive characteristics between participants who completed Choose to Move, those lost to follow-up and those in Cycle 8.

Baseline socio-demographic characteristics of participants who completed the Choose to Move intervention, those lost to follow-up and those in Cycle 8 (Winter 2020 cohort, excluded from the primary analysis). Values are n (%) or mean (standard deviation, SD).

(DOCX)

S2 Table. Results of linear mixed model for impact outcome measures for Choose to Move participants in Cycle 8 (Winter 2020 cohort).

Adjusted means (95% confidence interval) for impact outcome measures by time point and age group in Choose to Move Phase 3 –Cycle 8 (Winter 2020 cohort; excluded from primary analysis due to impact of COVID-19 on program delivery).

(DOCX)

Acknowledgments

We are grateful to the BC Ministry of Health and the Active Aging Society for their commitment to, and ongoing support of, Choose to Move. We also thank our delivery partner organizations, facility managers and coordinators, activity coaches, and all of the older adults who participated in Choose to Move. We are also appreciative of staff and trainees from the Active Aging Research Team for their assistance with data collection.

Data Availability

Data cannot be shared with anyone outside of the project team, as consent was not obtained from participants for this. The UBC Clinical Research Ethics Board can be approached with data requests, and they can provide options for sharing study data. The University of British Columbia's Clinical Research Ethics Board can be reached at: pia.ganz@ubc.ca (Pia Ganz, Manager).

Funding Statement

JSG and HMM received funding from the Canadian Institutes of Health Research (PJT-153248) for this work (https://cihr-irsc.gc.ca). The British Columbia Ministry of Health also provided funds to support delivery of Choose to Move (http://gov.bc.ca/health/). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

References

  • 1.Clarke J, Colley R, Janssen I, Tremblay MS. Accelerometer-measured moderate-to-vigorous physical activity of Canadian adults, 2007 to 2017. Health Rep. 2019;30(8):3–10. doi: 10.25318/82-003-x201900800001-eng [DOI] [PubMed] [Google Scholar]
  • 2.Copeland JL, Clarke J, Dogra S. Objectively measured and self-reported sedentary time in older Canadians. Prev Med Rep. 2015;2:90–5. doi: 10.1016/j.pmedr.2015.01.003 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3.Chase JA. Interventions to Increase Physical Activity Among Older Adults: A Meta-Analysis. Gerontologist. 2015;55(4):706–18. doi: 10.1093/geront/gnu090 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4.Reis RS, Salvo D, Ogilvie D, Lambert EV, Goenka S, Brownson RC, et al. Scaling up physical activity interventions worldwide: stepping up to larger and smarter approaches to get people moving. Lancet. 2016;388(10051):1337–48. doi: 10.1016/S0140-6736(16)30728-0 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5.Gray SM, McKay HA, Nettlefold L, Race D, Macdonald HM, Naylor PJ, et al. Physical activity is good for older adults-but is programme implementation being overlooked? A systematic review of intervention studies that reported frameworks or measures of implementation. Brit J Sport Med. 2021;55(2):84–91. [DOI] [PubMed] [Google Scholar]
  • 6.World Health Organization ExpandNet. Nine steps for developing a scaling-up strategy. Geneva: 2010.
  • 7.Indig D, Lee K, Grunseit A, Milat A, Bauman A. Pathways for scaling up public health interventions. BMC Public Health. 2017;18(1):68. doi: 10.1186/s12889-017-4572-5 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8.Milat AJ, King L, Bauman AE, Redman S. The concept of scalability: increasing the scale and potential adoption of health promotion interventions into policy and practice. Health Promot Int. 2013;28(3):285–98. doi: 10.1093/heapro/dar097 [DOI] [PubMed] [Google Scholar]
  • 9.Proctor EK, Powell BJ, McMillen JC. Implementation strategies: recommendations for specifying and reporting. Implement Sci. 2013;8:139. doi: 10.1186/1748-5908-8-139 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10.Aarons GA, Sklar M, Mustanski B, Benbow N, Brown CH. "Scaling-out" evidence-based interventions to new populations or new health care delivery systems. Implement Sci. 2017;12(1):111. doi: 10.1186/s13012-017-0640-6 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11.Harden SM, Johnson SB, Almeida FA, Estabrooks PA. Improving physical activity program adoption using integrated research-practice partnerships: an effectiveness-implementation trial. Transl Behav Med. 2017;7(1):28–38. doi: 10.1007/s13142-015-0380-6 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12.Gray SM, McKay HA, Hoy CL, Lau E, Ahn R, Lusina-Furst S, et al. Getting Ready for Scale-Up of an Effective Older Adult Physical Activity Program: Characterizing the Adaptation Process. Prev Sci. 2020;21(3):355–65. doi: 10.1007/s11121-019-01085-3 [DOI] [PubMed] [Google Scholar]
  • 13.McCrabb S, Lane C, Hall A, Milat A, Bauman A, Sutherland R, et al. Scaling-up evidence-based obesity interventions: A systematic review assessing intervention adaptations and effectiveness and quantifying the scale-up penalty. Obes Rev. 2019;20(7):964–82. doi: 10.1111/obr.12845 [DOI] [PubMed] [Google Scholar]
  • 14.Lane C, McCrabb S, Nathan N, Naylor PJ, Bauman A, Milat A, et al. How effective are physical activity interventions when they are scaled-up: a systematic review. Int J Behav Nutr Phys Act. 2021;18(1):16. doi: 10.1186/s12966-021-01080-4 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15.Tommeraas T, Ogden T. Is There a Scale-up Penalty? Testing Behavioral Change in the Scaling up of Parent Management Training in Norway. Adm Policy Ment Health. 2017;44(2):203–16. doi: 10.1007/s10488-015-0712-3 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16.Chambers DA, Glasgow RE, Stange KC. The dynamic sustainability framework: addressing the paradox of sustainment amid ongoing change. Implement Sci. 2013;8:117. doi: 10.1186/1748-5908-8-117 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.Kilbourne AM, Neumann MS, Pincus HA, Bauer MS, Stall R. Implementing evidence-based interventions in health care: application of the replicating effective programs framework. Implement Sci. 2007;2:42. doi: 10.1186/1748-5908-2-42 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18.Stewart AL, Gillis D, Grossman M, Castrillo M, Pruitt L, McLellan B, et al. Diffusing a research-based physical activity promotion program for seniors into diverse communities: CHAMPS III. Preventing chronic disease. 2006;3(2):A51–A. [PMC free article] [PubMed] [Google Scholar]
  • 19.McKay HA, Sims-Gould J, Nettlefold L, Hoy CL, Bauman AE. Implementing and Evaluating an Older Adult Physical Activity Model at Scale: Framework for Action. TJACSM. 2017;2(2):10. [Google Scholar]
  • 20.McKay H, Nettlefold L, Bauman A, Hoy C, Gray SM, Lau E, et al. Implementation of a co-designed physical activity program for older adults: positive impact when delivered at scale. BMC Public Health. 2018;18(1):1289. doi: 10.1186/s12889-018-6210-2 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21.McKay HA, Nettlefold L, Hoy C, Bauman AE, Sims-Gould J. Bright Spots, physical activity investments that work: Choose to Move: scaling up a physical activity model for older adults. Brit J Sport Med. 2019;53(15):976–7. [DOI] [PubMed] [Google Scholar]
  • 22.Stewart AL, Mills KM, Sepsis PG, King AC, McLellan BY, Roitz K, et al. Evaluation of CHAMPS, a physical activity promotion program for older adults. Ann Behav Med. 1997;19(4):353–61. doi: 10.1007/BF02895154 [DOI] [PubMed] [Google Scholar]
  • 23.Stewart AL, Verboncoeur CJ, McLellan BY, Gillis DE, Rush S, Mills KM, et al. Physical activity outcomes of CHAMPS II: a physical activity promotion program for older adults. J Gerontol A Biol Sci Med Sci. 2001;56(8):M465–70. doi: 10.1093/gerona/56.8.m465 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24.Locke EA, Latham GP. A theory of goal setting & task performance. Englewood Cliffs: Prentice-Hall; 1990. [Google Scholar]
  • 25.Bailey RR. Goal setting and action planning for health behavior change. Am J Lifestyle Med. 2019;13(6):615–8. doi: 10.1177/1559827617729634 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 26.Franke T, Sims-Gould J, Nettlefold L, Ottoni C, McKay HA. "It makes me feel not so alone": features of the Choose to Move physical activity intervention that reduce loneliness in older adults. BMC Public Health. 2021;21(1):312. doi: 10.1186/s12889-021-10363-1 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 27.McKay HA, Nettlefold L, Sims-Gould J, Macdonald HM, Khan KM, Bauman A. Status Quo or Drop-Off: Do Older Adults Maintain Benefits From Choose to Move-A Scaled-Up Physical Activity Program-12 Months After Withdrawing the Intervention? J Phys Act Health. 2021:1–9. doi: 10.1123/jpah.2020-0850 [DOI] [PubMed] [Google Scholar]
  • 28.Wandersman A, Duffy J, Flaspohler P, Noonan R, Lubell K, Stillman L, et al. Bridging the gap between prevention research and practice: the interactive systems framework for dissemination and implementation. Am J Community Psychol. 2008;41(3–4):171–81. doi: 10.1007/s10464-008-9174-z [DOI] [PubMed] [Google Scholar]
  • 29.Durlak JA, DuPre EP. Implementation matters: a review of research on the influence of implementation on program outcomes and the factors affecting implementation. Am J Community Psychol. 2008;41(3–4):327–50. doi: 10.1007/s10464-008-9165-0 [DOI] [PubMed] [Google Scholar]
  • 30.U.S. National Library of Medicine. Glossary of Common Site Terms 2021. [cited 2022 August 15]. Available from: https://clinicaltrials.gov/ct2/about-studies/glossary. [Google Scholar]
  • 31.Williams RJ, Tse T, Harlan WR, Zarin DA. Registration of observational studies: is it time? CMAJ. 2010;182(15):1638–42. doi: 10.1503/cmaj.092252 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 32.Sims-Gould J, McKay HA, Franke T. How central support built capacity to deliver a health-promoting intervention for older adults in Canada. Health Soc Care Community. 2022. doi: 10.1111/hsc.13751 [DOI] [PubMed] [Google Scholar]
  • 33.Curran GM, Bauer M, Mittman B, Pyne JM, Stetler C. Effectiveness-implementation hybrid designs: combining elements of clinical effectiveness and implementation research to enhance public health impact. Med Care. 2012;50(3):217–26. doi: 10.1097/MLR.0b013e3182408812 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 34.Warburton DE, Jamnik VK, Bredin SSD, Gledhill N, on behalf of the PAR-Q+ Collaboration. The Physical Activity Readiness Questionnaire for Everyone (PAR-Q+) and Electronic Physical Activity Readiness Medical Examination (ePARmed-X+). Health & Fitness Journal of Canada. 2011;4(2):3–23. [Google Scholar]
  • 35.Canadian Society for Exercise Physiology. Get Active Questionnaire. 2017. [Google Scholar]
  • 36.Harris PA, Taylor R, Thielke R, Payne J, Gonzalez N, Conde JG. Research electronic data capture (REDCap)—a metadata-driven methodology and workflow process for providing translational research informatics support. J Biomed Inform. 2009;42(2):377–81. doi: 10.1016/j.jbi.2008.08.010 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 37.McKay H, Naylor PJ, Lau E, Gray SM, Wolfenden L, Milat A, et al. Implementation and scale-up of physical activity and behavioural nutrition interventions: an evaluation roadmap. Int J Behav Nutr Phys Act. 2019;16(1):102. doi: 10.1186/s12966-019-0868-4 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 38.Saunders RP, Evans MH, Joshi P. Developing a process-evaluation plan for assessing health promotion program implementation: a how-to guide. Health Promot Pract. 2005;6(2):134–47. doi: 10.1177/1524839904273387 [DOI] [PubMed] [Google Scholar]
  • 39.Rabin BA, Brownson RC, Haire-Joshu D, Kreuter MW, Weaver NL. A glossary for dissemination and implementation research in health. J Public Health Manag Pract. 2008;14(2):117–23. doi: 10.1097/01.PHH.0000311888.06252.bb [DOI] [PubMed] [Google Scholar]
  • 40.Linnan L, Steckler A. Process evaluation for public health interventions and research: an overview. In: Linnan L, Steckler A, editors. San Francisco, CA: Jossey-Bass; 2002. [Google Scholar]
  • 41.Ware JE Jr, Sherbourne CD. The MOS 36-item short-form health survey (SF-36). I. Conceptual framework and item selection. Med Care. 1992;30(6):473–83. [PubMed] [Google Scholar]
  • 42.Eriksson I, Unden AL, Elofsson S. Self-rated health. Comparisons between three different measures. Results from a population study. Int J Epidemiol. 2001;30(2):326–33. doi: 10.1093/ije/30.2.326 [DOI] [PubMed] [Google Scholar]
  • 43.Statistics Canada. Visible Minority and Population Group Reference Guide, Census of Population, 2016. Catalogue no. 98-500-X2016006. 2017. [Google Scholar]
  • 44.Milton K, Bull FC, Bauman A. Reliability and validity testing of a single-item physical activity measure. Brit J Sport Med. 2011;45(3):203–8. doi: 10.1136/bjsm.2009.068395 [DOI] [PubMed] [Google Scholar]
  • 45.Milton K, Clemes S, Bull F. Can a single question provide an accurate measure of physical activity? Brit J Sport Med. 2013;47(1):44–8. doi: 10.1136/bjsports-2011-090899 [DOI] [PubMed] [Google Scholar]
  • 46.Macdonald HM, Nettlefold L, Bauman A, Sims-Gould J, McKay HA. Pragmatic Evaluation of Older Adults’ Physical Activity in Scale-Up Studies: Is the Single-Item Measure a Reasonable Option? J Aging Phys Act. 2021:1–8. [DOI] [PubMed] [Google Scholar]
  • 47.Simonsick EM, Newman AB, Visser M, Goodpaster B, Kritchevsky SB, Rubin S, et al. Mobility limitation in self-described well-functioning older adults: importance of endurance walk testing. J Gerontol A Biol Sci Med Sci. 2008;63(8):841–7. doi: 10.1093/gerona/63.8.841 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 48.Franke T, Sims-Gould J, Nettlefold L, Ottoni C, McKay HA. Choose to Move: A Health Promoting Physical Activity Intervention Can Also Enhance Social Connectedness. BMC Public Health. 2020;In Press. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 49.Vernoff J, Kulka RA, Douvan EAM. Mental health in America: Patterns of help-seeking from 1957 to 1976. New York, NY: Basic Books; 1981. [Google Scholar]
  • 50.Hughes ME, Waite LJ, Hawkley LC, Cacioppo JT. A short scale for measuring loneliness in large surveys: results from two population-based studies. Research on aging. 2004;26(6):655–72. doi: 10.1177/0164027504268574 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 51.Herdman M, Gudex C, Lloyd A, Janssen M, Kind P, Parkin D, et al. Development and preliminary testing of the new five-level version of EQ-5D (EQ-5D-5L). Qual Life Res. 2011;20(10):1727–36. doi: 10.1007/s11136-011-9903-x [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 52.Xie F, Pullenayegum E, Gaebel K, Bansback N, Bryan S, Ohinmaa A, et al. A Time Trade-off-derived Value Set of the EQ-5D-5L for Canada. Med Care. 2016;54(1):98–105. doi: 10.1097/MLR.0000000000000447 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 53.World Health Organization. Bridging the “Know–Do” Gap: Meeting on Knowledge Translation in Global Health. 2006. [Google Scholar]
  • 54.Pahor M, Guralnik JM, Ambrosius WT, Blair S, Bonds DE, Church TS, et al. Effect of structured physical activity on prevention of major mobility disability in older adults: the LIFE study randomized clinical trial. JAMA. 2014;311(23):2387–96. doi: 10.1001/jama.2014.5616 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 55.Bopp M, Saunders RP, Lattimore D. The tug-of-war: fidelity versus adaptation throughout the health promotion program life cycle. J Prim Prev. 2013;34(3):193–207. doi: 10.1007/s10935-013-0299-y [DOI] [PubMed] [Google Scholar]
  • 56.Mackey DC, Perkins AD, Hong Tai K, Sims-Gould J, McKay HA. Men on the Move: A Randomized Controlled Feasibility Trial of a Scalable, Choice-Based, Physical Activity and Active Transportation Intervention for Older Men. J Aging Phys Act. 2019;27(4):1–14. doi: 10.1123/japa.2018-0137 [DOI] [PubMed] [Google Scholar]
  • 57.National Cancer Institute. Guidelines for choosing and adapting programs. Research-Tested Intervention Programs (RTIPs). n.d.
  • 58.Family & Youth Services Bureau. Making Adaptations Tip Sheet. n.d.
  • 59.van Dongen EJ, Leerlooijer JN, Steijns JM, Tieland M, de Groot LC, Haveman-Nies A. Translation of a tailored nutrition and resistance exercise intervention for elderly people to a real-life setting: adaptation process and pilot study. BMC Geriatr. 2017;17(1):25. doi: 10.1186/s12877-017-0413-8 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 60.Castro FG, Barrera M Jr, Martinez CR Jr. The cultural adaptation of prevention interventions: resolving tensions between fidelity and fit. Prev Sci. 2004;5(1):41–5. doi: 10.1023/b:prev.0000013980.12412.cd [DOI] [PubMed] [Google Scholar]
  • 61.Cohen DJ, Crabtree BF, Etz RS, Balasubramanian BA, Donahue KE, Leviton LC, et al. Fidelity versus flexibility: translating evidence-based research into practice. Am J Prev Med. 2008;35(5):S381–S9. doi: 10.1016/j.amepre.2008.08.005 [DOI] [PubMed] [Google Scholar]
  • 62.Blase K, Fixsen D. Core Intervention Components: Identifying and Operationalizing What Makes Programs Work. ASPE Research Brief. US Department of Health and Human Services. 2013. [Google Scholar]
  • 63.Jakicic JM, Kraus WE, Powell KE, Campbell WW, Janz KF, Troiano RP, et al. Association between Bout Duration of Physical Activity and Health: Systematic Review. Med Sci Sports Exerc. 2019;51(6):1213–9. doi: 10.1249/MSS.0000000000001933 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 64.Sun F, Norman IJ, While AE. Physical activity in older people: a systematic review. BMC Public Health. 2013;13:449. doi: 10.1186/1471-2458-13-449 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 65.Bauman A, Merom D, Bull FC, Buchner DM, Fiatarone Singh MA. Updating the evidence for physical activity. Gerontologist. 2016;56(S2):S268–80. [DOI] [PubMed] [Google Scholar]
  • 66.Fjeldsoe B, Neuhaus M, Winkler E, Eakin E. Systematic review of maintenance of behavior change following physical activity and dietary interventions. Health Psychol. 2011;30(1):99–109. doi: 10.1037/a0021974 [DOI] [PubMed] [Google Scholar]
  • 67.Revicki DA, Cella D, Hays RD, Sloan JA, Lenderking WR, Aaronson NK. Responsiveness and minimal important differences for patient reported outcomes. Health Qual Life Outcomes. 2006;4:70. doi: 10.1186/1477-7525-4-70 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 68.Tsai APY, Hur SA, Wong A, Safavi M, Assayag D, Johannson KA, et al. Minimum important difference of the EQ-5D-5L and EQ-VAS in fibrotic interstitial lung disease. Thorax. 2021;76(1):37–43. doi: 10.1136/thoraxjnl-2020-214944 [DOI] [PubMed] [Google Scholar]
  • 69.Nolan CM, Longworth L, Lord J, Canavan JL, Jones SE, Kon SS, et al. The EQ-5D-5L health status questionnaire in COPD: validity, responsiveness and minimum important difference. Thorax. 2016;71(6):493–500. doi: 10.1136/thoraxjnl-2015-207782 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 70.Feng YS, Kohlmann T, Janssen MF, Buchholz I. Psychometric properties of the EQ-5D-5L: a systematic review of the literature. Qual Life Res. 2021;30(3):647–73. doi: 10.1007/s11136-020-02688-y [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 71.Wu B. Social isolation and loneliness among older adults in the context of COVID-19: a global challenge. Glob Health Res Policy. 2020;5(1):27. doi: 10.1186/s41256-020-00154-3 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 72.MacLeod S, Tkatch R, Kraemer S, Fellows A, McGinn M, Schaeffer J, et al. COVID-19 Era Social Isolation among Older Adults. Geriatrics (Basel). 2021;6(2). doi: 10.3390/geriatrics6020052 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 73.World Health Organization. Social isolation and loneliness among older people: advocacy brief. Geneva: World Health Organization, 2021. [Google Scholar]
  • 74.Cleland V, Hughes C, Thornton L, Venn A, Squibb K, Ball K. A Qualitative Study of Environmental Factors Important for Physical Activity in Rural Adults. PLoS ONE. 2015;10(11):e0140659. doi: 10.1371/journal.pone.0140659 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 75.Pelletier CA, Pousette A, Ward K, Keahey R, Fox G, Allison S, et al. Implementation of Physical Activity Interventions in Rural, Remote, and Northern Communities: A Scoping Review. Inquiry. 2020;57:46958020935662. doi: 10.1177/0046958020935662 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 76.Bauer GR, Braimoh J, Scheim AI, Dharma C. Transgender-inclusive measures of sex/gender for population surveys: Mixed-methods evaluation and recommendations. PLoS ONE. 2017;12(5):e0178043. doi: 10.1371/journal.pone.0178043 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 77.Graham ID, Logan J, Harrison MB, Straus SE, Tetroe J, Caswell W, et al. Lost in knowledge translation: time for a map? J Contin Educ Health Prof. 2006;26(1):13–24. doi: 10.1002/chp.47 [DOI] [PubMed] [Google Scholar]

Decision Letter 0

Jianhong Zhou

21 Nov 2022

PONE-D-22-11801What is the ‘voltage drop’ when an effective health promoting intervention for older adults—Choose to Move (Phase 3)—is implemented at broad scale?PLOS ONE

Dear Dr. Macdonald,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

Specifically, both reviewers raised concerns about the study. Please address all the comments point-by-point.

Please submit your revised manuscript by Jan 02 2023 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: https://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols.

We look forward to receiving your revised manuscript.

Kind regards,

Jianhong Zhou

Staff Editor

PLOS ONE

Journal Requirements:

When submitting your revision, we need you to address these additional requirements.

1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at

https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and

https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf

2. Please update your submission to use the PLOS LaTeX template. The template and more information on our requirements for LaTeX submissions can be found at http://journals.plos.org/plosone/s/latex

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

Reviewer #2: Partly

**********

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: I Don't Know

Reviewer #2: Yes

**********

3. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: No

Reviewer #2: Yes

**********

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

**********

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: The paper ‘What is the ‘voltage drop’ when an effective health promoting intervention for older adults—Choose to Move (Phase 3)—is implemented at broad scale?’ discusses an important study on the scale up of a health promoting intervention. The paper is important as this wider implementation is often not discussed after smaller scale implementations.

Overall, the study seems like it was well planned and though through with suitable measures and data collection in place. I want to commend the authors on continuing this work through the pandemic, it was not an easy time. That said there are some instances where they have excluded data collected during the pandemic from analysis. I would be interested in this data, to see how the pandemic waves impacted on the fidelity and deliverables of this intervention, even if done as a separate analysis. This may have also added strength to the discussion where they discuss the impact of the ‘stay home’ mandates on the later cycles follow up and maintenance.

One of the main overarching issues for me that requires addressing is the framing of the study results. In the discussion broad statements such as ‘CTM when adapted and delivered at scale (Phase 3) increased older adults’ physical activity’ appeared to be misleading and unsupported by the results which showed much more nuance. For adults >75 years an increase was shown at 3 months, but not even maintained to 6 months. Further when the full sample is looked at, there is only a significant increase at 3 months, no significant difference from baseline at 6 and 18 months. I am disappointed that this nuance was not explored more. I see it as a strength to the paper that they are showing such interesting variations by age, however, critique of this was disappointingly absent (apart from in discussion with pandemic impact). We must be more critical and curious when we have an intervention that appears to work well for 3 months, but then work sporadically. Could this be when there is the change from small groups to check-ins? These interesting questions are not explored.

I have provided my main comments on the attached PDF document, and hope that they help the authors improve this paper, as it is a great study.

Reviewer #2: The study aims to assess the implementation, impact on physical activity, mobility, social isolation, loneliness, and health-related quality of life (impact outcomes), whether intervention effects were maintained and to compare voltage drop with previous CTM phases.

Abstract

Line 36, the word mean sd to be added.

Method

Line 133, the total duration of the program is to be stated.

Line 206, at least one decimal point for the percentage figures. This applies throughout the manuscript including tables where applicable.

The following information are to be added.

i) Line 218, the key name of the single-item physical activity

ii) Line 225, the name of the questionnaire.

iii) Line 247, one or two-tailed to be stated.

iv) Line 253, to be written as Fisher’s exact test and one or two-tailed test to be stated.

Line 222. ‘as no/any difficulty walking 400m’ to be rephrased.

Line 236, the word dimension or levels to be added to 3125.

Line 282, the sentence requires revision.

Results

Table 2, statistical tests to be denoted in the table footnote. However, based on CONSORT statement, all statistical tests for baseline comparison are to be avoided.

Table 3 requires cosmetic changes. The p values were not placed on the same row with the outcome, time point and age group. n for Mobility apart from % to be added and Bonferroni correction is to be denoted.

Tables 3 & 4, the adjusted variables and statistical tests to be denoted in the table footnote.

Table 4, 95%CI is to be stated in the title. ND is to be denoted in the table footnote.

Supplemental Table 1, statistical test to be denoted in the table footnote.

Supplemental Table 1, the table title ‘those in Cycle 8 (excluded from the analysis’) looks confusing. The comparison groups are to be clearly stated. For *significantly different from the Lost to Follow-up (p=0.033) and Cycle 8 (p=0.037) groups, the statistical test is to be stated.

Model fit to be discussed.

Figure 2, the outcome measures, activity coaches and participants engagement survey could be incorporated into the figure. Provincial and Comprehensive are to be clearly denoted in the Figure 2 footnote.

**********

6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: No

**********

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

Attachment

Submitted filename: PONE-D-22-11801_reviewer.pdf

PLoS One. 2023 May 5;18(5):e0268164. doi: 10.1371/journal.pone.0268164.r002

Author response to Decision Letter 0


10 Feb 2023

Reviewer #1: The paper ‘What is the ‘voltage drop’ when an effective health promoting intervention for older adults—Choose to Move (Phase 3)—is implemented at broad scale?’ discusses an important study on the scale up of a health promoting intervention. The paper is important as this wider implementation is often not discussed after smaller scale implementations.

Overall, the study seems like it was well planned and thought through with suitable measures and data collection in place. I want to commend the authors on continuing this work through the pandemic, it was not an easy time. That said there are some instances where they have excluded data collected during the pandemic from analysis. I would be interested in this data, to see how the pandemic waves impacted on the fidelity and deliverables of this intervention, even if done as a separate analysis. This may have also added strength to the discussion where they discuss the impact of the ‘stay home’ mandates on the later cycles follow up and maintenance.

One of the main overarching issues for me that requires addressing is the framing of the study results. In the discussion broad statements such as ‘CTM when adapted and delivered at scale (Phase 3) increased older adults’ physical activity’ appeared to be misleading and unsupported by the results which showed much more nuance. For adults >75 years an increase was shown at 3 months, but not even maintained to 6 months. Further when the full sample is looked at, there is only a significant increase at 3 months, no significant difference from baseline at 6 and 18 months. I am disappointed that this nuance was not explored more. I see it as a strength to the paper that they are showing such interesting variations by age, however, critique of this was disappointingly absent (apart from in discussion with pandemic impact). We must be more critical and curious when we have an intervention that appears to work well for 3 months, but then work sporadically. Could this be when there is the change from small groups to check-ins? These interesting questions are not explored.

I have provided my main comments on the attached PDF document, and hope that they help the authors improve this paper, as it is a great study.

Response: We thank the Reviewer for their positive and constructive feedback on our manuscript. Regarding the Reviewer’s first main comment, we appreciate the opportunity to clarify how the COVID-19 pandemic impacted fidelity of CTM and the deliverables of this intervention. Of the 26 programs in the Winter 2020 cycle, 20 programs modified mode of delivery (from in person to online) for at least one of the 5 group meetings; 5 of these programs delivered more than 50% of their group meetings online. Although attendance at the online group meetings was similar to group meeting attendance in the other seven cycles, physical activity opportunities in the community that were part of individual action plans were no longer available due to public health restrictions and physical distancing measures. Given the impact of COVID-19 on this cohort, we felt it was inappropriate to include them in our primary analysis. However, we agree with the Reviewer that it is important for us to share the data for this group. We now include a supplementary table with the results of the linear mixed effects model for the impact outcome measures in the Winter 2020 cohort. Please note that duration of follow-up was three months shorter for this group; we provide outcomes at baseline, 3 and 6 months.

Regarding the Reviewer’s second comment, we did not intend to overstate the significance of our findings. We agree that the manuscript requires a more nuanced discussion of the apparent age-specificity of CTM’s benefit. In the Discussion, we now clarify the age-specificity of CTM’s impact on physical activity, noting that although CTM increased physical activity in all participants after 3 months, this benefit was only maintained in the younger group (<74 years) at 6 and 18 months. We agree that the lower program ‘dose’ during months 3-6 of the intervention may have contributed to the decline in physical activity among older participants. In the Discussion (Line 490), we now mention our current study that is investigating the efficacy of an extended contact intervention (i.e., monthly or quarterly group meetings following completing of the main CTM intervention). Continued contact with an activity coach may encourage participants, particularly those aged 75 years and older, to maintain their physical activity behaviours.

1. Introduction, Line 62 & 70: Include page numbers with direct quotes

Action: We added the end quotes and the page number for the direct quote.

2. Introduction, Line 76: Do smaller effect sizes indicate voltage drop?

Response: Yes, a smaller effect size in the scaled-up trial as compared with the pre-scale efficacy trial indicates voltage drop.

3. Introduction, Line 94: Was the previous CTM study split to younger and older age group as in the present study? Provide examples of health benefits maintained 12 months after the intervention ended.

Response: Yes, in the analysis of CTM Phases 1 and 2, we split the sample into the same age groups (60-74 yrs and > 75 yrs). Regarding maintenance of health benefits 12 months after CTM ended, we found that in the younger group, participants maintained their intervention benefits in mobility, social isolation and loneliness. Among older participants, only intervention-related decreases in loneliness were maintained 12 months after the intervention. We added this information to the introduction.

Action: Page 5, Lines 95-99 now read: Some health benefits were maintained 12 months after the intervention ended [27]. Specifically, among younger participants (60-74 years), intervention-related benefits in mobility, social isolation and loneliness were maintained 12 months after CTM ended, whereas in older participants (> 75 years), only decreased loneliness was maintained over 12 months.

4. Introduction, Line 98: Was there a numbers goal of how many locations/people involved?

Response: The number of programs we aimed to deliver in CTM Phase 3 (n=135) was determined according to our commitment to the British Columbia Ministry of Health (who provided funds to support delivery of CTM). With an expected average of 12 participants per program, we anticipated a total of 1620 older adult participants. Ultimately, we delivered more programs (n=165) because of a lower number of participants per program.

5. Methods: Line 115: Unnecessary to include the full definition of an observational study, be concise in how your study aligned with the definition.

Response: We removed the definition of an observational study.

6. Methods, Line 171: Move description of number of participants with consent to the Results.

Response: Thank you for this suggestion. We moved this information to the opening paragraph of the Results.

7. Methods, Line 175: (regarding exclusion of the Winter 2020 cycle) This seems really unfortunate to not include this subgroup in some form of analysis. If this is not going to be published elsewhere in the future, I think it should be included as a subgroup.

Response: Thank you for this suggestion. We now include the analysis of the Winter 2020 cohort in Supplementary Table 2 and summarize the results for this exploratory subgroup analysis. We also provide a brief interpretation of these findings in the Discussion.

Action: Lines 417-25 now read: Among all participants in cycle 8 (Winter 2020), physical activity and mobility did not change significantly over time. However, social isolation scores decreased (indicating increased feelings of social isolation) between baseline and 3 months in younger (-1.8; 95% CI: -2.6, -1.0) and older participants (-2.5; 95% CI: -3.5, -1.4). Social isolation scores were also lower at the end of the intervention in younger (-1.4; 95% CI: -2.2, -0.5) and older (-1.7; 95% CI: -2.8, -0.6) participants. Although loneliness scores increased in the whole Winter 2020 cohort after 3 months (+0.3; 95% CI: 0.01, 0.6); change in loneliness score after 3 months was not significant in each age group. EQ-5D-5L and VAS scores did not change significantly over time in either age group.

Action: Lines 561-8 now read: Finally, COVID-19 posed challenges for program delivery in the final cycle of Phase 3; the pandemic also affected participant follow-up for those who completed CTM prior to the pandemic. Although program delivery continued in cycle 8, 76.9% of programs pivoted to online delivery for at least one group meeting and 19.2% of these programs delivered more than half of group meetings online. Program attendance was similar to that observed in previous cycles; however, in our exploratory subgroup analysis of cycle 8 participants, we found, not surprisingly, that only social isolation scores changed during the 6-month intervention. Both younger and older participants reported feeling increasingly socially isolated whereas we did not observe any benefits of CTM on physical activity, mobility, loneliness or health-related quality of life in this cohort.

8. Methods, Line 214: On the PDF, the Reviewer added the comment “Why?” next to the ethnicity categories, which we assume to mean that they would like us to clarify why we collapsed information on ethnicity into three categories.

Response: We reduced the number of categories to three for inclusion in our statistical analysis. The three categories we chose (Asian, white or other/mixed) reflect the composition of our sample and align with Statistics Canada classifications (https://www12.statcan.gc.ca/census-recensement/2016/ref/guides/006/98-500-x2016006-eng.cfm).

9. Table 2: Why are baseline demographics presented by age group and not by cycle?

Response: We chose to present baseline demographics by age group rather than by program cycle because the variability in demographic outcomes was greater between age groups than between program cycles.

10. Table 2: Error in number of participants by age group.

Response: Thank you for noting this error. We corrected the number of participants by age group in Table 2.

11. Table 2: Clarify why the n differs for some outcomes.

Action: We added a footnote to the table to indicate that the n differs for some outcomes because of missing data.

12. Results, Line 330: Why was participant responsiveness only looked at after the first 3 months?

Response: Thank you for the opportunity to clarify our measure of participant responsiveness. Questions related to participant responsiveness were only asked after the first 3 months of the intervention because coaches were asked to reflect on participants’ level of engagement at the group meetings only. Coaches were not asked to comment on participants’ engagement during the telephone check-ins that took place throughout the 6-month intervention. We clarified in this section that group meetings only took place during the first 3 months of the intervention.

Action: Line 349-50 now reads: After the first 3 months of the intervention (period during which all group meetings were held), 90.4% of participants were satisfied with CTM.

13. Discussion, Line 427: This feels misleading. There is only evidence that it leads to an increased level of activity in younger adults. For older adults an increased was shown at three months, but not even maintained to 6 months, in your own words 'For older participants, physical activity at 18 months did not differ from values at 6 months, or at baseline.' Further when the full sample is looked at, there is only a significant increase at 3 months, no significant difference from baseline at 6 and 18 months.

Response: We agree with the Reviewer that this subheading may be considered misleading in the context of the full 6-month intervention, and the apparent age-specificity of intervention effectiveness. We modified the subheading accordingly.

Action: Lines 469-70 now read: CTM when adapted and delivered at scale (Phase 3) led to short-term increases in older adults’ physical activity

14. Discussion, Line 434: (in response to statement that CTM countered the trend that older adults’ PA declines with age) How? Activity levels were similar between older and younger adults at baseline of this study, and we saw differences in how they maintained physical activity. Additionally, the older adult group showed no change from baseline at 6 and 18 months.

Response: Thank you for the opportunity to clarify our thoughts on this point. Intervention benefits in physical activity were only maintained in the younger group in the year after the intervention ended. Thus, it is possible that in this age group CTM countered the trend that older adults’ physical activity declines with age. Similarly, although intervention benefits were not maintained in the older age group, it is reassuring that physical activity levels did not decrease below baseline values, particularly given the context of the COVID-19 pandemic. Additional program adaptation may be warranted to target maintenance behaviours in those aged 75 years and older.

Action: Lines 476-492 now read: Intervention-related benefits in physical activity were also maintained in younger participants 12-months after the intervention ended. This is a notable finding for two reasons. First, among older adults aged 74 years and younger, participation in CTM countered the trend that older adults’ physical activity declines, on average, with age [63, 64]. Second, we conducted the latter part of our study during the turbulence of the COVID-19 pandemic when public health measures, such as stay at home directives, generally impacted older adults’ daily routines. For 70.0% of participants, follow-up measurements were conducted during the first and second waves of the pandemic in BC. CTM group sessions were designed to instill long term skills such as goal setting and action planning; these lessons may have helped younger participants to maintain their physical activity during COVID. Although physical activity returned to baseline levels in older participants (>75 years), it is also reassuring that physical activity did not decline further, particularly given the context of the COVID-19 pandemic. Additional program adaptation is likely required in order to maintain physical activity benefits among participants aged 75 years and older. Currently, we are exploring the efficacy of an extended contact intervention [65] (i.e., monthly or quarterly group meetings following completion of the main CTM intervention) on participant outcomes (NCT04592614).

15. Discussion, Lines 438-440: Again, this doesn't align with your results. Both the pooled and >75 adults did not maintain their physical activity levels post 3 months.

Response: Thank you for noting this inconsistency. We clarified that CTM group sessions may have helped younger participants to maintain their physical activity during the pandemic. We also now comment on the need to adapt CTM to better support participants aged 75 years and older.

Action: Please see the Action for Comment 14 above.

16. Discussion, Line 450: Would we expect an impact on EQ-5D-5L when we haven’t seen any lasting impact on loneliness, social isolation, mobility or activity?

Response: CTM positively impacted physical activity, mobility, social isolation and loneliness among younger participants, and thus, the increased score on the EQ-5D-5L Visual Analog Scale aligns with these results. The VAS is a more subjective rating of health whereas the EQ-5D-5L score is generated by converting a 5-digit health state profile (which represents self-reported abilities/problems on 5 dimensions of health) into an index score using a value set that reflects the preferences of the general population. Further, as noted by Feng et al. in their systematic review (2021), additional study is needed to determine responsiveness and sensitivity to change of the EQ-5D-5L, and define what a relevant change is for this tool.

17. Discussion, Lines 471-472: These broad statements of CTM effectiveness again feel misleading.

Response: We did not intend to mislead readers with this statement. We acknowledge the wording of this sentence could be more specific; therefore we changed the text to make it more clear that we refer to adaptations to CTM in Phase 3 that may have led to the voltage drop we observed for some outcomes, as compared with changes we observed in Phases 1 and 2.

Action: Lines 524-526 now read: Adaptations to CTM Phase 3 may have reduced intervention-related benefits in physical activity (in younger participants only), mobility and loneliness when compared with CTM Phases 1 and 2.

18. Discussion, Line 485: Any theories as to why lower in phase 3?

Response: Check-in participation may have been lower in Phase 3 as compared with Phases 1 and 2 because of the lower overall dose delivered in Phase 3. This may have resulted in less commitment from participants. Alternatively, it is possible that coaches may have been unable to reach some participants by phone. However, we did not ask coaches to document how many times they tried to reach participants during the intervention.

Action: Lines 537-540 now read: Coaches were primary motivators for participants to ‘stick with’ their activity plans; reduced contact in Phase 3 may have contributed to lower check-in participation and ultimately to voltage drop in intervention effectiveness.

Reviewer #2: The study aims to assess the implementation, impact on physical activity, mobility, social isolation, loneliness, and health-related quality of life (impact outcomes), whether intervention effects were maintained and to compare voltage drop with previous CTM phases.

1. Abstract, Line 36, the word mean sd to be added.

Action: Line 36 now reads: We conducted a type 2 hybrid effectiveness-implementation pre-post study of CTM; older adult participants (n=1012; mean age 72.9, SD = 6.3 years; 81% female) were recruited by community delivery partners.

2. Methods, Line 133, the total duration of the program is to be stated.

Action: Line 133 now reads: During the first 3 months of the 6-month program, activity coaches provided participants…

3. Line 206, at least one decimal point for the percentage figures. This applies throughout the manuscript including tables where applicable.

Action: We added one decimal point to all percentage figures in the text and tables.

4. The following information is to be added.

i) Line 218, the key name of the single-item physical activity.

Response: As per the work of Milton et al., the name of the questionnaire is the single-item measure.

Action: None

ii) Line 225, the name of the questionnaire.

Response: The 3-item social isolation questionnaire does not have a formal name. We adapted the original two questions from Vernoff et al., (ref 48) (How often do you visit with neighbours? How often do you get together with friends) to characterize social isolation as the weekly frequency of: 1) visiting with friends, neighbours and/or relatives; 2) phone/email exchanges with friends, neighbours and/or relatives; and 3) attending programs/groups/clubs/organizations.

Action: Lines 233-34: We added the name of the loneliness questionnaire (UCLA Loneliness Scale, UCLA-3), but did not add a name for the social isolation questionnaire.

iii) Line 247, one or two-tailed to be stated.

Action: Lines 252-6 now read: With alpha=0.05 (one-tailed) and an estimated sample of 963 participants (1620*70% recruitment*15% attrition), we would have >95% power to detect a meaningful change in physical activity of 1 day/week between baseline and 6 months and >90% power to detect a change of 0.5 day/week.

iv) Line 253, to be written as Fisher’s exact test and one or two-tailed test to be stated.

Action: Lines 262-5 now read: We used two-tailed chi-squared or Fisher’s exact test for categorical variables (sex, age category, ethnicity, education, chronic conditions, mobility limitations, and subset participation) and analysis of variance for continuous variables (body mass index and impact variables).

5. Line 222. ‘as no/any difficulty walking 400m’ to be rephrased.

Action: Lines 227-9 now read: Participants also self-reported their capacity for mobility at each time point; we dichotomized responses as either NO difficulty or ANY difficulty walking 400m and/or climbing one flight of stairs [47].

6. Line 236, the word dimension or levels to be added to 3125.

Response: The EQ-5D-5L asks respondents to indicate their health state for each of 5 dimensions. Responses are coded as single-digit numbers (range 1-5) and then combined into a 5-digit code (e.g., 11245) to describe the overall health state. Therefore, there are 55 (=3125) possible health states. Based on this description, we don’t feel it is necessary to add the word dimension or levels to 3125 in this sentence.

Action: None

7. Line 282, the sentence requires revision.

Action: Lines 295-7 now read: We then calculated the voltage drop (i.e., percent of the effect size reported in CTM Phases 1-2 that was retained in Phase 3) as: (Phase 3 effect size / Phases 1-2 effect size)*100 [20].

8. Results, Table 2, statistical tests to be denoted in the table footnote. However, based on CONSORT statement, all statistical tests for baseline comparison are to be avoided.

Action: We added information on statistical tests to the table footnote. We feel it is appropriate to conduct baseline comparisons because this was not a randomized trial.

9. Table 3 requires cosmetic changes. The p values were not placed on the same row with the outcome, time point and age group. n for Mobility apart from % to be added and Bonferroni correction is to be denoted.

Response: Thank you for noting the missing details and formatting issue. While we appreciate the Reviewer’s feedback on the table format, we believe the original format is easiest to follow with respect to the time comparisons. For example, the first p-value corresponds to the 0-3 month comparison. If we placed this p-value on the first row, the reader may assume (without looking at the column heading) that the p-value is for baseline comparisons between age groups. We are happy to reconsider the Reviewer’s suggestion or another formatting suggestion from the Editorial Team if needed.

Action: Table 3- We added the n for Mobility and updated the percent values to include one decimal place. We also added information on the Bonferroni correction to the table footnote.

10. Tables 3 & 4, the adjusted variables and statistical tests to be denoted in the table footnote.

Action: We added details on the statistical tests to the table footnote.

11. Table 4, 95%CI is to be stated in the title. ND is to be denoted in the table footnote.

Action: We added 95% confidence interval to the title and defined ND in the table footnote.

12. Supplemental Table 1, statistical test to be denoted in the table footnote.

Action: We added information on the statistical tests to the table footnote.

13. Supplemental Table 1, the table title ‘those in Cycle 8 (excluded from the analysis’) looks confusing. The comparison groups are to be clearly stated. For *significantly different from the Lost to Follow-up (p=0.033) and Cycle 8 (p=0.037) groups, the statistical test is to be stated.

Response: We agree that the wording of the table caption be modified to clarify that participants in Cycle 8 were excluded from our primary analysis.

Action: Supplemental Table 1 heading now reads: Baseline socio-demographic characteristics of participants who completed the CTM intervention, those lost to follow-up and those in Cycle 8 (excluded from the primary analysis). Values are n (%) or mean (standard deviation, SD).

14. Model fit to be discussed.

Response: We assessed model fit graphically using residual plots. All plots indicated acceptable model fit. We now mention this in the methods.

Action: Lines 281-2 now reads: We assessed model fit graphically using residual plots; plots indicated acceptable model fit.

15. Figure 2 (participant flow diagram), the outcome measures, activity coaches and participants engagement survey could be incorporated into the figure. Provincial and Comprehensive are to be clearly denoted in the Figure 2 footnote.

Response: Thank you for this suggestion. We added details on outcome measures, activity coaches and participant engagement survey to the figure, and denoted the different cohorts in the Figure 2 caption.

Attachment

Submitted filename: CTM Phase 3_PLOS ONE_Response to Reviewers_2023.01.09_FINAL.docx

Decision Letter 1

Hugh Cowley

20 Apr 2023

What is the ‘voltage drop’ when an effective health promoting intervention for older adults—Choose to Move (Phase 3)—is implemented at broad scale?

PONE-D-22-11801R1

Dear Dr. Macdonald,

We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements.

Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication.

An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at http://www.editorialmanager.com/pone/, click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org.

If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

Kind regards,

Hugh Cowley

Staff Editor

PLOS ONE

Additional Editor Comments (optional):

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation.

Reviewer #1: All comments have been addressed

Reviewer #2: All comments have been addressed

**********

2. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

Reviewer #2: Yes

**********

3. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

Reviewer #2: Yes

**********

4. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

**********

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

**********

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: Thank you for you diligent and respectful response to my comments. I am really happy with the quality and presentation of the paper in its current format. I wish you all the best

Reviewer #2: (No Response)

**********

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: Yes: Fay Manning

Reviewer #2: No

**********

Acceptance letter

Hugh Cowley

27 Apr 2023

PONE-D-22-11801R1

What is the ‘voltage drop’ when an effective health promoting intervention for older adults—Choose to Move (Phase 3)—is implemented at broad scale?

Dear Dr. Macdonald:

I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department.

If your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org.

If we can help with anything else, please email us at plosone@plos.org.

Thank you for submitting your work to PLOS ONE and supporting open access.

Kind regards,

PLOS ONE Editorial Office Staff

on behalf of

Mr Hugh Cowley

Staff Editor

PLOS ONE

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Supplementary Materials

    S1 Table. Comparison of descriptive characteristics between participants who completed Choose to Move, those lost to follow-up and those in Cycle 8.

    Baseline socio-demographic characteristics of participants who completed the Choose to Move intervention, those lost to follow-up and those in Cycle 8 (Winter 2020 cohort, excluded from the primary analysis). Values are n (%) or mean (standard deviation, SD).

    (DOCX)

    S2 Table. Results of linear mixed model for impact outcome measures for Choose to Move participants in Cycle 8 (Winter 2020 cohort).

    Adjusted means (95% confidence interval) for impact outcome measures by time point and age group in Choose to Move Phase 3 –Cycle 8 (Winter 2020 cohort; excluded from primary analysis due to impact of COVID-19 on program delivery).

    (DOCX)

    Attachment

    Submitted filename: PONE-D-22-11801_reviewer.pdf

    Attachment

    Submitted filename: CTM Phase 3_PLOS ONE_Response to Reviewers_2023.01.09_FINAL.docx

    Data Availability Statement

    Data cannot be shared with anyone outside of the project team, as consent was not obtained from participants for this. The UBC Clinical Research Ethics Board can be approached with data requests, and they can provide options for sharing study data. The University of British Columbia's Clinical Research Ethics Board can be reached at: pia.ganz@ubc.ca (Pia Ganz, Manager).


    Articles from PLOS ONE are provided here courtesy of PLOS

    RESOURCES