Skip to main content

This is a preprint.

It has not yet been peer reviewed by a journal.

The National Library of Medicine is running a pilot to include preprints that result from research funded by NIH in PMC and PubMed.

medRxiv logoLink to medRxiv
[Preprint]. 2026 Mar 31:2026.03.29.26349681. [Version 1] doi: 10.64898/2026.03.29.26349681

Efficacy of Tailored Messages for 28-Week Exercise Sustainability in People with HIV

Paul F Cook 1, Allison R Webel 2, Melissa P Wilson 3, Christine Horvat Davey 4, Vitor H F Oliveira 2, Vincent Khuu 3, Samantha Matzio 1, Grace L Kulik 3, Samantha MaWhinney 5, Catherine M Jankowski 1, Kristine M Erlandson 3
PMCID: PMC13060439  PMID: 41959790

Abstract

Background:

People with HIV (PWH) have increased risk for cardiovascular diseases and other age-related comorbidities. These risks can be reduced through moderate to vigorous physical activity (MVPA), but MVPA can be difficult to sustain over time.

Purpose:

We tested tailored text messages added to motivational interviewing (MI) to sustain MVPA among PWH. Messages were created based on Two Minds Theory and matched to daily survey responses about exercise barriers.

Methods:

118 PWH ages ≥ 50 were initially randomized to high-intensity interval training or continuous moderate-intensity exercise. After 16 weeks, 92 participants were re-randomized to receive either tailored messages plus MI, or educational control messages, for 12 weeks. Both groups completed daily barrier surveys and wore an ActiGraph monitor for 1 week/month.

Results:

PWH still receiving messages at 28 weeks maintained their MVPA, ending at M = 48.8 minutes per day (SD = 45.8, n = 22/29), compared to a decrease among PWH in the educational-control group, ending at M = 40.7 (SD = 24.6, n = 25/32), p = .01 for the group-by-time interaction. Findings were similar using both actigraphy and self-reported MVPA, and were robust to attrition based on intent-to-treat analysis. PWH in the tailored-messaging group also reported higher exercise self-efficacy and better perceived health over time, relative to those in the educational-control group.

Conclusions:

An automated tailored-messaging intervention led to sustained MVPA. Tailored messages were superior to non-tailored educational messages, and may help PWH maintain their long-term health. Exploratory analyses suggested these effects were additive to motivational interviewing.

Keywords: HIV, mHealth, motivational interviewing, physical activity, tailored messages


People with HIV (PWH) experience accelerated and accentuated aging, meaning they develop chronic conditions at an earlier age and with greater severity than their peers without HIV [1]. Physical activity can mitigate these risks, especially moderate to vigorous physical activity (MVPA) that is done on a regular basis [2]. Aerobic exercise also has positive effects on mental health for people with HIV [3]. Despite these benefits of physical activity, many people find it hard to maintain increases in activity over the long term [4], which can weaken the effects of interventions to promote MVPA. Sustaining MVPA may be particularly challenging for PWH, many of whom have lower baseline activity than the general population [5].

Behavioral Theories for Sustained MVPA

The factors that lead people to initiate a new exercise program can differ from those that promote sustained MVPA over time. Prochaska and colleagues [6] suggested that the most successful initial behavior-change interventions utilize the “strong principle of change,” namely persuasion to increase the perceived importance of the activity. Some examples of strong-principle interventions might include cognitive-behavioral approaches or motivational interviewing (MI). To ensure successful maintenance, however, interventions should focus on the “weak principle of change,” which involves reducing barriers and making the new behavior an unconscious habit [6]. In line with that distinction, Kendrick et al. [4] found that social networks are particularly important in maintaining MVPA. Similarly, a qualitative study by Maula et al. [7] identified the importance of physical, psychological, social, and environmental factors as barriers or facilitators to sustained MVPA among older adults.

The best available interventions to improve sustained MVPA among older adults focus on enhancing self-efficacy, self-control, and capability for physical activity [8]. These findings have been interpreted in terms of Bandura’s Social-Cognitive Model, in line with the Behavior Change Consortium’s seminal work on health-behavior maintenance [9]. However, that model’s focus on cognition and attitudes is somewhat inconsistent with Prochaska et al.’s [6] finding that sustaining behavior depends on making it an unconscious habit. A recent expert group [10] instead used Bronfenbrenner’s Socio-Ecological Model, and identified environmental and social factors as more important for sustained MVPA.

A newer theoretical model that emphasizes non-conscious factors – collectively called the “Intuitive Mind” – is Two Minds Theory (TMT: [12]). This model suggests a range of non-conscious influences on behavior including social support, emotions, and sense of identity, in addition to conscious factors – called the “Narrative Mind” – that include attitudes, beliefs, and ideas. TMT posits that the Intuitive Mind controls behavior at any given time, but that the Narrative Mind has a feed-forward capability to affect future Intuitive-level decision-making [13]. For that reason, language-based interventions focused on the conscious Narrative Mind will be most successful in promoting sustained MVPA when their content addresses Intuitive-level factors such as emotions or social perceptions.

Purpose of the Current Study

We delivered an intervention to sustain MVPA among PWH based on TMT. After the primary intervention phase of a randomized trial comparing high-intensity interval training (HIIT) versus continuous moderate exercise (CME), 92 PWH were re-randomized to receive either tailored text messages or non-tailored educational messages. Tailored text messages were selected to match the participant’s primary barrier to exercise based on a daily electronic survey with 10 possibilities; within each of the 10 barrier categories, there were 25 possible messages, each linked to one of six intervention strategies suggested by TMT [12]. TMT-based intervention strategies target factors identified as important in the literature review above, including, e.g., social imagery (a Narrative-mind strategy), problem-solving (also Narrative-level), or use of cues and reminders (an Intuitive-mind strategy). All participants in the tailored-messaging group, and some of those in the educational-control group, also received MI from an exercise coach. The goal of this study was to determine whether tailored messages would help to sustain MVPA among PWH who had already successfully increased their MVPA through a structured exercise program. Our hypothesis was that participants receiving a coaching intervention for self-directed exercise that combines MI and personalized support during the maintenance phase can promote long-term adherence to physical activity. TMT has been used as a theoretical framework to understand patterns of physical activity among PWH [14, 15], but this is the first study to test an intervention designed specifically using TMT.

Method

Participants

Participants were PWH enrolled in the High-Intensity Exercise Study to Attenuate Limitations and Train Habits in Older Adults with HIV (HEALTH: [16]), who completed 16 weeks of supervised exercise. All participants were ≥ 50 years of age, reported fatigue symptoms, and had a sedentary lifestyle (MVPA < 3 times per week and no regular resistance exercise) for ≥ 3 months before enrollment. All participants had received HIV antiretroviral treatment (ART) ≥ 1 year, had well-controlled HIV (viral load < 200 copies/mL), owned a cell phone with text-messaging and/or email capabilities, and could speak, read, and write English. Medical exclusion criteria as described in Oliveira et al. [16] were also applied; most relevant to this analysis, participants had no substance use, unstable illness, recent surgery/trauma/injury, or other conditions that in the referring clinician’s judgment would have interfered with participation.

A total of 142 participants were recruited between April 1, 2021 and January 31, 2024 from sites in Aurora, CO and Seattle, WA. Participants came primarily from Ryan White HIV specialty clinics at the University of XXXX and University of YYYY. This study was approved by the XXXX Institutional Review Board (#19–1985) and registered at ClinicalTrials.gov (#NCT04550676), and all participants provided written informed consent. Study flow is shown in Figure 1. A total of 92 phase 1 participants were re-randomized (86 who were included in the phase 1 analysis, plus 6 others who were randomized but exercised independently). Participants’ demographics, overall and by phase 2 group assignment, are presented in Table 1. There were slight between-group differences on gender, education, and employment, but none reached conventional levels for statistical significance, suggesting that randomization was effective.

Fig. 1.

Fig. 1.

CONSORT Study Flow Diagram

Table 1.

Participant Demographics

Characteristic N (%) or M (SD) Difference between Groups? (t or χ2)
Tailored Messages Educational Control Full Sample
Age in Years 58.5 (0.96) 59.0 (5.64) 58.7 (6.04) t(90) = −0.36, p = .72
Sex at Birth:
 Male 40 (87.0%) 39 (84.8%) 79 (85.9%) χ2 = 0.90, p = .77
 Female 6 (13.0%) 7 (15.2%) 13 (14.1%)
Gender Identity:
 Male 40 (87.0%) 35 (76.1%) 75 (81.5%) χ2= 5.67, p = .34
 Female 5 (10.9%) 7 (15.2%) 12 (13.0%)
 Genderqueer 0 ( 0.0%) 2 ( 4.3%) 2 ( 2.2%)
 Nonbinary 1 ( 2.2%) 1 ( 2.2%) 2 ( 2.2%)
 Transgender Male 0 ( 0.0%) 1 ( 2.2%) 1 ( 1.1%)
Race/Ethnicity:
 Black, non-Hispanic 7 (15.2%) 7 (15.2%) 14 (15.2%) χ2 = 1.50, p = .68
 White, non-Hispanic 31 (67.4%) 28 (60.9%) 59 (64.1%)
 Hispanic, any race 5 (10.9%) 9 (19.6%) 14 (15.2%)
 Other or not reported 3 ( 6.5%) 2 ( 4.3%) 5 (11.9%)
Lowest Reported CD4:
 < 200 cells/mm3 25 (54.3%) 23 (50.0%) 48 (52.2%) χ2 = 4.64, p = .33
 200–350 cells/mm3 8 (17.4%) 6 (13.0%) 14 (30.4%)
 351–500 cells/mm3 4 ( 8.7%) 2 ( 4.3%) 6 ( 6.5%)
 > 500 cells/mm3 2 ( 4.3%) 8 (17.4%) 10 (10.9%)
 Not sure 7 (15.2%) 7 (15.2%) 14 (15.2%)
VACS Score 33.2 (9.66) 33.5 (9.48) 33.3 (9.52) t(89) = 0.14, p = .89
BMI Score 30.0 (6.72) 30.2 (5.70) 30.1 (6.20) t(90) = 0.19, p = .85
Level of Education: χ2 = 6.49, p = .17
 11th grade or less 1 ( 2.2%) 2 ( 4.3%) 3 ( 3.3%)
 High school or GED 3 ( 6.5%) 10 (21.7%) 13 (14.1%)
 Some college/technical 16 (34.8%) 16 (34.8%) 33 (35.9%)
 College (bachelor’s) 14 (30.4%) 11 (23.9%) 25 (27.2%)
 Master’s or higher 12 (26.1%) 6 (13.0%) 18 (19.6%)
Employment Category: χ2 = 8.54, p = .07
 Working (part/full time) 25 (54.3%) 16 (34.8%) 41 (44.6%)
 Disabled 5 (10.9%) 13 (28.3%) 18 (19.6%)
 Retired 13 (28.3%) 9 (19.6%) 22 (23.9%)
 Other 2 ( 4.3%) 3 ( 6.5%) 7 ( 7.6%)
 Declined to answer 1 ( 2.2%) 5 (10.9%) 4 ( 4.3%)
Adherence to exercise regimen during phase 1 97.1% (6.59) 95.9% (3.09) 96.5% (5.15) t(90) = −1.10, p = .28

Note. BMI = body mass index; CD4 = cluster of differentiation 4 in white blood cells; GED = general education development degree; VACS = Veterans’ Aging Cohort Study (comorbidities).

Procedure

After completing the 16-week in-person, supervised exercise intervention in phase 1 (HIIT or CME), participants were re-randomized with 1:1 allocation to receive either a tailored-messaging intervention or educational-control messages [16]. The randomization sequence was blocked by sex (2 levels), age (3 levels), study site (2 levels), and phase 1 study group (HIIT vs. CME: 2 levels). Messages were digitally delivered to the participant’s device (cellphone or computer) via text, email, or both (participant’s choice). Both conditions first administered a daily survey about barriers to exercise, then delivered daily messages to encourage continued physical activity; however, the tailored-messaging condition had greater use of psychological theory, more message variety, and active tailoring of message content to the participant’s daily survey responses. In phase 2, participants were encouraged to continue exercising using any method they chose, regardless of phase 1 group assignment. Participants continued to complete in-person physical function and fatigue assessments every 4 weeks, as they had during phase 1 of the HEALTH study. The study ended as planned in June 2025.

Interventions

Daily surveys.

A daily survey was administered to each participant (regardless of phase 2 randomized group assignment) via a link in an SMS text message, email, or both. Surveys asked about 10 possible barriers to exercise commonly reported by PWH. The full text of barrier items from the daily survey is available in Online Resource 1. All participants then immediately received text messages, which differed between experimental groups as described below. Messages in both groups were signed by a HEALTH study team member with a photograph, to increase social motivation for physical activity.

Tailored messages.

Participants in the tailored-messaging group received MI plus daily text messages that were automatically selected and delivered by an algorithm programmed in the Caspio application development tool (Caspio, Inc.: Sunnyvale, CA). A set of 400 tailored exercise promotion messages was created, and the algorithm selected one of these messages to deliver based on the single most important barrier to exercise that day, according to the individual participant’s daily survey responses. All messages employed evidence-based psychological behavior change strategies selected based on TMT [12], which is an integrative health behavior model that suggests multiple pathways for motivating behavior via both the Intuitive (nonconscious, automatic) and Narrative (conscious, rational) processing systems of the brain. Sample messages are shown in Online Resource 2. Multiple messages were available for each barrier, with a random component in the algorithm to prevent participants from receiving the same message multiple days in a row. Messages varied in terms of the barrier addressed and the TMT behavior-change strategy used. We also classified messages in terms of whether they included an external URL, provided individualized feedback about the participant’s survey responses, allowed a free-text response, or displayed the participant’s daily MVPA minutes. These features were designed to keep participants engaged by fostering a sense of novelty, which was identified as important in past tailored-messaging research [17]. Surveys and messages were refined based on early feedback from PWH [16].

Educational control messages.

Participants in the educational-control group received daily messages that were designed to be factual and informative, and some also had features such as links to other Internet resources on exercise. However, these messages did not use psychological behavior-change principles and were not tailored based on the participant’s survey responses. This condition was designed to control for the “pseudo-tailoring” effect of completing a daily survey and then receiving a message [18], even though there was no actual tailoring in this group. A sample educational message read, “Keep exercising. Physical activity helps you the most when it’s a long-term habit.” As with the tailored-messaging intervention, there was a random component to keep participants from receiving exactly the same message multiple days in a row. Nevertheless, there were only 25 total educational-message options due to the lack of personalization, so more repetition was likely over the course of the study.

Coaching using Motivational Interviewing (MI).

Health coaches were trained on MI by the first author, an experienced MI trainer [19]. MI is a well-supported method for promoting health behavior change, including sustaining MVPA [20], using a combination of technical skills (open-ended questions, reflective listening, etc.) and relational empathy [21]. Health coaches used MI during three 5–10 minute conversations with participants, at weeks 16, 20, and 24. MI treatment fidelity was assessed through role-play activities during training, and all health coaches achieved a minimum standard of 80% MI consistency before using this technique with participants. We did not record calls or code MI skills during the intervention itself.

At the XXXX site, a health coach delivered MI only to participants in the tailored-messaging group, while participants in the educational-control condition received a check-in call without any use of MI skills. University of YYYY health coaches delivered MI to all participants, including those in the educational-control condition as well as those in the tailored-messaging condition (this was a protocol deviation). Therefore, about 50% of participants received tailored messages plus MI, 25% received educational-control messages plus MI, and 25% received educational-control messages without MI. Because some participants received MI with tailored messages and others received MI with educational-control messages, we were able to estimate the effects of MI separately from the tailored-messaging component in an exploratory analysis.

Measures

Participant Demographic and Clinical Characteristics.

PWH provided demographic information before initial randomization. Demographic variables included sex, gender, race, ethnicity, age, education, and employment. Clinical variables were also collected at baseline, including HIV viral load, body mass index, and lowest reported CD4 count (by self-report). A comorbidity metric, the Veterans Aging Cohort Study [VACS] Index, was calculated from baseline laboratory and clinical variables. Throughout the study, adverse events (AEs) and changes in participants’ clinical status were recorded by study staff using a structured reporting form.

Primary Outcome: Actigraphy-Measured Minutes of Moderate-to-Vigorous Physical Activity (MVPA).

Participants wore an ActiGraph GT3X monitor (ActiGraph LLC, Fort Walton Beach FL) on their non-dominant hip for four 7-day periods, at study weeks 16, 20, 24, and 28 – i.e., one week per month during phase 2. Participants were asked to wear the ActiGraph during all waking hours; data were considered valid if they included ≥ 4 days with 10 hours of wear time, including one weekend day. Actigraphy data were sampled at a frequency of 30 Hz, with 60-second epochs, and processed using the company’s standard activity algorithm [22] which defines “moderate” activity in terms of minutes when the participant’s activity level was in the range of 3–6 metabolic equivalents (METs) and “vigorous” activity as > 6 METs. ActiGraph data are considered valid and reliable for detecting sedentary time, and for differentiating levels of physical activity (light, moderate, vigorous). Participants could not view their own daily results. We summed minutes of moderate and vigorous activity per day to get a daily MVPA total. We then averaged across all available days to calculate weekly MVPA for each participant.

Secondary Outcome: Self-Report Minutes of MVPA.

We also asked participants to estimate minutes of light, moderate, and vigorous physical activity as part of each daily survey, before the barrier items. Minutes of moderate and vigorous activity were summed to generate an MVPA measure parallel to that obtained from actigraphy. Because self-report data were obtained daily, we averaged across the first 2 weeks for a baseline measurement comparable to the 16-week actigraphy data, then each 4 weeks thereafter to obtain similar timeframes to the 20-, 24-, and 28-week actigraphy data points. Self-report and sensor measures of the same construct often provide complementary information, as they have different sources of error variance [23]. One important source of error in self-reported MVPA was missing data, because we only had MVPA data on days when a survey was completed, and we do not know whether there was a systematic relationship between survey completion and having exercised.

Exploratory Measures: Symptoms and Barriers to Exercise.

Participants’ daily surveys included yes/no questions about specific barriers; participants who said “yes” were then asked for more detail about that barrier, using established self-report tools. Fatigue was measured using the 4-item Patient-Reported Outcomes Measurement Information System (PROMIS: [24]) fatigue screener, which has been used for daily surveys with PWH, has internal consistency reliability of α = .93 (all alphas in this section were calculated from the current dataset), and correlates with behavioral sleep data as well as biomarkers of inflammation associated with fatigue [25]. Mood was measured using 7 items from the Diary of Ambulatory Behavioral States (DABS: [26]), which has high internal consistency of α = .84 and predictive validity based on prior daily survey research with PWH [25, 27]. Specific task self-efficacy for exercise was measured using a 6-item scale that was also adapted from the DABS [26], with internal consistency reliability of α = .82 and construct validity based on expert consensus and participant review [16]. Pain was measured using the 6-item PROMIS pain screener, which has internal consistency of α = .92 and concurrent validity with functional impairment measures [28]. Motivation was measured using 2 items from the Herzog motivation scale [29], with items selected based on factor loadings in [30]; this scale has internal consistency of α = .84 and predictive validity for behavioral outcomes in PWH [25, 27]. Perceived health was measured using 3 items from the SF-36 [31] with internal consistency of α = .67, including a global health estimate that prospectively predicts mortality in older adults [32]. The daily survey also included six yes/no barrier items adapted from prior treatment adherence research with PWH [27].

Analysis Plan

All analyses were performed using SPSS 31.0 (Armonk, NY: IBM Corp.). After basic descriptive analysis, we screened for participant characteristics that were used as covariates in phase 1 (age, sex, and study site) as potential predictors of MVPA minutes in phase 2. We also tested the potential interaction between phase 2 behavioral intervention and phase 1 exercise condition, in case a specific behavioral approach was more efficacious when paired with either HIIT or CME. For each outcome, we constructed a linear mixed model with time nested within persons, study group as a person-level variable, and the group-by-time interaction effect as the outcome of interest; this is because differences in the pattern of MVPA over time reflect different sustainability of physical activity across groups. All tests were based on fixed effects of predictors, a compound symmetry matrix, person-mean-centering at level 1, and a target α = .05 for significance. Outcome variables had moderate intra-class correlations of .69 (self-report) to .71 (actigraphy) within persons. To address missing data, we used conservative intent-to-treat (ITT) principles for the main outcome analyses, then also tested complete cases to understand potential benefits for participants who received the full intervention. In all exploratory analyses, the most conservative ITT-based ActiGraph data were used as the measure of MVPA.

The HEALTH study was powered for the phase 1 test of HIIT versus CME on time to complete a 400-m walk test, which required a sample size of 50 in each condition. We re-randomized participants in phase 2, resulting in half of participants assigned to the tailored-messaging condition and half assigned to the educational-control condition, so there was similar power available for phase 2 as in phase 1, where the target N = 100 yielded 88% power to detect effects as small as d = 0.63 at α = .05. As described above, only about a quarter of participants did not receive MI, which led to a lower-powered test of MI’s effects (d ≥ 0.65 at power = .80); this was not considered a significant issue because MI’s relatively strong effects are already well-documented in many healthcare contexts – see, e.g., [20]. Our goal for phase 2 was to determine the additional benefit, if any, of tailored messaging for sustained MVPA.

Results

Covariate Screening

None of the potential covariates used in phase 1 differed between groups at the phase 2 baseline, as shown in Table 1. Nevertheless, we screened for potential effects of these variables on actigraphy-based MVPA in both the ITT and completer datasets. Participant age predicted phase 2 MVPA in the ITT dataset only, F(1, 361) = 5.25, p = .02; study site predicted MVPA in the completers dataset only, F(1, 168) = 4.42, p = .04; and sex predicted MVPA in both the ITT, F(1, 361) = 5.52, p = .02, and completers datasets, F(1, 144) = 7.31, p = .008. We therefore controlled for age, sex, and study site in all models, as well as main effects when testing interactions; however, a sensitivity analysis showed that models without these covariates led to the same conclusions. Phase 1 group assignment did not predict phase 2 MVPA minutes in either dataset, p > .37, and was omitted from subsequent models. We also conducted a sensitivity analysis in which we omitted the 6 participants who had exercised independently after phase 1 randomization, in case they differed in systematic ways from those who exercised per the phase 1 protocol; however, all conclusions were unchanged.

Primary Outcome: Effect on Actigraphy-Measured MVPA

Participants in the tailored-messaging group were more likely to sustain MVPA throughout phase 2, based on a significant group-by-time interaction in the ITT dataset, F(1, 274) = 4.09, p = .04, d = 0.24. Although educational-control participants had slightly higher daily MVPA at the start of phase 2 (M = 36.2 minutes, SD = 31.4) than those in the tailored-messaging group (M = 27.4, SD = 26.8), this pattern reversed by 28 weeks as shown in Figure 2 (Panel a), with higher daily MVPA in the tailored-messaging group (M = 23.3, SD = 39.8) than in the educational-control group (M = 22.1, SD = 27.2). The completers analysis of actigraphy data similarly showed a significant group-by-time interaction, F(1, 133) = 6.48, p = .01, d = 0.44, again indicating more MVPA minutes over time in the tailored-messaging group (Figure 2, Panel b), ending at M = 48.8 minutes per day (SD = 45.8) compared to M = 40.7 in the educational-control group (SD = 24.6). An exploratory test for interaction between phase 1 and phase 2 intervention assignment was nonsignificant, p = .91, suggesting that tailored messaging was equally effective in promoting sustained MVPA for participants who were initially assigned to either HIIT or CME.

Fig. 2.

Fig. 2.

Between-group differences in MVPA minutes per day, based on actigraphy. Panel A shows the intent-to-treat (ITT) analysis, and panel B shows the less-restrictive completers analysis with missing data points omitted. The number of participants with valid actigraphy data, per group at each study week is noted on the second graph. The lower number of daily MVPA minutes in the tailored-messaging group (solid line) than in the educational-control group (dotted line) at weeks 16–20 is unexplained, but it appears in both graphs, suggesting that it is not simply a function of missing data. Error bars show ±1.96 standard errors of the mean.

Secondary Outcome: Effect on Self-Reported MVPA

The analysis of self-reported MVPA minutes confirmed the ActiGraph results, although the overall correlation between the two measures was just r = .56. Using an ITT-based dataset in which days with no survey were treated as though there had been no exercise, participants in the tailored-messaging group reported fewer MVPA minutes per day at the start of phase 2 (M = 15.9, SD = 24.4) than participants in the educational-control group (M = 22.7, SD = 30.9). This pattern then reversed after 3 months, with better daily MVPA in the tailored-messaging group (M = 23.3, SD = 42.8) than the educational-control group (M = 9.3, SD = 13.2). Figure 3 (Panel a) shows the change in ITT-based daily MVPA minutes by month, with a significant group-by-time interaction, F(1, 259) = 9.65, p = .002, d = 0.39. As in the ActiGraph data, there was no interaction between the phase 2 intervention effect and phase 1 group assignment to HIIT or CME, p = .35. Results again might have been biased by attrition, with numbers in Figure 3 (Panel b) showing retention per month in each group. However, the group-by-time interaction remained significant in a completers analysis of self-reported MVPA minutes, F(1, 182) = 6.76, p = .01, d = 0.39. Under the plausible assumption that those who continued receiving messages were more adherent to physical activity as well as daily survey completion (in this study, a participant’s average MVPA and the number of surveys they completed were correlated at r = +.47), an attrition pattern with more dropout would tend to favor higher MVPA in the control group and therefore a weaker intervention effect in this completers analysis. Therefore, our conclusions about self-reported MVPA are robust to challenges based on missing data.

Fig. 3.

Fig. 3.

Between-group differences in MVPA minutes per day, based on self-report. MVPA was calculated as the sum of moderate plus vigorous activity minutes reported on daily surveys, and averaged within participants for each month of the phase 2 behavioral intervention. Panel A shows the intent-to-treat (ITT) analysis, where any participant without data was treated as having zero minutes of MVPA. Panel B shows the completers analysis, with averages for those participants who continued to fill out daily surveys; numbers show how many were receiving messages each month after the start of phase 2. Solid lines show means for the tailored-messaging group, dotted lines the educational-control group, and error bars ±1.96 SEMean.

Adverse Events

In phase 2, a total of 10 AEs were reported by 8 participants, all of whom were seen at the XXXX study site. One participant (2 events) was in the tailored-messaging group, with all others in the educational-control group. There were two serious AEs, a COVID-19-related hospitalization and a sinus infection, which were both considered unlikely to be study-related. Two moderate study-related AEs (both in the same participant) involved knee/hip pain and resulted in an emergency room visit. All other moderate AEs were considered unlikely to be study-related, including depression, COVID-19, flu-like symptoms, flank and leg pain, knee and back pain, and pneumonia. All AEs were resolved with no additional intervention, but in some cases resulted in a missed study visit for physical function assessment.

Intervention Effects on Symptom and Barrier Measures

There were no significant intervention effects on the measures of fatigue, mood, pain, motivation for exercise, or any of the following barriers: forgetting, travel, weather, boredom, or “other,” all ps > .07. However, there was a significant group-by-time interaction for change in self-efficacy, in which the tailored-messaging group participants reported improved self-efficacy for exercise over time relative to the trend among participants in the educational-control group, F(1, 2730) = 4.54, p = .03, d = 0.08. Similarly, a significant group-by-time interaction for perceived health showed that participants’ scores on SF-36 items stayed at a high level in the tailored-messaging group, while those in the educational-control group decreased, F(1, 2765) = 10.4, p = .001, d = 0.13. Participants in the tailored-messaging group also became less likely to report lack of time as a barrier to exercise, relative to educational-control participants, F(2, 2694) = 8.92, p < .001, d = 0.12 for the group-by-time interaction.

Exploratory Tests of MI versus Messaging

We conducted an exploratory analysis to determine the contribution of MI to the overall intervention effect documented above. First, we compared sites within the educational-control group, to examine whether MVPA was greater among University of YYYY participants (all of whom received MI in addition to daily educational-control messages) than those at the University of XXXX (who did not receive MI in the educational-control group). We excluded tailored-messaging participants from this analysis because all of them had also received MI, so the effects of those two interventions could not be disaggregated. In this test we observed a slight advantage for the educational-control intervention at the University of YYYY, M = 25.3 MVPA per day (SD = 36.7, N = 23) versus the University of XXXX, M = 20.8 (SD = 30.8, N = 23), suggesting that MI was a beneficial addition to the educational-control messages, even though this test did not reach conventional levels for statistical significance, F(1, 62) = 3.82, p = .055, d = 0.49. We then looked at University of YYYY participants alone, all of whom received MI, with N = 24 in the tailored-messaging group and N = 23 in the educational-control group. We found an even stronger effect of the tailored-messaging intervention (with MI) compared to the educational-control intervention (with MI), F(1, 68) = 11.7, p = .001, d = 0.83 for the group-by-time interaction effect. The second of these exploratory tests suggests that tailored messaging had a positive effect independent of MI. But because of the site-by-condition confounding, this exploratory analysis could not conclusively determine whether MI or tailored messages (or both) was the active ingredient of the MI plus tailored-messaging group.

Other Exploratory Analyses

Given the variety of strategies to explain sustained MVPA that were reviewed in the Introduction, we also conducted exploratory analyses to determine whether specific types of intervention messages were more effective than others (Table 2). Participants reported significantly higher MVPA minutes on days when they were able to enter a free-text response to that day’s message, when the message emphasized either mindfulness or social connection, and when the participant reported any barrier other than lack of time for exercise. These effects were particularly evident in the tailored-messaging group, with minimal differences among educational-control participants. Other broad intervention characteristics such as whether the message contained an external URL (e.g., to a video or interactive resource), displayed the participant’s current active minutes, or provided other personalized feedback such as symptom scores from the daily survey, were not significantly associated with daily MVPA (all ps > .49). It is still possible that some of these features were more effective for specific participants or at specific times, a matching hypothesis that we plan to explore in future research.

Table 2.

Effect of Aggregate Message Characteristics on Daily MVPA Minutes

Characteristic Tailored-Message Group: M (SD) Educational-Control Group: M (SD) Effect on MVPA
Message Strategy Stimulus Control: 49.8 (84.8)
Cues/Reminders: 40.7 (79.1)
Problem-Solving: 48.5 (81.8)
Social Imagery: 63.5 (96.1)*
Mindfulness: 58.9 (92.9)*
Reframing: 29.5 (63.3)
Education: 13.1 (30.8) F(5, 1460) = 3.35, p = .005, d = 0.10 [for subgroups of tailored messages only; excludes education group]
Message Included Survey Feedback? Yes: 35.3 (64.3)
No: 49.4 (85.6)
N/A F(1, 2729) = 0.15, p = .70, d = 0.02
Message Displayed Active Minutes? Yes: 57.4 (86.0)
No: 48.9 (85.4)
N/A F(1, 2643) = 0.49, p = .49, d = 0.03
Message Included External URL? Yes: 22.6 (51.0)
No: 49.3 (85.3)
Yes: 14.7 (28.6)
No: 14.3 (31.4)
F(1, 2730) = 0.06, p = .81, d = 0.00
Message Included Free-Text Response Field? Yes: 56.8 (89.7)*
No: 25.8 (62.9)
Yes: 14.4 (33.7)
No: 13.0 (30.1)
F(1, 2688) = 4.97, p = .03, d = 0.09
Most Important Barrier Identified in Daily Survey Fatigue: 64.1 (93.6)
Perceived Health: 66.2 (94.5)
Mood: 65.8 (94.8)
Pain: 65.9 (94.3)
Self-Efficacy: 67.2 (95.1)
Forgetting: 67.0 (95.3)
No Time: 54.4 (88.8)†
Travel: 65.7 (94.5)
Boredom: 68.8 (95.9)
Weather: 66.4 (94.5)
Fatigue: 16.0 (32.8)
Health: 15.9 (32.7)
Mood: 16.2 (33.6)
Pain: 16.1 (33.5)
Self-Efficacy: 16.5 (33.7)
Forgetting: 16.6 (33.3)
No Time: 16.6 (33.3)
Travel: 16.1 (33.0)
Boredom: 17.0 (33.8)
Weather: 17.0 (33.6)
F(14, 932) = 2.93, p < .001, d = 0.11

MVPA = moderate to vigorous physical activity; URL = uniform resource locator.

Note. All tests of message characteristics were conducted as multilevel models (survey days nested within persons) using ITT-based self-reported MVPA minutes across all time points as the outcome variable, after controlling for site, age, and sex.

*

indicates significantly higher MVPA versus at least 1 of the comparison groups in that cell of the table (p < .05) in post-hoc Tukey comparisons of individual group means, and † indicates significantly lower MVPA than at least 1 of the other groups in that cell.

Discussion

This randomized trial showed that psychologically tailored messages based on TMT were efficacious for sustaining MVPA among older PWH, in comparison to non-tailored educational messages delivered by the same automated system, on the same schedule, and in response to the same daily survey. Results were similar whether daily MVPA minutes were measured by actigraphy or self-report; even though both measures were affected by attrition, convergent results suggest a positive effect. Furthermore, using ITT principles with the very conservative assumption that people without data were not exercising at all still showed a positive effect. This study did not include a no-intervention control, so we do not know if educational-control participants’ results mirror what would have happened in the absence of any intervention.

The efficacy of tailored messages was potentially separate from the effect of MI delivered by an exercise coach, which was also part of this multi-component intervention, based on evidence from the site that delivered MI to both groups. At that site, the MI-plus-tailored-messaging intervention was still superior to the MI-plus-educational-messaging condition. By comparing across study sites, we estimated the effect of MI alone to be d = 0.49, and MI-plus-tailored-messaging to be of d = 0.83, suggesting that about 41% of the combined effect was due to tailored messaging. MI is an intervention with known efficacy for physical activity promotion [20] and maintenance [11] but is time-consuming and requires trained providers. Theory-based tailored messaging might be a way to augment or replace this type of counseling with a more automated approach. Although both MI and tailored messaging had positive effects in this study, further research is needed to determine their relative contributions.

Besides MVPA, participants in the tailored-messaging group reported more self-efficacy for exercise over time, better perceived health, and less of a perception that they did not have time to exercise, relative to the trend among educational-control participants. The self-efficacy change is consistent with one of the psychological mechanisms linked to exercise maintenance in prior research [8]. The perceived health findings are likely related to PWH maintaining a higher level of fitness as they continued to exercise. These exploratory results suggest that an MVPA sustainability intervention can produce benefits beyond cardiovascular fitness.

Finally, with regard to behavioral theory, some message characteristics were associated with higher daily MVPA than others. For example, messages focused on the barrier of time were associated with a slightly lower level of MVPA than messages targeted to other barriers, and messages using social imagery and mindfulness strategies were associated with slightly higher levels of same-day MVPA than those designed using other TMT-based behavior change strategies. Messages that offered the opportunity for a free-text response were also associated with higher same-day MVPA minutes. However, these message characteristics did not produce any differential benefit in the educational-control group. Although our educational-control group included some features designed to create a perception that those messages were also custom-selected (to avoid a “pseudotailoring” effect), it is still possible that people’s appreciation for the tailoring itself contributed to the intervention effect [18]. A second possible explanation is that the tailored-messaging intervention had more variety to maintain participants’ attention; the educational-control group had fewer total messages available, so statistically each one was likely to come up more often, which might have led to enhanced message features being seen as more novel in the tailored-messaging group [17]. This interpretation is consistent with the lower rate of attrition in the tailored messaging group. Nevertheless, all tailored message types were effective, and any differences based on message characteristics were small (d = 0.09–0.11) compared to the overall effect of the tailored-messaging intervention (d = 0.25–0.42). Future research could examine contextual or person-level differences that might moderate the efficacy of specific message characteristics.

Limitations and Directions for Future Research

Positive intervention effects were seen both in a completers analysis and in an ITT analysis, suggesting that our findings cannot be explained by attrition alone. Similarly, the results were consistent across both self-report and more objective actigraphy measures of MVPA, which suggests that our findings are not the result of self-report bias or selective reporting. Despite these strengths of the study, attrition and self-report bias each remain potential weaknesses, which might have affected our results in unknown ways. Because both the actigraphy and self-report measures had substantial missing data, this study had no single “gold standard” measure of MVPA. Despite that weakness, the consistency of our findings across various measures still suggests a positive intervention effect.

Our exploratory subgroup analysis focused on MI suggests that tailored messages could have an independent effect. However, this test was perfectly confounded with intervention site (one of the sites delivered MI to educational-control-group participants and the other did not), and participants did differ in important ways by site, so it is possible that other site-level differences affected the results. Although we interpret our findings as an additive effect of MI plus tailored messages, it is also possible that the MI and tailored-messaging components interacted in some way. Future research with a group that receives only tailored messages is needed to determine whether tailored messaging can help to sustain MVPA on its own.

Finally, we again note that all participants completed a 16-week structured exercise intervention before starting this behavioral intervention trial, and that messages in this study were designed to promote sustained MVPA among people who were already exercising. Even the 6 participants who did not participate in supervised exercise during phase 1 exercised regularly on their own. This study therefore does not provide any evidence on the question of whether tailored messages would help people to initiate a new exercise program, or to establish a regular exercise habit during the first 3 months. In Prochaska et al.’s [6] framework, the first 3 months of a new behavior are considered the “action phase,” separate from the later “maintenance phase” when exercise has already become a habit. Different interventions may be required for these two distinct steps in the process of health behavior change.

Conclusion

In this randomized trial, following 16 weeks of supervised exercise, PWH had higher levels of sustained MVPA when they received an intervention consisting of tailored messages plus MI. This was true even though the comparison group also received an intervention that included daily self-assessment surveys, educational messages, and in some cases MI. Because sustaining MVPA over the long term is critically important for maintaining its health benefits in order to support healthy aging, this type of low-cost intervention should be considered for PWH who successfully initiate new exercise habits. Future research could investigate the applicability of this type of intervention to people who are starting a new exercise habit, to people with other chronic conditions, or to older adults more generally.

Supplementary Material

Supplement 1
media-1.docx (23.9KB, docx)
Supplement 2
media-2.docx (18.5KB, docx)

Funding:

The research described in this manuscript was supported by NIH grants R01AG066562 (to KME and AW) and K24AG082527 (to KME); the National Center for Advancing Translational Sciences (NCATS) Colorado CTSA Grant Number UM1 TR004399; the Prevention Center Shared Resource, RRID:SCR026631, of the Fred Hutch/University of Washington/Seattle Children’s Cancer Consortium (P30 CA015704); and the Colorado Nutrition and Obesity Research Core (P30 DK048520). Contents are the authors’ responsibility and do not necessarily represent official NIH views.

Competing Interests:

KME has received grant funding from Gilead Sciences and served as a consultant for ViiV, Merck, and Gilead. SMaW serves as a consultant to ViiV. All other authors have no relevant financial or non-financial interests to disclose.

Funding Statement

The research described in this manuscript was supported by NIH grants R01AG066562 (to KME and AW) and K24AG082527 (to KME); the National Center for Advancing Translational Sciences (NCATS) Colorado CTSA Grant Number UM1 TR004399; the Prevention Center Shared Resource, RRID:SCR026631, of the Fred Hutch/University of Washington/Seattle Children’s Cancer Consortium (P30 CA015704); and the Colorado Nutrition and Obesity Research Core (P30 DK048520). Contents are the authors’ responsibility and do not necessarily represent official NIH views.

Footnotes

Compliance with Ethical Standards: Ethics Approval: This study was approved by the Colorado Multiple Institutional Review Board, protocol #19–1985. Pre-Registration: ClinicalTrials.gov study #NCT04550676. Informed Consent: All participants provided written informed consent.

CRediT Statement: Administration: ARW, KME; Conceptualization: PFC, ARW, SM, CMJ, KME; Data curation: PFC; Formal analysis: PFC, MPW, SM; Funding: ARW, KME; Investigation: VHFO, VK, GLK; Methodology: PFC, ARW, MPW, SM, SMaW, CMJ, KME; Supervision: ARW, KME; Visualization: PFC; Validation, review and editing: all authors; Writing – original draft: PFC.

Data Availability:

De-identified participant data with a data dictionary will be available upon reasonable request to the corresponding author (PFC), upon institutional review board approval, with additional agreement, and dependent on approval of a data analysis protocol.

References

  • 1.Pathai S, et al. Is HIV a model of accelerated or accentuated aging? J Gerontol Med Sci. 2014;69:833–42. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 2.Erlandson KM, MaWhinney S, Wilson M, Gross L, McCandless SA, Campbell TB, Kohrt WM, Schwartz R, Brown TT, Jankowski CM. Physical function improvements with moderate or high-intensity exercise among older adults with or without HIV infection. AIDS. 2018;32:2317–26. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3.Heissel A, Zech P, Rapp MA, Schuch FB, Lawrence JB, Kangas M, Heinzel S. Effects of exercise on depression and anxiety in persons living with HIV: A meta-analysis. J Psychosom Res. 2019;126:109823. [DOI] [PubMed] [Google Scholar]
  • 4.Kendrick D, Orton E, Lafond N, Audsley S, Maula A, Morris R, et al. Keeping active: maintenance of physical activity after exercise programmes for older adults. Public Health. 2018;164:118–27. [DOI] [PubMed] [Google Scholar]
  • 5.Vancampfort D, Mugisha J, De Hert M, Probst M, Firth J, Gorczynski P, Stubbs B. Global physical activity levels among people living with HIV: a systematic review and meta-analysis. Disabil Rehabil. 2018;40:388–97. [DOI] [PubMed] [Google Scholar]
  • 6.Prochaska JO. Strong and weak principles for progressing from precontemplation to action on the basis of twelve problem behaviors. Health Psychol. 1994;13:47–51. [DOI] [PubMed] [Google Scholar]
  • 7.Maula A, LaFond N, Orton E, Iliffe S, Audsley S, Vedhara K, Kendrick D. Use it or lose it: a qualitative study of the maintenance of physical activity in older adults. BMC Geriatr. 2019;19:1–12. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8.Sansano-Nadal O, Giné-Garriga M, Brach JS, Wert DM, Jerez-Roig J, Guerra-Balic M, et al. Exercise-based interventions to enhance long-term sustainability of physical activity in older adults: a systematic review and meta-analysis of randomized clinical trials. Int J Environment Res Public Health. 2019;16:2527. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9.Ory MG, Lee Smith M, Mier N, Wernicke MM. The science of sustaining health behavior change: the health maintenance consortium. Am J Health Behav. 2010;34:647–59. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10.Hughes JM, Brown RT, Fanning J, Raj M, Bisson AN, Ghneim M, Kritchevsky SB. Achieving and sustaining behavior change for older adults: a Research Centers Collaborative Network workshop report. The Gerontologist. 2023;63:1268–78. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11.Naar-King S, Earnshaw P, Breckon J. Toward a universal maintenance intervention: Integrating cognitive-behavioral treatment with motivational interviewing for maintenance of behavior change. J Cog Psychother. 2013;27:126–37. [DOI] [PubMed] [Google Scholar]
  • 12.Cook PF, Schmiege SJ, Reeder B, et al. Temporal immediacy: A two-system theory of mind for understanding and changing health behaviors. Nurs Res. 2018;67:108–21. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13.Messer LH, Sousa K, Cook PF. Applying two minds theory to self-management of Type 1 diabetes. Res Nurs Health. 2019;42:500–8. [DOI] [PubMed] [Google Scholar]
  • 14.Cook PF, Jankowski C, Erlandson KM, Reeder B, Starr W, Flynn Makic MB. Low- and high-intensity physical activity among people living with HIV: A multilevel modeling analysis using sensor- and survey-based predictors. J Med Internet Res. 2022;10:e33938. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15.Adhiambo HF, Cook P, Erlandson KM, Jankowski C, Oliveira VH, Do H, et al. Qualitative Description of Exercise Perceptions and Experiences Among People With Human Immunodeficiency Virus in the High-Intensity Exercise to Attenuate Limitations and Train Habits Study. J Cardiovascular Nurs. 2025;40:E101–9. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16.Oliveira VHF, Erlandson K, Cook PF, Jankowski C, MaWhinney S, Dirajlal-Fargo S, Knaub L, Hsaio C-P, Horvat Davey C, Webel AR. The High-Intensity Exercise Study to Attenuate Limitations and Train Habits in Older Adults with HIV (HEALTH): A research protocol. J Assoc Nurs AIDS Care. 2022;33:178–88. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.Cook PF, Carrington JM, Schmiege SJ, Starr W, Reeder B. A counselor in your pocket: Feasibility of tailored mHealth messages to support HIV medication adherence. Patient Prefer Adher. 2015;9:1353–66. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18.Weinstein ND. Misleading tests of health behavior theories. Ann Behav Med. 2007;33:1–10. [DOI] [PubMed] [Google Scholar]
  • 19.Cook PF, Manzouri S, Aagaard L, et al. Results from 10 years of interprofessional training on motivational interviewing. Eval Health Prof. 2016;40:159–79. [DOI] [PubMed] [Google Scholar]
  • 20.Lundahl BW, Kunz C, Brownell C, Tollefson D, Burke BL. A meta-analysis of motivational interviewing: Twenty-five years of empirical studies. Res Soc Work Pract. 2010;20:137–60. [Google Scholar]
  • 21.Miller WR, Rose GS. Toward a theory of motivational interviewing. Am Psychol. 2009;64:527–37. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22.Migueles JH, Cadenas-Sanchez C, Ekelund U, Delisle Nyström C, Mora-Gonzalez J, Löf M, et al. Accelerometer data collection and processing criteria to assess physical activity and other outcomes: a systematic review and practical considerations. Sports Med. 2017;47:1821–45. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 23.Cook P, Schmiege S, McClean M, Aagaard L, Kahook M. Practical and analytic issues in the electronic assessment of adherence. West J Nurs Res. 2012;34:598–620. [DOI] [PubMed] [Google Scholar]
  • 24.Ameringer S, Elswick RK Jr, Menzies V, Robins JL, Starkweather A, Walter J, et al. Psychometric evaluation of the patient-reported outcomes measurement information system fatigue-short form across diverse populations. Nurs Res. 2016;65:279–89. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 25.Makic MB, Gilbert D, Jankowski C, Reeder B, Al-Salmi N, Starr W, Cook PF. Sensor and survey measures associated with daily fatigue in HIV: Findings from a mixed-method study. J Assoc Nurs AIDS Care. 2020;31:12–24. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 26.Kamarck TW. The Diary of Ambulatory Behavioral States. In Krantz D. S. and Baum A. (eds), Technology and Methods in Behavioral Medicine. Mahwah, NJ: Erlbaum. 1998;163–185. [Google Scholar]
  • 27.Cook PF, Schmiege SJ, Starr W, Carrington JM, Bradley-Springer L: Prospective state and trait predictors of daily medication adherence behavior in HIV. Nurs Res. 2017, 66:275–285. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28.Stephan A, Stadelmann VA, Leunig M, Impellizzeri FM. Measurement properties of PROMIS short forms for pain and function in total hip arthroplasty patients. J Patient-Reported Outcomes. 2021;5:41. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 29.Herzog TA, Blagg CO. Are most precontemplators contemplating smoking cessation? Assessing the validity of the stages of change. Health Psychol. 2007;26:222–231. [DOI] [PubMed] [Google Scholar]
  • 30.Cook PF, Schmiege SJ, Bradley-Springer L, Starr W, Carrington JM. Motivation as a mechanism for daily experiences’ effects on HIV medication adherence. J Assoc Nurs AIDS Care. 2018;29:383–93. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 31.Ware JE, Sherbourne CD. The MOS 36-item Short-Form Health Survey (SF-36): I. Conceptual framework and item selection. Med Care. 1992;30:473–83. [PubMed] [Google Scholar]
  • 32.DeSalvo KB, Bloser N, Reynolds K, He J, Muntner P. Mortality prediction with a single general self-rated health question: A meta-analysis. J Gen Intern Med. 2006;21:267–75. [DOI] [PMC free article] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

Supplement 1
media-1.docx (23.9KB, docx)
Supplement 2
media-2.docx (18.5KB, docx)

Data Availability Statement

De-identified participant data with a data dictionary will be available upon reasonable request to the corresponding author (PFC), upon institutional review board approval, with additional agreement, and dependent on approval of a data analysis protocol.


Articles from medRxiv are provided here courtesy of Cold Spring Harbor Laboratory Preprints

RESOURCES