Skip to main content
PMC home page
Journal of Medical Internet Research logoLink to Journal of Medical Internet Research
. 2012 Feb 29;14(1):e37. doi: 10.2196/jmir.1998

Do Participants’ Preferences for Mode of Delivery (Text, Video, or Both) Influence the Effectiveness of a Web-Based Physical Activity Intervention?

Corneel Vandelanotte 1,✉, Mitch J Duncan 1, Ronald C Plotnikoff 2, W Kerry Mummery 3
Editor: Gunther Eysenbach
Reviewed by: Shannon Sahlqvist
PMCID: PMC3374539  PMID: 22377834

Abstract

Background

In randomized controlled trials, participants cannot choose their preferred intervention delivery mode and thus might refuse to participate or not engage fully if assigned to a nonpreferred group. This might underestimate the true effectiveness of behavior-change interventions.

Objective

To examine whether receiving interventions either matched or mismatched with participants’ preferred delivery mode would influence effectiveness of a Web-based physical activity intervention.

Methods

Adults (n = 863), recruited via email, were randomly assigned to one of three intervention delivery modes (text based, video based, or combined) and received fully automated, Internet-delivered personal advice about physical activity. Personalized intervention content, based on the theory of planned behavior and stages of change concept, was identical across groups. Online, self-assessed questionnaires measuring physical activity were completed at baseline, 1 week, and 1 month. Physical activity advice acceptability and website usability were assessed at 1 week. Before randomization, participants were asked which delivery mode they preferred, to categorize them as matched or mismatched. Time spent on the website was measured throughout the intervention. We applied intention-to-treat, repeated-measures analyses of covariance to assess group differences.

Results

Attrition was high (575/863, 66.6%), though equal between groups (t 86 3 =1.31, P =.19). At 1-month follow-up, 93 participants were categorized as matched and 195 as mismatched. They preferred text mode (493/803, 61.4%) over combined (216/803, 26.9%) and video modes (94/803, 11.7%). After the intervention, 20% (26/132) of matched-group participants and 34% (96/282) in the mismatched group changed their delivery mode preference. Time effects were significant for all physical activity outcomes (total physical activity: F 2,801 = 5.07, P = .009; number of activity sessions: F 2,801 = 7.52, P < .001; walking: F 2,801 = 8.32, P < .001; moderate physical activity: F 2,801 = 9.53, P < .001; and vigorous physical activity: F 2,801 = 6.04, P = .002), indicating that physical activity increased over time for both matched and mismatched groups. Matched-group participants improved physical activity outcomes slightly more than those in the mismatched group, but interaction effects were not significant. Physical activity advice acceptability (content scale: t 368 = .10, P = .92; layout scale: t 368 = 1.53, P = .12) and website usability (layout scale: t 426 = .05, P = .96; ease of use scale: t 426 = .21, P = .83) were generally high and did not differ between the matched and mismatched groups. The only significant difference (t 621 = 2.16, P = .03) was in relation to total time spent on the website: the mismatched group spent significantly more time on the website (14.4 minutes) than the matched group (12.1 minutes).

Conclusion

Participants’ preference regarding delivery mode may not significantly influence intervention outcomes. Consequently, allowing participants to choose their preferred delivery mode may not increase effectiveness of Web-based interventions.

Keywords: Physical activity: computer tailoring, mismatch, preferences, delivery method, website-delivered intervention, behavior-change intervention

Introduction

Physical inactivity increases the risk of developing cardiovascular disease, diabetes, hypertension, some cancers, and obesity [1,2]. As large proportions of the population are not meeting physical activity guidelines [3-5], increasing physical activity is a public health priority. As such, intervention strategies that can reach many people in a cost-effective manner are desired.

Web-based physical activity interventions have shown promising results [6-8] and will continue to gain importance through growth in Internet access (in Australia, 73% of households have broadband access), the power of Web-based applications (eg, Facebook or YouTube), and convenience (through mobile devices) [9,10]. However, the immense versatility of the Internet allows for health information to be delivered in several ways [8]. For example, interventions delivered via websites can provide personally tailored information through different modes, such as text based, video based, or both [11]. While personally tailored interventions have been shown to be effective both in offline (print based) and online studies [12-15], there are large variations in individual preferences for the mode of intervention delivery [16,17]. This raises the question as to whether the effectiveness of an intervention may be enhanced or reduced when it is provided through a preferred or nonpreferred mode [18].

This may be important, as a review of randomized controlled trials found that a substantial proportion of potential participants refused to participate in these trials for fear of being assigned to the nonpreferred option [19]. Participants may also drop out of a trial after being assigned to the nonpreferred mode, or may enter and remain in the study but not adhere to or be engaged in the treatment [20]. As such, randomly assigning participants to nonpreferred delivery modes may reduce their participation, follow-up, and satisfaction, and may thus lead to poor outcomes [21]. Conversely, allocation to the preferred intervention delivery mode may lead to greater participation and better intervention effectiveness [21]. Ideally, however, population-based interventions should be robust and optimally effective no matter which delivery mode participants prefer.

Numerous studies have compared the effectiveness of different intervention delivery modes [22-26], but few have evaluated intervention effectiveness when participants were matched with their preferred intervention delivery mode. This is because randomized controlled trials are the gold standard in intervention research, so participants do not get to choose their preferred mode of delivery [27]. Therefore, the effect that delivery mode preferences may have on intervention outcomes remains largely unknown [28]. It could be argued that randomized controlled trials underestimate the gains possible in real-life intervention implementation [29], simply because no effort is made to match delivery mode with preference.

To our knowledge, only one behavioral study has examined whether preferred and nonpreferred modes of delivery influence intervention effectiveness. In a comparison of interventions delivered by print or telephone, Lewis et al [18] found that being in the preferred group did not influence physical activity levels. A few medical studies have also examined the influence of preferences on treatment outcomes, but with inconclusive results: some studies found better effects on satisfaction [20] and effectiveness [30] when participants were allocated to the preferred group and others not [19]. Overall, there is little evidence that preference effects significantly compromise internal validity [19], but this conclusion rests on a small number of studies. If preference has indeed little impact on effectiveness, the most cost-effective practice would be to develop only the delivery mode shown to have the greatest impact on health behavior, as the development of different intervention delivery modes is time consuming and costly. This might be more important for Web-based interventions where participants are simply given a choice to receive the intervention in a different way via the website, and where developers should avoid designing costly alternative delivery modes if they will not make a substantial difference.

Nevertheless, we need to know what works for whom; as such, there is a need for algorithms that will efficiently and effectively match participants to physical activity programs that best meet their needs [31]. Computer-tailored interventions aim to do this by providing information that is as personally relevant as possible [32]. However, as alluded to above, it is perhaps not only the content of the health information that needs to be tailored to the individual to achieve optimal effectiveness [13], but also the mode by which the intervention is delivered. Therefore, this study aimed to examine the impact of receiving computer-tailored intervention content that is either matched or mismatched with participants’ preferred mode of delivery (text based, video based, or both) on the acceptability, usability, and effectiveness of a Web-based physical activity intervention.

Methods

Design

We conducted a three-arm, randomized trial with balanced allocation ratio to assess the effectiveness of a Web-based, computer-tailored physical activity intervention. The intervention content was identical across the three arms; however, this content was delivered in a different mode for each group. The first arm received personalized physical activity feedback intervention in video mode, the second arm received the intervention in text mode, and the third arm received the intervention in combination mode, which provided both video- and text-tailored information. Data were collected during three measurement waves: baseline, 1-week follow-up, and 1-month follow-up.

Participants and Procedure

In January and February 2011, male and female adults over 18 years of age from the general population in Australia were invited by email to participate in the study. People listed in a database held by the Population Research Laboratory at the Institute of Health and Social Sciences Research at the University of Central Queensland were invited. To be eligible, participants had to have Internet access and no medical constraints that would prevent an increase in physical activity. The invitation emails contained a link to a website with information about the nature and purpose of the present study and access to the baseline survey. By accessing the baseline survey, participants provided consent to participate and agreed that they were well informed about the study. We used the Physical Activity Readiness Questionnaire (PAR-Q) to screen for participants for whom it was not safe to increase physical activity [33]. If participants answered yes to one of the PAR-Q questions, they were thanked for their time and not provided with access to the intervention website. After completing the baseline survey, participants were given a link to the intervention website; participants were automatically randomly assigned to one of the three groups on accessing the website. Nonresponders were reminded three times to complete each assessment. The whole study was entirely Web-based without any face-to-face components as part of the intervention or the assessment; as such, real-life conditions were mimicked as closely as possible. The study received ethical approval by the Human Research Ethics Committees at Central Queensland University. Figure 1 provides an overview of participant flow.

Figure 1.

Figure 1

Open in a new tab

Participant flow. PA = physical activity; PAR-Q = Physical Activity Readiness Questionnaire.

Intervention

The intervention was based on previous Internet-delivered and computer-tailored studies that successfully increased physical activity [34-38]. However, we developed additional intervention delivery modes. In addition to the previously developed text mode, we developed a video mode and a combination mode for this study. To inform the development of the video-tailored content, focus groups and a statewide survey were conducted to explore perceived appropriateness of the new delivery modes and volume of information presented [11]. The computer-tailored content of the three intervention modes was identical; only the intervention delivery mode was different. We did not change the intervention contents during the trial. A series of screenshots provides an impression of the intervention and shows the home page (Figure 2), an example of survey questions (Figure 3), an example of text mode (Figure 4); an example of video mode (Figure 5), and two examples of combination mode (Figure 6, Figure 7).

Figure 2.

Figure 2

Open in a new tab

Screenshot of introduction/home page.

Figure 3.

Figure 3

Open in a new tab

Screenshot of survey questions.

Figure 4.

Figure 4

Open in a new tab

Screenshot of text mode feedback.

Figure 5.

Figure 5

Open in a new tab

Screenshot of video mode feedback.

Figure 6.

Figure 6

Open in a new tab

Screenshot of combination mode feedback 1.

Figure 7.

Figure 7

Open in a new tab

Screenshot of combination mode feedback 2.

The intervention was largely based on the theory of planned behavior [39] and the stage of change concept [40]. Constructs of the theory of planned behavior were presented through provision of personally relevant feedback on attitudes, self-efficacy, intentions, benefits, and barriers in relation to their physical activity level. The intervention content was also adapted based on participants’ stage of change, and normative feedback (whether participants met the physical activity recommendation [41]) was provided in a graph. Other nontheoretical tailored variables were age, body mass index (BMI), work environment, and the distance to often-visited places. To receive personalized physical activity advice, participants first had to complete a short questionnaire about their physical activity levels, after which the personal advice immediately appeared on screen. Participants who did not meet the physical activity recommendation were encouraged to receive more feedback by completing additional questions related to the psychosocial correlates of physical activity. Participants were provided with unlimited access to the intervention website during the intervention period.

Measures

We assessed all measures using a Web-based survey. The following demographic information was collected: gender, age, height and weight (to calculate BMI), employment status (unemployed; employed), level of education (low education being up to high school; high education being university or other tertiary degree), and confidence with using the Internet (“How confident are you with using the Internet for general purposes?”) whereby not confident at all, not confident, and neither confident nor not confident were scored as low confidence; and whereby very confident and confident were scored as high confidence.

Physical activity level was measured using the Active Australia Survey, which has demonstrated good validity in different population groups [42,43], as well as being sensitive to change in intervention trials [44]. Questions included items on duration and frequency of walking, and of moderate- and vigorous-intensity physical activity in the previous week. To be included, all activities had to be performed continuously for at least 10 minutes at a time.

Preferred intervention delivery mode was measured using the following question: “If you were going to receive personally relevant physical activity feedback via the Internet, which intervention mode of delivery would you prefer?” The answering options were “Personally relevant written text that can be read or printed out,” “A personal video message that you can watch online or download,” and “A personal video message added with transcripts that can be printed.” This question was asked during the baseline assessment (before randomization), as well as 1 week after participants received the intervention, to assess whether being exposed to a nonpreferred delivery method would change participants’ opinions about their preference.

For the assessment of physical activity advice acceptability and website usability (assessed only at the 1-week time point), surveys were largely based on previous published questionnaires [36,45,46]. Physical activity advice acceptability was assessed through 13 items on a 5-point Likert scale (from 1, strongly disagree, to 5, strongly agree) and divided (using factor analysis) into two scales. The first scale, physical activity advice content, was measured by 8 items, such as “The physical activity advice is credible” (alpha = .90). The second scale, physical activity advice layout, was assessed by 5 questions, such as “I liked the format through which the physical activity advice was provided” (alpha = .87). Website usability was measured by 22 items on a 5-point Likert scale (from 1, strongly disagree, to 5, strongly agree) and also divided into two scales. The website layout scale was assessed by 8 questions, such as “I liked the overall organization of the website—the links, tabs, and buttons” (alpha = .92), and the website ease of use scale was measured by another 14 questions, such as “I was able to easily find my way around the website” (alpha = .94).

Website user statistics, measuring time spent on website, were collected during the entire 1-month intervention period.

Analysis

We created two groups based on whether the intervention delivery mode to which participants were assigned was matched or mismatched with their preferred intervention delivery mode. For example, participants were mismatched if they were assigned to receive the intervention in video mode, yet they preferred to receive the intervention in text mode. Vice versa, participants were matched if, for example, they preferred to receive the intervention in combination mode (video and text based) and were actually also randomly assigned to this group.

We used 1-way analyses of variance, independent-samples t tests, and chi-square tests to analyze dropout, compare baseline characteristics, and examine differences in website usability, physical activity advice acceptability, and time spent on the intervention website between the matched and mismatched groups.

According to the Active Australia Survey guidelines for analysis and reporting, we computed total physical activity minutes by summing the time spent walking and on moderate- and vigorous-intensity physical activity in the past week (vigorous-intensity physical activity was weighted by two) [47]. Walking, moderate-intensity physical activity, and vigorous-intensity physical activity were added together for the total number of physical activity sessions of the past week. To account for overreporting, we truncated each activity type on the Active Australia Survey at 14 hours per week, and total activity at a maximum of 28 hours per week. A sufficient level of physical activity was defined as being active for at least 150 minutes spread across a minimum of 5 sessions each week [47].

To evaluate the intervention effects on physical activity, we conducted repeated-measures analyses of covariance with time (baseline, 1 week, 1 month) as the within-participants factor and group (matched and mismatched) as the between-participants factor, controlled for baseline differences and delivery mode to which participants were assigned. We used both an intention-to-treat analysis (last value carry forward; n = 803) and a retained-sample analysis (n = 288). All analyses were performed using SPSS version 18.0 (IBM Corporation, Somers, NY, USA). Statistical significance was set at a level of .05.

Results

Participants

Of 3233 people contacted, 1332 (41.20%) completed the PAR-Q screening. Of these, we excluded 450 (33.8%) because they were not eligible according to the screening questionnaire. Of the 863 participants who completed the baseline questionnaire, we excluded from further analysis 51 (6%) because they did not receive any tailored feedback and 9 (1%) because they did not visit the website, yielding 803 participants. The 1-week follow-up questionnaire was completed by 370 (42.9%) respondents, and 288 (33.4%) completed the 1-month follow-up (see Figure 1).

Table 1 shows participant characteristics at baseline. The average age of all respondents was 52.4 years (range 19–89 years) and the majority were women (60.7%). Levels of education (78.5%), employment (70.9%), and Internet confidence (84.3%) were high. No significant baseline differences were observed in any of the examined variables between participants in the matched and mismatched groups, except for the intervention mode to which participants were originally randomly assigned (χ2 2,801 = 151.3, P < .001). This was because preferences were distributed differently for each delivery mode.

Table 1.

Participant characteristics at baseline across matched and mismatched groups.

Total study population
(n = 803) 		Groupa
Match (n = 261) Mismatch (n = 542)
Gender, n(%)
Male 316 (39.4%) 103 (39.5%) 213 (39.3%)
Female 487 (60.7%) 158 (60.5%) 329 (60.7%)
Age (years), mean (SD) 52.4 (11.9) 51.6 (12.3) 52.8 (11.8)
BMIb (kg/m2), mean (SD) 27.3 (6.2) 26.7 (5.3) 27.6 (6.7)
Employment status, n(%)
Unemployed 234 (29.1%) 77 (30%) 157 (29.0%)
Employed 569 (70.9%) 184 (70.5%) 385 (71.0%)
Internet confidence, (n, %)
Low 126 (15.7%) 37 (14%) 89 (16%)
High 677 (84.3%) 224 (85.8%) 453 (83.6%)
Education level, n (%)
Low 173 (21.5%) 57 (22%) 116 (21.4%)
High 630 (78.5%) 204 (78.6%) 426 (78.6%)
Baseline physical activity level, n (%)
Insufficient 352 (43.8%) 109 (41.8%) 243 (44.8%)
Sufficient 451 (56.2%) 152 (58.2%) 299 (55.2%)
Intervention condition, n (%)
Video based 258 (32.1%) 31 (12%) 227 (41.9%)
Text based 262 (32.6%) 159 (60.9%) 103 (19.0%)
Combination 283 (35.2%) 71 (27%) 212 (39.1%)
Open in a new tab

a No baseline differences were observed between matched and mismatched participants, except for intervention condition (χ2 2,801= 151.3, P < .001).

b Body mass index.

Dropout

Dropout levels differed only for the age of participants. Young people were significantly more likely than older participants to drop out during the course of the study (t 86 3 = 4.23, P = .000); the mean age of dropouts (50.8 years) was lower than the mean age of completers (54.3 years). No differences in dropout levels were observed for any other variables. Specifically, when comparing matched and mismatched participants, dropout was somewhat higher in the matched group (188/281, 66.9%) than in the mismatched group (387/582, 66.4%), but this difference was not significant (t 86 3 = 1.31, P = .19). In relation to this, few participants took the opportunity to return to the website more than once, and there were no significant differences between matched (8/194, 4%) and mismatched (17/429, 4%) groups (t 621 = .65, P = .51).

Preferred Intervention Delivery Mode

Table 2 shows the distributions of delivery mode preferences between matched and mismatched groups before and after the intervention. The text mode was by far the most popular preference, the video mode was the least popular preference, and the combination mode was in the middle. At baseline, delivery mode preferences were equal between matched and mismatched participants (χ2 2 ,801 = 0.03, P = .98). After receiving the intervention, participants’ overall delivery mode preferences changed, although this was not statistically significant (χ2 2 ,412 = 4.1, P = .13).

Table 2.

Delivery mode preferences for matched and mismatched participants pre- and postintervention.

Video
n (%) 		Text
n (%) 		Combination
n (%) 		χ2 df P value
Preintervention
Matched 31 (12%) 159 (60.9%) 71 (27%)
Mismatched 63 (12%) 334 (61.6%) 145 (26.8%) 0.03 2,801 .98
Postintervention
Matched 14 (11%) 92 (70%) 26 (20%)
Mismatched 44 (16%) 168 (59.6%) 70 (25%) 4.1 2,412 .13
Open in a new tab

While the overall proportions of participants’ preferences changed little after receiving the intervention, further examination of change in preference in the matched and mismatched groups revealed that change in preference appeared to be group dependent. After having received the intervention, 20% (26/132) of the participants in the matched group changed their delivery mode preference: this was 31% (4/13) for those who preferred the video mode at baseline, 3% (2/77) for those who preferred text mode, and 48% (20/42) for those who preferred the combination mode. In the mismatched group, 34% (96/282) of participants changed their delivery mode preference: this was 61% (17/28) for those who preferred the video mode at baseline, 25% (44/175) for those who preferred text mode, and 44% (35/79) for those who preferred the combination mode.

Physical Activity Changes

Table 3 reports the outcomes of the repeated-measures analyses of covariance. Significant time effects were observed for all the different physical activity outcomes (total minutes of physical activity, total number of activity sessions, walking minutes, and minutes of moderate and vigorous physical activity) according to the intention-to-treat analysis; indicating that physical activity increased over time for both matched and mismatched groups combined. This was also the case for the analysis including only participants who completed all measurements, though the F values are lower and not all values are significant. The participants in the matched group improved physical activity outcomes slightly more than did those in the mismatched group, but we observed no significant interaction effects for either the intention-to-treat or completer analysis. Intervention effects for participants not meeting the physical activity recommendations were also calculated; outcomes were similar to those of the total group, though time effects were stronger (the F values ranged between 6 and 24). However, we again noted no interaction effects (outcomes not reported in table). Finally, both the matched and the mismatched groups had an increase of 5% of participants meeting the physical activity guidelines from baseline to 1 week and then a decrease of 2% from 1 week to 1 month; there were no significant differences between groups.

Table 3.

Main and interaction effects for physical activity (mean, SD) between matched and mismatched groups.

Intention-to-treat (n = 803) Completers (n = 288)
Matched
(n = 261) 		Mismatched
(n = 542) 		Time (F2,801) group × time (F2,801) Matched
(n = 93) 		Mismatched
(n = 195) 		Time (F2,284) group × time (F2,284)
Total physical activity (minutes)
Baseline 336 (352) 315 (342) 308 (301) 314 (344)
1 week 355 (339) 320 (325) 348 (265) 322 (293)
1 month 362 (362) 335 (345) 5.07** 0.87 355 (332) 344 (339) 2.16 0.59
Difference +26 +20 +47 +30
Total physical activity sessions
Baseline 9.7 (7.1) 9.9 (9.3) 9.0 (6.1) 9.5 (7.5)
1 week 10.2 (7.1) 10.3 (9.8) 9.6 (5.7) 10.3 (8.9)
1 month 10.5 (7.6) 10.6 (9.4) 7.52*** 0.04 10.1 (7.4) 11.2 (8.7) 5.63** 0.23
Difference +0.8 +0.7 +1.1 +1.7
Walking (minutes)
Baseline 146 (158) 134 (154) 129 (146) 142 (167)
1 week 153 (155) 139 (150) 141 (139) 143 (140)
1 month 162 (159) 148 (159) 8.32*** 0.08 165 (156) 154 (161) 4.71* 0.93
Difference +16 +14 +36 +12
Moderate-intensity activity (minutes)
Baseline 54 (116) 50 (121) 44 (83) 54 (142)
1 week 66 (125) 56 (110) 55 (102) 56 (107)
1 month 70 (132) 59 (111) 9.53*** 1.13 56 (122) 60 (111) 0.49 0.19
Difference +16 +9 +12 +6
Vigorous-intensity activity (minutes)
Baseline 69 (121) 69 (130) 66 (111) 60 (105)
1 week 76 (118) 73 (125) 75 (102) 66 (113)
1 month 80 (125) 79 (133) 6.04** 0.26 67 (116) 66 (122) 0.64 0.22
Difference +11 +10 +1 +6
Open in a new tab

* P < .05, **P < .01, ***P < .001.

Physical Activity Advice Acceptability, Website Usability, and Time Spent on the Website

Physical activity advice acceptability and website usability were generally high, and differences between the matched and mismatched groups were few (Table 4). The only significant difference (t 621 = 2.16, P = .03) was in relation to the total time spent on the website: those in the mismatched group spent significantly more time on the website (14.4 minutes) than those in the matched group (12.1 minutes). Thus, exposure to intervention materials in the mismatched group was significantly greater than in the matched group.

Table 4.

Differences between matched and mismatched groups for acceptability of activity advice, website usability, and time spent on the website (mean, SD).

Total study population
(n = 428) 		Matched
(n = 137) 		Mismatched
(n = 291) 		t test df
Physical activity advice acceptabilitya
Advice content 3.2 (0.7) 3.2 (0.6) 3.2 (0.7) 0.10 368
Advice layout 3.9 (0.5) 3.8 (0.5) 3.9 (0.5) 1.53 368
Website usabilitya
Layout 3.7 (0.5) 3.7 (0.5) 3.7 (0.6) 0.05 426
Ease of use 4.0 (0.5) 4.0 (0.5) 4.0 (0.5) 0.21 426
Time spent on website (minutes) 13.7 (12.2) 12.1 (9.6) 14.4 (13.1) 2.16b 621
Open in a new tab

a On a scale ranging from 1, strongly disagree, to 5, strongly agree.

b P = .31.

Discussion

The main finding of this study was that delivery mode preference does not influence behavioral outcomes and other outcomes that are important in the effectiveness of Web-based interventions. The acceptability, usability, and effectiveness of the physical activity intervention was not significantly different for participants matched or mismatched to their preferred intervention delivery mode (video based, text based, or combination). This finding is in line with other studies that have examined preference effects for other types of interventions within different populations [18-20,48]. Only in their study on human papillomavirus testing did McCaffery et al [30] find effects on quality of life based on preferences for different interventions. The outcomes of the current study confirm the conclusion by King et al [19]: although participants may have strong intervention preferences, there is not much support for the hypothesis that preferences significantly compromise the internal validity of randomized controlled trials. The outcomes indicate that health promotion practitioners can be guided by efficacy outcomes obtained through randomized controlled trials and do not have to accommodate participant preferences with regard to intervention delivery modes in Web-based, computer-tailored physical activity interventions, as doing so would not increase intervention effectiveness.

It is difficult to explain why no differences were found, as the findings seem counterintuitive [18]. It might be that the differences between the intervention delivery modes in this study were too small to alter effectiveness. Preferences may have more impact when, for example, comparing a face-to-face intervention with a website-delivered intervention [25,26]. Different variations of the same website-delivered intervention may have been too subtle to be influential. Or a form of recruitment bias might have been at play. As all participants were reactively recruited via email, it might be that the participants liked interacting with any kind of technology or delivery mode, thus providing little opportunity for the influence of preference. This is in line with the high levels of Internet confidence reported. Alternatively, Lewis et al [18] suggested that perhaps, after being randomly assigned to a nonpreferred intervention, participants are pleasantly surprised regarding the components of the intervention and care less about being assigned to the a nonpreferred intervention. This is in line with King’s [21] assumption that the stability of attitudes will affect the internal validity; a positive experience with an intervention during a trial may change negative attitudes and weaken the effect of preference on outcomes.

Though acceptability of the advice and website usability were not influenced by delivery mode preferences in this study, others have seen an impact of participant satisfaction levels [20]. Therefore, in line with Foley et al [49], we recommend offering participants a delivery mode choice if possible, as it will not harm intervention effectiveness, and might also increase participant satisfaction levels. The current study unexpectedly found that mismatched participants spend significantly more time on the website, yet this longer exposure to intervention materials did not translate to differences in outcomes. This is in contrast to previous studies that have emphasized the importance of intervention exposure to achieve behavioral change [50-52]. However, while the differences in time spent on the website were statistically significant, we do not know whether this difference in time (approximately 2.3 minutes) was meaningful enough to alter behavior. Alternatively, it might be that the extra time spent on the website was of low quality in relation to paying attention to the physical activity message. Participants might have been distracted by emails or might have visited another website simultaneously. As the online environment is extremely competitive, further research should investigate the effects on outcomes of paying attention to website-delivered interventions.

When examining the preferences themselves, we noted that strong support for the text-based delivery mode was evident, and this remained so after participants were exposed to the text mode. Also, change in preference was very low among those who preferred and received a text mode intervention ((2/77, 3%), and it was very high for those who preferred a video mode intervention but did not receive it (17/28, 60%). This is in contrast with eye-tracking research, which has shown that people don’t fully read text on the Internet; instead, they scan and skim the content [53,54]. Internet-based reading behavior is characterized by more time spent on browsing and scanning, keyword spotting, nonlinear reading, and more selective reading, while less time is spent on in-depth and concentrated reading [53,55]. Perhaps this is different when the information offered is personally relevant, as is the case with computer-tailored interventions [12]. According to the Elaboration Likelihood Model, information is processed more thoroughly when it is perceived to be personally relevant [56]. Finally, change in delivery mode preferences, after participants received the intervention, was greatest in the mismatched group (34.0% vs 19.7%). This was not unexpected, as for matched participants a change in preference is likely related to dissatisfaction with their original choice; for mismatched participants a change in preference is likely related to satisfaction with the delivery mode to which they were exposed during the intervention over their original preference.

This study has some limitations that limit its generalizability. First, the low-intensity real-life implementation of the current study (email recruitment, no face-to-face or telephone contact for the entire study) was more than likely responsible for the high attrition levels [57,58]. Yet these dropout levels are comparable with those of other website-delivered studies with similar protocols [59-61]. Second, as also mentioned by Lewis et al [18], participants were administered a forced-choice question regarding preference. In other words, even when participants didn’t have a preference, or would have preferred not to use any of the delivery modes presented to them, they were forced to make a choice. In relation to this, participants might have had a different preference if they would have been able to experience each of the delivery modes beforehand; due to the innovative nature of this intervention and its delivery modes (with which the participant would have been unfamiliar), this might have indeed been the case. However, from a practical point of view, it was not possible to expose participants to the delivery mode options prior to the randomized trial. A third limitation is that the sample was relatively homogeneous (eg, mostly white and educated). The effect of preference may possibly vary across sociodemographic variables. Fourth, a larger sample size is needed to explore the effects of preference within each intervention delivery mode (video based, text based, and combination) separately; the current study was not sufficiently powered to do so. Fifth, the follow-up period in this study was short, and potentially preferences play a greater role in maintenance and use of different delivery modes over the longer term.

In conclusion, this study illustrates that the importance of preference effects in different delivery modes of an Internet-based physical activity intervention is limited. However, due to the scarcity of research in this area, more studies to investigate this research topic that can address the above-mentioned limitations are needed.

Acknowledgments

This study was funded by a Central Queensland University Merit Grant (which is part of the Research Development and Incentive Program). The Population Research Laboratory, managed by Ms Christine Hanley, was responsible for participant recruitment and data collection using Web-based surveys. Dr Vandelanotte was supported by a National Health and Medical Research Council of Australia (#519778) and National Heart Foundation of Australia (#PH 07B 3303) postdoctoral research fellowship. Professor Plotnikoff was supported by a Senior Research Fellowship from the National Health and Medical Research Council of Australia.

Abbreviations

BMI

body mass index

PAR-Q

Physical Activity Readiness Questionnaire

Multimedia Appendix 1

CONSORT-EHEALTH form V1.6 [62].

jmir_v14i1e37_app1.pdf (812.7KB, pdf)
Open in a new tab

Footnotes

Dr Vandelanotte is the owner and codeveloper of the intervention presented in this study.

References

  • 1.Haskell WL, Lee IM, Pate RR, Powell KE, Blair SN, Franklin BA, Macera CA, Heath GW, Thompson PD, Bauman A. Physical activity and public health: updated recommendation for adults from the American College of Sports Medicine and the American Heart Association. Med Sci Sports Exerc. 2007 Aug;39(8):1423–34. doi: 10.1249/mss.0b013e3180616b27.00005768-200708000-00027 [DOI] [PubMed] [Google Scholar]
  • 2.Blair SN, Morris JN. Healthy hearts--and the universal benefits of being physically active: physical activity and health. Ann Epidemiol. 2009 Apr;19(4):253–6. doi: 10.1016/j.annepidem.2009.01.019.S1047-2797(09)00035-0 [DOI] [PubMed] [Google Scholar]
  • 3.Vandelanotte C, Duncan MJ, Caperchione C, Hanley C, Mummery WK. Physical activity trends in Queensland (2002 to 2008): are women becoming more active than men? Aust N Z J Public Health. 2010 Jun;34(3):248–54. doi: 10.1111/j.1753-6405.2010.00521.x.AZPH521 [DOI] [PubMed] [Google Scholar]
  • 4.US Department of Health and Human Services . Physical Activity and Health: A Report of the Surgeon General. Atlanta, GA: US Department of Health and Human Services, Centers for Disease Control and Prevention, National Center for Chronic Disease Prevention and Health Promotion; 1996. [Google Scholar]
  • 5.Tucker JM, Welk GJ, Beyler NK. Physical activity in U.S.: adults compliance with the Physical Activity Guidelines for Americans. Am J Prev Med. 2011 Apr;40(4):454–61. doi: 10.1016/j.amepre.2010.12.016.S0749-3797(11)00012-2 [DOI] [PubMed] [Google Scholar]
  • 6.Vandelanotte C, Spathonis KM, Eakin EG, Owen N. Website-delivered physical activity interventions a review of the literature. Am J Prev Med. 2007 Jul;33(1):54–64. doi: 10.1016/j.amepre.2007.02.041.S0749-3797(07)00164-X [DOI] [PubMed] [Google Scholar]
  • 7.van den Berg MH, Schoones JW, Vliet Vlieland TP. Internet-based physical activity interventions: a systematic review of the literature. J Med Internet Res. 2007;9(3):e26. doi: 10.2196/jmir.9.3.e26. http://www.jmir.org/2007/3/e26/v9i3e26 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8.Webb TL, Joseph J, Yardley L, Michie S. Using the internet to promote health behavior change: a systematic review and meta-analysis of the impact of theoretical basis, use of behavior change techniques, and mode of delivery on efficacy. J Med Internet Res. 2010;12(1):e4. doi: 10.2196/jmir.1376. http://www.jmir.org/2010/1/e4/v12i1e4 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9.Australian Bureau of Statistics . Household Use of Information Technology, Australia, 2010-11. Canberra: Australian Bureau of Statistics; 2011. [2012-02-14]. http://www.abs.gov.au/ausstats/abs@.nsf/mf/8146.0?OpenDocument. [Google Scholar]
  • 10.Wei J, Hollin I, Kachnowski S. A review of the use of mobile phone text messaging in clinical and healthy behaviour interventions. J Telemed Telecare. 2011;17(1):41–8. doi: 10.1258/jtt.2010.100322.jtt.2010.100322 [DOI] [PubMed] [Google Scholar]
  • 11.Vandelanotte C, Mummery WK. Qualitative and quantitative research into the development and feasibility of a video-tailored physical activity intervention. Int J Behav Nutr Phys Act. 2011;8(1):70. doi: 10.1186/1479-5868-8-70. http://www.ijbnpa.org/content/8/1/70.1479-5868-8-70 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12.Kroeze W, Werkman A, Brug J. A systematic review of randomized trials on the effectiveness of computer-tailored education on physical activity and dietary behaviors. Ann Behav Med. 2006 Jun;31(3):205–23. doi: 10.1207/s15324796abm3103_2. [DOI] [PubMed] [Google Scholar]
  • 13.Lustria ML, Cortese J, Noar SM, Glueckauf RL. Computer-tailored health interventions delivered over the Web: review and analysis of key components. Patient Educ Couns. 2009 Feb;74(2):156–73. doi: 10.1016/j.pec.2008.08.023.S0738-3991(08)00469-2 [DOI] [PubMed] [Google Scholar]
  • 14.Neville LM, O'Hara B, Milat A. Computer-tailored physical activity behavior change interventions targeting adults: a systematic review. Int J Behav Nutr Phys Act. 2009;6:30. doi: 10.1186/1479-5868-6-30. http://www.ijbnpa.org/content/6//30.1479-5868-6-30 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15.Noar SM, Benac CN, Harris MS. Does tailoring matter? Meta-analytic review of tailored print health behavior change interventions. Psychol Bull. 2007 Jul;133(4):673–93. doi: 10.1037/0033-2909.133.4.673.2007-09203-006 [DOI] [PubMed] [Google Scholar]
  • 16.Daley A, Stokes-Lampard H, Wilson S, Rees M, Roalfe A, Macarthur C. What women want? Exercise preferences of menopausal women. Maturitas. 2011 Feb;68(2):174–8. doi: 10.1016/j.maturitas.2010.11.011.S0378-5122(10)00422-6 [DOI] [PubMed] [Google Scholar]
  • 17.Rogers LQ, Courneya KS, Verhulst S, Markwell SJ, McAuley E. Factors associated with exercise counseling and program preferences among breast cancer survivors. J Phys Act Health. 2008 Sep;5(5):688–705. doi: 10.1123/jpah.5.5.688. [DOI] [PubMed] [Google Scholar]
  • 18.Lewis BA, Napolitano MA, Whiteley JA, Marcus BH. The effect of preferences for print versus telephone interventions on compliance and attrition in a randomized controlled physical activity trial. Psychol Sport Exerc. 2006;7(5):453–62. doi: 10.1016/j.psycholsport.2006.04.004. [DOI] [Google Scholar]
  • 19.King M, Nazareth I, Lampe F, Bower P, Chandler M, Morou M, Sibbald B, Lai R. Impact of participant and physician intervention preferences on randomized trials: a systematic review. JAMA. 2005 Mar 2;293(9):1089–99. doi: 10.1001/jama.293.9.1089. http://jama.ama-assn.org/cgi/pmidlookup?view=long&pmid=15741531.293/9/1089 [DOI] [PubMed] [Google Scholar]
  • 20.Floyd AH, Moyer A. Effects of participant preferences in unblinded randomized controlled trials. J Empir Res Hum Res Ethics. 2010 Jun;5(2):81–93. doi: 10.1525/jer.2010.5.2.81. [DOI] [PubMed] [Google Scholar]
  • 21.King M. The effects of patients' and practitioners' preferences on randomized clinical trials. Palliat Med. 2000 Nov;14(6):539–42. doi: 10.1191/026921600701536309. [DOI] [PubMed] [Google Scholar]
  • 22.Marcus BH, Lewis BA, Williams DM, Dunsiger S, Jakicic JM, Whiteley JA, Albrecht AE, Napolitano MA, Bock BC, Tate DF, Sciamanna CN, Parisi AF. A comparison of Internet and print-based physical activity interventions. Arch Intern Med. 2007 May 14;167(9):944–9. doi: 10.1001/archinte.167.9.944. http://archinte.ama-assn.org/cgi/pmidlookup?view=long&pmid=17502536.167/9/944 [DOI] [PubMed] [Google Scholar]
  • 23.Marcus BH, Napolitano MA, King AC, Lewis BA, Whiteley JA, Albrecht A, Parisi A, Bock B, Pinto B, Sciamanna C, Jakicic J, Papandonatos GD. Telephone versus print delivery of an individualized motivationally tailored physical activity intervention: Project STRIDE. Health Psychol. 2007 Jul;26(4):401–9. doi: 10.1037/0278-6133.26.4.401.2007-09406-003 [DOI] [PubMed] [Google Scholar]
  • 24.Steele R, Mummery WK, Dwyer T. Using the Internet to promote physical activity: a randomized trial of intervention delivery modes. J Phys Act Health. 2007 Jul;4(3):245–60. doi: 10.1123/jpah.4.3.245. [DOI] [PubMed] [Google Scholar]
  • 25.Steele RM, Mummery WK, Dwyer T. A comparison of face-to-face or internet-delivered physical activity intervention on targeted determinants. Health Educ Behav. 2009 Dec;36(6):1051–64. doi: 10.1177/1090198109335802.1090198109335802 [DOI] [PubMed] [Google Scholar]
  • 26.Steele RM, Mummery WK, Dwyer T. Examination of program exposure across intervention delivery modes: face-to-face versus internet. Int J Behav Nutr Phys Act. 2007;4:7. doi: 10.1186/1479-5868-4-7. http://www.ijbnpa.org/content/4//7.1479-5868-4-7 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 27.Bonell CP, Hargreaves J, Cousens S, Ross D, Hayes R, Petticrew M, Kirkwood BR. Alternatives to randomisation in the evaluation of public health interventions: design challenges and solutions. J Epidemiol Community Health. 2011 Jul;65(7):582–7. doi: 10.1136/jech.2008.082602.jech.2008.082602 [DOI] [PubMed] [Google Scholar]
  • 28.Torgerson DJ, Klaber-Moffett J, Russell IT. Patient preferences in randomised trials: threat or opportunity? J Health Serv Res Policy. 1996 Oct;1(4):194–7. doi: 10.1177/135581969600100403. [DOI] [PubMed] [Google Scholar]
  • 29.Udell JA, Redelmeier DA. Patient preferences and the ironic nature of randomized trials. Med Decis Making. 2011;31(2):226–8. doi: 10.1177/0272989X11399125.31/2/226 [DOI] [PubMed] [Google Scholar]
  • 30.McCaffery KJ, Turner R, Macaskill P, Walter SD, Chan SF, Irwig L. Determining the impact of informed choice: separating treatment effects from the effects of choice and selection in randomized trials. Med Decis Making. 2011;31(2):229–36. doi: 10.1177/0272989X10379919.0272989X10379919 [DOI] [PubMed] [Google Scholar]
  • 31.King AC, Marcus B, Ahn D, Dunn AL, Rejeski WJ, Sallis JF, Coday M, Activity Counseling Trial Research Group Identifying subgroups that succeed or fail with three levels of physical activity intervention: the Activity Counseling Trial. Health Psychol. 2006 May;25(3):336–47. doi: 10.1037/0278-6133.25.3.336.2006-05891-010 [DOI] [PubMed] [Google Scholar]
  • 32.Vandelanotte C, De Bourdeaudhuij I, Sallis JF, Spittaels H, Brug J. Efficacy of sequential or simultaneous interactive computer-tailored interventions for increasing physical activity and decreasing fat intake. Ann Behav Med. 2005 Apr;29(2):138–46. doi: 10.1207/s15324796abm2902_8. [DOI] [PubMed] [Google Scholar]
  • 33.Cardinal BJ, Esters J, Cardinal MK. Evaluation of the revised physical activity readiness questionnaire in older adults. Med Sci Sports Exerc. 1996 Apr;28(4):468–72. doi: 10.1097/00005768-199604000-00011. [DOI] [PubMed] [Google Scholar]
  • 34.Spittaels H, De Bourdeaudhuij I, Brug J, Vandelanotte C. Effectiveness of an online computer-tailored physical activity intervention in a real-life setting. Health Educ Res. 2007 Jun;22(3):385–96. doi: 10.1093/her/cyl096. http://her.oxfordjournals.org/cgi/pmidlookup?view=long&pmid=16971674.cyl096 [DOI] [PubMed] [Google Scholar]
  • 35.Spittaels H, De Bourdeaudhuij I, Vandelanotte C. Evaluation of a website-delivered computer-tailored intervention for increasing physical activity in the general population. Prev Med. 2007 Mar;44(3):209–17. doi: 10.1016/j.ypmed.2006.11.010.S0091-7435(06)00502-0 [DOI] [PubMed] [Google Scholar]
  • 36.Vandelanotte C, De Bourdeaudhuij I. Acceptability and feasibility of a computer-tailored physical activity intervention using stages of change: project FAITH. Health Educ Res. 2003 Jun;18(3):304–17. doi: 10.1093/her/cyf027. http://her.oxfordjournals.org/cgi/pmidlookup?view=long&pmid=12828232. [DOI] [PubMed] [Google Scholar]
  • 37.Vandelanotte C, De Bourdeaudhuij I, Brug J. Two-year follow-up of sequential and simultaneous interactive computer-tailored interventions for increasing physical activity and decreasing fat intake. Ann Behav Med. 2007 Apr;33(2):213–9. doi: 10.1080/08836610701310086. [DOI] [PubMed] [Google Scholar]
  • 38.Vandelanotte C, Reeves MM, Brug J, De Bourdeaudhuij I. A randomized trial of sequential and simultaneous multiple behavior change interventions for physical activity and fat intake. Prev Med. 2008 Mar;46(3):232–7. doi: 10.1016/j.ypmed.2007.07.008.S0091-7435(07)00299-X [DOI] [PubMed] [Google Scholar]
  • 39.Ajzen I. The theory of planned behavior. Organ Behav Hum Decis Process. 1991;50(2):179–211. doi: 10.1016/0749-5978(91)90020-T. [DOI] [Google Scholar]
  • 40.Prochaska JO, Velicer WF. The transtheoretical model of health behavior change. Am J Health Promot. 1997;12(1):38–48. doi: 10.4278/0890-1171-12.1.38. [DOI] [PubMed] [Google Scholar]
  • 41.Department of Health and Aged Care (DHAC) National Physical Activity Guidelines for Australians. Canberra: Australian Government, Department of Health and Ageing; 1999. [Google Scholar]
  • 42.Brown WJ, Trost SG, Bauman A, Mummery K, Owen N. Test-retest reliability of four physical activity measures used in population surveys. J Sci Med Sport. 2004 Jun;7(2):205–15. doi: 10.1016/s1440-2440(04)80010-0. [DOI] [PubMed] [Google Scholar]
  • 43.Heesch KC, Hill RL, van Uffelen JG, Brown WJ. Are Active Australia physical activity questions valid for older adults? J Sci Med Sport. 2011 May;14(3):233–7. doi: 10.1016/j.jsams.2010.11.004.S1440-2440(10)00912-6 [DOI] [PubMed] [Google Scholar]
  • 44.Reeves MM, Marshall AL, Owen N, Winkler EA, Eakin EG. Measuring physical activity change in broad-reach intervention trials. J Phys Act Health. 2010 Mar;7(2):194–202. [PubMed] [Google Scholar]
  • 45.Vandelanotte C, De Bourdeaudhuij I, Brug J. Acceptability and feasibility of an interactive computer-tailored fat intake intervention in Belgium. Health Promot Int. 2004 Dec;19(4):463–70. doi: 10.1093/heapro/dah408. http://heapro.oxfordjournals.org/cgi/pmidlookup?view=long&pmid=15522947.dah408 [DOI] [PubMed] [Google Scholar]
  • 46.Hinchliffe A, Mummery WK. Applying usability testing techniques to improve a health promotion website. Health Promot J Austr. 2008 Apr;19(1):29–35. doi: 10.1071/he08029. [DOI] [PubMed] [Google Scholar]
  • 47.Australian Institute of Health and Welfare . The Active Australia Survey: A Guide and Manual for Implementation, Analysis and Reporting. Canberra: Australian Institute of Health and Welfare; 2003. [Google Scholar]
  • 48.Ward J, Wilkinson C, Graser SV, Prusak KA. Effects of choice on student motivation and physical activity behaviour in physical education. J Teach Phys Educ. 2008;27:385–98. [Google Scholar]
  • 49.Foley L, Maddison R, Jones Z, Brown P, Davys A. Comparison of two modes of delivery of an exercise prescription scheme. N Z Med J. 2011 Jul 8;124(1338):44–54. [PubMed] [Google Scholar]
  • 50.Davies C, Corry K, Van Itallie A, Vandelanotte C, Caperchione C, Mummery WK. Prospective associations between intervention components and website engagement in a publicly available physical activity website: the case of 10,000 steps australia. J Med Internet Res. 2012;14(1):e4. doi: 10.2196/jmir.1792. http://www.jmir.org/2012/1/e4/v14i1e4 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 51.van den Berg MH, Ronday HK, Peeters AJ, Voogt-van der Harst EM, Munneke M, Breedveld FC, Vliet Vlieland TP. Engagement and satisfaction with an Internet-based physical activity intervention in patients with rheumatoid arthritis. Rheumatology (Oxford) 2007 Mar;46(3):545–52. doi: 10.1093/rheumatology/kel341. http://rheumatology.oxfordjournals.org/cgi/pmidlookup?view=long&pmid=17043050.kel341 [DOI] [PubMed] [Google Scholar]
  • 52.Wanner M, Martin-Diener E, Bauer G, Braun-Fahrländer C, Martin BW. Comparison of trial participants and open access users of a web-based physical activity intervention regarding adherence, attrition, and repeated participation. J Med Internet Res. 2010;12(1):e3. doi: 10.2196/jmir.1361. http://www.jmir.org/2010/1/e3/v12i1e3 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 53.Liu Z. Reading behavior in the digital environment: changes in reading behavior over the past ten years. J Doc. 2005;61(6):700–12. doi: 10.1108/00220410510632040. [DOI] [Google Scholar]
  • 54.Nielsen J, Pernice K. Eyetracking Web Usability (Voices That Matter) Berkeley, CA: New Riders Press; 2010. [Google Scholar]
  • 55.Sutherland-Smith W. Weaving the literacy Web: changes in reading from page to screen. Read Teach. 2002;55:662–9. [Google Scholar]
  • 56.Petty RE, Cacioppo JT. The elaboration likelihood model of persuasion. Adv Exp Soc Psychol. 1986;19:123–205. doi: 10.1016/S0065-2601(08)60214-2. [DOI] [Google Scholar]
  • 57.Bennett GG, Glasgow RE. The delivery of public health interventions via the Internet: actualizing their potential. Annu Rev Public Health. 2009 Apr 29;30:273–92. doi: 10.1146/annurev.publhealth.031308.100235. [DOI] [PubMed] [Google Scholar]
  • 58.Wantland DJ, Portillo CJ, Holzemer WL, Slaughter R, McGhee EM. The effectiveness of Web-based vs. non-Web-based interventions: a meta-analysis of behavioral change outcomes. J Med Internet Res. 2004 Nov 10;6(4):e40. doi: 10.2196/jmir.6.4.e40. http://www.jmir.org/2004/4/e40/v6e40 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 59.Eysenbach G. The law of attrition. J Med Internet Res. 2005;7(1):e11. doi: 10.2196/jmir.7.1.e11. http://www.jmir.org/2005/1/e11/v7e11 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 60.Kosma M, Cardinal BJ, McCubbin JA. A pilot study of a web-based physical activity motivational program for adults with physical disabilities. Disabil Rehabil. 2005 Dec 15;27(23):1435–42. doi: 10.1080/09638280500242713.L51X290818153558 [DOI] [PubMed] [Google Scholar]
  • 61.Woolf SH, Krist AH, Johnson RE, Wilson DB, Rothemich SF, Norman GJ, Devers KJ. A practice-sponsored Web site to help patients pursue healthy behaviors: an ACORN study. Ann Fam Med. 2006;4(2):148–52. doi: 10.1370/afm.522. http://www.annfammed.org/cgi/pmidlookup?view=long&pmid=16569718.4/2/148 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 62.Eysenbach G, CONSORT-EHEALTH Group CONSORT-EHEALTH: improving and standardizing evaluation reports of Web-based and mobile health interventions. J Med Internet Res. 2011;13(4):e126. doi: 10.2196/jmir.1923. http://www.jmir.org/2011/4/e126/v13i4e126 [DOI] [PMC free article] [PubMed] [Google Scholar]

Articles from Journal of Medical Internet Research are provided here courtesy of JMIR Publications Inc.

RESOURCES