Two challenging issues in Internet intervention research, as well as in other behavioral intervention trials, are ensuring that participants receive the intervention (adherence) and that their outcomes are captured at follow-up (retention) [1]. The interesting analysis presented by Murray et al [2] demonstrated that, at least in their study sample, the participant adherence and retention were positively related.
One issue to consider is whether this finding can be replicated in other study samples. It is possible that research involving, for example, different recruitment methods or with higher (or lower) retention rates, might not display this same positive relationship. To that purpose, results were examined from an Internet intervention trial that employed a proactive telephone recruitment method and obtained complete follow-up data for 86% of participants [3-5]. As with the Murray et al study [2], adherence (measured by the number of intervention participants logging onto a brief alcohol intervention, where N=92; 57 participants logged onto the intervention and 35 participants did not log on) and retention were strongly positively related (retention at 3-months: logged onto intervention=100%, did not log on=80%, P<.001; retention at 6-months: logged onto intervention=100%; did not log on=80%, P<.001; retention at 12-months: logged onto intervention=96%; did not log on=74.3%, P=.002; Fisher’s Exact Tests).
Given that the positive relationship between adherence and retention can be replicated, what are the implications of this finding? From one perspective, the fact that these two key issues are related could underline the increased importance of obtaining a good retention rate. This is because the positive relationship of adherence to retention implies that a confound in the interpretation of the results is more likely as loss to follow-up (or reduced adherence to the intervention) increases. Alternatively, it could be argued that this positive relationship might reduce the importance of obtaining a good retention rate. This is because traditional intent-to-treat analysis assumes that participants who are lost to follow-up do not make any change in their behavior from baseline to follow-up (and are included as imputed values in the analysis based on this assumption). If it is then assumed that only those participants who accessed the intervention will actually make a change in their behavior, then the fact that participants who adhere to the intervention are more likely to follow-up can only increase the likelihood that participants who are lost to follow-up are less likely to have made a change in their behavior (thus validating the intent-to-treat analysis assumption). Determining which of these implications is correct is important, particularly in a field where low retention rates are an unfortunate reality in many research trials [1].
Footnotes
Conflicts of Interest: None declared.
References
- 1.Eysenbach G. The law of attrition. J Med Internet Res. 2005;7(1):e11. doi: 10.2196/jmir.7.1.e11. http://www.jmir.org/2005/1/e11/ [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Murray E, White IR, Varagunam M, Godfrey C, Khadjesari Z, McCambridge J. Attrition revisited: adherence and retention in a web-based alcohol trial. J Med Internet Res. 2013;15(8):e162. doi: 10.2196/jmir.2336. http://www.jmir.org/2013/8/e162/ [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.Cunningham JA, Wild TC, Cordingley J, van Mierlo T, Humphreys K. A randomized controlled trial of an internet-based intervention for alcohol abusers. Addiction. 2009 Dec;104(12):2023–32. doi: 10.1111/j.1360-0443.2009.02726.x. http://dx.doi.org/10.1111/j.1360-0443.2009.02726.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Cunningham JA, Wild TC, Cordingley J, Van Mierlo T, Humphreys K. Twelve-month follow-up results from a randomized controlled trial of a brief personalized feedback intervention for problem drinkers. Alcohol. 2010 Jun;45(3):258–62. doi: 10.1093/alcalc/agq009. http://alcalc.oxfordjournals.org/cgi/pmidlookup?view=long&pmid=20150170. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Cunningham JA, Wild TC, Humphreys K. Who uses online interventions for problem drinkers? J Subst Abuse Treat. 2011 Oct;41(3):261–4. doi: 10.1016/j.jsat.2011.03.003. http://europepmc.org/abstract/MED/21632197. [DOI] [PMC free article] [PubMed] [Google Scholar]