Abstract
Background
Combination antiretroviral therapy (cART) as treatment for human immunodeficiency virus (HIV) infection is effective and available, but poor medication adherence limits benefits, particularly in vulnerable populations. In a Kenyan randomized controlled trial, a weekly text-messaging intervention (WelTel) improved cART adherence and HIV viral load (VL). Despite growing evidence for short message service (SMS) text-message interventions in HIV care, there is a paucity of data utilizing these interventions in marginalized or female cohorts.
Objective
This study was undertaken to assess whether the standardized WelTel SMS text-message intervention applied to a vulnerable, predominantly female, population improved cART adherence and VL.
Methods
We conducted a repeated measures study of the WelTel intervention in high-risk HIV-positive persons by measuring change in VL, CD4 count, and self-reported adherence 12 months before and 12 months after the WelTel intervention was introduced. Inclusion criteria included VL ≥200 copies/mL, indication for treatment, and meeting vulnerability criteria. Participants were given a mobile phone with unlimited texting (where required), and weekly check-in text messages were sent for one year from the WelTel computer platform. Clinical data were collected for control and intervention years. Participants were followed by a multidisciplinary team in a clinical setting. Outcomes were assessed using Wilcoxon signed ranks tests for change in CD4 and VL from control year to study end and mixed-effects logistic regressions for change in cART adherence and appointment attendance. A secondary analysis was conducted to assess the effect of response rate on the outcome by modeling final log10 VL by number of responses while controlling for mean log10 VL in the control year.
Results
Eighty-five participants enrolled in the study, but 5 withdrew (final N=80). Participants were predominantly female (90%, 72/80) with a variety of vulnerabilities. Mean VL decreased from 1098 copies/mL in the control year to 439 copies/mL at study end (P=.004). Adherence to cART significantly improved (OR 1.14, IQR 1.10-1.18; P<.001), whereas appointment attendance decreased slightly with the intervention (OR 0.81, IQR 0.67-0.99; P=.03). A response was received for 46.57% (1753/3764) of messages sent and 9.62% (362/3764) of text messages sent were replied to with a problem. An outcome analysis examining relationship between reply rate and VL did not meet statistical significance (P=.07), but may be worthy of investigating further in a larger study.
Conclusions
WelTel may be an effective tool for improving cART adherence and reducing VLs among high-risk, vulnerable HIV-positive persons.
Trial Registration
Clinicaltrials.gov NCT02603536; https://clinicaltrials.gov/ct2/show/NCT02603536 (Archived by WebCite at http://www.webcitation.org/6qK57zCwv)
Keywords: mHealth, HIV, medication adherence, vulnerable, female, viral load, mobile phone, engagement
Introduction
In Canada, approximately 75,500 people are living with human immunodeficiency virus (HIV), 16,800 of whom are women [1]. Combination antiretroviral therapy (cART) has led to enormous improvements in health and survival of HIV-positive individuals [2]. Moreover, by decreasing the amount of virus circulating in the plasma (viral load [VL]), cART offers the possibility of treatment as prevention by minimizing viral transmission [3,4]. Despite the well-established benefits of cART, nonadherence to medications, delayed initiation of therapy, and poor follow-up are ongoing limitations of effective HIV management leading to multidrug resistance, progression to acquired immune deficiency syndrome (AIDS), transmission to others, and mortality [2,5-7].
Engagement in longitudinal HIV care is an ongoing challenge, with studies from the United States showing long-term retention in care ranging from 37% to 65% [8-11]. Retention in care is particularly important on a public health scale because those individuals not retained in care have been estimated to account for twice as many HIV transmissions as nondiagnosed individuals [11]. In British Columbia, Canada, there is emerging evidence that cART adherence among women is lagging behind that of men (59% vs 68%, respectively) [12]. A variety of factors have been shown to decrease care retention and cART adherence in women, including intimate partner violence, medication side effects, role as care provider, and gender-specific stigma [13-19]. Other risk factors associated with poor adherence in both men and women include substance abuse, recent incarceration, psychiatric conditions, advanced HIV, and lack of social or housing supports [8,20-25]. Previous peer mentoring and behavioral interventions tested in these populations have failed to show objective improvements in HIV care [26-28]. For an illness that now has beneficial long-term treatment available, effective adherence strategies for difficult-to-engage populations will be of paramount importance from an individual and public health standpoint.
Mobile health (mHealth), the use of mobile phone technology to deliver health care, is an emerging area of disease management that can assist in patient adherence to prolonged chronic treatment regimens and monitoring of care [29-31]. Short message service (SMS) text messaging is particularly appealing as a mHealth intervention because it makes use of standard services offered by cellular providers, requires minimal additional infrastructure, and is user-friendly, ubiquitous, and flexible [29,30,32]. In a landmark randomized controlled trial, Lester et al conducted a mHealth intervention (WelTel Kenya1) whereby providing a bidirectional, weekly text-messaging intervention for one year significantly improved cART adherence and VL suppression compared with controls in an HIV-positive Kenyan population initiating cART [16]. Several other SMS text-message interventions have been developed and implemented in HIV care with promising results; however, WelTel remains the approach validated in the largest setting to date [33-35]. In addition, reviews and a meta-analysis have assessed available evidence to confirm that SMS text-message interventions can improve parameters of HIV care, especially cART adherence [17,36-38]. Despite this emerging evidence, there remains a lack of focus on vulnerable populations less likely to access care and a paucity of data focused on female populations [39-42]. Our goal in this study was to assess whether the standardized WelTel intervention applied to a vulnerable, predominantly female population improved cART adherence and VL.
Methods
Study Participants
Participants were enrolled in a repeated measures cohort study between April 2013 and May 2014 with the 12 months prior to initiation of the study used retrospectively as the control year. Participants were recruited from the Oak Tree Clinic in Vancouver, BC, Canada, which is a provincial referral center for women and families living with HIV throughout British Columbia, many of whom face multiple barriers to engagement in care. The clinic offers an interdisciplinary care team consisting of physicians, nurses, pharmacists, social workers, dieticians, and counselors addressing the holistic health needs of women and their families in a single care setting.
As outlined in Figure 1, 413 individuals were assessed for eligibility, 129 were eligible, and 85 enrolled in the study. Five participants dropped out of the study early on and were not included in the final analysis. HIV-positive patients were eligible for study participation if they met the following inclusion criteria: attendance at the clinic for at least one year prior to study entry, an indication for cART (at time of study development, CD4 <500 cells/mm3), detectable VL (≥200 copies/mL) in the year prior to study entry (control year), age 14 years or older, and high risk for disengagement in treatment according to a list of predetermined criteria. High-risk individuals were identified based on care team consensus that at least one of the following vulnerability criteria were present: intimate partner violence, unstable housing, advanced HIV infection/AIDS, mental health illness, cART nonadherence, difficult to contact, poor appointment attendance, active substance use, long distance from care, or recent incarceration. All candidates were reviewed by the multidisciplinary care team that decided on applicable vulnerabilities by manner of consensus. We excluded those who did not meet the preceding criteria or lived in an area with no cell phone service. Those who were unable to communicate by text messaging due to language barriers, illiteracy, or physical disabilities preventing use were also excluded. For those participants aged 14 to 18 years, parental consent for enrollment in the study was not obtained in an effort to protect confidentiality and promote safety in this marginalized cohort.
Prospective participants were introduced to the WelTel intervention during a routine clinical visit and provided written informed consent if interested in the study. Participants were given a basic cell phone with unlimited text-messaging capability if they did not have one. For those patients that did own a phone with a text-messaging plan, no payment incentive was provided. However, if an individual required a phone or phone plan at a later time, they were provided with one. When required, participants received instruction on how to use text messaging for communication. In addition to the intervention, participants continued to receive their regular care through the interdisciplinary team. In British Columbia, cART is fully funded for HIV-positive patients through the Provincial Antiretroviral Drug Treatment program and was prescribed according to published therapeutic guidelines by the BC Centre for Excellence in HIV/AIDS [43]. The study protocol was approved by the University of British Columbia Research Ethics Board (H12-03002) and registered as a clinical trial (NCT02603536).
Intervention
The SMS text-message intervention was modeled after the WelTelKenya1 study with participant-driven modifications according to a qualitative assessment conducted with patient participants and health care providers at the clinic prior to study start [16,18,44]. The WelTel model was selected because it has been validated in the largest setting to date and contains many features (ie, weekly, short, bidirectional messages) that have been subsequently shown to be effective SMS text-message strategies [16,34]. For one year, the text message “How are you?” was sent to all participants every Monday at noon from the automated WelTel platform through a number not traceable to the clinic. Participants were instructed to respond “OK” or “not OK,” and those responding “not OK” received a follow-up call by a study nurse within approximately 24 hours. If no response was received from the initial SMS text message, a second text message was sent on Wednesday stating, “Haven’t heard from you yet, how are you?” If there was still no response, this was followed by a call on Thursday by study nurses. Participants were instructed that the intervention was not an emergency service and were provided with a written reminder of the current practices for after-hours concerns and emergencies. This open-ended check-in approach was specifically designed to preserve confidentiality and provide a personal connection to clinic staff to triage all problem types. For confidentiality reasons, health care providers did not text information relating to HIV status unless asked explicitly to do so by the participant. Participants who lost their own phone or the study phone were offered a replacement on a one-time basis. Participants were allowed to reinitiate the study at any time simply by providing the team with the new phone number.
Measuring Outcomes
The primary outcome of the study was change in VL from control year (mean VL over one year prior to study entry) to final VL at study end. Secondary outcomes included change in cART adherence, CD4 count, and appointment attendance following the WelTel intervention. Parameters anticipated to respond after a lag time (VL and CD4) were compared using a mean of all measurements in the control year to final values at the study end, whereas those expected to have rapid response to the intervention (cART adherence and appointment attendance) were assessed by comparing means of control and intervention years in their entirety. To estimate the number of cART doses taken, self-reported adherence was collected at each medical visit with appointments arranged at 1- to 4-month intervals according to health status. At each visit, the patient was asked to estimate the number of ingested doses and missed doses since the past visit. Self-reported adherence was then compared to pharmacy refill records, always favoring the lowest estimate of doses taken. Finally, adherence was then calculated as the percentage of estimated doses taken from the total number of doses prescribed in the year. Appointment attendance data was gathered from the electronic booking system for the clinic.
Data were collected for one year prior to texting start date and for the duration of the study such that each participant served as their own control in the intervention. Participant self-reported ethnicity and vulnerability data were collected at time of enrollment. Chart review was used to collect the following: age, housing status, substance use, geographic location, CD4 count and percentage, VL, cART regimen (including dates of initiation or discontinuation), emergency department visits, hospital admissions, self-reported medication adherence, pharmacy refill data, and clinic appointment attendance. All text-messaging responses, follow-up calls, and team member referrals were tracked and nature of the problem noted.
Statistical Analysis
A sample size of 100 was initially targeted based on pilot study values of the primary outcome (VL) to allow for statistical assessment with a power of 80% and significance level of .05. To assess changes in VL and CD4, we computed the geometric mean (log10-transformed for VL) from raw data of all laboratory results from the control year for each participant. These means were then compared to the final VL or CD4 from the intervention year using nonparametric Wilcoxon signed ranks tests for paired data. Odds ratios for cART adherence and clinic attendance were analyzed based on binomial “yes/no” responses for each event with several events for each participant and then calculated by logistic regression. For each participant, the number of possible appointments and doses was tallied within each year, and the proportion of those that were attended/taken was compared between years using mixed-effect logistic regressions to control for paired measurements for each participant. Given the bidirectional nature of the text-messaging intervention, participants and care providers were not blinded throughout. In addition, outcomes were assessed according to the pre/post intervention study design rather than blinded.
To facilitate a comparison between those patients regularly using mHealth technology versus those not actively using it, we analyzed variation in the number of responses to the text messages. All participants should have received 52 messages making the number of responses a useful proxy of engagement. We used bivariate negative binomial regression to analyze the number of responses by age, gender, ethnicity, income, long-distance telephone, distance traveled to clinic (≤50km, >50km), any substance use (not including smoking), and mean log10 VL during control year. We estimated the effect of response rate on the outcome by modeling final log10 VL by number of responses while controlling for mean log10 VL in the control year using a general linear model.
Results
Cohort Characteristics
Between April 2013 and May 2014, 85 participants were enrolled in the study. Although an initial target of 100 patients was selected based on statistical analysis, there were limitations in eligible clinic patients for enrollment. As such, study size was reanalyzed and determined to have sufficient power with a modified goal of 85 participants. Five participants withdrew from the study. Baseline demographics of the remaining participants are outlined in Table 1. The population was predominantly female (90%, 72/80) with a median age of 38 (IQR 29-47, range 15-61) years. Six (8%, 6/80) participants were younger than 18 years and received pediatric care at the clinic. The majority of the cohort had multiple vulnerabilities (76%, 62/80) of which cART nonadherence (54%, 44/80), mental health illness (48%, 39/80), active substance use (28%, 23/80), and unstable housing (28%,14/80) were the most common (Table 1). Almost half of participants did not own a cell phone at the time of enrollment (46%, 37/80). Geographic distance varied widely; however, the majority of participants lived within 50 km of the clinic. Final recorded VL measurements were taken a median of 314 days (IQR 269-348) after initiation of text messaging.
Table 1.
Demographics | Participants | ||
Gender, n (%) | |||
Female | 72 (90) | ||
Male | 6 (8) | ||
Transgender | 2 (3) | ||
Age (years), median (range) | 38 (15-61) | ||
Ethnicity, n (%) | |||
Caucasian | 30 (38) | ||
First Nations | 27 (34) | ||
African Canadian | 18 (22) | ||
South Asian | 5 (6) | ||
Income source, n (%) | |||
Disability | 57 (71) | ||
Welfare | 6 (8) | ||
Employed | 4 (5) | ||
Other | 13 (16) | ||
Housing status, n (%) | |||
Stable housing | 57 (71) | ||
Unstable housing | 23 (29) | ||
Unsheltered | 1 (1) | ||
Emergency sheltered | 9 (11) | ||
Provisionally sheltered | 13 (16) | ||
Vulnerability,an (%) | |||
Multiple (≥2) vulnerabilities | 62 (76) | ||
Intimate partner violence | 4 (5) | ||
Unstable housing | 23 (28) | ||
Advanced HIVb | 22 (27) | ||
Mental health illness | 39 (48) | ||
cART nonadherence | 44 (54) | ||
Difficult to contact | 12 (15) | ||
Poor appointment attendance | 22 (27) | ||
Substance use | 22 (28) | ||
Long distance from care | 6 (7) | ||
Recent incarceration | 4 (5) | ||
Cell phone ownership, n (%) | |||
Yes | 43 (54) | ||
No | 37 (46) | ||
Geographic distance (km),c median (IQR, max) | 29.6 (7.75-44.9, 1500) |
a Vulnerabilities were expressed as percentage of population. Because multiple vulnerabilities were allowed for each individual, combined percentages will exceed 100%.
b Advanced HIV was defined by CD4 count ≤200 cells/mm3.
c Geographic distance was calculated as the distance (in km) from the Oak Tree Clinic.
Intervention Efficacy
Viral load, the primary outcome, significantly decreased from control year to study end (P=.004; Table 2 and Figure 2). Overall, geometric mean VL decreased from mean 1098 (95% CI 647-1866) copies/mL in the control year to mean 439 (95% CI 217-888) copies/mL at intervention end (log10 VL 3.04-2.64; Cohen’s d=0.33, 95% CI 0.02-0.65), with 38 of 80 participants having undetectable VL at study end. In contrast, CD4 did not significantly change postintervention (Table 2 and Figure 3). Of the secondary outcomes, cART adherence significantly improved from control year to intervention year with the odds of adherence increasing by 14% during the WelTel intervention (OR 1.14, IQR 1.10-1.18, P<.001; Table 2). Finally, there was a 19% reduction in the odds of attending clinic appointments in the intervention year (OR 0.81, IQR 0.67-0.99, P=.03). Other variables, including CD4 count, substance use, cART regimen, and hospital admissions, did not significantly change postintervention (Table 2).
Table 2.
Outcomes and health measures | Control year | Intervention year | P | ||
Primary outcome | |||||
Geometric mean VL (copies/mL), mean (95% CI) | 1098 (647-1866) | 439 (217-888) | .004 | ||
Secondary outcomes | |||||
CD4 (cells/mm3),a median (IQR) | 370 (166-550) | 320 (190-600) | .24 | ||
Attendance (%), mean (95% CI) | |||||
Clinic appointments | 52 (48-55) | 47 (43-50) | .03 | ||
All appointments | 51 (48-55) | 48 (45-51) | .12 | ||
cART adherence | 60.3 (59.8-60.8) | 62.2 (61.6-62.7) | <.001 | ||
Other health measures | |||||
Substance use, n (%) | |||||
Heroin | 9 (11) | 6 (8) | .45 | ||
Crack/cocaine/crystal meth | 15 (19) | 14 (19) | >.99 | ||
Polysubstance useb | 13 (16) | 13 (17) | >.99 | ||
Methadone | 17 (21) | 17 (21) | .68 | ||
cART regimen,cn (%) | |||||
Protease inhibitor-based | 49 (61) | 39 (48) | .29 | ||
Nonnucleoside reverse transcriptase inhibitor-based | 10 (12) | 7 (9) | .47 | ||
Integrase-based | 10 (12) | 17 (21) | .18 | ||
Combination | 7 (9) | 11 (14) | .45 | ||
None | 4 (5) | 6 (7) | .53 | ||
Hospital staysd | |||||
Total visits to ED for cohort, n, individual median (range) | 62, 0 (0-11) | 77, 0 (0-17) | .30 | ||
Total admissions to hospital, n, individual median (range) | 20, 0 (0-2) | 28, 0 (0-5) | .23 | ||
Days of hospital stay/admission individual median (IQR) | 11.7 (5-11.5) | 9.6 (1.8-15.3) | .63 |
a Viral load and CD4 counts for intervention year were calculated based on study end data: geometric mean (95% CI) for VL and median (IQR) for CD4.
b Polysubstance use was defined as use of more than one of the following substances: alcohol, heroin, crack/cocaine, and methamphetamine.
c The reported cART regimen is the treatment combination used for the majority of study days in the control and intervention periods.
d Visits to the emergency department (ED) and hospital admissions were compared using Wilcoxon rank sum tests.
Intervention Responses
Of the 3674 text messages sent to the 80 remaining participants over the study period, 46.57% (1753/3764) of messages sent resulted in an initial “OK” reply, whereas 9.85% (362/3674) resulted in a reply of a “problem” and 42.43% (1559/3674) returned no reply. Although 362 “problem” replies were received in response to the Monday text message, an additional 203 “problem” replies were received later in the week, either as a second “problem” or as a new problem after an initial “OK” response. All “problem” replies were triaged by the study nurse. A total of 267 such problems were then referred to another health care team member as outlined in Figure 4. Physicians, nurse practitioners, and pharmacists were most commonly consulted to address a variety of issues that included medical advice, cART prescription refill orders, medication side effects, and medication pick-ups. Fifty participants were provided with a mobile phone at the beginning of the study, whereas 31 individuals lost a phone and required replacement. Response rates to weekly text messages initially started as high as 68% (54/80), but leveled off by the sixth week to an ongoing rate of approximately 45% (36/80) that remained constant to study end (Figure 5). On average, a fairly constant rate of 10% (8/80) of individuals reported “problems” each week.
Individual response rates varied greatly among participants (0%-98%) with a mean of 50% (26/52 responses). Based on these findings, an exploratory subgroup analysis was undertaken to compare demographic characteristics and VL by the number of replies to the text messages. There was no significant difference in the reply rate by any of the demographic or clinical characteristics explored (Table 3).
Table 3.
Outcome Variable | n | Incident rate ratio (95% CI) | P | |
Gendera | ||||
Male | 6 | Reference | ||
Female | 72 | 1.00 (0.45-1.94) | .99 | |
Age (years) | 80 | 1.00 (0.99-1.02) | .91 | |
Ethnicity | ||||
Caucasian | 30 | Reference | ||
First Nations | 27 | 1.32 (0.84-2.07) | ||
African Canadian | 18 | 1.28 (0.78-2.14) | ||
South Asian | 5 | 1.50 (0.71-3.68) | .56 | |
Income source | ||||
Disability | 57 | Reference | ||
Other | 23 | 1.18 (0.78-1.81) | .44 | |
Long-distance call | ||||
Yes | 15 | Reference | ||
No | 64 | 0.82 (0.49-1.31) | .42 | |
Geographic distance | ||||
≤50 km | 58 | Reference | ||
>50 km | 20 | 0.85 (0.56-1.32) | .47 | |
Substance use | ||||
None | 28 | Reference | ||
Alcohol or illicit drug use | 47 | 0.75 (0.50-1.11) | .15 | |
Mean control year log10 VL | 80 | 0.94 (0.78-1.14) | .54 |
a The two transgender participants were excluded from this comparison.
An outcome analysis of final log10 VL by number of replies revealed a trend for a relationship between decreasing VL by increasing reply rate controlling for mean log10 VL in the control year (P=.07; Figure 6), suggesting that the magnitude of the change in VL during the intervention year was larger for those who were more engaged. The model estimates that for every increase in one reply, the geometric mean VL is reduced by approximately 3% (95% CI 0%-7%).
Discussion
This study showed that a cohort of difficult-to-engage, vulnerable individuals living with HIV showed evidence of improved measures of HIV care (VL, cART adherence) when exposed to a weekly bidirectional text-messaging intervention. The study is unique in that participants were provided with mobile phones, allowing for increased engagement of marginalized populations that would otherwise be difficult to access. This intervention could potentially bring substantial health benefits to vulnerable populations in an era in which HIV care is largely limited by medication adherence.
The population demographic was a marginalized, predominantly female cohort with markers of poor HIV engagement. Participants came from a diversity of backgrounds and exhibited the wide range of vulnerabilities and barriers to care that could be encountered in any typical North American urban setting (Table 1; [24,40,45-48]). Vulnerabilities common in our population, including mental illness (48%), active substance use (28%), and unstable housing (17%), have been previously associated with poor cART adherence [24,45-50]. Cell phone ownership in this cohort was lower than average among Canadians (54% vs 82%), further confirming the inaccessible nature of this vulnerable study group [51,52]. By including a majority of women, we propose an adherence strategy applicable for the growing proportion of women living with HIV, a subpopulation that has been minimally studied and has characteristically poor cART adherence [13-15].
Our study demonstrated that effective introduction of the WelTel intervention decreased VL within our cohort. VL in our population was initially 1098 copies/mL, more than double the estimated mean of less than 500 copies/mL in British Columbia [53]. This dropped significantly following introduction of the WelTel intervention to a level that was on par with the provincial average by study end (439 copies/mL, P=.004; Table 2). Effective cART therapy is known to reduce viral replication [2]. Therefore, the observed VL reduction is likely a consequence of increased cART adherence (OR 1.14, IQR 1.10-1.18, P<.001) and minimizing treatment interruption during the WelTel intervention; we expect this relates to prompt recognition of problems and close connection with care. Due to the nature of studying a high-risk group, there is a risk of exaggerating treatment effects due to anticipated regression to the mean. However, additional analysis suggested that those who regularly used the service (ie, repliers) trended toward greater benefit to VL (Figure 4; P=.07). This argues that the improved parameters of HIV care may be due to exposure to the WelTel intervention rather than regression to the mean.
WelTel likely mitigated common barriers to cART adherence by (1) serving as a user-friendly, patient-directed connection tool with the care team, (2) connecting patients in an ongoing fashion with a support network to reduce the effects of isolation and stigma, and (3) aiding health care providers in identifying and resolving problems (both medical and related to the social determinants of health) as they arose, thereby preventing crises. Although the odds of adhering to cART was significantly improved during the intervention (OR 1.14, IQR 1.10-1.18, P<.001), the rate of adherence showed only modest improvement (60.3% vs 62.2%, Table 2). We expect that this difference appears small for a variety of reasons, including inaccuracies in self-reported adherence, failure to report treatment interruption, and a large variance in adherence rates. The strategy of early recognition and mitigation of problems has been shown to prevent treatment interruption in other settings as well, such as directly observed treatment of tuberculosis [54]. WelTel appears to improve patient-provider relationships by opening a channel of communication through which both medical concerns and those related to the social determinants of health may be addressed [18,44]. We expect that as these relationships improve and so, in turn, will medication adherence and eventually VL. Taken together, these results suggest that WelTel may be an effective patient-oriented tool to support and improve care in vulnerable HIV-positive populations.
The secondary outcome showing decreased clinic appointment attendance during our intervention year was an unexpected finding (Table 2). In other studies, participant fatigue has occurred with frequent or lengthy messaging interventions [34]. However, our observed consistency in texting response rates suggests that user fatigue does not explain our lower clinic attendance (Figure 3). Instead, we postulate that WelTel addressed common problems that would otherwise be resolved at clinic appointments to the point where participants had a decreased need for clinical appointments [18,29]. Despite having lower clinic attendance after the WelTel intervention, several other markers of health status, such as VL, emergency visits, and hospitalization rates, were the same or improved with the text-messaging intervention (Table 2). A previous hypertension study found that using two-way SMS text-message feedback and telephone consultation as a guide to plan ambulatory care management allowed for improved blood pressure management [55]. This raises the possibility that an effective two-way text-message intervention could be used to help guide HIV ambulatory follow-up frequency, in some cases safely decreasing appointment frequency. Finally, the text-messaging platform could be used to send reminders for upcoming appointments, a technique that has successfully improved clinic attendance in similar studies [34,39,56].
The text-messaging response rate was consistent throughout the study without any tapering trend (Figure 3). Previous studies involving patient participant feedback examined the optimal length and frequency of text messaging and found the best approach to maximize responses was a short weekly SMS text message, as opposed to daily texts or longer messaging interventions [33,34,39]. Our study supports this messaging strategy by showing consistent response rates after a full year of weekly text messages. The consistency in response rates that we observed also suggests that participants continue to make use of the intervention after one year, highlighting its feasibility in promoting long-term patient engagement. Previous studies have shown that mHealth interventions continue to have effect up to 18 months after introduction, but the optimal duration beyond this has not yet been studied nor have we seen whether there is a lasting effect if the intervention is withdrawn [16]. As WelTel moves toward broadening its application, future studies investigating the optimal duration of text-messaging interventions and the durability of its effect would help to guide implementation of this tool. Finally, through our analysis of participant engagement, we observed that some of those participants most poised to benefit from the intervention (ie, less adherent with cART) had poor uptake of the intervention in general. This may be because certain characteristics that result in poor adherence in HIV care also contribute to poor engagement with our intervention. Moving forward, it would be of interest to further delineate participant characteristics to anticipate who may maximally benefit from the intervention and for whom the resources will not be effectively allocated.
This study is a repeated measures study rather than a randomized controlled trial; therefore, we are only able to infer association not causation. WelTel had strong evidence of benefit in previous studies and, as such, our study was designed as a cohort study to offer maximal resources to all individuals in a high-risk population rather than random allocation [16-18]. Our study is limited by its sample size, predominantly female composition, and high-risk population studied, and it is therefore not generalizable to all populations. Medication adherence, one of our secondary outcomes, is a notoriously difficult parameter to study and patient self-reports are susceptible to recall bias and reporting inaccuracies. To mitigate this, we included pharmacy refill data in our assessment of number of doses taken, with the lower value being recorded as the correct one. Despite this, our method may still overestimate the number of pills actually ingested. Another limitation was that a large proportion of our cohort (47%) received a cell phone from us during the study, and we cannot control for all effects of cell phone ownership alone. Owning a mobile phone may impact several social determinants of health by impacting relationships, mobility, mental health, and self-perception [57,58]. Changes in these parameters may have gone on to positively influence outcomes associated with HIV care. Finally, multiple factors contribute to a patient’s engagement in care, decision to initiate cART, and readiness to adhere to medication. Complex issues such as mental health and substance use cannot be solved by text messaging alone. However, it is our hope that this technology may act as a facilitator to establish a meaningful connection to care so that our most vulnerable patients may be better able to utilize and engage in the services available to them.
This study found that a simple and easily implemented mHealth intervention may significantly improve HIV care in vulnerable populations, a finding that holds great potential for real world application. Moving forward, further identification of subgroups poised to benefit most from WelTel will be important, particularly if the intervention includes the provision of a cell phone and phone plan. Finally, a cost analysis would shed light on the feasibility of introducing WelTel in a larger scale to targeted populations. We anticipate that the cost of the intervention would be mitigated by the cost-savings benefit of reduced HIV transmission and decreased use of health care resources associated with effective HIV care [2,59]. Taken as a whole, this study is pivotal in proposing an adherence strategy for at-risk HIV populations that we hope can be applied in a broad clinical context.
Acknowledgments
We would like to thank Gilead Sciences and Telus Mobility for their support of this study. The study was funded through a competitive grant competition through Gilead Sciences. Telus Mobility provided in-kind support in the form of technical support and cellular phone minutes for this study.
Abbreviations
- AIDS
acquired immune deficiency syndrome
- cART
combination antiretroviral therapy
- HIV
human immunodeficiency virus
- SMS
short message service
- VL
viral load
Consort E-Health Form.
Footnotes
Conflicts of Interest: Dr Richard Lester is the founder of WelTel, the text-messaging platform used in this study. The technology platform was developed by a nonprofit organization, WelTel mHealth Society, and a private company, WelTel Incorporated. Dr Richard Lester has financial as well as professional interests in both organizations. All other authors declare no conflict of interest.
References
- 1.Public Health Agency of Canada . Summary: Estimates of HIV Incidence, Prevalence and Prorportion Undiagnosed in Canada, 2014. Ottawa, ON: Public Health Agency of Canada; 2015. Nov, [2017-02-26]. http://www.catie.ca/sites/default/files/2014-HIV-Estimates-in-Canada-EN.pdf . [Google Scholar]
- 2.Montaner JS, Hogg R, Wood E, Kerr T, Tyndall M, Levy AR, Harrigan PR. The case for expanding access to highly active antiretroviral therapy to curb the growth of the HIV epidemic. Lancet. 2006 Aug 5;368(9534):531–536. doi: 10.1016/S0140-6736(06)69162-9. [DOI] [PubMed] [Google Scholar]
- 3.Cohen MS, Chen YQ, McCauley M, Gamble T, Hosseinipour MC, Kumarasamy N, Hakim JG, Kumwenda J, Grinsztejn B, Pilotto JH, Godbole SV, Mehendale S, Chariyalertsak S, Santos BR, Mayer KH, Hoffman IF, Eshleman SH, Piwowar-Manning E, Wang L, Makhema J, Mills LA, de Bruyn G, Sanne I, Eron J, Gallant J, Havlir D, Swindells S, Ribaudo H, Elharrar V, Burns D, Taha TE, Nielsen-Saines K, Celentano D, Essex M, Fleming TR, HPTN 052 Study Team Prevention of HIV-1 infection with early antiretroviral therapy. N Engl J Med. 2011 Aug 11;365(6):493–505. doi: 10.1056/NEJMoa1105243. http://europepmc.org/abstract/MED/21767103. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Dube S, Boily M, Mugurungi O, Mahomva A, Chikhata F, Gregson S. Estimating vertically acquired HIV infections and the impact of the prevention of mother-to-child transmission program in Zimbabwe: insights from decision analysis models. J Acquir Immune Defic Syndr. 2008 May 1;48(1):72–81. doi: 10.1097/QAI.0b013e31816bcdbb. [DOI] [PubMed] [Google Scholar]
- 5.Bangsberg DR, Perry S, Charlebois ED, Clark RA, Roberston M, Zolopa AR, Moss A. Non-adherence to highly active antiretroviral therapy predicts progression to AIDS. AIDS. 2001 Jun 15;15(9):1181–1183. doi: 10.1097/00002030-200106150-00015. [DOI] [PubMed] [Google Scholar]
- 6.Wilson DP, Law MG, Grulich AE, Cooper DA, Kaldor JM. Relation between HIV viral load and infectiousness: a model-based analysis. Lancet. 2008 Jul 26;372(9635):314–320. doi: 10.1016/S0140-6736(08)61115-0. [DOI] [PubMed] [Google Scholar]
- 7.Lima VD, Johnston K, Hogg RS, Levy AR, Harrigan PR, Anema A, Montaner JS. Expanded access to highly active antiretroviral therapy: a potentially powerful strategy to curb the growth of the HIV epidemic. J Infect Dis. 2008 Jul 1;198(1):59–67. doi: 10.1086/588673. http://www.jid.oxfordjournals.org/cgi/pmidlookup?view=long&pmid=18498241. [DOI] [PubMed] [Google Scholar]
- 8.Hu YW, Kinsler JJ, Sheng Z, Kang T, Bingham T, Frye DM. Using laboratory surveillance data to estimate engagement in care among persons living with HIV in Los Angeles County, 2009. AIDS Patient Care STDS. 2012 Aug;26(8):471–478. doi: 10.1089/apc.2011.0371. [DOI] [PubMed] [Google Scholar]
- 9.Mugavero MJ, Amico KR, Horn T, Thompson MA. The state of engagement in HIV care in the United States: from cascade to continuum to control. Clin Infect Dis. 2013 Oct;57(8):1164–1171. doi: 10.1093/cid/cit420. http://www.cid.oxfordjournals.org/cgi/pmidlookup?view=long&pmid=23797289. [DOI] [PubMed] [Google Scholar]
- 10.Yehia BR, Stephens-Shields AJ, Fleishman JA, Berry SA, Agwu AL, Metlay JP, Moore RD, Christopher MW, Nijhawan A, Rutstein R, Gaur AH, Gebo KA. The HIV care continuum: changes over time in retention in care and viral suppression. PLoS One. 2015;10(6):e0129376. doi: 10.1371/journal.pone.0129376. http://dx.plos.org/10.1371/journal.pone.0129376. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Skarbinski J, Rosenberg E, Paz-Bailey G, Hall HI, Rose CE, Viall AH, Fagan JL, Lansky A, Mermin JH. Human immunodeficiency virus transmission at each step of the care continuum in the United States. JAMA Intern Med. 2015 Apr;175(4):588–596. doi: 10.1001/jamainternmed.2014.8180. [DOI] [PubMed] [Google Scholar]
- 12.British Columbia Centre for Excellence in HIV/AIDS . HIV Monitoring Quarterly Report for British Columbia: First Quarter 2016. Vancouver, BC: British Columbia Centre for Excellence in HIV/AIDS; 2016. http://www.cfenet.ubc.ca/sites/default/files/uploads/publications/centredocs/bc_monitoring_report_16q1_final_may20.pdf . [Google Scholar]
- 13.Tapp C, Milloy M, Kerr T, Zhang R, Guillemi S, Hogg RS, Montaner J, Wood E. Female gender predicts lower access and adherence to antiretroviral therapy in a setting of free healthcare. BMC Infect Dis. 2011;11:86. doi: 10.1186/1471-2334-11-86. http://bmcinfectdis.biomedcentral.com/articles/10.1186/1471-2334-11-86. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Emery J, Pick N, Mills EJ, Cooper CL. Gender differences in clinical, immunological, and virological outcomes in highly active antiretroviral-treated HIV-HCV coinfected patients. Patient Prefer Adherence. 2010;4:97–103. doi: 10.2147/ppa.s9949. http://www.dovepress.com/articles.php?article_id=4376. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Sordo del Castillo L, Ruiz-Pérez I, Olry de Labry LA. Biological, psychosocial, therapeutic and quality of life inequalities between HIV-positive men and women - a review from a gender perspective. AIDS Rev. 2010;12(2):113–120. [PubMed] [Google Scholar]
- 16.Lester RT, Ritvo P, Mills EJ, Kariri A, Karanja S, Chung MH, Jack W, Habyarimana J, Sadatsafavi M, Najafzadeh M, Marra CA, Estambale B, Ngugi E, Ball TB, Thabane L, Gelmon LJ, Kimani J, Ackers M, Plummer FA. Effects of a mobile phone short message service on antiretroviral treatment adherence in Kenya (WelTel Kenya1): a randomised trial. Lancet. 2010 Nov 27;376(9755):1838–1845. doi: 10.1016/S0140-6736(10)61997-6. [DOI] [PubMed] [Google Scholar]
- 17.Horvath T, Azman H, Kennedy GE, Rutherford GW. Mobile phone text messaging for promoting adherence to antiretroviral therapy in patients with HIV infection. Cochrane Database Syst Rev. 2012;3:CD009756. doi: 10.1002/14651858.CD009756. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Smillie K, Van BN, Abaki J, Pick N, Maan EJ, Friesen K, Graham R, Levine S, van der Kop ML, Lester RT, Murray M. A qualitative study investigating the use of a mobile phone short message service designed to improve HIV adherence and retention in care in Canada (WelTel BC1) J Assoc Nurses AIDS Care. 2014;25(6):614–625. doi: 10.1016/j.jana.2014.01.008. http://linkinghub.elsevier.com/retrieve/pii/S1055-3290(14)00040-5. [DOI] [PubMed] [Google Scholar]
- 19.Jewkes RK, Dunkle K, Nduna M, Shai N. Intimate partner violence, relationship power inequity, and incidence of HIV infection in young women in South Africa: a cohort study. Lancet. 2010 Jul 03;376(9734):41–48. doi: 10.1016/S0140-6736(10)60548-X. https://linkinghub.elsevier.com/retrieve/pii/S0140-6736(10)60548-X. [DOI] [PubMed] [Google Scholar]
- 20.Springer SA, Pesanti E, Hodges J, Macura T, Doros G, Altice FL. Effectiveness of antiretroviral therapy among HIV-infected prisoners: reincarceration and the lack of sustained benefit after release to the community. Clin Infect Dis. 2004 Jun 15;38(12):1754–1760. doi: 10.1086/421392. [DOI] [PubMed] [Google Scholar]
- 21.Aidala AA, Wilson MG, Shubert V, Gogolishvili D, Globerman J, Rueda S, Bozack AK, Caban M, Rourke SB. Housing status, medical care, and health outcomes among people living with HIV/AIDS: a systematic review. Am J Public Health. 2016 Jan;106(1):e1–e23. doi: 10.2105/AJPH.2015.302905. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Villes V, Spire B, Lewden C, Perronne C, Besnier J, Garré M, Chêne G, Leport C, Carrieri MP, Le Moings V, ANRS CO-8 APROCO-COPILOTE Study Group The effect of depressive symptoms at ART initiation on HIV clinical progression and mortality: implications in clinical practice. Antivir Ther. 2007;12(7):1067–1074. [PubMed] [Google Scholar]
- 23.Sin NL, DiMatteo MR. Depression treatment enhances adherence to antiretroviral therapy: a meta-analysis. Ann Behav Med. 2014 Jun;47(3):259–269. doi: 10.1007/s12160-013-9559-6. http://europepmc.org/abstract/MED/24234601. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.Giordano TP, Visnegarwala F, White AC, Troisi CL, Frankowski RF, Hartman CM, Grimes RM. Patients referred to an urban HIV clinic frequently fail to establish care: factors predicting failure. AIDS Care. 2005 Aug;17(6):773–783. doi: 10.1080/09540120412331336652. [DOI] [PubMed] [Google Scholar]
- 25.Malta M, Magnanini MM, Strathdee SA, Bastos FI. Adherence to antiretroviral therapy among HIV-infected drug users: a meta-analysis. AIDS Behav. 2010 Aug;14(4):731–747. doi: 10.1007/s10461-008-9489-7. [DOI] [PubMed] [Google Scholar]
- 26.Purcell DW, Latka MH, Metsch LR, Latkin CA, Gómez CA, Mizuno Y, Arnsten JH, Wilkinson JD, Knight KR, Knowlton AR, Santibanez S, Tobin KE, Rose CD, Valverde EE, Gourevitch MN, Eldred L, Borkowf CB. Results from a randomized controlled trial of a peer-mentoring intervention to reduce HIV transmission and increase access to care and adherence to HIV medications among HIV-seropositive injection drug users. J Acquir Immune Defic Syndr. 2007 Nov 1;46 Suppl 2:S35–S47. doi: 10.1097/QAI.0b013e31815767c4. [DOI] [PubMed] [Google Scholar]
- 27.Arnsten JH, Li X, Mizuno Y, Knowlton AR, Gourevitch MN, Handley K, Knight KR, Metsch LR. Factors associated with antiretroviral therapy adherence and medication errors among HIV-infected injection drug users. J Acquir Immune Defic Syndr. 2007 Nov 1;46 Suppl 2:S64–S71. doi: 10.1097/QAI.0b013e31815767d6. [DOI] [PubMed] [Google Scholar]
- 28.Jones TS, Vlahov D. What we can learn from the INSPIRE Study about improving prevention and clinical care for injection drug users living with HIV. J Acquir Immune Defic Syndr. 2007 Nov 1;46 Suppl 2:S31–S34. doi: 10.1097/QAI.0b013e318157892d. [DOI] [PubMed] [Google Scholar]
- 29.Lester R, Karanja S. Mobile phones: exceptional tools for HIV/AIDS, health, and crisis management. Lancet Infect Dis. 2008 Dec;8(12):738–739. doi: 10.1016/S1473-3099(08)70265-2. [DOI] [PubMed] [Google Scholar]
- 30.Wei J, Hollin I, Kachnowski S. A review of the use of mobile phone text messaging in clinical and healthy behaviour interventions. J Telemed Telecare. 2011;17(1):41–48. doi: 10.1258/jtt.2010.100322. [DOI] [PubMed] [Google Scholar]
- 31.Kang H, Park H. A mobile app for hypertension management based on clinical practice guidelines: development and deployment. JMIR Mhealth Uhealth. 2016 Feb 02;4(1):e12. doi: 10.2196/mhealth.4966. http://mhealth.jmir.org/2016/1/e12/ [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32.Buis L, Hirzel L, Dawood RM, Dawood KL, Nichols LP, Artinian NT, Schwiebert L, Yarandi HN, Roberson DN, Plegue MA, Mango LC, Levy PD. Text messaging to improve hypertension medication adherence in african americans from primary care and emergency department settings: results from two randomized feasibility studies. JMIR Mhealth Uhealth. 2017 Feb 01;5(2):e9. doi: 10.2196/mhealth.6630. http://mhealth.jmir.org/2017/2/e9/ [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33.Mbuagbaw L, van der Kop ML, Lester RT, Thirumurthy H, Pop-Eleches C, Ye C, Smieja M, Dolovich L, Mills EJ, Thabane L. Mobile phone text messages for improving adherence to antiretroviral therapy (ART): an individual patient data meta-analysis of randomised trials. BMJ Open. 2013;3(12):e003950. doi: 10.1136/bmjopen-2013-003950. http://bmjopen.bmj.com/cgi/pmidlookup?view=long&pmid=24345901. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34.Pop-Eleches C, Thirumurthy H, Habyarimana JP, Zivin JG, Goldstein MP, de Walque D, MacKeen L, Haberer J, Kimaiyo S, Sidle J, Ngare D, Bangsberg DR. Mobile phone technologies improve adherence to antiretroviral treatment in a resource-limited setting: a randomized controlled trial of text message reminders. AIDS. 2011 Mar 27;25(6):825–834. doi: 10.1097/QAD.0b013e32834380c1. http://europepmc.org/abstract/MED/21252632. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 35.Simoni JM, Huh D, Frick PA, Pearson CR, Andrasik MP, Dunbar PJ, Hooton TM. Peer support and pager messaging to promote antiretroviral modifying therapy in Seattle: a randomized controlled trial. J Acquir Immune Defic Syndr. 2009 Dec 1;52(4):465–473. doi: 10.1097/qai.0b013e3181b9300c. http://europepmc.org/abstract/MED/19911481. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 36.Finitsis DJ, Pellowski JA, Johnson BT. Text message intervention designs to promote adherence to antiretroviral therapy (ART): a meta-analysis of randomized controlled trials. PLoS One. 2014;9(2):e88166. doi: 10.1371/journal.pone.0088166. http://dx.plos.org/10.1371/journal.pone.0088166. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37.van Velthoven MH, Brusamento S, Majeed A, Car J. Scope and effectiveness of mobile phone messaging for HIV/AIDS care: a systematic review. Psychol Health Med. 2013;18(2):182–202. doi: 10.1080/13548506.2012.701310. [DOI] [PubMed] [Google Scholar]
- 38.Hall AK, Cole-Lewis H, Bernhardt JM. Mobile text messaging for health: a systematic review of reviews. Annu Rev Public Health. 2015 Mar 18;36:393–415. doi: 10.1146/annurev-publhealth-031914-122855. http://europepmc.org/abstract/MED/25785892. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 39.Bigna JJ, Noubiap JJ, Kouanfack C, Plottel CS, Koulla-Shiro S. Effect of mobile phone reminders on follow-up medical care of children exposed to or infected with HIV in Cameroon (MORE CARE): a multicentre, single-blind, factorial, randomised controlled trial. Lancet Infect Dis. 2014 Jul;14(7):600–608. doi: 10.1016/S1473-3099(14)70741-8. [DOI] [PubMed] [Google Scholar]
- 40.Ingersoll KS, Dillingham RA, Hettema JE, Conaway M, Freeman J, Reynolds G, Hosseinbor S. Pilot RCT of bidirectional text messaging for ART adherence among nonurban substance users with HIV. Health Psychol. 2015 Dec;34 Suppl:1305–1315. doi: 10.1037/hea0000295. http://europepmc.org/abstract/MED/26651472. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 41.Garofalo R, Kuhns LM, Hotton A, Johnson A, Muldoon A, Rice D. A randomized controlled trial of personalized text message reminders to promote medication adherence among HIV-positive adolescents and young adults. AIDS Behav. 2016 May;20(5):1049–1059. doi: 10.1007/s10461-015-1192-x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 42.Catalani C, Philbrick W, Fraser H, Mechael P, Israelski DM. mHealth for HIV treatment & prevention: a systematic review of the literature. Open AIDS J. 2013;7:17–41. doi: 10.2174/1874613620130812003. http://europepmc.org/abstract/MED/24133558. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 43.Montaner JS, Guillemi S, Harris M. Therapeutic Guidelines for Antiretroviral (ARV) Treatment of Adult HIV Infection. Vancouver, BC: British Columbia Centre for Excellence in HIV/AIDS; 2015. Sep, [2017-05-28]. http://europepmc.org/abstract/MED/20638713 . [Google Scholar]
- 44.Murray MC, O'Shaughnessy S, Smillie K, Van Borek N, Graham R, Maan EJ, van der Kop ML, Friesen K, Albert A, Levine S, Pick N, Ogilvie G, Money D, Lester R, WelTel BC1 Study Team Health care providers' perspectives on a weekly text-messaging intervention to engage HIV-positive persons in care (WelTel BC1) AIDS Behav. 2015 Oct;19(10):1875–1887. doi: 10.1007/s10461-015-1151-6. [DOI] [PubMed] [Google Scholar]
- 45.Lucas GM, Chaisson RE, Moore RD. Highly active antiretroviral therapy in a large urban clinic: risk factors for virologic failure and adverse drug reactions. Ann Intern Med. 1999 Jul 20;131(2):81–87. doi: 10.7326/0003-4819-131-2-199907200-00002. [DOI] [PubMed] [Google Scholar]
- 46.Arnsten JH, Demas PA, Grant RW, Gourevitch MN, Farzadegan H, Howard AA, Schoenbaum EE. Impact of active drug use on antiretroviral therapy adherence and viral suppression in HIV-infected drug users. J Gen Intern Med. 2002 May;17(5):377–381. doi: 10.1046/j.1525-1497.2002.10644.x. http://onlinelibrary.wiley.com/resolve/openurl?genre=article&sid=nlm:pubmed&issn=0884-8734&date=2002&volume=17&issue=5&spage=377. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 47.Avants SK, Margolin A, Warburton LA, Hawkins KA, Shi J. Predictors of nonadherence to HIV-related medication regimens during methadone stabilization. Am J Addict. 2001;10(1):69–78. doi: 10.1080/105504901750160501. [DOI] [PubMed] [Google Scholar]
- 48.Chen NE, Meyer JP, Avery AK, Draine J, Flanigan TP, Lincoln T, Spaulding AC, Springer SA, Altice FL. Adherence to HIV treatment and care among previously homeless jail detainees. AIDS Behav. 2013 Oct;17(8):2654–2666. doi: 10.1007/s10461-011-0080-2. http://europepmc.org/abstract/MED/22065234. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 49.Bouhnik A, Chesney M, Carrieri P, Gallais H, Moreau J, Moatti J, Obadia Y, Spire B, MANIF 2000 Study Group Nonadherence among HIV-infected injecting drug users: the impact of social instability. J Acquir Immune Defic Syndr. 2002 Dec 15;31 Suppl 3:S149–S153. doi: 10.1097/00126334-200212153-00013. [DOI] [PubMed] [Google Scholar]
- 50.Bouhnik A, Préau M, Vincent E, Carrieri MP, Gallais H, Lepeu G, Gastaut J, Moatti J, Spire B, MANIF 2000 Study Group Depression and clinical progression in HIV-infected drug users treated with highly active antiretroviral therapy. Antivir Ther. 2005;10(1):53–61. [PubMed] [Google Scholar]
- 51.Canadian Wireless Telecommunications Association CWTA Subscriber Stats: Wireless Phone Subscribers in Canada in 2015. 2015. [2017-05-16]. https://cwta.ca/wp-content/uploads/2016/03/SubscribersStats_en_2015_Q4.pdf .
- 52.PopulationPyramid.net. 2015. [2017-05-16]. Population pyramids of the world from 1950 to 2100: Canada http://www.populationpyramid.net/canada/2015/
- 53.Montaner JS, Lima VD, Barrios R, Yip B, Wood E, Kerr T, Shannon K, Harrigan PR, Hogg RS, Daly P, Kendall P. Association of highly active antiretroviral therapy coverage, population viral load, and yearly new HIV diagnoses in British Columbia, Canada: a population-based study. Lancet. 2010 Aug 14;376(9740):532–539. doi: 10.1016/S0140-6736(10)60936-1. http://europepmc.org/abstract/MED/20638713. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 54.Kamolratanakul P, Sawert H, Lertmaharit S, Kasetjaroen Y, Akksilp S, Tulaporn C, Punnachest K, Na-Songkhla S, Payanandana V. Randomized controlled trial of directly observed treatment (DOT) for patients with pulmonary tuberculosis in Thailand. Trans R Soc Trop Med Hyg. 1999;93(5):552–557. doi: 10.1016/s0035-9203(99)90379-6. [DOI] [PubMed] [Google Scholar]
- 55.Kiselev AR, Gridnev VI, Shvartz VA, Posnenkova OM, Dovgalevsky PY. Active ambulatory care management supported by short message services and mobile phone technology in patients with arterial hypertension. J Am Soc Hypertens. 2012;6(5):346–355. doi: 10.1016/j.jash.2012.08.001. [DOI] [PubMed] [Google Scholar]
- 56.Gurol-Urganci I, de Jongh T, Vodopivec-Jamsek V, Atun R, Car J. Mobile phone messaging reminders for attendance at healthcare appointments. Cochrane Database Syst Rev. 2013;12:CD007458. doi: 10.1002/14651858.CD007458.pub3. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 57.McInnes DK, Li AE, Hogan TP. Opportunities for engaging low-income, vulnerable populations in health care: a systematic review of homeless persons' access to and use of information technologies. Am J Public Health. 2013 Dec;103 Suppl 2:e11–e24. doi: 10.2105/AJPH.2013.301623. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 58.Eyrich-Garg KM. Mobile phone technology: a new paradigm for the prevention, treatment, and research of the non-sheltered “street” homeless? J Urban Health. 2010 May;87(3):365–380. doi: 10.1007/s11524-010-9456-2. http://europepmc.org/abstract/MED/20397058. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 59.Mocroft A, Phillips AN, Gatell J, Ledergerber B, Fisher M, Clumeck N, Losso M, Lazzarin A, Fatkenheuer G, Lundgren JD, Euro SG. Normalisation of CD4 counts in patients with HIV-1 infection and maximum virological suppression who are taking combination antiretroviral therapy: an observational cohort study. Lancet. 2007 Aug 4;370(9585):407–413. doi: 10.1016/S0140-6736(07)60948-9. [DOI] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
Consort E-Health Form.