Skip to main content
NIHPA Author Manuscripts logoLink to NIHPA Author Manuscripts
. Author manuscript; available in PMC: 2011 Nov 1.
Published in final edited form as: Curr HIV/AIDS Rep. 2010 Nov;7(4):234–244. doi: 10.1007/s11904-010-0061-5

Retention in Care Among HIV-Infected Patients in Resource-Limited Settings: Emerging Insights and New Directions

Elvin H Geng, Denis Nash, Andrew Kambugu, Yao Zhang, Paula Braitstein, Katerina A Christopoulos, Winnie Muyindike, Mwebesa Bosco Bwana, Constantin T Yiannoutsos, Maya L Petersen, Jeffrey N Martin
PMCID: PMC3021803  NIHMSID: NIHMS254779  PMID: 20820972

Abstract

In resource-limited settings—where a massive scale up of HIV services has occurred in the last 5 years—both understanding the extent of and improving retention in care presents special challenges. First, retention in care within the decentralizing network of services is likely higher than existing estimates that account only for retention in clinic, and therefore antiretroviral therapy services may be more effective than currently believed. Second, both magnitude and determinants of patient retention vary substantially and therefore encouraging the conduct of locally relevant epidemiology is needed to inform programmatic decisions. Third, socio-structural factors such as program characteristics, transportation, poverty, work/child care responsibilities, and social relations are the major determinants of retention in care, and therefore interventions to improve retention in care should focus on implementation strategies. Research to assess and improve retention in care for HIV-infected patients can be strengthened by incorporating novel methods such as sampling-based approaches and a causal analytic framework.

Keywords: HIV care and treatment, retention in care, resource-limited settings, loss to follow-up, access to care

Introduction

Retention in care is required for optimal clinical outcomes in patients with HIV infection. Among patients who have not initiated antiretroviral therapy (ART), retention in care allows provision of prophylactic medications for opportunistic infections, ongoing staging, prevention of mother-to-child transmission (pMTCT), and prompt initiation of ART once indications arise. For patients on ART, retention in care is necessary to ensure ongoing receipt of ART, evaluate the emergence of medication toxicities, and identify the occurrence of treatment failure when it occurs in order to switch regimens. Finally, retention in care for all patients provides additional benefits through ancillary services, social support, and secondary prevention messages that can help patients navigate a lifelong and complicated infection [1].

The vast majority of the world's 33 million HIV-infected patients—including the over 4 million on ART already—reside in resource-limited settings (RLS) such as sub-Saharan Africa, Asia, and parts of South America where retention in care potentially takes on an even more important role than in industrialized settings. For patients who have tested HIV-positive but who do not yet have indications for ART, poor retention prevents ongoing immunologic and clinical evaluation. This increases the risk of late presentation when opportunistic infections such as tuberculosis and cryptococcosis are already in motion—conditions with particularly high mortality in RLS [2, 3]. In addition, provision of co-trimoxazole prophylaxis also has significant benefits for HIV-infected patients with CD4 counts above the threshold for ART [4]. For patients who have started ART, failures of retention are often tantamount to medication cessation. Once interrupted, the effects of ART are rapidly reversed and additional harms can accrue through the emergence of drug resistance mutations [5] that limit future drug options and increase mortality [6]. Furthermore, ongoing clinical visits are needed to identify toxicities in order to substitute single offending drugs as well as diagnose treatment failure in order to switch to second-line regimens when indicated. Finally, because medication adherence is relatively in sub-Saharan Africa among patients in care [7, 8], the importance of retention in care may comprise the most important factor in the overall effectiveness of ART programs there.

To date, most studies, including a recent review [9], describing the magnitude and determinants of retention in care for HIV-infected patients have been in industrialized settings. In this article, we focus on the rapidly growing literature from RLS for adult patients and 1) summarize definitions and terminology regarding retention in care; 2) critically review the literature on the extent of retention in care; 3) evaluate determinants of, and strategies to improve, retention in care; and 4) highlight methodological issues that can help to advance the study of retention in care in RLS.

Defining Retention in Care

Reviewing the literature on retention in care begins with summarizing commonly used, yet heterogeneous definitions of the term. Working in the North American HIV epidemic, Messeri et al. proposed that “`Retention in care' implies remaining connected to medical care, once entered” [1]. In RLS, retained patients have been defined as “patients known to be alive and receiving highly active ART at the end of a follow-up period” [10••]. Other authors proposed retention in care to mean “patients alive and on ART at the same facility or those formally transferred out to another ART unit and thus assumed to be on therapy” [11, 12]. Operationally, in industrialized settings, visit frequency has often been used as a measure of retention [13]. In RLS, retention is usually defined as ending at some interval of time after a scheduled appointment. The actual interval, however, is not clearly established and has been set as 14 days [14], 30 days [15], 90 days [16], 6 months [17••], or 1 year [18]. Finally, since ART patients are expected to come to clinic more frequently (eg, monthly) than patients who have not yet initiated ART (eg, semiannual), the optimal interval for the definition may differ for each type of patient.

Existing definitions of retention in care, however, contain several limitations that must first be discussed in order to frame the following review of retention in care. First, most studies focus on patients already on ART, but the public health benefits of continuous and appropriate care begin for HIV-infected patients even before eligibility for ART. Second, retention in care is usually defined from the perspective of the clinic rather than the patient. During scale up and decentralization of HIV care in RLS, patients inevitably access care within a rapidly widening network of sites, many which may be increasingly closer to their residences [19]. Estimates of retention defined by continued presence at a specific clinic are tantamount to retention in clinic rather than retention in care, and these two metrics will likely differ in both magnitude and significance. Third, the definition of retention in care is often predicated on “known outcomes.” In this case, the mechanisms in place to know about outcomes (such as passive vs active tracing, death registries, etc.) can artificially influence estimates of retention in care. For the purposes of this review, therefore, we will consider all patients who have registered at an HIV clinic regardless of ART status to be the population of interest, highlight estimates of patient retention (as opposed to clinic retention) by emphasizing “tracing” studies that seek outcomes among patients lost to follow-up, and remark on the methods of outcome ascertainment whenever possible.

How Good is Retention in Care Among HIV-Infected Patients in RLS?

Patients who have initiated ART

A large systematic review in 2007 that surveyed 32 publications on 33 cohorts in 13 countries and contained information on 74,289 patients raised an early alarm about poor retention in care among HIV-infected patients on ART in Africa. Using weighted averages and considering deaths as not-retained, the authors contend that a plausible mid-point estimate of retention 2 years after ART initiation was only 50%, with best and worst case scenarios of 77% and 24% [10••]. The analysis was updated in 2010, and it was found using an additional 39 cohorts and 226,307 patients that the 24-month retention rate was 70.0% and 36-month estimate was 64.8% [20••]. Overall, these studies paint a rather dismal picture of retention in care and led some commentators to call into question the effectiveness of ART programs in RLS [21].

Methodological issues, however, influence our interpretation of these studies and assessment of the magnitude of retention in care. These reports have been conducted from the perspective of clinics and have assumed that patients who are lost to follow-up (ie, who have unknown outcomes) are no longer engaged in care. As discussed above, in the setting of rapid ART scale-up and decentralization of care, this assumption may not always be true. Indeed by design in most countries, ART delivery started in urban hospital-based referral centers and then later extended to lower-level health centers and rural sites [19, 22]. Some fraction of patients initially accessing care at the centralized sites can be expected to shift in this process. Given the speed and scope of the scale-up in settings without pre-existing integrated medical records, complete capture of patient movement cannot be expected. Therefore, existing estimates of retention in care must be interpreted in light of the specific contexts, definitions, and methods of ascertaining outcomes in order to best understand their implications.

“Tracing” studies that evaluate outcomes among lost patients in the community provide insight into retention in care by documenting patient movement across clinic sites. In many instances, patients who are lost to follow-up continue to receive care at other, more local facilities (Table 1). In rural Uganda, 61% to 80% of 111 patients lost between 2004 and 2007 and found alive were in care elsewhere (as defined by both seeing an HIV provider and continuing to obtain ART) [23]. In Kampala, Uganda, investigators found that 50% of patients lost from the Infectious Diseases Institute, a large central clinic, were in care elsewhere [18]. In the Lighthouse clinic in Malawi, among 2253 patients who missed at least one clinic visit by 3 weeks, 1580 (70%) were found to be alive and 55% were still in care and on ART [24]. In Johannesburg, one group noted that 41% of 90 lost patients who were found to be alive were in care elsewhere [25], while a second group found 66% of 260 traced patients who were alive to be in care elsewhere [26]. The fraction of living patients lost from one clinic who remain in care, however, is heterogeneous: a figure of 20% was reported from Ethiopia [27], 20% from an earlier study in Johannesburg, and in Botswana 87% of 46 lost patients were dead, leaving very few who could be retained in care [15]. Overall, however, among 14 studies where outcomes in some patients lost to clinic were reported, a crude unweighted median of 48.5% were in care elsewhere. This suggests that retention in care is on average substantially higher than retention in clinic.

Table 1.

Vital status and HIV care status of patients lost to follow-up from HIV care and treatment clinics in resource-limited settings

Study Setting and patients Study period ART status Patients in the clinic population under consideration, total n Definition of loss to follow-up Patients lost to follow-up, n (%) Tracing attempted, n (%) Median time (IQR)in months between last visit and tracing N (%) of traced in whom no further information obtained (ie, unsuccessfully traced) N (%) of traced with ascertained outcomes (ie, successfully traced) Patients successfully traced found to have died, n (%) Patients successfully traced found alive, n (%) Living patients not in care elsewhere, n (%) Living patients in care elsewhere, N (%) Living patients whose current care status is unknown or not reporteda, n (%)
Published articles
Maskew et al [42], 2007 Themba Lethu Clinic in Johannesburg, South Africa (urban) 2005 On ART nrb Missed a single clinic visit during a 2-month interval 154 154 (100) nr 84 (55) 70 (45) 19 (27) 51 (70) 41 (80) 10 (20) 0 (0)
Yu et al [37•], 2007 Four public-sector ART facilities in northern Malawi, including one central hospital and three peripheral hospitals 2004–2006 On ART 5009 3 months of absence from clinic 253 (5) 253 (100) 6.4 (IQR nr) 68 (27) 185 (73) 127 (67) 58 (23) 37 (64) 21 (36) 0 (0)
Dalal et al [25•], 2008 The Johannesburg Hospital adult HIV clinic, Johannesburg, South Africa (urban) 2004–2005 On ART 1631 Missing a scheduled appointment for 6 weeks 267 (16) 267(100) nr 94 (35) 173 (65) 83 (48) 90 (52) 34 (38) 42 (47)c 14 (16)
Krebs et al [32], 2008 Lusaka ART program, Zambia (urban and rural) 2005 49% on ART, 51% no ART nr Missed visit 1343 1343 (100) nr 554 (41) 789 (59) 359 (46) 430 (54) nr nr nr
Bisson et al [15], 2008 The Infectious Disease Care Clinics in Gaborone, Botswana (urban) 2003 On ART 410 30 days late for scheduled visit 68 (17) 68 (100) nr 22 (32) 46 (68) 40 (87) 6 (13) nr nr nr
Deribe et al [27], 2008 Jimma University Specialized Hospital in semi-rural Jimma zone, Ethiopia (urban and rural) 2003 On ART 1270 Missed 2 or more monthly scheduled clinic appointments 173 (14) 173 (100) nr 65 (37) 108 (67) 29 (27) 79 (83) 59 (75) 20 (25) 0 (0)
Amuron et al [35••], 2009 The AIDS Support Organizaiton (TASO) centers in the semi-rural southeastern district of Jinja, Uganda (semi-urban) 2004–2006 Pre-ART 2483 Failure to complete 3 pre-ART visits 637 (26) 637 (100) 11.5 (6.0–17.0) 109 (17) 528 (83) 181(34) 347 (66) 158 (46) 189 (54) 0 (0)
Bassett et al [16], 2009 Sinikithemba HIV Clinic at McCord Hospital in Durban, South Africa (urban) 2006 Pre-ART 501 Failure to complete 3 pre-ART visits or initiate ART 82 (16) 82 (100) nr 32 (39) 50 (61) 28 (56) 22 (44) 4 (18) 15 (68) 3 (14)
Geng et al [23], 2010 Immune Suppression Syndrome Clinic in Mbarara, Uganda (semi-rural) 2004–2007 On ART 3628 6 months absent for a visit 829 (23) 128 (15) 11.6 (9.4–14.3) 17 (13) 111 (87) 32 (29) 79 (79) 8 (10) 48 (51) 31 (39)d
Tweya et al [24], 2010 Lighthouse Clinic, Lilongwe and Martin Preuss Center in Milawi (urban and semi-rural) 2006–2009 On ART 13,981 3 weeks late for a visit 3098 (22) 3098 (100) nr 845 (27) 2253 (73) 673 (30) 1580 (70) 909 (58)e 671 (38) nr
McGuire et al [34•], 2010 MSF, Chiradzulu, Malawi (rural) 2004–2007 On ART 11,683 1 month late for appointment 1261 (11) 656 (52) 23.2 (14.4–35.1) 205 (31) 451 (69) 244 (54) 207 (44) nr nr nr
McGuire et al [34•], 2010 MSF, Chiradzulu, Malawi (rural) 2004–2007 Pre-ART 7943 1 month late for appointment 1747 (22) 981 (56) 18.9 (14.1–26.8) 287 (29) 694 (71) 343 (71) 351 (51) nr nr nr
Rosen and Ketlhapile [26], 2010 Themba Lethu Clinic in Johannesburg, South Africa (urban) 2008 On ART nr 3 months late for appointment 869 493 (57) (random sample) nr 233 (47) 260 (53) 55 (21) 205 (79) 70 (34) 135 (66) 0 (0)
Abstracts
Ive et al [54], 2005 Themba Lethu Clinic, Johanesburg, South Africa 2004–2005 On ART 2400 nr nr 74 nr 26 (35) 48 (65) 26 (54) 22 (46) nr nr nr
Hochgesang et al [14], 2006 Lighthouse Clinic, Lilongwe, Malawi 2004–2005 On ART 3840 2 weeks late for an appointment 1843 (48) 727 (39) nr 189 (26) 538 (74) 218 (41) 320 (59) 23 (7) 297 (93) 0 (0)
Dehab et al [55], 2008 Public sector HIV ART program in South Africa nr On ART 267 1 month late for the 6 month appointment 44 44 (100) nr 9 (20) 35 (80) 18 (51) 17 (49) 14 (82) 3 (18) 0 (0)
Dehab et al [55], 2008 Workplace ART program in South Africa nr On ART 146 1 month late for the 6 month appointment 53 53 nr 12 (23) 41 (77) 5 (12) 36 (88) 25 (69) 2 (6) 9 (25)
Lurton et al [69], 2008 Community ART scale-up in Segou, Mali (rural) 2003–2007 On ART 1568 3 months late for appointment 236 (15) 71 (30) nr 10 (14) 61 (86) 25 (41) 26 (59) 5 (8) 14 (54) 7 (27)
Joshi et al [40], 2008 Referral Hospital, Jodhpur, India (rural) nr On ART 1911 3 months late for appointment 152 (8) 152 (100) nr 46 (30) 106 (70) 13 (12) 93 (88) nr nr 11 (10)
Muwanga et al [18], 2008 Infectious Diseases Institute, Kampala, Uganda 2004–2007 On ART 6654 3 months late for appointment 831 (12) 831 (100) nr 450 (54) 381 (46) 159 (40) 234 (60) 117 (50) 117 (50) 0 (0)
a

Patients who were found alive by tracing can have unknown current care status because it was not asked by the tracing protocol, or it was not ascertainable because patients moved out of the area and informants about vital status were unable to provide information on current care status.

b

Inclusion in this study was defined by clinic visit, not unique patient identifier.

c

Includes 7 patients who were obtaining medications privately, as well as 35 transferred to another facility.

d

A high fraction with unknown treatment status was because patients whose vital status was ascertained through an informant were not asked about current HIV care.

e

This fraction considers 27 patients who had treatment gaps but who returned as being “in care” and 29 patients with no treatment gaps but incorrect record as being “in care.”

ART—antiretroviral therapy, nr—not reported

Studies that reveal retention at central, large, hospital-based sites to be worse than at peripheral health centers also provide indirect evidence that apparent retention in care is susceptible to influence from the process of decentralization. In a Medecins Sans Frontieres program in rural Lusikisiki, South Africa, the rate of loss at more peripheral decentralized sites was 2.2% (95% CI: = 1.2%–3.7%) versus 19.3% (95% CI = 15.7%–23.4%) at the central site [19]. In Malawi, loss from a hospital “hub” was fourfold greater than at the health center “spoke,” with an absolute difference of 77% [11]. In the district of Zomba, Malawi, retention was approximately 90% at the decentralized sites and 77% at the hospital site by 3 years [22]. Finally, in a meta-analysis that included 13 cohorts from Africa and Asia, the fraction of patients lost to follow-up correlated to the size of the program [28]. Although these data are consistent with the hypothesis that poorer retention at large, central sites is due in part to decentralization, further confirmation of this hypothesis is an important research priority. Finally, although silent transfers appear to be retained, critical evaluation of the frequency of treatment gaps during this process is also an important operational research question.

Retention in Care for Pre-ART Patients

For patients not yet starting ART, we consider retention to be an issue after registration at an HIV clinic. The fraction of patients who enrolled and who obtained staging through CD4 determination was assessed in two cities in Mozambique during the first 12 months of free ART availability in 2005. The investigators found that 77.1% of those enrolling had a CD4 determination—routine staging mechanism in this setting—within 30 days. Overall, 43% of patients testing positive completed enrollment and staging within 60 days [29]. This study was unique in that only one site in each city provided free CD4 testing and ART; therefore, the fractions reported are likely unbiased by incomplete capture of the outcomes.

Retention for patients without indications for ART appears to be particularly challenging. In a 2005 study among 3370 HIV-infected patients in KwaZulu-Natal in South Africa, only 49.4% of individuals with an initial CD4 cell count > 200/cm3 returned for a subsequent CD4 measurement within the next 13 months [30]. In Witwatersrand, South Africa, investigators found that 75 of 128 (59%) patients who had initial CD4 counts from 251 to 350 did not return by 1 year and that 169 of 228 (74%) patients with a CD4 > 351 did not return by 1 year [31]. In a study in Zambia among 1343 patients who missed a visit, only 11% of the non-ART patients returned whereas 39% of the patients on ART returned [32]. Finally, in western Kenya, patients in the clinic who had a CD4 > 200/cm3 were 3.5-fold more likely to never make a second visit than patients with lower CD4 counts [33]. In Chiradzulu, Malawi, over 3 years 52.5% of pre-ART patients—not distinguished by ART eligibility criteria—failed to be retained compared to 16.1% of patients who had initiated ART [34•]. These estimates, however, do not distinguish retention in program and retention in care. Therefore, the actual estimates provided here can be interpreted as the worst case scenarios.

Among patients with an indication for ART—the subgroup of patients not on ART at highest risk for death—retention has also been found to be suboptimal. Among 2483 patients with CD4-based indications for ART in Jinja (a semi-rural area in Eastern Uganda), 88% returned for a second visit and overall 74% returned for a third visit and started ART [35••]. This occurred in a community that was highly sensitized to the beneficial effects of ART. An important strength of this study was that investigators sought outcomes among those lost to follow-up in order to obtain true outcomes. Of the 637 patients who did not start ART, investigators found that 189 (28%) had started ART with a different provider. Therefore, retention in care among pre-ART patients was higher than thought, but overall, nearly 30% of eligible patients did not start ART. In McCord Hospital in Durban, South Africa, 16% of patients with clear indications for ART failed to complete ART training [16]. Among over 22,000 patients with CD4 levels < 200/cm3 enrolling in the Free State ART program, 13% were lost to care before ART initiation [36]. In ART-eligible patients, the risk of death is high and reaches 28% to 34% at 1 year in these studies; hence failures of retention in this group are likely to have a marked impact on survival.

Improving Retention in Care

A number of studies have sought to understand the determinants of retention through identifying factors associated with retention. Although this section summarizes the findings of these studies, the effect of unknown outcomes that we raise with regard to the estimates of the magnitude of retention in care also apply to analyses that seek to identify the determinants of retention in care. In other words, factors associated with retention in clinic may not always be an accurate proxy for retention in care.

Transportation to clinic

Distance to clinic and transportation are major barriers to retention in care in a wide variety of settings in Africa and Asia. In rural Uganda, among 111 patients lost to follow-up, the most common reasons for absence were lack of transportation in 50% and excessive distance in 42% [23]. In rural Malawi, 35% of patients who were lost and traced cited the high cost of transport to the clinic as the reason for absence [37•]. The International Center for AIDS Care and Treatment (ICAP) performed a multisite analysis in Western, Eastern, and Southern Africa using a 6-month absence as the outcome. The study found that if travel time to clinic exceeded 2 hours, the risk of non-retention was doubled [38]. In Cambodia, among 6688 patients of whom 4150 were on ART, living out of province was the only risk factor for failure to return to clinic [39]. In Rajasthan, India, among 106 patients who failed to return for 3 or more months, 20% cited distance and lack of transportation [40]. In pre-ART patients in Jinja, Uganda, 44% of patients who were eligible for ART but did not start cited transportation as the major reason for failure to initiate [35••]. In Western Kenya, one study found that among pre-ART patients, travel time was only significantly associated with failure of retention among women (OR = 1.07; 95% CI = 1.00–1.16) [33]. The consistent relationship between transportation and distance on retention has prompted the only randomized trial we are aware of studying retention. In this trial, conducted in Mbarara, Uganda, individuals were randomized to receive a cash transfer of 10,000 to 15,000 Uganda Shillings ($5–$8) to be used for transportation. Only 14 (18%) patients were lost from the intervention group, versus 23 (34%) lost from the control group (P = 0.04) [41].

Poverty

Financial constraints also figure prominently in non-retention and “tracing” studies. Lost patients consistently report finances as a limiting factor: 34% in a South African study [42] and 35% in rural Ugandans. Among poor families, work and childcare responsibilities can compete with retention in care. In over 50,000 patients in The Academic Model Providing Access to Healthcare (AMPATH) programs in Kenya, 21% of women cited family commitments for missing a clinic appointment and 24% of men cited work commitments [33]. Lack of food or hunger—particularly concurrent with reversal of cachexia and improving health after ART initiation—has been cited as a reason for poor adherence [43], and may compromise retention in care as well. In Jimma zone in Ethiopia—an area that has faced food shortages in the last decade—17.6% of patients who defaulted reported lack of food as a reason for absence from clinic [27].

Social support, stigma, and disclosure

In RLS, social determinants of retention in care have also been found to be important in a number of settings. Ware et al. [7] conducted the largest qualitative study to date in Africa on patterns of accessing care among HIV-infected patients in Nigeria, Uganda, and Tanzania through 252 qualitative interviews. Patients reported that social relationships can help in overcoming barriers to care through the force of social expectations and can also be used to obtain material benefits that make remaining in care possible [7]. In Tanzania, qualitative interviews with 42 patients revealed that many felt fulfilling responsibility to their children formed a motivating factor for retention in care [44]. Social support interventions for vulnerable groups appear to be promising interventions to improve retention. In a study from Kenya, a targeted program providing social support for youths found retention was better at the intervention clinic with 70% remaining in active care versus 55% at the general site for the same age group [45]. Disclosure—which has been hypothesized to be a marker of social support—was found to be associated with a 70% rise in the odds of retention in 3362 patients in the pMTCT Plus network supported by ICAP [38]. Although qualitative interviews from South Africa found stigma did not represent a big challenge to retention [46], in a study from Malawi, stigma led to non-retention in 45.8% of pre-ART and 25% of on-ART patients [34•].

Models of care

Certain program strategies have been associated with greater retention in care. Given that structural barriers such as distance and transportation play large roles in retention in care, programs that deliver care in a more decentralized way or provide home-based therapy may improve retention in care. The multinational organization AIDS Relief reported on an association between four different models of care and retention among 13,391 patients at 27 facilities in eight countries from August 2004 to June 2005. They found that, compared to groups that received adherence counseling only, programs with home visits and community health worker involvement had loss to follow-up of 5% and 1% compared to 14% [47]. In Malawi, Massaquoi et al. [11] demonstrated that a centralized “hub” lost patients faster than a “spoke” site. In the rural district of Lusikisiki in South Africa, the rate of loss to follow-up among patients who started ART at decentralized sites was 8.8-fold lower than in centralized sites [19]. As discussed previously, however, it is not possible to completely disentangle retention in care from patient movement during centralization. Although ancillary services have not been extensively studied in RLS, among 122,405 patients in 216 facilities supported by the ICAP, the better retention was associated with presence of peer support groups (173 vs 315 losses per 1000 patient-years) and outreach services (120 vs 231 losses per 1000 patient-years), but not with food supplementation [48].

CD4 level

Low and higher CD4 counts have both been associated with worse retention. In 11 cohorts in West Africa, the retention probability was lower for patients with baseline CD4 count < 50 cells/mm3 (HR = 2.27; CI = 1.96–2.64; P < 0.001) compared to CD4 > 200 cells/mm3 [49]. Interestingly, among 50,275 pre-ART patients in Kenya, a CD4 > 200/cm3 increased the risk of non-retention by 3.49-fold [33]. Likewise, in the China National Treatment cohort, lower baseline CD4 was associated with lower rate of missed visits in on-ART patients [50]. The bidirectional nature of this association may be because patients with high CD4 counts are more likely to move for work but those with low CD4 levels are at risk for unascertained deaths that appear to be failures of retention.

Sex

Male sex has emerged as a predictor of poor retention in a number of settings. In a South African study, even though 30% of the clinic were men, 42% of missed visits during a 2-month window were by men (P < 0.05) [42]. In a large multisite study from West Africa, males had a 14% higher rate of loss than females. In western Kenya, combining those on and not on ART, the rate of loss among men was 28.1/100 person-years but 23.8 among women [33]. In a study focused on teachers in Malawi, men had an unadjusted 73% higher rate of loss to follow-up [51]. In the West Africa IeDEA consortium, with 13,102 patients from 11 cohorts from Benin, the Ivory Coast, Gambia, Mali, and Senegal, men had a 10% higher hazard of failure to retain [52]. Again, given the overall higher likelihood that men travel for work—particularly in professions of truck drivers, fishermen, and migrant agricultural workers—the observed association between men and loss to follow-up may be due at least in part to migratory labor patterns [53]. These generalizations, however, are not universal. In China, which has a concentrated rather than a generalized epidemic, women were more likely to miss visits during the first 6 months of ART [50].

Toxicities of ART

Toxicities appear to be a relatively less common reason for disengagement from care. In the Themba Lethu Clinic in Johannesburg, among 70 patients who were lost to follow-up (defined here as a single missed visit), only 1.4% cited side effects as a reason for failure to return to clinic [42] and in a later study at the same site, only 4.1% reported toxicity as a reason for absence [26]. In another clinic in Johannesburg, only 2.9% of 90 lost patients reported toxicity as a reason for absence [25•]. However, in another Johannesburg study, among 30 lost patients, 19% noted medication toxicity [54]. Among 49 defaulting patients in Malawi, 12.8% reported toxicity [34•].

Other

A few other reasons for failure to retain in care have been cited by studies in fewer numbers of patients. These include feeling well and not needing ART [32, 55], use of alternative medicines in Malawi and India [40, 55], younger age in western Kenya, and discordance in Ethiopia [27]. Low pretherapy hemoglobin has also been associated with death or loss to follow-up [52]. Pregnant women have been found to have a high rate of loss to follow-up in South Africa [56] and other settings, and this may be due to increased burden of attending both antenatal clinics as well as HIV clinics.

Methodological Issues and Research Agenda

The study of retention in care can lead to several immediately relevant findings. First, retention in care is a primary metric of the conduct of routine, day-to-day health care delivery at the front lines. For this reason, describing the magnitude of retention in care is central to understanding the comparative effectiveness of HIV care and treatment programs in RLS. Second, enhancing retention in care requires knowledge about the chain of events that leads to failures of retention; therefore, studies to identify determinants of retention are needed to target the right interventions to the right people. Third, estimating the causal effect of retention on mortality is needed to appropriately prioritize retention among many health care delivery aims. Fourth, operational research on the programmatic determinants of retention—including the processes to optimize transfers of care without treatment interruptions and with appropriate medical documentation—is urgently needed. Novel methodological approaches can strengthen each of these avenues of research.

Estimating the magnitude of retention in care requires a strategy to account for patient movement within the system but outside of the clinic. A sampling-based approach is one such strategy. Reports of transfers between clinics are rarely complete—an unsurprising fact given that the roll out of care and treatment for HIV-infected patients in Africa is massive in scale, emergent in nature, and was initiated without the benefit of previously established health records infrastructures. Sampling-based approaches track a numerically small but representative sample of patients with unknown outcomes and use supplemental data on outcomes thus obtained to adjust program-level estimates of mortality and retention in care. In initial work, the sampling-based approach has found estimates of retention in care at a single site in Uganda to be 70% higher than believed at 2 years [57••]. Sampling is a potentially efficient and scalable strategy that allows us to disentangle what we care about (retention in care) with our insufficient ability to measure what we care about (ie, ascertainment of outcomes).

Understanding the determinants of retention requires epidemiologists to move away from nominal statistical “associations” to causal inferences. In short, it has been well established that a large fraction of patients lost to follow-up have died [58], but this numerical association glosses over two distinct causal relationships. First, patients who die despite adequate engagement in care often subsequently appear to not be retained because deaths are systematically underreported in most of Africa [59, 60]. On the other hand, failure to retain in care eventually leads to clinical deterioration and high risk of death. These patients, for whom the absence from clinic itself contributes to death, must be identified, epidemiologically characterized, and systematically targeted for outreach activities.

Third, attempts to estimate the effect of retention on survival must take into account that retention in care is a longitudinal exposure likely subject to time-dependent confounding [6163]. In other words, time-varying factors such as deteriorating health status may act both as mediators of the effect of past missed clinic visits on mortality and confounders of the effect of future missed clinic visits on mortality. Confounding of this nature is not amenable to adjustment using standard regression-based adjustment [63]. Further, strategies such as defining the exposure to be retention during a restricted interval and the outcome to be survival in a subsequent interval [13, 50] may not capture the full effect of retention in care on survival. Control for time-dependent confounding can be accomplished through the use of alternative analytic approaches that employ marginal structural models and inverse probability weights [64]. Of note, however, control for time-dependent confounding requires that time-updated covariates be measured in both subjects that do and do not return to clinic. Such measurements are available only in cohorts that are followed both clinically and by research studies (such as the CHAIN cohort in New York City) and may be less common in RLS [65].

Fourth, program-level factors (eg, role of peer educators, adherence support, outreach, other ancillary services, staffing ratios, approaches to appointments, mechanisms to facilitate transfers, etc.) are likely to play a key role in patient retention. Yet to date, measurement of these key programmatic elements has not been highly featured and is not widely standardized. In particular, given the magnitude of both documented and undocumented transfers, mechanisms to ensure smooth conveyance of patient information and continuation of uninterrupted ART across sites are priority research questions. Research on program-level determinants of retention requires both standardized measures of program characteristics as well as hierarchical, multilevel models in epidemiology to “bring context” into analyses [66]. Standardized approaches to measurement and analysis of key processes that make up day-to-day implementation of HIV care can eventually yield public health “best practices” and optimize patient retention.

Conclusions

In summary, our reading of the literature is that retention in care among ART patients in RLS requires further characterization but is likely higher than commonly publicized estimates. The reasons for underestimation to date of retention in care in RLS is because many patients who have unknown outcomes are accessing care within the wider network of public health ART clinics. Furthermore, few studies have attempted to address deaths that are clearly not a result of failures of retention (eg, late ART initiation, treatment failure, opportunistic infections, etc.) [57••]. Also, it is clear that marked differences in retention exist and this underscores the importance of “knowing your epidemic” and the conduct of locally relevant epidemiologic studies in diverse settings. For example, the fraction of living patients among those lost to follow-up has been found to be between 70% [42] and 13% [15], and the fraction of living patients who report being in care ranges from 93% [14] to 20%–25% [27, 42, 55]. These wide differences mean that caution is required before extrapolating from one setting to another. These differences also underscore the fact that in many situations clinic retention is a poor proxy for patient retention.

In data from RLS, factors associated with poor retention are often structural, such as transportation, poverty, and work/child care responsibilities. Associations between retention and individual psychosocial or behavioral factors have not been extensively documented [67]. Improving retention in care in RLS, therefore, begins with addressing the relevant social, economic, geographical, and political forces. Key steps include strengthening information management strategies, reducing deaths, preventing stock-outs, reducing regimen toxicity, decentralization, and reducing ancillary costs [68]. Finally, more research that focuses on retention in care (as opposed to retention in clinic), includes pre-ART as well as ART patients, and that employs sampling-based and causal approaches, can deepen our understanding of the effectiveness of care and treatment for HIV-infected patients in RLS.

Acknowledgments

From University of California, San Francisco, United States (E.H.G., K.A.C., J.N.M); International Center for AIDS Care and Treatment Programs, Columbia University, New York, United States (D.N.); Infectious Diseases Institute, Kampala, Uganda (A.K.); Division of Treatment and Care, National Center for AIDS/STD, Chinese Center of Disease Control and Prevention, Beijing, People's Republic of China (Z.Y); Mbarara University of Science and Technology, Mbarara, Uganda (W.M., M.B.B.); Indiana University, Indianapolis, United States (C.T.Y.); Department of Biostatistics, University of California, Berkeley, United States (M.L.P); and the East Africa International Databases to Evaluate AIDS (E.H.G., D.N., A.K., P.B., W.M., M.B.B., C.T.Y., M.L.P., J.N.M).

Footnotes

Disclosure No potential conflicts of interest relevant to this article were reported.

References

  • 1.Messeri PA, Abramson DM, Aidala AA, et al. The impact of ancillary HIV services on engagement in medical care in New York City. AIDS Care. 2002;14(Suppl 1):S15–S29. doi: 10.1080/09540120220149948. [DOI] [PubMed] [Google Scholar]
  • 2.Kigozi IM, Dobkin LM, Martin JN, et al. Late-disease stage at presentation to an HIV clinic in the era of free antiretroviral therapy in Sub-Saharan Africa. J Acquir Immune Defic Syndr. 2009;52:280–289. doi: 10.1097/QAI.0b013e3181ab6eab. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3.Makadzange AT, Ndhlovu CE, Takarinda K, et al. Early versus delayed initiation of antiretroviral therapy for concurrent HIV infection and cryptococcal meningitis in sub-Saharan Africa. Clin Infect Dis. 2010;50:1532–1538. doi: 10.1086/652652. [DOI] [PubMed] [Google Scholar]
  • 4.Mermin J, Lule J, Ekwaru JP, et al. Effect of co-trimoxazole prophylaxis on morbidity, mortality, CD4-cell count, and viral load in HIV infection in rural Uganda. Lancet. 2004;364:1428–1434. doi: 10.1016/S0140-6736(04)17225-5. [DOI] [PubMed] [Google Scholar]
  • 5.Bangsberg DR, Kroetz DL, Deeks SG. Adherence-resistance relationships to combination HIV antiretroviral therapy. Curr HIV/AIDS Rep. 2007;4:65–72. doi: 10.1007/s11904-007-0010-0. [DOI] [PubMed] [Google Scholar]
  • 6.Deeks SG, Gange SJ, Kitahata MM, et al. Trends in multidrug treatment failure and subsequent mortality among antiretroviral therapy-experienced patients with HIV infection in North America. Clin Infect Dis. 2009;49:1582–1590. doi: 10.1086/644768. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.Ware NC, Idoko J, Kaaya S, et al. Social relationships explain ART adherence success in Sub-Saharan Africa: an account of resources and responsibility. 2010 In press. [Google Scholar]
  • 8.Mills EJ, Nachega JB, Buchan I, et al. Adherence to antiretroviral therapy in sub-Saharan Africa and North America: a meta-analysis. JAMA. 2006;296:679–690. doi: 10.1001/jama.296.6.679. [DOI] [PubMed] [Google Scholar]
  • 9.Horstmann E, Brown J, Islam F, et al. Retaining HIV-infected patients in care: Where are we? Where do we go from here? Clin Infect Dis. 2010;50:752–761. doi: 10.1086/649933. [DOI] [PubMed] [Google Scholar]
  • 10••.Rosen S, Fox MP, Gill CJ. Patient retention in antiretroviral therapy programs in sub-Saharan Africa: a systematic review. PLoS Med. 2007;4:e298. doi: 10.1371/journal.pmed.0040298. [DOI] [PMC free article] [PubMed] [Google Scholar]; This systematic review brought substantial attention to the issue of retention in care in HIV-infected patients on ART in RLS.
  • 11.Massaquoi M, Zachariah R, Manzi M, et al. Patient retention and attrition on antiretroviral treatment at district level in rural Malawi. Trans R Soc Trop Med Hyg. 2009;103:594–600. doi: 10.1016/j.trstmh.2009.02.012. [DOI] [PubMed] [Google Scholar]
  • 12.Cheever LW. Engaging HIV-infected patients in care: their lives depend on it. Clin Infect Dis. 2007;44:1500–1502. doi: 10.1086/517534. [DOI] [PubMed] [Google Scholar]
  • 13.Giordano TP, Gifford AL, White AC, Jr, et al. Retention in care: a challenge to survival with HIV infection. Clin Infect Dis. 2007;44:1493–1499. doi: 10.1086/516778. [DOI] [PubMed] [Google Scholar]
  • 14.Hochgesang M, Kuyenda A, Hosseinipour M, et al. Active tracing of ART patients lost to follow-up at Lighthouse shows that few `stopped' treatment for their own reasons, but many have died. 16th International AIDS Conference; Toronto, Canada. Aug 13–18, 2006. [Google Scholar]
  • 15.Bisson GP, Gaolathe T, Gross R, et al. Overestimates of survival after HAART: implications for global scale-up efforts. PLoS ONE. 2008;3:e1725. doi: 10.1371/journal.pone.0001725. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16.Bassett IV, Wang B, Chetty S, et al. Loss to care and death before antiretroviral therapy in Durban, South Africa. J Acquir Immune Defic Syndr. 2009;51:135–139. doi: 10.1097/qai.0b013e3181a44ef2. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17••.Geng EH, Emenyonu N, Bwana MB, et al. Sampling-based approach to determining outcomes of patients lost to follow-up in antiretroviral therapy scale-up programs in Africa. JAMA. 2008;300:506–507. doi: 10.1001/jama.300.5.506. [DOI] [PMC free article] [PubMed] [Google Scholar]; This study demonstrated that sampling provides a potential solution to understanding outcomes among lost patients in settings where the absolute number of lost patients is too high—an approach that can potentially be applied to retention in care as well as mortality.
  • 18.Muwanga A, Easterbrook PJ, Schaefer P, et al. Losses to follow-up in a large ART program in Uganda. 15th Conference on Retroviruses and Opportunistic Infections; Boston, MA. February 3–6, 2008. [Google Scholar]
  • 19.Bedelu M, Ford N, Hilderbrand K, Reuter H. Implementing antiretroviral therapy in rural communities: the Lusikisiki model of decentralized HIV/AIDS care. J Infect Dis. 2007;196(Suppl 3):S464–S468. doi: 10.1086/521114. [DOI] [PubMed] [Google Scholar]
  • 20••.Fox MP, Rosen S. Patient retention in antiretroviral therapy programs up to three years on treatment in sub-Saharan Africa, 2007–2009: systematic review. Tropical Med Int Health. 2010;15:1–16. doi: 10.1111/j.1365-3156.2010.02508.x. [DOI] [PMC free article] [PubMed] [Google Scholar]; This systematic review brought substantial attention to the issue of retention in care in HIV-infected patients on ART in RLS.
  • 21.Navario P. PEPFAR's biggest success is also its largest liability. Lancet. 2009;374:184–185. doi: 10.1016/S0140-6736(09)61312-X. [DOI] [PubMed] [Google Scholar]
  • 22.Chan AK, Mateyu G, Jahn A, et al. Outcome assessment of decentralization of antiretroviral therapy provision in a rural district of Malawi using an integrated primary care model. Trop Med Int Health. 2010;15:90–97. doi: 10.1111/j.1365-3156.2010.02503.x. [DOI] [PubMed] [Google Scholar]
  • 23.Geng EH, Bangsberg DR, Musinguzi N, et al. Understanding reasons for and outcomes of patients lost to follow-up in antiretroviral therapy programs in Africa through a sampling-based approach. J Acquir Immune Defic Syndr. 2010;53:405–411. doi: 10.1097/QAI.0b013e3181b843f0. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24.Tweya H, Gareta D, Chagwera F, et al. Early active follow-up of patients on antiretroviral therapy (aRT) who are lost to follow-up: the `Back-toCare' project in Lilongwe, Malawi. Trop Med Int Health. 2010;15:82–89. doi: 10.1111/j.1365-3156.2010.02509.x. [DOI] [PubMed] [Google Scholar]
  • 25•.Dalal RP, Macphail C, Mqhayi M, et al. Characteristics and outcomes of adult patients lost to follow-up at an antiretroviral treatment clinic in Johannesburg, South Africa. J Acquir Immune Defic Syndr. 2008;47:101–107. doi: 10.1097/QAI.0b013e31815b833a. [DOI] [PubMed] [Google Scholar]; This study provides more detailed assessment of patients who were not retained in care than most studies.
  • 26.Rosen S, Ketlhapile M. Cost of using a patient tracer to reduce loss to follow-up and ascertain patient status in a large antiretroviral therapy program in Johannesburg, South Africa. Trop Med Int Health. 2010;15:98–104. doi: 10.1111/j.1365-3156.2010.02512.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 27.Deribe K, Hailekiros F, Biadgilign S, et al. Defaulters from antiretroviral treatment in Jimma University Specialized Hospital, Southwest Ethiopia. Trop Med Int Health. 2008;13:328–333. doi: 10.1111/j.1365-3156.2008.02006.x. [DOI] [PubMed] [Google Scholar]
  • 28.Brinkhof MW, Dabis F, Myer L, et al. Early loss of HIV-infected patients on potent antiretroviral therapy programmes in lower-income countries. Bull World Health Organ. 2008;86:559–567. doi: 10.2471/BLT.07.044248. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 29.Micek MA, Gimbel-Sherr K, Baptista AJ, et al. Loss to follow-up of adults in public HIV care systems in central Mozambique: identifying obstacles to treatment. J Acquir Immune Defic Syndr. 2009;52:397–405. doi: 10.1097/QAI.0b013e3181ab73e2. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 30.Lessells R, Mutevedzi P, Thulare H, et al. Monitoring HIV-positive individuals prior to eligibility for antiretroviral therapy: do current strategies promote retention in HIV care in rural KwaZulu-Natal?. 5th IAS Conference on HIV Pathogenesis, Treatment, and Prevention; Capetown, South Africa. 2009. [Google Scholar]
  • 31.Larson BA, Brennan A, McNamara L, et al. Early loss to follow up after enrolment in pre-ART care at a large public clinic in Johannesburg, South Africa. Trop Med Int Health. 2010;15:43–47. doi: 10.1111/j.1365-3156.2010.02511.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 32.Krebs DW, Chi BH, Mulenga Y, et al. Community-based follow-up for late patients enrolled in a district-wide programme for antiretroviral therapy in Lusaka, Zambia. AIDS Care. 2008;20:311–317. doi: 10.1080/09540120701594776. [DOI] [PubMed] [Google Scholar]
  • 33.Ochieng-Ooko V, Ochieng D, Sidle JE, et al. Influence of gender on loss to follow-up in a large HIV treatment programme in western Kenya. Bull World Health Organ. 2010 doi: 10.2471/BLT.09.064329. In press. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 34•.McGuire M, Muyenyembe T, Szumilin E, et al. Vital status of pre-ART and ART patients defaulting from care in rural Malawi. Trop Med Int Health. 2010;15:55–62. doi: 10.1111/j.1365-3156.2010.02504.x. [DOI] [PubMed] [Google Scholar]; This comprehensive “tracing” study of outcomes among patients lost to clinic documented both outcomes and reasons for absence
  • 35••.Amuron B, Namara G, Birungi J, et al. Mortality and loss-to-follow-up during the pre-treatment period in an antiretroviral therapy programme under normal health service conditions in Uganda. BMC Public Health. 2009;9:290. doi: 10.1186/1471-2458-9-290. [DOI] [PMC free article] [PubMed] [Google Scholar]; This study highlights the importance of retention among pre-ART patients and also conducted “tracing” among patients with unknown outcomes to show that a substantial fraction had died while many others were in care elsewhere.
  • 36.Ingle S, Fairall L, Timmerman V, et al. Pre-treatment mortality and probability of starting ART in patients enrolled in the free state ARV program, South Africa: implications for treatment guidelines. 17th Conference on Retroviruses and Opportunistic Infections; San Francisco, CA. 2010. [Google Scholar]
  • 37•.Yu JK, Chen SC, Wang KY, et al. True outcomes for patients on antiretroviral therapy who are “lost to follow-up” in Malawi. Bull World Health Organ. 2007;85:550–554. doi: 10.2471/BLT.06.037739. [DOI] [PMC free article] [PubMed] [Google Scholar]; This was the first study to evaluate true outcomes among HIV-infected patients lost from a clinic rather than assuming that they were all out of care.
  • 38.Rabkin M, Austin J, Nash D, et al. High patient retention rates in a multinational HIV/AIDS treatment program: The Columbia University Mother-to-Child-Plus Experience. 17th Conference on Retroviruses and Opportunistic Infections; San Francisco, CA. February 16–19, 2010. [Google Scholar]
  • 39.Raguenaud ME, Isaakidis P, Vonthanak S, et al. Good ART patient outcomes and survival achieved in a six-year HIV/AIDS program in Cambodia. 5th IAS Conference on HIV Pathogenesis, Treatment, and Prevention; Cape Town, South Africa. July 19–22, 2009. [Google Scholar]
  • 40.Joshi K, Jhanwar S, Mathur A, et al. Barriers in adherence of ART (anti retroviral treatment): a experience of ART Centre of Western Rajasthan, India. 17th International AIDS Conference; Mexico City, Mexico. August 3–8, 2008. [Google Scholar]
  • 41.Emenyonu N, Muyindike W, Habyarimana J, et al. Cash transfers to cover clinic transportation costs improve adherence and retention in care in a HIV treatment program in Rural Uganda. 17th Conference on Retroviruses and Opportunistic Infections; San Francisco, CA. 2010. [Google Scholar]
  • 42.Maskew M, MacPhail P, Menezes C, Rubel D. Lost to follow up: contributing factors and challenges in South African patients on antiretroviral therapy. S Afr Med J. 2007;97:853–857. [PubMed] [Google Scholar]
  • 43.Weiser SD, Tuller DM, Frongillo EA, et al. Food insecurity as a barrier to sustained antiretroviral therapy adherence in Uganda. PLoS One. 2010;5:e10340. doi: 10.1371/journal.pone.0010340. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 44.Wringe A, Roura M, Urassa M, et al. Doubts, denial and divine intervention: understanding delayed attendance and poor retention rates at a HIV treatment programme in rural Tanzania. AIDS Care. 2009;21:632–637. doi: 10.1080/09540120802385629. [DOI] [PubMed] [Google Scholar]
  • 45.Otieno V, Marima R, Odhiambo J, et al. Improving enrollment and retention of youth into HIV services: lessons learned from Kisumu, Kenya. 17th International AIDS Conference; Mexico City. August 3–8, 2008. [Google Scholar]
  • 46.Miller CM, Ketlhapile M, Rybasack-Smith H, Rosen S. Why are antiretroviral treatment patients lost to follow-up? A qualitative study from South Africa. Trop Med Int Health. 2010;15:48–54. doi: 10.1111/j.1365-3156.2010.02514.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 47.Etienne M, Burrows L, Osotimehin B, et al. Situational analysis of varying models of adherence support and loss to follow up rates; findings from 27 treatment facilities in eight resource limited countries. Trop Med Int Health. 2010;15:76–81. doi: 10.1111/j.1365-3156.2010.02513.x. [DOI] [PubMed] [Google Scholar]
  • 48.Nash D, Korves C, Saito S, et al. Characteristics of facilities and programs delivering HIV care and treatment services are associated with loss to follow-up rates in programs from 7 Sub-Saharan African countries. 15th Conference on Retroviruses and Opportunistic Infections; Montreal, Canada. 2008. [Google Scholar]
  • 49.Zannou MD, Ekouevi DK, Ba-Gomis FO, et al. Retention of HIV-infected patients on antiretroviral therapy in 11 clinical centres within the International epidemiologic databases to evaluate AIDS West Africa collaboration. 17th International AIDS Conference; Mexico City. 2008. [Google Scholar]
  • 50.Zhang Y, Dou Z, Zhao Y, et al. Association between missed early visits and survival among patients of China national free ART cohort. 17th Conference on Retroviruses and Opportunistic Infections; San Francisco, CA. February 16–19, 2010. [Google Scholar]
  • 51.Makombe SD, Jahn A, Tweya H, et al. A national survey of teachers on antiretroviral therapy in Malawi: access, retention in therapy and survival. PLoS One. 2007;2:e620. doi: 10.1371/journal.pone.0000620. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 52.Ekouevi DK, Balestre E, Ba-Gomis FO, et al. Low retention of HIV-infected patients on antiretroviral therapy in 11 clinical centers in West Africa. Trop Med Int Health. 2010;15:34–42. doi: 10.1111/j.1365-3156.2010.02505.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 53.Lagarde E, Schim van der Loeff M, Enel C, et al. Mobility and the spread of human immunodeficiency virus into rural areas of West Africa. Int J Epidemiol. 2003;32:744–752. doi: 10.1093/ije/dyg111. [DOI] [PubMed] [Google Scholar]
  • 54.Ive T, Conradie F, Xaba S, Sanne I. Causes of loss to follow-up in patients taking antiretroviral therapy in the national rollout program of South Africa. 3rd International AIDS Society Conference on HIV Pathogenesis and Treatment; Rio de Janeiro. July 24–27, 2005. [Google Scholar]
  • 55.Dehab M, Charalambous S, Karstaedt A, et al. Off the radar screen: comparing reasons for treatment default in a workplace ART programme and a public sector clinic in South Africa. 17th International AIDS Conference; Mexico City, Mexico. 2008. [Google Scholar]
  • 56.Kaplan R, Orrell C, Zwane E, et al. Loss to follow-up and mortality among pregnant women referred to a community clinic for antiretroviral treatment. AIDS. 2008;22:1679–1681. doi: 10.1097/QAD.0b013e32830ebcee. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 57••.Geng EH, Glidden DV, Bwana MB, et al. Retention in care and connection to care among HIV-infected patients receiving antiretroviral therapy in Africa: estimation via a sampling-based approach. Submitted. 2010 doi: 10.1371/journal.pone.0021797. [DOI] [PMC free article] [PubMed] [Google Scholar]; This study demonstrated that using an efficient sampling-based approach to ascertain outcomes among patients lost from clinic, retention in care among HIV-infected patients on ART can be estimated and that it differs markedly from retention in clinic.
  • 58.Brinkhof MW, Pujades-Rodriguez M, Egger M. Mortality of patients lost to follow-up in antiretroviral treatment programmes in resource-limited settings: systematic review and meta-analysis. PLoS ONE. 2009;4:e5790. doi: 10.1371/journal.pone.0005790. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 59.Anglaret X, Toure S, Gourvellec G, et al. Impact of vital status investigation procedures on estimates of survival in cohorts of HIV-infected patients from Sub-Saharan Africa. J Acquir Immune Defic Syndr. 2004;35:320–323. doi: 10.1097/00126334-200403010-00015. [DOI] [PubMed] [Google Scholar]
  • 60.Botha JL, Bradshaw D. African vital statistics--a black hole? S Afr Med J. 1985;67:977–981. [PubMed] [Google Scholar]
  • 61.Petersen ML, Deeks SG, Martin JN, van der Laan MJ. History-adjusted marginal structural models for estimating time-varying effect modification. Am J Epidemiol. 2007;166:985–993. doi: 10.1093/aje/kwm232. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 62.Petersen ML, Wang Y, van der Laan MJ, Bangsberg DR. Assessing the effectiveness of antiretroviral adherence interventions. Using marginal structural models to replicate the findings of randomized controlled trials. J Acquir Immune Defic Syndr. 2006;43(Suppl 1):S96–S103. doi: 10.1097/01.qai.0000248344.95135.8d. [DOI] [PubMed] [Google Scholar]
  • 63.Robins JM, Hernan MA, Brumback B. Marginal structural models and causal inference in epidemiology. Epidemiology. 2000;11:550–560. doi: 10.1097/00001648-200009000-00011. [DOI] [PubMed] [Google Scholar]
  • 64.Cole SR, Hernan MA. Constructing inverse probability weights for marginal structural models. Am J Epidemiol. 2008;168:656–664. doi: 10.1093/aje/kwn164. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 65.Magnus M, Jones K, Phillips G, 2nd, et al. Characteristics associated with retention among African American and Latino adolescent HIV-positive men: results from the outreach, care, and prevention to engage HIV-seropositive young MSM of color special project of national significance initiative. J Acquir Immune Defic Syndr. 53:529–536. doi: 10.1097/QAI.0b013e3181b56404. [DOI] [PubMed] [Google Scholar]
  • 66.Diez-Roux AV. Bringing context back into epidemiology: variables and fallacies in multilevel analysis. Am J Public Health. 1998;88:216–222. doi: 10.2105/ajph.88.2.216. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 67.Bangsberg DR, Ware N, Simoni JM. Adherence without access to antiretroviral therapy in sub-Saharan Africa? AIDS. 2006;20:140–141. doi: 10.1097/01.aids.0000196168.50303.31. author reply 141–142. [DOI] [PubMed] [Google Scholar]
  • 68.Harries AD, Zachariah R, Lawn SD, Rosen S. Strategies to improve patient retention on antiretroviral therapy in sub-Saharan Africa. Trop Med Int Health. 2010;15:70–75. doi: 10.1111/j.1365-3156.2010.02506.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 69.Lurton G, Akonde A, Madec Y, et al. Looking for lost to follow-up patients: experience of Ségou, Mali. 17th International AIDS Conference; Mexico City, Mexico: 2008. [Google Scholar]

RESOURCES