Skip to main content
PLOS ONE logoLink to PLOS ONE
. 2015 Jul 6;10(7):e0130676. doi: 10.1371/journal.pone.0130676

The Impact of Visual Aids and Enhanced Training on the Delivery of Positive Health, Dignity, and Prevention Messages to Adult Patients Living with HIV in Rural North Central Mozambique

Carolyn M Audet 1,2,6,*, Sarah A Gutin 4, Meridith Blevins 1,3,6, Elvino Chiau 5, Fernanda Alvim 5, Eurico Jose 5, Lara M E Vaz 1,6, Bryan E Shepherd 3, Carol Dawson Rose 5
Editor: Marcia Edilaine Lopes Consolaro7
PMCID: PMC4493138  PMID: 26147115

Abstract

Introduction

Positive health, dignity, and prevention (PHDP) interventions target people living with HIV and AIDS (PLHIV) to promote well-being and prevent onward transmission. Concern that increased life expectancy and improved well-being would lead to increased risky sexual behaviour and subsequent HIV transmission motivated researchers to test novel strategies to support treatment adherence, encourage safer sex, STI treatment and partner testing, prevention of mother to child transmission, and support uptake of family planning.

Methods

We assessed the number and type of PHDP messages delivered to PLHIV before and after the implementation of an educational intervention for health providers combined with the distribution of visual job aids and monthly technical assistance.

Results

From April 21, 2013 to March 20, 2014, we documented 54,731 clinical encounters at three rural health centres in Zambézia province, Mozambique from 9,248 unique patients. The percentage of patients who received all seven PHDP messages during their last three visits was 1.9% pre-intervention vs. 13.6% post- intervention (p=<0.001). Younger patients (25 years vs. 35) and those with a recent HIV diagnosis (two weeks vs. two years) had higher odds of receiving any PHDP message (Odds Ratio [OR]: 1.22 and 2.79, respectively). Patients >59 days late collecting medications were not more likely to receive adherence messages than adherent patients (p=0.17).

Discussion

Targeting HIV prevention efforts to PLHIV is an effective HIV prevention approach to eliminate HIV transmission. Despite intensive training and support, PHDP message delivery remained unacceptably low in rural Mozambique. Patients at high risk for treatment abandonment were not more likely to be counselled about adherence and support measures, something that needs to be addressed.

Conclusions

We need to develop novel strategies to motivate health care providers to deliver these messages more consistently to all patients and develop a system that assists counsellors and clinicians to quickly and effectively determine which messages should be delivered.

Introduction

Mozambique has one of the world’s highest burdens of human immunodeficiency virus (HIV) and acquired immunodeficiency syndrome (AIDS), with an estimated 11.1% of the adult population living with HIV [1]. The Mozambican Ministry of Health (MISAU) has partnered with the Centers for Disease Control and Prevention (CDC) to provide nationwide free access to HIV care and treatment. Given the generalized HIV epidemic, the current national strategy is the antiretroviral therapy (ART) acceleration plan, which aims to have 85% of individuals who are HIV infected, started on antiretroviral medication as directed through the World Health Organization (WHO) HIV treatment guidelines [2]. Initiation, retention, and adherence to ART reduces the risk of HIV transmission to sexual partners and infants [3, 4] and mortality [5]. As a result, life expectancy for those initiating treatment with baseline CD4 counts >350 cells/mm3 is approaching that of the general population [6]. Concern that increased life expectancy and improved well-being would lead to increased risky sexual behaviour and subsequent HIV transmission [711] motivated researchers to test novel clinical strategies to support treatment adherence, encourage safer sex, STI treatment and partner testing, and support uptake of family planning services [12, 13].

Positive health, dignity, and prevention (PHDP), or as they are known in Mozambique, Positive prevention (PP) interventions, specifically target people living with HIV and AIDS (PLHIV) to promote well-being and prevent onward transmission, including sexual transmission and mother-to-child transmission [1420]. Strategies to improve PHDP behaviours have included: clinical based couples counselling and testing,[2125] counselling and increased availability of family planning,[26] individualized clinician-delivered prevention interventions,[27, 28] and group counselling and education for HIV-infected adults;[29] internet or computer-based education sessions; [30] and peer-delivered HIV prevention interventions [31]. Most studies have shown that communication of prevention messages is effective at increasing condom use and uptake of family planning services when done by a health care worker (HCW) in a clinic setting [3235]. Mozambique is one of the few countries that has prioritized PHDP as part of their national strategy to address HIV prevention in all health facilities. The approach in Mozambique is to train and enlist all health facility staff to ensure patients receive messages throughout the continuum of care. However, two primary challenges limit scale up of PHDP: (1) low-resourced health infrastructure and staffing to meet the population demands; and (2) extremely low health literacy levels among patients, estimated at 52% nationwide [36].

Training HCWs to incorporate PHDP message delivery and counselling into their clinical services presents a solid, evidence-based approach to the prevention of HIV transmission by those already infected [35]. Integrating PHDP into clinical service delivery in rural Mozambique has remained a challenge, however, despite the introduction of an evidence-based curriculum by the University of California, San Francisco (UCSF)[37, 38]. While PHDP training materials and sessions were acceptable to both patients and providers,[37] delivery of PHDP messages remained poorly documented in the medical record. The purpose of this study was to assess the number and type of PHDP messages delivered to PLHIV before and after the implementation of an educational intervention for clinicians providing HIV care and treatment combined with the distribution of job aids (including posters and flipcharts with images depicting PHDP messages) to each clinical and counselling room.

Materials and Methods

Study Setting

Morrumbala, Pebane and Maganja da Costa are rural districts with estimated populations of 215,000 (Morrumbala and Pebane) and 305,000 (Maganja da Costa) respectively. Educational attainment in the region is typically less than primary school and few people have any monthly income [39]. The three district hospitals included in the study provide HIV testing, care and treatment services (including ART), prevention of mother-to-child transmission (PMTCT), family planning, and early infant diagnosis and treatment, free of charge. These sites were chosen for their linguistic variability (they represent three distinct linguistic groups) and because they provide all referral services described on the PHDP package of services

Study Population

All HIV-positive male and female patients aged ≥ 18 years with at least one contact (clinical appointment, counselling session, or pharmacy pick-up) at one of the three study sites from April 2013 to March 2014 were included in the study. Patients < 18 years of age enrolled in care were excluded.

Positive Prevention Intervention Protocol

Every patient receiving HIV care and treatment in Mozambique should be provided PHDP messages during clinical, counselling, and pharmacy visits [40]. These messages (part of the Positive Prevention Toolkit) were developed by researchers at University of California, San Francisco [41], from pilot studies in Maputo, Mozambique [37, 38, 42] and implemented as a national strategy by the Ministry of Health in April 2013. Concurrently, a new form, the Ficha de Avaliação Psicossocial e de Prevenção Positiva (Psychosocial Assessment and Positive Prevention Record) was introduced into patient records to allow providers to document delivery of PHDP messages during each clinical encounter (Fig 1). In November 2013, a four day short-course PHDP training session for all HIV care and treatment clinicians and counsellors was provided at the three study sites. The training focused on the importance of PHDP, how and when to deliver messages, how to address patient barriers to service uptake, and how to use new visual aids (a poster and flip-chart containing images of PHDP services and behaviours). These providers were also given a PHDP poster and flip-chart for their offices which provide visual images of PHDP messages to facilitate discussion with patients. Monthly technical assistance follow-up visits at the HCW’s clinical care site within four weeks of the training were provided to improve the implementation of the PHDP intervention in their day-to-day work and as a way to provide reinforcement for the skills taught in the enhanced PHDP training package. Providers were trained to ensure that each patient received all seven messages (including the most relevant PHDP 5 message) every three months (Table 1).

Fig 1. Psychosocial Evaluation and Positive Prevention form.

Fig 1

Table 1. Positive Health, Dignity, and Prevention (PHDP) messages.

PHDP1 Sexual behavior and use of condoms
PHDP2 Reveal serostatus to partner/invite partner to test
PHDP3 Adherence to care and medication
PHDP4 Screening for sexually transmitted infections
PHDP5a Family planning service availability
PHDP5b PMTCT
PHDP6 Use of drugs and alcohol
PHDP7 Community support group referral

Data Management and Outcomes

Data was documented during each patient visit by the provider using the Ficha de Avaliação Psicossocial e de Prevenção Positiva (a Ministry of Health approved form) and subsequently entered into an OpenMRS Electronic Medical Records (EMR). Major categories of data included: demographics (age, sex, marital status, service entry into program), routine clinical information (pregnancy status, partner serostatus, use of ART, and last two pharmacy pick-ups), and receipt of the seven PHDP messages at each clinical visit. Of primary interest was the number of messages received. Additionally, type of message receipt was considered. The number and type of messages received occurs at the visit level and the database includes anywhere from 1 to 21 visits per patient. Messages are detailed in Table 1.

Ethics considerations

This study was approved by the Vanderbilt University Institutional Review Board, the University of California, San Francisco Committee on Human Research, the Comité Nacional de Bioética a Saúde in Mozambique, and the Centers for Disease Control and Prevention in Maputo, Mozambique and Atlanta, USA. The data utilized constitute fully de-identified data; the research file has an encrypted identifier and does not include patient names, addresses, or ID numbers. As the data was de-identified when it was collected, patient consent was not required.

Statistical methods

Patient characteristics were compared among those with visits before and after intervention using descriptive statistics. The proportion of patients who received all seven PHDP messages during their last three visits (excluding pharmacy-only visits) was compared using chi-square test. This analysis was repeated for patients who received four of seven messages during the same time period. The frequency and proportion of visits with PHDP message receipt were compared before and after intervention using cluster-adjusted Wald statistics to account for correlation between visits from the same patient.

Multivariable negative binomial regression with robust variance estimation was used to determine whether the incidence of message receipt was higher post-training. Multivariable logistic regression with robust variance estimation modelled receipt of any PHDP message as a binary response variable. Both models included an indicator for pre-/post-training and adjusted for health facility, time since HIV diagnosis, patient sex, and age. We hypothesized that message receipt across patient sex would be different following training and that sites would have differential PHDP message delivery following training; thus, a three-way interaction effect was included in both models for pre-/post-training, health facility, and patient sex. The robust covariance estimates account for correlation of the count data across multiple patient visits. To relax linearity assumptions in the logistic regression, we modelled age and time since HIV diagnosis using restricted cubic splines with 4 knots [43]. The database had a record for date of last scheduled ART pickup and last actual ART pickup. We subsetted to each patient's last visit occurring after the last pharmacy pick-up and consider only PHDP3 as the outcome of interest, such that we modelled the probability of adherence message receipt using logistic regression. The model included an indicator for late pharmacy pick-up (>59 days late) and adjusts for pre-/post-intervention receipt, health facility, time since HIV diagnosis, patient sex, and age. Additionally, we tested for an interaction between pre-/post-training and site to determine if administration of the adherence message differed across site. To relax linearity assumptions, we modelled age and time since HIV diagnosis using restricted cubic splines with 4 knots [43]. Marital status was missing for nearly 40% of patients and was excluded from regression models. All regression models used complete cases with no imputation; missing data was minimal. All statistical analyses were conducted using R-software 3.0.2 (www.r-project.org/).

Results

From April 21, 2013 to March 20, 2014, we documented 54,731 clinical encounters at Maganja da Costa, Pebane, and Morrumbala from 9,248 unique patients. The number of visits per patient during follow-up ranged from 1 to 21. Table 2 summarizes characteristics of eligible participants. Participants were primarily female (70%), had a median age of 32 years (interquartile range [IQR]: 26–39), were taking ART (77%), and were living with a partner (38%). Patients received up to three types of services at each visit: (1) medical consultation; (2) medication pick-up; and (3) psychosocial counselling. Fig 2 shows a diagram: types of visits during the study.

Table 2. Summary of Patient Characteristics.

Maganja da Costa Pebane Morrumbala Combined
(n = 3405) (n = 3157) (n = 2686) (n = 9248)
Female, n(%) 2501 (73%) 2132 (68%) 1814 (68%) 6447 (70%)
Current age b , median (IQR) 31 (26–38) 32 (26–41) 32 (26–39) 32 (26–39)
Age at enrollment, median (IQR) 29 (23–35) 30 (24–39) 29 (24–36) 29 (23–37)
Marital status, n(%)
 Missing 1023 (30%) 1465 (46%) 1110 (41%) 3598 (39%)
  Divorced 3 (< 1%) 1 (< 1%) 0 (0%) 4 (< 1%)
  Living with partner 1405 (59%) 476 (28%) 291 (18%) 2172 (38%)
  Married 341 (14%) 590 (35%) 735 (47%) 1666 (29%)
  Never married 449 (19%) 535 (32%) 423 (27%) 1407 (25%)
  Separated 1 (< 1%) 2 (< 1%) 2 (< 1%) 5 (< 1%)
  Widowed 183 (8%) 88 (5%) 125 (8%) 396 (7%)
Currently pregnant b , n(%) 397 (12%) 205 (6%) 244 (9%) 846 (9%)
Currently on ART b , n(%) 2552 (75%) 2389 (76%) 2178 (81%) 7119 (77%)
Time since HIV diagnosis (days), median (IQR) 399 (0–1220) 355 (0–1010) 528 (14–1430) 418 (0–1210)
 Missing, n(%) 99 (3%) 175 (6%) 120 (4%) 394 (4%)
GAAC (community adherence groups) 310 (9%) 22 (1%) 456 (17%) 788 (9%)
Current visit type b , c , n(%)
  Consultation 2796 (82%) 1653 (52%) 1881 (70%) 6330 (68%)
  Med pick-up 1736 (51%) 1659 (53%) 1497 (56%) 4892 (53%)
  Counseling 542 (16%) 1385 (44%) 1505 (56%) 3432 (37%)

Interquartile range (IQR) comprises the 25th and 75th percentiles.

b Current variables reflect data from the first visit during study period.

c Percentages may sum over 100%.

Fig 2. Types of Visits during Study Period.

Fig 2

PEPFAR, the CDC and the Mozambican Ministry of Health recommend that each patient receive all seven PHDP messages within three visits to the health facility. The percentage of patients who received all seven PHDP messages during their last three visits pre-intervention was 1.9% vs. 13.6% post- intervention (excluding pharmacy-only visits) (p-value <0.001). We also computed the percentage of patients who received four of seven messages over the same time period (with the assumption that clinicians may already know some messages were not relevant to a particular person based on clinical or social history of the patient). We found that only 14.8% received four messages pre-intervention vs. 38.5% post-intervention (p-value <0.001).

Frequency of PHDP message delivery increased from pre- to post-intervention (Table 3: Positive Prevention Message Receipt). Post-intervention, the most commonly delivered messages were: (1) the importance of adherence to ART (14%); (2) the importance of using condoms during sex (14%); and (3) the importance of revealing serostatus to partner/inviting one’s partner to test (13%). Messages about use of drugs and alcohol, community support groups, and family planning/PMTCT showed the greatest improvements, given extremely low delivery levels pre-intervention.

Table 3. Receipt of Positive Prevention Messages during 54731 Patient Visits by Intervention Period.

Pre Post Combined P-value a
(n = 34041) (n = 20690) (n = 54731)
Sexual behavior and use of condoms 2475 (7%) 2899 (14%) 5374 (10%) < 0.001
Reveal serostatus to partner/invite partner to test 2043 (6%) 2767 (13%) 4810 (9%) < 0.001
Adherence to care and medication 2482 (7%) 2887 (14%) 5369 (10%) < 0.001
Sexually transmitted infections 1296 (4%) 2387 (12%) 3683 (7%) < 0.001
Family planning 1051 (3%) 1924 (9%) 2975 (5%) < 0.001
PMTCT 736 (2%) 1718 (8%) 2454 (4%) < 0.001
Use of drugs and alcohol 773 (2%) 2235 (11%) 3008 (5%) < 0.001
Community support group referral 503 (1%) 1695 (8%) 2198 (4%) < 0.001

a Tests of association based on cluster-adjusted Wald statistics that account for correlation between visits from the same patient. There are 9248 patients and 54731 visits included in this table. During pre-intervention, 7702 patients were seen, and during post intervention 6734 patients were seen; among these, 5188 had visits both pre- and post-intervention. The most visits for any one patient pre-intervention was 15 and post-intervention was 13 visits.

Table 4 shows factors associated with the number of messages received. Younger patients and those more recently diagnosed with HIV were more likely to receive messages. Patient visits including a clinical consultation or counselling contact had rates of message delivery almost twice those of other patient visits. Message delivery was much higher after intervention than before, the change differed by sex and site (p<0.001). The rate of message receipt for a female patient in Morrumbala was almost four times greater post-intervention than pre-intervention training. In contrast, the rate of message receipt for a female in Pebane post-intervention was only 1.22 times greater than the rate at pre-intervention.

Table 4. Adjusted incident rate ratios for number of messages received in a visit.

Incident Rate Ratio (95% CI)
Age (per 1 year increase) 0.98 (0.98, 0.99)
Time since HIV diagnosis (per 1 sqrt-day increase) 0.98 (0.97, 0.98)
Consultation 2.01 (1.86, 2.17)
Pharmacy pick-up 0.73 (0.69, 0.77)
Counseling 2.91 (2.72, 3.11)
Contrasts of Post vs. Pre (ref)
 Female at Maganja da Costa 1.84 (1.68, 2.02)
 Male at Maganja da Costa 2.59 (2.05, 3.28)
 Female at Morrumbala 3.73 (3.16, 4.42)
 Male at Morrumbala 3.66 (2.44, 5.47)
 Female at Pebane 1.22 (1.01, 1.46)
 Male at Pebane 2.48 (1.59, 3.86)

Results were similar when we looked at factors associated with any receipt of messages. Younger patients (25 years vs. 35) and those with a recent HIV diagnosis (two weeks vs. two years) had higher odds of receiving any PHDP message (Odds Ratio [OR]: 1.22 and 2.79, respectively) (Table 5: Adjusted Odds Ratios for ANY PHDP Message Receipt). Those who received counselling had 5.1 times greater odds of receiving a message (vs. those who did not receive counselling that visit), while those who received a clinical consultation had 2.54 times the odds of receiving a message (vs. someone who did not receive a clinical consultation). People who collected medications from the pharmacy had 25% lower odds of receiving a message (vs. those who did not pick up medication). This trend existed for all messages. Delivery of any PHDP message increased for men and women at all three clinics post-intervention. While improvements were noted in each clinic for every type of PHDP message, Pebane consistently had lower odds of increased message delivery than Morrumbala and Maganja da Costa.

Table 5. Adjusted Odds Ratios for ANY PP Message Receipt.

Odds Ratio (95% CI)
Age
 25 years 1.22 (1.15, 1.30)
 35 years (ref) 1
 45 years 0.91 (0.86, 0.97)
Time since HIV diagnosis
 Recent (two weeks) 2.79 (2.51, 3.11)
 One year 1.31 (1.27, 1.35)
 Two years (ref) 1
 Five years 1.48 (1.35, 1.63)
Consultation 2.54 (2.34, 2.77)
Pharmacy pick-up 0.75 (0.70, 0.80)
Counseling 5.10 (4.71, 5.52)
Contrasts of Post vs. Pre (ref)
 Female at Maganja da Costa 2.01 (1.82, 2.23)
 Male at Maganja da Costa 2.61 (2.17, 3.14)
 Female at Morrumbala 3.38 (3.02, 3.78)
 Male at Morrumbala 3.28 (2.73, 3.94)
 Female at Pebane 1.50 (1.29, 1.75)
 Male at Pebane 2.49 (1.86, 3.32)

Age and time since diagnosis are modeled using restricted cubic splines with 4 knots.

Tests of association: age (p < 0.001), time since HIV diagnosis(p < 0.001), sex, (p < 0.001), clinic (p < 0.001), intervention (p < 0.001), clinic consultation (p < 0.001), pharmacy pick-up (p < 0.001), counseling visit (p < 0.001), three-way interaction of sex-clinic-intervention (p = 0.017).

We modelled the probability of adherence message delivery to determine if a patient being more than 59 days late for pharmacy visit had higher odds of receiving an adherence message receipt from clinicians. While there were statistically significant increases in adherence message delivery pre- and post-intervention at all sites (data not shown), there was little evidence that those who were non-adherent to their medication pick-up had higher odds of receiving a message about the importance of adherence (OR: 1.23; 95% CI: 0.91–1.65; p = 0.18). Considering adherence message receipt among all adult visits, messages about adherence were most commonly delivered by counsellors (OR: 3.82; 95%CI: 3.51–4.16) and clinicians (OR: 2.33; 95% CI: 2.12–2.57), with pharmacists least likely (OR: 0.73; 95% CI:0.67–0.78) to deliver messages.

Discussion

While HIV risk reduction interventions for PLHIV have been shown to be effective in the United States [4447], few programs have focused on developing HIV prevention interventions within clinical settings for PLHIV in African contexts, despite the need for these. One successful program in South Africa has found that PHDP interventions can be delivered with fidelity with counsellors providing the majority of intervention steps during visits [33, 34]. The results of another prevention intervention package for healthcare and treatment settings in Kenya, Namibia, and Tanzania are yet to be released [48, 49]. In Mozambique, in addition to a National ART acceleration plan that seeks to reach 85% of infected Mozambicans with antiretroviral medication, the Ministry of Health is using Positive Prevention/ PHDP, a health education and behavioural approach, towards facilitating better HIV outcomes and less HIV transmissions [40]. In this study in rural Mozambique, we assessed whether a PHDP training approach focused on using updated training materials, support guides and job aides along with monthly HCW technical assistance follow-up visits would improve the delivery of PHDP messages during clinical encounters, as documented in the clinical record. Overall, as a result of the PHDP training and follow-up approach, improvements were seen in both the percentage of patients who received all seven PHDP messages during their last three visits as well as the percentage of patients who received each individual PHDP message, but the proportion of patients receiving adequate PHDP messages remains sub-optimal. Despite intensive training and support, PHDP message delivery remained unacceptably low in rural Mozambique. We need to develop novel strategies to motivate health care providers to deliver these messages more consistently to all patients.

In this study younger patients and those with a recent HIV diagnosis had higher odds of receiving PHDP messages. While we did not investigate provider rational for message delivery focused on these two populations the literature suggests: (1) younger HIV-positive patients engage in higher risk behaviour than older adults; (2) clinicians are more comfortable addressing prevention with younger patients and those new to HIV care; and (3) patients newly-engaging in care have the least information and thus are in need of a greater amount of counselling [5054]. Several studies correlate younger age with HIV risk behaviour in HIV-positive clinic samples [5052]. Flickinger found that younger patients and those who had a shorter duration of the patient provider relationship were more likely to report greater sexual risk behaviour when compared with older, more established patients [54]. Duration of the clinical relationship may indicate a more recent diagnosis [53] and HIV-positive patients recently engaged in care report higher risk behaviours [11]. Other studies have indicated that it is important to capitalize on those newly infected patients [55] because diagnosis presents an opportunity to address prevention of transmission earlier in their illness. Offering continued messages to patients who have been living with HIV and engaged with services however is also necessary as these patients will continue to have distinct and changing needs over time [7, 56]. In addition, PHDP is not only about decreasing transmission but a method of increasing the quality of care for HIV-positive individuals over time. Thus, it will be necessary to work with providers on continuing to give attention to the needs of ongoing patients.

HIV prevention needs to be multi-faceted and patients may feel that receiving information and support from various sources is beneficial. In this study, counsellors were most likely to offer patients a PHDP message, followed by clinical providers and lastly by pharmacy staff. Counsellors had almost two times higher odds of giving patients a PHDP message compared to clinical providers. These findings are not surprising given that in many health centres, there is a shortage of trained clinicians both in Mozambique as well as in other African contexts [5759]. In such situations, counsellors tend to spend more time with patients addressing behavioural issues than clinicians. Additionally, in the Mozambican context, counsellors play an important role providing psycho-social support services. In various settings, counsellors have been found to be effective at delivering HIV prevention messages [60, 61]. However, research in the US has suggested that messages given by clinicians have the most impact on changing the behaviours of HIV clients [32]. The lower number of messages given by clinicians, although perhaps not surprising, is disappointing, given that messages from clinical providers have been shown to be effective at reducing high risk behaviours [62] and may carry more weight. Clinicians should continue to be encouraged to help their patients reduce risk behaviours and may be best placed to offer bio-medical messages about treatment for STIs and PMTCT, for example. However, due to the patient volume and complex needs of PLHIV, various cadres could offer HIV prevention messages so that comprehensive prevention that better meets the needs of patients is offered.

For pharmacies and pharmacy staff who are serving and supporting patients with HIV, optimal adherence is critical for improved health as well as prevention [63]. Our findings indicate that patients were unlikely to receive information about the importance of, or support for, adherence to ART during their pharmacy visits. Adherence, which is one of the PHDP messages, is a cornerstone of HIV prevention and care, and a visit to the pharmacy represents an opportunity for both adherence assessment and counselling. However, pharmacy and medication dispensing has not historically been utilized to its fullest benefit especially in low and middle income countries [64]. However, recent study findings indicate that for patients using pharmacies with HIV specific services or having HIV pharmacy staff involved in HIV care is associated both with improvements in ART adherence as well as facilitating an increase in the proportion of patients with suppressed viral load [65] and higher medication refill rates [63]. Also, in a recent review [65], in all but one study, the contribution of an HIV pharmacist to patient care was associated with clinically and statistically significant improvements in ART adherence. Supporting patients with HIV to achieve ART adherence is important for patients and because of the low documented number of PHDP messages given during pharmacy visits, this is an area that could be targeted for improvement in the delivery of PHDP. This represents a missed opportunity for pharmacy staff to offer an appropriate PHDP message, prevention education and behavioural support.

There are several limitations to our study. The pre-post design is vulnerable to a time bias (perhaps PHDP message delivery was improving due to an undocumented outside effect, unrelated to our training and materials). In this study, documentation of PHDP messages on the Ficha de Avaliação Psicossocial e de Prevenção Positiva was used as proxy for PHDP messages delivered. Clinicians may be delivering messages but may not document this delivery, despite training and recommendations (resulting in under-reporting). Alternatively, clinicians may be documenting message delivery which never occurred or which patients do not understand (resulting in over-reporting). If a clinician knows the patient, and believes a message will be of no value (for example, they know the person does not drink alcohol or is not sexually active) it is reasonably certain messages will not be provided. This will result in apparent under-delivery of messages, but would not result in a negative impact on the patient’s well-being.

Conclusions

For the thousands of individuals living with or at risk for HIV in Mozambique, HIV prevention is paramount. Targeting HIV prevention efforts with individuals who are aware of their infection is one of the most effective HIV prevention approaches we have towards eliminating HIV transmission. An effective approach to preventing the transmission of HIV includes supporting prevention efforts at the point of clinical care. Our intervention improved PHDP message delivery in rural Mozambique, but despite intensive training using established materials and monthly follow-up with all providers, PHDP message delivery remained unacceptably low. We need to develop novel strategies to motivate health care providers to deliver these messages more consistently to all patients.

Acknowledgments

The authors would like to thank the Mozambican Ministry of Health and the Centers for Disease Control and Prevention for their support during the intervention and evaluation. Special thanks to the clinicians, psychologists, technicians, and patients in Morrumbala, Maganja da Costa, and Pebane for their assistance in the intervention development, improvement, and implementation.

Data Availability

Due to ethical restrictions, de-identified data are available from the Vanderbilt University Institutional Ethics Committee for researchers who meet the criteria for access to confidential data. Furthermore, data are also available upon request after all necessary ethics approvals from the Mozambican Bioethics Committee (contact Vice- President Lazaro Calvo Gonzalez at Lazaro.Calvo@fgh.org.mz).

Funding Statement

This research has been supported by the President's Emergency Plan for AIDS Relief (PEPFAR) through the U.S. Department of Health and Human Services and the Centers for Disease Control and Prevention (CDC) under the terms of Cooperative Agreement Numbers 1U2GPS002770-01, 5U2GPS002770-02, 5U2GPS002770-03 and 5U2GPS002770-04. The findings and conclusions presented in this manuscript are those of the authors and do not necessarily represent the official position of the CDC. CMA was supported, in part, by a Vanderbilt career development award, UL1TR000445 (PI Bernard) and NIMH No. 1K01MH107255-01.

References

  • 1.Data on the size of the HIV/AIDS epidemic: Prevalence of HIV among adults aged 15–49 [Internet]. WHO. 2012. Available: http://apps.who.int/gho/data/node.main.622?lang=en. Accessed 2014 May 15. [Google Scholar]
  • 2. World Health Organization. WHO Consolidated Guidelines on THE USE OF ARV DRUGS FOR TREATING & PREVENTING HIV INFECTION. WHO Press; [Internet]. 2013:[273 p.]. Available: http://apps.who.int/iris/bitstream/10665/85321/1/9789241505727_eng.pdf [Google Scholar]
  • 3. Granich RM, Gilks CF, Dye C, De Cock KM, Williams BG. Universal voluntary HIV testing with immediate antiretroviral therapy as a strategy for elimination of HIV transmission: a mathematical model. Lancet. 2009;373(9657):48–57. Epub 2008/11/29. 10.1016/S0140-6736(08)61697-9 . [DOI] [PubMed] [Google Scholar]
  • 4. Donnell D, Baeten JM, Kiarie J, Thomas KK, Stevens W, Cohen CR, et al. Heterosexual HIV-1 transmission after initiation of antiretroviral therapy: a prospective cohort analysis. Lancet. 2010;375(9731):2092–8. 10.1016/S0140-6736(10)60705-2 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5. Walensky RP, Wood R, Weinstein MC, Martinson NA, Losina E, Fofana MO, et al. Scaling up antiretroviral therapy in South Africa: the impact of speed on survival. J Infect Dis. 2008;197(9):1324–32. 10.1086/587184 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6. Samji H, Cescon A, Hogg RS, Modur SP, Althoff KN, Buchacz K, et al. Closing the Gap: Increases in Life Expectancy among Treated HIV-Positive Individuals in the United States and Canada. PLoS ONE. 2013;8(12):e81355 10.1371/journal.pone.0081355 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7. Wamoyi J, Mbonye M, Seeley J, Birungi J, Jaffar S. Changes in sexual desires and behaviours of people living with HIV after initiation of ART: implications for HIV prevention and health promotion. BMC Public Health. 2011;11:633 10.1186/1471-2458-11-633 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8. Kennedy C, O'Reilly K, Medley A, Sweat M. The impact of HIV treatment on risk behaviour in developing countries: a systematic review. AIDS Care. 2007;19(6):707–20. 10.1080/09540120701203261 . [DOI] [PubMed] [Google Scholar]
  • 9. Bateganya M, Colfax G, Shafer LA, Kityo C, Mugyenyi P, Serwadda D, et al. Antiretroviral therapy and sexual behavior: a comparative study between antiretroviral- naive and -experienced patients at an urban HIV/AIDS care and research center in Kampala, Uganda. AIDS Patient Care STDS. 2005;19(11):760–8. 10.1089/apc.2005.19.760 . [DOI] [PubMed] [Google Scholar]
  • 10. Kembabazi A, Bajunirwe F, Hunt PW, Martin JN, Muzoora C, Haberer JE, et al. Disinhibition in risky sexual behavior in men, but not women, during four years of antiretroviral therapy in rural, southwestern Uganda. PLoS One. 2013;8(7):e69634 10.1371/journal.pone.0069634 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11. Pettifor A, MacPhail C, Corneli A, Sibeko J, Kamanga G, Rosenberg N, et al. Continued high risk sexual behavior following diagnosis with acute HIV infection in South Africa and Malawi: implications for prevention. AIDS Behav. 2011;15(6):1243–50. 10.1007/s10461-010-9839-0 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12. Bunnell R, Mermin J, De Cock KM. HIV prevention for a threatened continent: implementing positive prevention in Africa. JAMA. 2006;296(7):855–8. Epub 2006/08/15. 296/7/855 [pii] 10.1001/jama.296.7.855 . [DOI] [PubMed] [Google Scholar]
  • 13. Kennedy CE, Medley AM, Sweat MD, O'Reilly KR. Behavioural interventions for HIV positive prevention in developing countries: a systematic review and meta-analysis. Bull World Health Organ. 2010;88(8):615–23. 10.2471/BLT.09.068213 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14. Global Network of People Living with HIV, UNAIDS. Positive Health, Dignity, and Prevention: A Policy Framework. Amsterdam: 2011. [Google Scholar]
  • 15. Sikkema KJ, Watt MH, Drabkin AS, Meade CS, Hansen NB, Pence BW. Mental health treatment to reduce HIV transmission risk behavior: a positive prevention model. AIDS Behav. 2010;14(2):252–62. 10.1007/s10461-009-9650-y [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16. Kalichman SC. Positive prevention: reducing HIV transmission among people living with HIV/AIDS. New York: Kluwer Academic/Plenum Publishers; 2005. xxii, 281 p. p. [Google Scholar]
  • 17. Parker L, Maman S, Pettifor A, Chalachala JL, Edmonds A, Golin CE, et al. Adaptation of a U.S. evidence-based Positive Prevention intervention for youth living with HIV/AIDS in Kinshasa, Democratic Republic of the Congo. Eval Program Plann. 2013;36(1):124–35. 10.1016/j.evalprogplan.2012.09.002 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18. Parker L, Maman S, Pettifor A, Chalachala JL, Edmonds A, Golin CE, et al. Feasibility Analysis of an evidence-based positive prevention intervention for youth living with HIV/AIDS in Kinshasa, Democratic Republic of the Congo. AIDS Educ Prev. 2013;25(2):135–50. 10.1521/aeap.2013.25.2.135 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19. Auerbach JD. Principles of positive prevention. J Acquir Immune Defic Syndr. 2004;37 Suppl 2:S122–5. . [DOI] [PubMed] [Google Scholar]
  • 20. Fisher JD, Smith L. Secondary prevention of HIV infection: the current state of prevention for positives. Curr Opin HIV AIDS. 2009;4(4):279–87. 10.1097/COH.0b013e32832c7ce5 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21. Allen S, Meinzen-Derr J, Kautzman M, Zulu I, Trask S, Fideli U, et al. Sexual behavior of HIV discordant couples after HIV counseling and testing. AIDS. 2003;17(5):733–40. Epub 2003/03/21. 10.1097/01.aids.0000050867.71999.ed . [DOI] [PubMed] [Google Scholar]
  • 22. Allen S, Serufilira A, Gruber V, Kegeles S, Van de Perre P, Carael M, et al. Pregnancy and contraception use among urban Rwandan women after HIV testing and counseling. Am J Public Health. 1993;83(5):705–10. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 23. Farquhar C, Kiarie JN, Richardson BA, Kabura MN, John FN, Nduati RW, et al. Antenatal couple counseling increases uptake of interventions to prevent HIV-1 transmission. J Acquir Immune Defic Syndr. 2004;37(5):1620–6. Epub 2004/12/04. 00126334-200412150-00016 [pii]. . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24. Pickering H, Quigley M, Pepin J, Todd J, Wilkins A. The effects of post-test counselling on condom use among prostitutes in The Gambia. AIDS. 1993;7(2):271–3. . [DOI] [PubMed] [Google Scholar]
  • 25. Roth DL, Stewart KE, Clay OJ, van Der Straten A, Karita E, Allen S. Sexual practices of HIV discordant and concordant couples in Rwanda: effects of a testing and counselling programme for men. Int J STD AIDS. 2001;12(3):181–8. . [DOI] [PubMed] [Google Scholar]
  • 26. King R, Estey J, Allen S, Kegeles S, Wolf W, Valentine C, et al. A family planning intervention to reduce vertical transmission of HIV in Rwanda. AIDS. 1995;9 Suppl 1:S45–51. . [PubMed] [Google Scholar]
  • 27. Grimley DM, Bachmann LH, Jenckes MW, Erbelding EJ. Provider-delivered, theory-based, individualized prevention interventions for HIV positive adults receiving HIV comprehensive care. AIDS Behav. 2007;11(5 Suppl):S39–47. Epub 2006/12/07. 10.1007/s10461-006-9196-1 . [DOI] [PubMed] [Google Scholar]
  • 28. Sikkema KJ, Hansen NB, Kochman A, Santos J, Watt MH, Wilson PA, et al. The development and feasibility of a brief risk reduction intervention for newly HIV-diagnosed men who have sex with men. Journal of community psychology. 2011;39(6):717–32. 10.1002/jcop.20463 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 29. Silveira MFd Santos ISd. Impact of an educational intervention to promote condom use among the male partners of HIV positive women. Journal of evaluation in clinical practice. 2006;12(1):102–11. 10.1111/j.1365-2753.2005.00626.x [DOI] [PubMed] [Google Scholar]
  • 30. Miranda J, Cote J, Godin G, Blais M, Otis J, Gueheneuc YG, et al. An Internet-Based Intervention (Condom-Him) to Increase Condom Use Among HIV-Positive Men Who Have Sex With Men: Protocol for a Randomized Controlled Trial. JMIR Research 2013;2(2). [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 31. Safren SA, O'Cleirigh C, Skeer MR, Driskell J, Goshe BM, Covahey C, et al. Demonstration and evaluation of a peer-delivered, individually-tailored, HIV prevention intervention for HIV-infected MSM in their primary care setting. AIDS Behav. 2011;15(5):949–58. 10.1007/s10461-010-9807-8 . [DOI] [PubMed] [Google Scholar]
  • 32. Myers JJ, Shade SB, Rose CD, Koester K, Maiorana A, Malitz FE, et al. Interventions delivered in clinical settings are effective in reducing risk of HIV transmission among people living with HIV: results from the Health Resources and Services Administration (HRSA)'s Special Projects of National Significance initiative. AIDS Behav. 2010;14(3):483–92. 10.1007/s10461-010-9679-y [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 33. Cornman DH, Kiene SM, Christie S, Fisher WA, Shuper PA, Pillay S, et al. Clinic-based intervention reduces unprotected sexual behavior among HIV-infected patients in KwaZulu-Natal, South Africa: results of a pilot study. J Acquir Immune Defic Syndr. 2008;48(5):553–60. 10.1097/QAI.0b013e31817bebd7 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 34. Cornman DH, Christie S, Shepherd LM, MacDonald S, Amico KR, Smith LR, et al. Counsellor-delivered HIV risk reduction intervention addresses safer sex barriers of people living with HIV in KwaZulu-Natal, South Africa. Psychology & health. 2011;26(12):1623–41. 10.1080/08870446.2011.552180 . [DOI] [PubMed] [Google Scholar]
  • 35. Rose CD, Courtenay-Quirk C, Knight K, Shade SB, Vittinghoff E, Gomez C, et al. HIV intervention for providers study: a randomized controlled trial of a clinician-delivered HIV risk-reduction intervention for HIV-positive people. J Acquir Immune Defic Syndr. 2010;55(5):572–81. 10.1097/QAI.0b013e3181ee4c62 . [DOI] [PubMed] [Google Scholar]
  • 36. National Institute of Statistics Mozambique. Adult Literacy Rate. Maputo, Mozambique: 2010. [Google Scholar]
  • 37. Gutin SA, Cummings B, Jaiantilal P, Johnson K, Mbofana F, Dawson Rose C. Qualitative evaluation of a Positive Prevention training for health care providers in Mozambique. Eval Program Plann. 2014;43:38–47. 10.1016/j.evalprogplan.2013.10.006 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 38. Dawson Rose C, Gutin SA, Reyes M. Adapting positive prevention interventions for international settings: applying U.S. evidence to epidemics in developing countries. J Assoc Nurses AIDS Care. 2011;22(1):38–52. Epub 2010/06/12. 10.1016/j.jana.2010.04.001 [DOI] [PubMed] [Google Scholar]
  • 39.Vergara A, Blevins M, Vaz LM, Manders E, Calvo L, Arregui C, et al. Baseline Survey Report: Phase I and II: Zambezia Wide. 2011.
  • 40. Conselho Nacional de Combate ao HIV e SIDA. National Strategie HIV and AIDS Response Plan 2010–2014. Maputo, Mozambique: Ministry of Health; 2010. [Google Scholar]
  • 41. University of California; San Francisco: Positive Prevention Toolkit San Francisco, USA: UCSF; 2012. [cited 2015 April 24]. Available: http://positiveprevention.ucsf.edu/moz?page=moz-HOME00EN. [Google Scholar]
  • 42. Hilliard S, Gutin SA, Dawson Rose C. Messages on pregnancy and family planning that providers give women living with HIV in the context of a Positive Health, Dignity, and Prevention intervention in Mozambique. International journal of women's health. 2014;6:1057–67. Epub 2014/12/30. 10.2147/ijwh.s67038 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 43. Harrell FE. Regression modeling strategies: with applications to linear models, logistic regression, and survival analysis. New York: Springer; 2001. xxii, 568 p. p. [Google Scholar]
  • 44. Kalichman SC, Rompa D, Cage M, DiFonzo K, Simpson D, Austin J, et al. Effectiveness of an intervention to reduce HIV transmission risks in HIV-positive people. Am J Prev Med. 2001;21(2):84–92. . [DOI] [PubMed] [Google Scholar]
  • 45. Fisher JD, Cornman DH, Osborn CY, Amico KR, Fisher WA, Friedland GA. Clinician-initiated HIV risk reduction intervention for HIV-positive persons: Formative Research, Acceptability, and Fidelity of the Options Project. J Acquir Immune Defic Syndr. 2004;37 Suppl 2:S78–87. . [DOI] [PubMed] [Google Scholar]
  • 46. Richardson JL, Milam J, McCutchan A, Stoyanoff S, Bolan R, Weiss J, et al. Effect of brief safer-sex counseling by medical providers to HIV-1 seropositive patients: a multi-clinic assessment. AIDS. 2004;18(8):1179–86. . [DOI] [PubMed] [Google Scholar]
  • 47. Fisher JD, Fisher WA, Cornman DH, Amico RK, Bryan A, Friedland GH. Clinician-delivered intervention during routine clinical care reduces unprotected sexual behavior among HIV-infected patients. J Acquir Immune Defic Syndr. 2006;41(1):44–52. . [DOI] [PubMed] [Google Scholar]
  • 48.Bachanas P, Moore J, Bollini A, Kidder D. HIV Prevention for People Living with HIV/AIDS: Evaluation of an Intervention Toolkit for HIV Care and Treatment Settings2012. Available from: http://clinicaltrials.gov/ct2/show/NCT01256463.
  • 49. Bachanas P, Medley A, Pals S, Kidder D, Antelman G, Benech I, et al. Disclosure, Knowledge of Partner Status, and Condom Use Among HIV-Positive Patients Attending Clinical Care in Tanzania, Kenya, and Namibia. AIDS patient care and STDs. 2013;27(7):425–35. Epub 2013/07/09. 10.1089/apc.2012.0388 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 50. Mhalu A, Leyna GH, Mmbaga EJ. Risky behaviours among young people living with HIV attending care and treatment clinics in Dar Es Salaam, Tanzania: implications for prevention with a positive approach. J Int AIDS Soc. 2013;16:17342 10.7448/IAS.16.1.17342 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 51. Mmbaga EJ, Leonard F, Leyna GH. Incidence and Predictors of Adolescent’s Early Sexual Debut after Three Decades of HIV Interventions in Tanzania: A Time to Debut Analysis. PLoS ONE. 2012;7(7):e41700 10.1371/journal.pone.0041700 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 52. Rotheram-Borus M, Murphy D, Coleman C, Kennedy M, Reid H, Cline T, et al. Risk Acts, Health Care, and Medical Adherence Among HIV+ Youths in Care over Time. AIDS and Behavior. 1997;1(1):43–52. 10.1023/A:1026213905034 [DOI] [Google Scholar]
  • 53. Flickinger TE, Berry S, Korthuis PT, Saha S, Laws MB, Sharp V, et al. Counseling to reduce high-risk sexual behavior in HIV care: a multi-center, direct observation study. AIDS Patient Care STDS. 2013;27(7):416–24. Epub 2013/06/27. 10.1089/apc.2012.0426 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 54. Flickinger TE, Saha S, Moore RD, Beach MC. Higher quality communication and relationships are associated with improved patient engagement in HIV care. J Acquir Immune Defic Syndr. 2013;63(3):362–6. Epub 2013/04/18. 10.1097/QAI.0b013e318295b86a [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 55. Janssen RS, Holtgrave DR, Valdiserri RO, Shepherd M, Gayle HD, De Cock KM. The Serostatus Approach to Fighting the HIV Epidemic: prevention strategies for infected individuals. Am J Public Health. 2001;91(7):1019–24. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 56. Venkatesh KK, Flanigan TP, Mayer KH. Is expanded HIV treatment preventing new infections? Impact of antiretroviral therapy on sexual risk behaviors in the developing world. AIDS. 2011;25(16):1939–49. 10.1097/QAD.0b013e32834b4ced . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 57. Hirschhorn LR, Oguda L, Fullem A, Dreesch N, Wilson P. Estimating health workforce needs for antiretroviral therapy in resource-limited settings. Hum Resour Health. 2006;4:1 Epub 2006/01/28. 1478-4491-4-1 [pii] 10.1186/1478-4491-4-1 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 58. Hagopian A, Micek MA, Vio F, Gimbel-Sherr K, Montoya P. What if we decided to take care of everyone who needed treatment? Workforce planning in Mozambique using simulation of demand for HIV/AIDS care. Hum Resour Health. 2008;6:3 Epub 2008/02/09. 1478-4491-6-3 [pii] 10.1186/1478-4491-6-3 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 59. Zachariah R, Ford N, Philips M, Lynch S, Massaquoi M, Janssens V, et al. Task shifting in HIV/AIDS: opportunities, challenges and proposed actions for sub-Saharan Africa. Trans R Soc Trop Med Hyg. 2009;103(6):549–58. Epub 2008/11/11. S0035-9203(08)00423-9 [pii] 10.1016/j.trstmh.2008.09.019 . [DOI] [PubMed] [Google Scholar]
  • 60. Rotheram-Borus MJ, Swendeman D, Comulada WS, Weiss RE, Lee M, Lightfoot M. Prevention for substance-using HIV-positive young people: telephone and in-person delivery. J Acquir Immune Defic Syndr. 2004;37 Suppl 2:S68–77. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 61. Fisher JD, Cornman DH, Shuper PA, Christie S, Pillay S, Macdonald S, et al. HIV Prevention Counseling Intervention Delivered During Routine Clinical Care Reduces HIV Risk Behavior in HIV-Infected South Africans Receiving Antiretroviral Therapy: The Izindlela Zokuphila/Options for Health Randomized Trial. J Acquir Immune Defic Syndr. 2014. 10.1097/QAI.0000000000000348 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 62. Morin SF, Koester KA, Steward WT, Maiorana A, McLaughlin M, Myers JJ, et al. Missed opportunities: prevention with HIV-infected patients in clinical care settings. J Acquir Immune Defic Syndr. 2004;36(4):960–6. . [DOI] [PubMed] [Google Scholar]
  • 63. Cocohoba J, Comfort M, Kianfar H, Johnson MO. A qualitative study examining HIV antiretroviral adherence counseling and support in community pharmacies. Journal of managed care pharmacy: JMCP. 2013;19(6):454–60. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 64. Penn C, Watermeyer J, Evans M. Why don't patients take their drugs? The role of communication, context and culture in patient adherence and the work of the pharmacist in HIV/AIDS. Patient Educ Couns. 2011;83(3):310–8. 10.1016/j.pec.2011.02.018 . [DOI] [PubMed] [Google Scholar]
  • 65. Saberi P, Dong BJ, Johnson MO, Greenblatt RM, Cocohoba JM. The impact of HIV clinical pharmacists on HIV treatment outcomes: a systematic review. Patient preference and adherence. 2012;6:297–322. 10.2147/PPA.S30244 [DOI] [PMC free article] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Data Availability Statement

Due to ethical restrictions, de-identified data are available from the Vanderbilt University Institutional Ethics Committee for researchers who meet the criteria for access to confidential data. Furthermore, data are also available upon request after all necessary ethics approvals from the Mozambican Bioethics Committee (contact Vice- President Lazaro Calvo Gonzalez at Lazaro.Calvo@fgh.org.mz).


Articles from PLoS ONE are provided here courtesy of PLOS

RESOURCES