Skip to main content
Springer Nature - PMC COVID-19 Collection logoLink to Springer Nature - PMC COVID-19 Collection
. 2021 Feb 8;25(10):3355–3376. doi: 10.1007/s10461-021-03181-4

Efficacy of Psychological Interventions Towards the Reduction of High-Risk Sexual Behaviors Among People Living with HIV: A Systematic Review and Meta-analysis, 2010–2020

Hanxi Zhang 1, Qing Yu 2, Zheng Li 1, Xiangfei Xiu 1, Fan Lv 1, Mengjie Han 1, Lu Wang 1,
PMCID: PMC7869767  PMID: 33559070

Abstract

People living with HIV/AIDS (PLWH) may be vulnerable to mental illness. As sexual transmission is the leading cause of HIV infection, evidence-based study for the effect of psychological interventions on the change of sexual is needed. To estimate the efficacy of psychological interventions towards reducing unprotected sex and increasing condom use among PLWH. We systematically searched PubMed, Web of Science, EMBASE (OVID), and PsycINFO (OVID) for studies reporting psychological intervention effects on the outcomes of condom use and/or unprotected sex from 2010 to 2020. This review is registered with PROSPERO, CRD42020193640. Of 949 studies, 17 studies were included in this systematic review. Overall, participants in the intervention group reduced sexual risk or condomless sex relative to control groups. The effect was higher for people having sex with HIV-positive partners comparing with those who had sex with HIV-negative or unknown status partners. Psychological interventions might positively affect the condom use of PLWH and should be prioritized and regularly.

Keywords: HIV, Behavior, Condom use, Psychological interventions, PLWH, Meta-analysis

Introduction

HIV has become a chronic illness instead of a disease that rapidly leads to severe sickness or death due to antiretroviral medication in recent years. Sexual transmission, via unprotected heterosexual or homosexual contact, is the leading cause of HIV infection. Thus, sexual risk behaviors increasing becomes an important reason for HIV transmission [1]. Simultaneously, people living with HIV/AIDS (PLWH) are those who suffer mental illness most [2]. Depression or stigmas occur commonly in HIV-positive individuals with limited the quality of life, and leading to poorly clinical outcomes [3]. A study focused on mental health problems among female sex workers has revealed that sexual assault was associated with current PTSD (post-traumatic stress disorder) symptoms. Female sex workers who had experienced violence were five times more likely to be depressed than those who were not victims of violence [4], which may increase the spread of HIV or sexual transmitted diseases (STDs) [5]. HIV-related stigma might lead HIV-positive people to internalize negative messages about themselves and other HIV-positive individuals [6]. The internalized HIV-related stigma might lead to HIV transmission-related risk behaviors, including suboptimal antiretroviral adherence, condomless sex, avoidance of medical services, and HIV status disclosure [7].

In light of the above, several previous psychosocial interventions were conducted recent years to promote mental health among PLWH. Theoretical basis including cognitive-behavioral therapy (CBT), stress management interventions, information-motivation, and behavioral skills (IBM) have been developed for PLWH with mental disorders. These interventions effectively reduce symptoms of depression, anxiety and improving quality of life among PLWH [8, 9]. At the same time, previous systematic reviews and meta-analyses about behavioral intervention suggested that risk reduction interventions on people living with HIV/AIDS are efficacious in reducing 43% of self-reported unprotected sex [1, 10]. However, no meta-analysis was conducted to investigate the effects of psychological interventions on sexual behaviors.

Evidence showed that condom effectiveness against HIV found an average protective effect of 80% for consistent condom use, unadjusted for lack of correct use [11]. One study in New Zealand have emphasized evidence-based primary prevention by condom use, which was implemented in communities and supported by comprehensive public health action [12]. Condom use remains a staple prevention method though international attention has been recently devoted to biomedical prevention strategies such as pre-exposure prophylaxis (PrEP) [11, 13, 14].

In conclusion, the systematic review and meta-analysis on psychological interventions was conducted to evaluate the efficacy of HIV risk reduction, especially on condom use, among PLWH.

Methods

This review complied with preferred reporting items for systematic review and meta-analysis (PRISMA) [15]. A systematic literature search was performed to identify trials that evaluated the impact of psychological interventions on self-reported condom use among PLWH. The literature searching strategy was decided after several rounds of discussion. Two authors performed the searching process independently. Articles with different opinions were discussed with one or more of the other authors to decide.

Literature Search, Study Selection, and Data Extraction

We searched on PubMed, Web of Science, EMBASE (OVID), and PsycINFO (OVID) from May 4th to 12th, 2020. The search strategy can be found in the Appendix. And We selected studies carried out from January 1, 2010, to December 31, 2019. The articles were screened to determine by the following criteria: (1) The intervention target population was 14 years old or above HIV-positive subjects (including HIV discordant couples). (2) The study design should be intervention studies, including clinical trials, randomized controlled trials (RCT), a quasi-experimental design with a comparison condition, and pilot study. (3) Psychological intervention, which means the intervention primary aimed to change the mental disorders, thoughts, or emotions among PLWH. (4) Intervention outcomes included at least one behavior change technique or behavioral outcomes (condom use, sexual behavior times, number of sexual partners, commercial behavior, etc.) The flow diagram for the identification and selection of articles for inclusion was shown in Fig. 1.

Fig. 1.

Fig. 1

Flow chart showing the search and study selection process for literature

Two trained coders independently coded each eligible intervention for the following study characteristics (e.g., study date, author, location, sample size, study design), intervention characteristics (e.g., components, delivery method, follow-up), outcomes, and risk of bias. If sexual behavior data for different types of partners were reported, the review summarized the results of sex with all partners or at-risk partners (i.e., HIV-negative or status-unknown partners). Besides, for studies that reported multiple measurements or follow-up assessments, we summarized all the results for interventions by different assessments in each eligible research (i.e., condom use frequencies/proportions, condomless sex frequencies/proportions, risk/odds ratio).

Quality Assessment

Study quality was assessed using adapted Cochrane risk-of-bias variables [16]. Each intervention was evaluated for Sequence generation, Allocation concealment, Blinding (participants), Incomplete outcome data, Selective outcome reporting, Availability of treatment manual, and Use of training for therapy providers. Each item was scored as high (−1), or unclear (0) or low (1) risk of bias. Overall, study quality was scored from 0 to 7, with a higher score indicating a lower risk of bias [17]. ‘Low risk of bias’, means plausible bias unlikely to seriously alter the results (Score:  ≥ 4). ‘Unclear risk of bias’, means plausible bias that raises some doubt about the results (Score: − 4  to  4). ‘High risk of bias’, means plausible bias that seriously weakens confidence in the results (Score: ≤ −4). Disagreements in quality assessment were resolved through discussion.

Data Analysis

Meta-analysis was conducted among studies using the same measurement of condom use. For studies using various assessment were qualitatively summarized. However, we did not conduct meta-analysis for all included studies due to various intervention design and outcome assessments across sexual behaviors. We used standardized mean differences (SMD) for condom use proportion to calculate the effect size. The SMD was defined as the mean difference between treatment and control groups divided by the pooled standard deviation. Cohen’s D was calculated as a measure of effect size, and the evaluation criteria of Cohen’s D were as follows: small effects (≥ 0.2 and < 0.5); Moderate effect (≥ 0.5 and < 0.8); Big effect (0.8 or higher). Heterogeneities were assessed by I2 statistics, I2 ≤ 50% was considered as no heterogeneity, and the fixed-effects model was adopted; otherwise, a random-effects model with restricted maximum likelihood variance estimation was used to obtain average condom use effect sizes. And the funnel plot, Egger’s test of the intercept, was employed to assess indications of publication bias. All analyses were conducted in R studio 1.1.456 using a “meta” meta-analysis package.

Results

Database searching produced a total of 949 citations (Fig. 1). After the initial screening of duplicates, 699 citations were dependently reviewed by two authors, of which 643 were excluded for not meeting the inclusion criteria (e.g., review, qualitative studies, irrelevant studies, or studies without psychological intervention). Fifty-six articles were pulled for full-text review, and 39 were excluded for different reasons (unable to access the full text or specific data, or no target population, et al. See details in Fig. 1). Ultimately, 17 studies were included in the review (Table 1). The review registration number was PROSPERO CRD42020193640.

Table 1.

Descriptions of included studies

Authors, publication year Location Participants Theoretical basis Intervention Follow-up time Outcomes
Klein CH et al. 2013 [18] USA HIV-positive African-American women

Session 1: Change what you think, change what you do;

Session 2: Risk reduction, condoms and relationships;

Session 3: Risk reduction and condom management;

Session 4: Building healthy relationships, and it’s your turn, in which participants practice being peer educators

3-month

Behavioral outcomes:

(1) Percentage of condom protected vaginal and anal intercourse,

(2) 100% condom use for vaginal and anal sex

Condom use frequencies were calculated based on self-reported sexual behavior in the past 30 days

Cruess DG et al. 2018 [21] Unclear HIV-positive Gay or bisexual IMB model

Session1: Group facilitators and group members introduced themselves;

Session2: The facilitators reviewed the assignment on deception from the previous session, and introduced the topic of HIV status disclosure with partners met online

Session3: Discussion began with the assignment on sero status disclosure from the previous session

Session4: Discussed their experiences with the condom negotiation assignment from the previous session

6-month

Self-reported

total number of male sex partners during the past 6 months: including partner sero status (HIV-positive vs. HIV-negative/unknown) and the number of times they had CAS with partners in each sero status category

Parsons JT et al. 2017 [29] Unclear HIV-positive Gay and bisexual men

Unified Protocol for Trans diagnostic Treatment of Emotional Disorders (UP), consisted of the following 5 core treatment modules:

(1) Mindful emotion awareness, (2) cognitive flexibility, (3) identifying and preventing patterns of emotion avoidance, (4) increasing awareness and tolerance of emotion-related physical sensations, and (5) interoceptive and situational emotion-focused exposures

The 5 core modules are preceded by a module focused on enhancing motivation as well as an introductory module on the adaptive nature of emotions that provides a framework for understanding emotional experiences

3-month Emotion regulation; Symptoms of Sexual Compulsity; HIV transmission risk behavior
Poudel KC et al. 2015 [31] Kathmandu Valley, Nepal HIV-positive Protection Motivation Theory, Social Cognitive Theory

Session 1: emphasized skill development to cope with HIV-related stressors

Session 2: focused on participants’ knowledge of HIV; the possibility of HIV co-infection and super infection; and the consequences of having HIV co-infection, super infection, or other STIs among HIV-positive individuals

Session 3: designed to enhance participants’ knowledge of HIV transmission risk behaviors and addressed common myths about HIV/STI prevention among HIV-positive persons

Session 4: focused on the importance of condom use in preventing pregnancy and transmission of HIV and other STIs

Session 5: reinforced the benefits of consistent condom use among HIV-positive persons and the participants conducted role-play to improve safer sex negotiation skills with various partners

Post-intervention Condom use intention
Jones DL et al. 2017 [24] Urban South Florida Perinatally infected or behaviorally infected with HIV MI

Session 1: expressing empathy, identifying positive elements of target behaviors, discussing discrepancies between current behavior and goals, supporting positive behavior, promoting decision making, goal setting, exploring ambivalence and using change talk and reflecting

Session 2: focused on fertility desires, a plan for safer conception or selection of an appropriate contraceptive based on their own plan, and initiation of preconception communication with their provider

Post-intervention, 6-month Condom use proportion
Williams M et al. 2012 [33] Unclear Heterosexual African American crack cocaine users living with HIV infection Social cognitive theory

The (positive choice intervention) PCI was composed of six, 60 mins mixed gender group sessions

Session 1: Effects of antiretroviral medications, the risks and consequences of HIV/STD infection/reinfection, HIV transmission to sex partners, and risks when both sex partners are HIV-positive

Session 2:explored ways to make sex with a condom pleasurable and fun, and strategies for negotiating condom use with a reluctant partner

Session 3: examined disclosing HIV status to all sex partners and how to talk with partners about HIV and condom use

Session 4: devoted to assessing personal sexual rights, sexual diversity, the need for intimacy, and positive sexual choices

Session 5: A forum for examining gender role and relationship expectations, sexual scripts, and achieving sexual pleasure without vaginal sex

Session 6: reviewed intervention topics and invited participants to discuss any intervention topic interesting to them

3, 9-month Frequency of sex, number of sex partners, and consistent condom use in the past 30 days
Lovejoy TI et al. 2014 [26] Eastern and Midwestern United States HIV-positive late middle-age and older adults Trans theoretical model and IMB

The 4-Session Tele-MI:

Session 1 focused on ascertaining the client’s current relationship and sexual dynamics

Session 2, therapists discussed the client’s concurrent sexual relationships

If not addressed in an earlier session, Session 3 focused on the identification of barriers to engaging in protected sex and the development of a client-generated sexual behavior change plan

Session 4, the client and therapist discussed the client’s progress toward implementing the change plan and made plan modifications as needed

The 1-Session Tele-MI: therapists focused on the most high-risk behavior for clients who had multiple risky behaviors and/or sexual partnerships and only discussed secondary behaviors and concurrent sexual partnerships

3, 6-month Sexual behaviors, depression symptoms
Hart TA et al. 2016 [34] Toronto HIV-positive MSM

IMB, motivational interviewing, self-directed behavioral

skills practice

(a) Basics of HIV transmission and pathogenesis; HIV-status disclosure skills;

(b) Negotiation of safer sex practices;

(c) Exploration of non-penetrative sex alternatives;

(d) Experimentation with a variety of condoms to enhance the condom-wearing experience

Post-intervention, 3-month Sexual behavior. Participants reported the total number of male sexual partners
El-Bassel N et al. 2010 [22] Atlanta; Los Angeles; New York; Philadelphia African American HIV discordant couples Social cognitive theory, relationship-oriented ecological framework

Session1: provide information about STDs, HIV, and safer sex practices;

Session2: Enhancing Couple Communication

Session3: Safer sex methods;

Session4: Discussed other issues (e.g., use of alcohol or drugs) in their relationship that may have affected their sexual risk-taking behaviors;

Session5: Practicing the FENCE techniques to problem solve barriers to safer sex and learning to identify and build social networks that promote safer sex

Post intervention, 6, 12-month Couple’s reported proportion of condom-protected intercourse acts in the past 90 days
Mashaphu S et al. 2020 [27] Durban, South Africa HIV discordant couples Social cognitive theory, relationship-oriented ecological framework

Session1: Provide information about STDs, HIV, and safer sex practices;

Session2: Enhancing couple communication

Session3: Safer sex methods;

Session4: Discussed other issues in their relationship that may have affected their sexual risk-taking behaviors;

Session5: Practicing the FENCE techniques to problem solve barriers to safer sex; and learning to identify and build social networks that promote safer sex

3, 6-month Condom use; concurrent partners. Biological outcomes
Hightow-Weidman LB et al. 2019 [23] Unclear Young black HIV-positive MSM Integrated behavioral model (IBM)

The mobile phone and internet-based HIV intervention Interactive features within the intervention include:

Forums for discussion of relevant topics, such as HIV prevention and treatment, dealing with stigma, safer sex behaviors and relationships;

A space to upload and share personal videos, audio, pictures or prose (Getting Real); the availability of an online doctor who would respond to questions within 72-h;

Decision support tools (e.g. brief surveys, with feedback and referral to prevention services based on results, HIV testing and care locators) for assessing and addressing risk behaviors

3,6,12-month

Sexual risk behaviors;

Detectable viral load;

Psychosocial variables

Kalichman SC  et al. 2018 [25] Atlanta, GA HIV-positive Social cognitive theory of behavior change

The one-on-one coaching sessions included a brief personalized assessment of recent experiences gaining access to health care, addressing barriers to staying in care, challenges to taking cART, sexual decisions, emotions, and relationships

Each session included content directed at addressing the links between mood, situational contexts, social relations and substance use in relation to HIV health care, cART adherence, and sexual behaviors

Decisional balance exercises and problem-solving activities focused on treatment adherence and sexual risks for STI in the context of viral load

In each session, sexual decision-making was placed within scenarios of individually tailored challenges such as substance use, mood/depression, relationship status, viral load, and HIV disclosure. Effective decisions regarding medication management and sexual health strategies were the focus of each session

3,6,9,12-month

HIV viral load;

Antiretroviral adherence and HIV care visits;

Sexual behavior

Nöstlinger C et al. 2016 [28] European HIV-positive MSM SCT, IMB, and dual process approaches in health risk decision making

Session 1: focused on exploring participants emotional response to individual problems with safer sex, using the filmed role models;

Session 2: focused on developing personal solutions

for the identified problems that would fit participants’ context and lifestyles;

Session 3: counseling interaction and resulted in a personalized risk reduction plan

Post intervention, 3,6-month

Condom use; Relevant Socio-demographic;

Health-related variables

Teti M et al. 2010 [32] Philadelphia, PA Women Living with HIV/AIDS Trans theoretical Model, the Modified AIDS Risk Reduction Model, and the Theory of Gender and Power

Brief HIV prevention messages delivered by clinicians in the context of routine medical visits

• A group-level intervention (GLI) delivered by a Health Educator

• A Peer-led support group

6,12,18- month Partner Disclosure; Condom use
Brown JL et al. 2019 [19] Northeastern US city HIV-positive MSM  Motivational interviewing

Session 1: Program overview, focus on healthy living, coping effectiveness training, and stress management;

Session 2: Healthy relationships

The two group sessions that addressed motivational, behavioral skills, and HIV transmission information tailored to HIV-infected MSM coupled with stress management training

Post intervention, 3-month HIV Transmission Knowledge; Condom Attitudes; Unprotected Sexual Behaviors
Caballero-Suárez NP et al. 2019 [20] Mexico City HIV-positive CBT

Module1: Emotional regulation

Module2: Sero status disclosure

Module3: Quality of sexual life

Module4: Triggers of sexual risk behaviors

Module5: Correct and consistent condom use

Module6: Negotiation of sex

1,3-month Depression symptoms; Anxiety symptoms; Sero-status disclosure; Quality of sexual life; Consistent condom use; Correct condom use skills
Pettifor A et al. 2015 [30] Lilongwe, Malawi Acute HIV Infection IMB, Motivational interviewing

This and all subsequent sessions will begin with a review of the participant’s emotional status, understanding of HIV, behavioral experiences relating to sex or abstinence, and barriers to the chosen behavioral goals

Learning condom-use skills and negotiation, disclosure-communication skills, and social support

Reviewing the participant’s emotional status, HIV understanding, behavioral experiences relating to sex or abstinence and barriers to the chosen behavioral goals, and the status of partner notification/disclosure and referral

Weeks 2, 4, 8, 12, 16, 20 and 24 Sexual behaviors

Study Descriptions

As Table 1 showed, included studies were published between 2010 and 2020. In total, 2885 participants reported in 17 unique publications [1834] were included in the current review. Interventions focused on HIV-positive men who have sex with men (MSM) (n = 6), HIV discordant couples (n = 2), HIV-positive women (n = 2), or other HIV-positive participants (n = 7). The majority of the interventions were conducted in the United States (n = 8), while others were conducted in South Africa (n = 1), Nepal (n = 1), Canada (n = 1), Malawi (n = 1), Europe (n = 1), and four unclear study fields.

The studies differed substantially in their design. Eleven studies of them were randomized controlled trials (RCTs) with randomization at either the individual or group (facility/community) level [18, 2128, 32, 33], while six studies employed non-randomized trials (pilot study/quasi-experimental study) or a randomized trial with no control [19, 20, 2931, 34]. Studies varied in the number of interventions adopted, with fourteen reported a two-armed design, one reported a three-armed design, and two reported no control design.

Almost all studies had one or more underlying theoretical basis. Information, motivation and behavior skills model (IMB) [21, 26, 28, 30, 34], protection motivation theory/social Cognitive theory [22, 25, 27, 28, 31, 33] were the first two theories that founded the basis of intervention, others including Motivational interviewing [19, 24, 30, 34], Transtheoretical Model [32], self-directed behavioral skills practice [34], relationship-oriented ecological framework [22, 27], Integrated Behavioral Model (IBM) [23], cognitive-behavior therapy (CBT) [20], Modified AIDS Risk Reduction Model [32], and the Theory of Gender and Power [32].

Summary of Intervention Characteristics

Interventions of seventeen studies showed in Table 1. Most interventions adopted face to face, but some interventions used multiple adaptations such as mobile phones or internet-based methods [23]. The online-intervention built forums for discussion on relevant topics, such as HIV prevention and treatment, dealing with stigma and relationships, safer sex behaviors, or provided space to upload and share personal videos, etc. Some interventions combined multiple intervention components, many of which based on IMB and MI model.

Almost all of these interventions involve changing behavior by changing thoughts, mainly focused on motivation activation and skill training, such as communicated risk awareness, thinking changes, status exposure, and condom use skills training. Some interventions also included counseling and strengthened/promoted the relationship between partners to improve condom use.

Study Quality

Table 2 presented information on quality assessment. More than half of all the studies were classified as low (9/17) quality regarding the overall quality classification. One study was classified as high quality. None of the studies met all quality criteria.

Table 2.

Quality assessment of included studies

Author Sequence generation Allocation concealment Blinding of participants Incomplete outcome data Selective outcome reporting Availability of treatment manual Use of training for therapy providers Quality classification
Charles H. Klein Low Low Low Low Unclear Low Low Low
Dean G. Cruess Low Unclear Low Low Unclear Unclear Low Low
Jeffrey T. Parsons NA NA High Unclear Unclear Low Low Unclear
Krishna C. Poudel Unclear Low Unclear Unclear Unclear Unclear Low Unclear
Deborah L Jones Unclear Unclear Unclear Unclear Unclear Unclear Unclear Unclear
Mark Williams Low Low Unclear Unclear Unclear Unclear Unclear Unclear
Travis I. Lovejoy Unclear Low Unclear Unclear Unclear Low Low Low
Trevor A. Hart NA NA High Unclear Unclear Low Low Unclear
Nabila El-Bassel Low Low Low Low Unclear Low Low Low
Lisa B Hightow-Weidman Unclear Unclear Unclear Unclear Unclear Low Low Unclear
Sibongile Mashaphu Low Low Low Low Unclear Low Low Low
Seth C. Kalichman Low Low Low Low Unclear Unclear Low Low
Christiana Nöstlinger Low Low High High Unclear Unclear High High
Michelle Teti Low Low Unclear Unclear Unclear Low Low Low
Jennifer L. Brown Unclear Unclear Unclear Low Unclear Low Low Unclear
Nancy Patricia Caballero-Suárez NA NA High Unclear Unclear Low Low Low
Audrey Pettifor Low Low High Unclear Unclear Low Low Low

Intervention Effects on Condom Use or Unprotected Sex Outcomes

Table 3 showed detailed intervention effects on sexual behaviors. Included studies used different measures. Six studies provided proportions of condom use [18, 22, 24, 27, 30, 32], five studies used RR or OR as the intervention effect size [21, 23, 26, 28, 32], and others provided proportions of condomless anal sex (CAS) [19, 25, 30], frequencies of CAS [29, 34], and condom use intention [31]. These studies’ follow-up time points were generally post-intervention, three and six months after completing the intervention. And one study used ‘Treatment as Prevention’ intervention and follow up almost every month after the intervention [25].

Table 3.

Sexual behaviors findings from included studies

Variables Author Findings
Proportions of condom use
Charles H. Klein

3-month:

Sex with All partners: mean difference = 0.33, P = 0.002

HIV negative partners: mean difference = 0.31, P = 0.04

HIV positive partners: mean difference = 0.48, P = 0.003

Deborah L Jones

Means:

Control: baseline: 0.72, post intervention: 0.70, 6-month: 0.63

Intervention: baseline: 0.60, post intervention: 0.73, 6-month: 0.57

Nabila El-Bassel

Intervention:

Baseline: 0.44 (0.38)

Post-intervention: 0.82 (0.28)

6-month: 0.75 (0.36)

12-month: 0.72 (0.38)

Control:

Baseline: 0.44 (0.40)

Post intervention: 0.55 (0.43)

6-month: 0.56 (0.43)

12-month: 0.56 (0.43)

Sibongile Mashaphu

3-month:

Intervention: 73.68% Control: 37.50%

6-month:

Intervention: 77.78% Control: 71.42%

Nancy Patricia Caballero-Suárez

Baseline Mdn = 100, IQR: 88.88–100

F (One week after intervention) Mdn = 95.83%, IQR: 80.35–95.83

Correct condom use skills:

Before Mdn = 57.14%, IQR: 42.85–64.28

After Mdn = 100%

Effect size (d = 2.75)

F (One week after intervention) Mdn = 100% IQR: 85.71–100

F versus FU1 (1-month) Mdn = 92.85% IQR: 85.7–92.85, P = 0.039;

F versus FU2 (3-month) Mdn = 92.85%, IQR 85.71–92.85, P = 0.013

Mark Williams

Intervention:

Intake: 23%

3-month: 55%

9-monh: 48%

Control:

Intake: 22%

3-month: 39%

9-monh: 44%

CAS* frequencies
Jeffrey T. Parsons

3-month:

Means ± d: 9.50 ± 1.66

Trevor A. Hart

Sex with Casual HIV-positive partners:

Baseline: 61.5%, post-intervention: 46.2% 3-month: 42.3%

Sex with Casual HIV-negative partners:

Baseline: 17.3%, post-intervention: 21.2%, 3-month: 17.3%;

Casual partners of unknown HIV-status:

Baseline: 42.3%, post-intervention: 26.9% 3-month: 21.1%

Sex with Regular HIV-positive partner:

Baseline: 32.8%, post-intervention: 28.9% 3-month: 25.0%

Sex with Regular HIV-negative partner:

Baseline: 1.9%, post-intervention: 1.9% 3-month: 0.0%

Proportion of CAS*
Seth C. Kalichman

Intervention (N = 250) M (Se)

2-month: 0.69 (0.05)

4-month: 0.43 (0.04)

5-month: 0.45 (0.04)

6-month: 0.34 (0.03)

7-month: 0.44 (0.04)

9-month: 0.50 (0.04)

10-month: 0.46 (0.04)

12-month: 0.50 (0.04)

Comparison Condition (N = 250)

0.54 (0.04)

0.62 (0.05)

0.52 (0.04)

0.39 (0.04)

0.46 (0.04)

0.37 (0.03)

0.41 (0.04)

0.36 (0.04)

Jennifer L. Brown

3 months:

Intervention: M (se) 0.18 (.05) Control: M (se) 0.27 (.05),

Effect size = 0.02

Audrey Pettifor

Intervention:

Baseline: 36%

Week 12: 0%

Week 24: 0%

Control:

54%

8%

0%

RR or OR
 Condom use RR Dean G. Cruess

6-month:

Intervention vs. Control

Sex with All partners: incident rate ratios (IRR) = 0.91(0.63–1.30)

Sex with HIV-negative/unknown: (IRR) = 0.33(0.20–0.53)

Travis I. Lovejoy

3-month follow-up,

4-session MI participants vs. Controls: OR = 3.15 [1.02–9.72];

4- session vs. 1-session MI conditions: OR = 1.17 [0.48–2.86];

1-session MI vs. Control conditions: OR = 2.69 [0.88–8.27]

6-month:

4-session MI participants vs. Controls: OR = 2.23 [0.78–6.40]

4- session vs. 1-session MI conditions: OR = 1.19 [0.48–2.99];

1-session MI vs. Control conditions: OR = 1.87 [0.66–5.30]

 CAS* RR Lisa B Hightow-Weidman

3-months post-intervention:

HIV-positive partners:

Incidence ratio 0.18, 95% CI: 0.04, 0.32

Either HIV-positive with undetectable viral loads or HIV-negative/unknown:

Incidence ratio 0.88, 95% CI: 0.51, 1.26

HIV-positive partners:

Incidence ratio 0.50, 95% CI: 0.12, 0.89

Either HIV-positive with undetectable viral loads or HIV-negative/unknown:

Incidence ratio 0.87, 95% CI: 0.51, 1.23

 Condom use OR Christiana Nöstlinger

3 month vs. baseline:

Intervention: OR = 6.77, 95%CI: 2.48–18.52

Control: OR = 1.77, 95%CI: 0.72–4.32 P = 0.03

6-month vs. baseline:

Intervention: OR = 5.46, 95%CI: 2.16–13.79

Control: OR = 2.53, 95%CI: 0.98–6.52 P = 0.19

 Proportion of condom use difference OR Michelle Teti

Baseline difference: OR: 4.58 (0.85, 24.74)

6-Month difference: OR: 17.13 (2.96, 99.10)

12-Month difference: OR: 1.52 (0.25, 9.24)

18-Month difference: OR: 270.04 (24.53, 2971.94)

Condom use intention net difference
Krishna C. Poudel

Post intervention:

Regular partners: 0.60, P < 0.001;

HIV positive: 0.36, P = 0.005;

HIV negative: 0.11, P = 0.34;

HIV status unknown: 0.05, P = 0.65

CAS Condom less Anal sex

IRR Incidence risk ratio

We did meta-analysis with three interventions, which had the same measure for proportions of condom use, with means (standard variations) provided in both arms [18, 22, 24]. Heterogeneity was present in these three studies (I2 = 56%), so the random effect model was used (Fig. 2). The pooled results showed that the condom use proportion increased in the experimental group after intervention compared with the control group (Random SMD (Standard Mean Difference): 0.36; 95% CI: 0.06, 0.65). The intervention mainly contained emotional regulation, increasing communication with sexual partners, and teaching condom use skills.

Fig. 2.

Fig. 2

Forest plot of effect size: impact of prevention interventions on proportions of condom uses

There were also trials with more than one intervention arm, Travis I. Lovejoy’s study used 4-session intervention and 1-session MI to intervene with the participants. They found significant effects in 4-session group versus the control group for condom use in 3-month (OR = 3.15, 95%CI: 1.02–9.72) but not significant in 6-month follow-up (OR = 2.23, 95% CI: 0.78–6.40). In addition, no differences were observed between participants in the 1-session and control conditions or the 4-session and 1-session MI conditions at 3-month (OR = 2.69, 95% CI: 0.88–8.27 and OR = 1.17, 95% CI: 0.48–2.86, respectively) or 6-month follow-up (OR = 1.87, 95% CI: 0.66–5.30 and OR = 1.19, 95% CI: 0.48–2.99, respectively). It was noteworthy that the intervention effect decreased over time after the intervention [26].

Some studies compared condom use between different sex partners, including HIV-positive, HIV-negative, or unknown status. It showed that there were differences when had sex with HIV-positive partners compared with HIV-negative or unknown status partners [18, 21, 23, 34]. In Trevor A. Hart et al. study, they aimed to use IMB, MI to enhance condom use among HIV-positive MSM. The results showed that the condomless anal sex decreased at post-intervention and 3-month follow-up with any type of sexual partners. Besides, during the sex with casual partners who were HIV-negative or unknown, the condomless anal sex decreased largely [34]. Both HIV-positive couples might not use condoms during sex, so interventions targeting multiple HIV infections or drug resistance might be an effective intervention in helping increase condom use for both HIV-positive couples. Results also showed that condomless sex frequencies reduced for HIV-negative or unknown infection status partners, which were the significant factor for HIV transmission decreasing [35, 36]. Mark Williams’s study included the risks and consequences of HIV/STD infection/reinfection, HIV transmission to sex partners, and risks when both sex partners were HIV-positive [33]. In summary, our finding provided additional evidence for psychological intervention was helpful for HIV risk behaviors reduction, which was significant for public health implications and HIV reduction.

Discussion

This systematic review and meta-analysis provided support for conducting psychological interventions on risky sexual behaviors among people living with HIV/AIDS. For the theory basis, most studies used the IMB model and MI. The IMB model combined with HIV prevention information, motivation, and behavioral skills to change sexual risk behaviors. The IMB model was an empirically supported model for sexual risk reduction and mental health problem reduction. The intervention content involved in this paper was almost combined with HIV-related knowledge, mental health management, behavioral skills, and communication or how to disclose with sexual partners.

Overall, these interventions had positive effects on reducing sexual risk, for example, psychological interventions significantly improved the proportion of condom use. However, in most studies, effects on condom use increased post-intervention, then the effect declined with time. Effect of psychological or behavioral intervention was peak immediately after the completion of the intervention, then decreased over time, which indicated that the intervention needs to be permanent and normalized to benefit PLWH consistently.

One study combined psychological interventions into a mobile phone and internet-based platform. This study also showed a positive effect on condom use: for HIV-positive partners, the RR for CAS was 0.50 (95% CI: 0.12, 0.89) compared with the control group, and the RR for CAS was 0.87 (95% CI: 0.51, 1.23) for either HIV-positive with undetectable viral loads or HIV-negative/unknown partners [23]. Mobile health intervention studies had shown feasibility and efficacy to improve mental health in different populations in recent years [3741]. There were trends that mobile health (mHealth) intervention on improving mental health because of its convenience and accessibility. Moreover, it may be imperative to develop effective interventions to improve mental health and quality of life for PLWH considering the current COVID-19 epidemic.

Considering the decrease of the intervention effects as time passed by, it was important to investigate whether these interventions could be administered easily, such as conducted at a community level, as one part of normal care for PLWH, or intervened by mHealth. One study used a mutual recovery method based on CBT among community-dwelling adults with depressive symptoms in China in 2012, and the decrease in depressive symptoms was observed immediately after the intervention [42]. This study reminded us to explore the non-personal intervention methods to change mental health or behaviors.

Limitations

The sexually related behaviors were not merely condom use; also included commercial sex, more than one sex partner, etc. This review set condom use as the outcome of the psychological interventions, which may not be able to conclude the comprehensive effects of the intervention. Secondly, data used in this review was only derived from literature published in English, with non-English databases excluded consciously. Thirdly, although this review showed the efficacy of psychological health interventions on behavior change, we did not further compare the effectiveness of the different psychosocial interventions to find the most effective one. Thus, more research was needed to better understand these findings.

Conclusion

This systematic review and meta-analysis found that psychological interventions might positively affect the condom use of PLWH. Based on this meta-analysis results, it is essential to incorporate psychosocial therapies into the routine care of PLWH to avoid the transient effects of the concerned intervention.

Appendix

[Search terms included (hiv [mesh] or hiv infection [mesh] or hiv [tiab] or aids [tiab] or acquired human immunodeficiency syndrome[tiab] or human immunodeficiency virus[tiab]) AND (psychotherapy [mesh] or mental health services [mesh] or self-care [mesh] or self-help groups [mesh] or telemedicine [mesh] or therapy, computer assisted [mesh] or psychotherap* [tiab] or psychological therap* [tiab] or psychological treatment* [tiab] or psychological intervention* [tiab] or counsel* [tiab] or cbt [tiab] or behavior therap* [tiab] or behaviour therap*[tiab] or interpersonal therap* [tiab] or coping [tiab] or peer support [tiab] or social support [tiab] or problem solving [tiab] or stress manage* [tiab] or self-help [tiab] or internet therap* [tiab] or online therap* [tiab] or psychoed* [tiab] or training [tiab] or exposure therap* [tiab]relaxation [tiab] or mindfulness [tiab] or reinforcement [tiab] or commitment therap* [tiab] or case manage* [tiab] OR depression [mesh] OR depress* [tiab] OR anxiety [mesh] OR anxi* [tiab] OR fear [tiab] OR quality of life [mesh] OR quality-of-life [tiab] OR well-being [tiab] OR stress, psychological [mesh] OR stress* [tiab] OR distress [tiab] OR mental health [tiab]) AND (condom use[tiab] or safe sex[tiab] or condom*[tiab]) AND ((clinicaltrial[Filter] OR randomizedcontrolledtrial[Filter]) AND (y_10[Filter]) AND (humans[Filter]) AND (english[Filter])).]

Compliance with Ethical Standards

Conflict of interest

The authors declare that they have no conflict of interest.

Research Involving Human Participants and/or Animals

This article does not contain any studies with human participants or animals performed by any of the authors.

Informed Consent

Informed consent did not apply to our study, as it contained no studies with human participants performed by any of the authors.

Footnotes

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

References

  • 1.Yin L, Wang N, Vermund SH, Shepherd BE, Ruan Y, et al. Sexual risk reduction for HIV-infected persons: a meta-analytic review of ‘‘positive prevention’’ randomized clinical trials. PLoS ONE. 2014;9(9):e107652. doi: 10.1371/journal.pone.0107652. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 2.Niu L, Luo D, Liu Y, Silenzio VMB, Xiao S. The mental health of people living with HIV in China, 1998–2014: a systematic review. PLoS ONE. 2016;11:e153489. doi: 10.1371/journal.pone.0153489. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3.Walkup J, Blank MB, Gonzalez JS, Schwartz R, Brown L, et al. The impact of mental health and substance abuse factors on HIV prevention and treatment. J Acquir Immune Defic Syndr. 2008;47(Suppl 1):S15. doi: 10.1097/QAI.0b013e3181605b26. [DOI] [PubMed] [Google Scholar]
  • 4.Shen H, Zou H, Huang S, Liu F, Zhao P, Chen L, Zhang Ye, Luo X, Tang W, Zheng H, Yang B. Depression and HIV risk behaviors among female sex workers in Guangdong, China: a multicenter cross-sectional study. Biomed Res Int. 2016 doi: 10.1155/2016/6986173. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5.Hong Y, Li X, Fang X, Zhao R. Depressive symptoms and condom use with clients among female sex workers in China. Sexual Health. 2007;4(2):99–104. doi: 10.1071/SH06063. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6.Berger BE, Ferrans CE, Lashley FR. Measuring stigma in people with HIV: psychometric assessment of the HIV stigma scale. Res Nurs Health. 2001;24:518–529. doi: 10.1002/nur.10011. [DOI] [PubMed] [Google Scholar]
  • 7.Jonathon Rendina H, Gamarel KE, Pachankis JE, Ventuneac A, Grov C, Parsons JT. Extending the minority stress model to incorporate HIV-positive gay and bisexual men’s experiences: a longitudinal examination of mental health and sexual risk behavior. Ann Behav Med. 2017;51(2):147–158. doi: 10.1007/s12160-016-9822-8. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8.van Luenen S, Garnefski N, Spinhoven P, Spaan P, Dusseldorp E, Kraaij V. The benefits of psychosocial interventions for mental health in people living with HIV: a systematic review and meta-analysis. AIDS Behav. 2018;22(1):9–42. doi: 10.1007/s10461-017-1757-y. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9.Spies G, Asmal L, Seedat S. Cognitive-behavioural interventions for mood and anxiety disorders in HIV: a systematic review. J Affect Disord. 2013;150(2):171–180. doi: 10.1016/j.jad.2013.04.018. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10.Johnson BT, Carey MP, Chaudoir SR, Reid AE. Sexual risk reduction for persons living with HIV: research synthesis of randomized controlled trials, 1993 to 2004. J Acquir Immune Defic Syndr. 2006;41:642–650. doi: 10.1097/01.qai.0000194495.15309.47. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11.Weller SC, Davis-Beaty K. Condom effectiveness in reducing heterosexual HIV transmission. Cochrane Database Syst Rev. 2002 doi: 10.1002/14651858.CD003255. [DOI] [PubMed] [Google Scholar]
  • 12.Crosby RA, DiClemente RJ, Charnigo R, et al. A brief, clinicbased, safer sex intervention for African American men at-risk of HIV acquisition: a randomized controlled trial. Am J Public Health. 2009;99:S96–S103. doi: 10.2105/AJPH.2007.123893. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13.Crosby RA. State of condom use in HIV prevention science and practice. Curr HIV/AIDS Rep. 2013;10:59–64. doi: 10.1007/s11904-012-0143-7. [DOI] [PubMed] [Google Scholar]
  • 14.Crosby RA, Cates W. Condom use: still a sexual health staple. Sex Health. 2012;9:1–3. doi: 10.1071/SH11111. [DOI] [PubMed] [Google Scholar]
  • 15.Moher D, Liberati A, Tetzlaff J, Altman DG. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. PLoS Med. 2009;6:e1000097. doi: 10.1371/journal.pmed.1000097. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16.Higgins JPT, Altman DG, Gotzsche PC, Juni P, Moher D, Oxman AD, et al. The cochrane collaboration’s tool for assessing risk of bias in randomised trials. BMJ. 2011;343:9. doi: 10.1136/bmj.d5928. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.Crepaz N, Baack BN, Higa DH, Mullins MM. Effects of integrated interventions on transmission risk and care continuum outcomes in persons living with HIV: meta-analysis, 1996–2014. AIDS. 2015;29(18):2371–2383. doi: 10.1097/QAD.0000000000000879. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18.Klein CH, Lomonaco CG, Pavlescak R, Card JJ. WiLLOW: reaching HIV-positive African-American women through a computer-delivered intervention. AIDS Behav. 2013;17(9):3013–3023. doi: 10.1007/s10461-013-0479-z. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19.Brown JL, Vanable PA, Bostwick RA, Carey MP. A pilot intervention trial to promote sexual health and stress management among HIV-infected men who have sex with men. AIDS Behav. 2019;23(1):48–59. doi: 10.1007/s10461-018-2234-y. [DOI] [PubMed] [Google Scholar]
  • 20.Caballero-Suarez NP, Iglesias MC, Estrada ER, Teran GR, Rosas AR. Effects of cognitive-behavioural therapy on anxiety, depression and condom use in people with HIV in Mexico city: a pilot study. Psychol Health Med. 2019;24(1):115–125. doi: 10.1080/13548506.2018.1503694. [DOI] [PubMed] [Google Scholar]
  • 21.Cruess DG, Burnham KE, Finitsis DJ, Goshe BM, Strainge L, Kalichman M, et al. A randomized clinical trial of a brief internet-based group intervention to reduce sexual transmission risk behavior among HIV-positive gay and bisexual men. Ann Behav Med. 2018;52(2):116–129. doi: 10.1093/abm/kax031. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22.El-Bassel N, Jemmott JB, Landis JR, Pequegnat W, Wingood GM, Wyatt GE, et al. National institute of mental health multisite Eban HIV/STD prevention intervention for African American HIV Serodiscordant couples a cluster randomized trial. Arch Intern Med. 2010;170(17):1594–1601. doi: 10.1001/archinternmed.2010.261. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 23.Hightow-Weidman LB, LeGrand S, Muessig KE, Simmons RA, Soni K, Choi SK, et al. A randomized trial of an online risk reduction intervention for young black MSM. AIDS Behav. 2019;23(5):1166–1177. doi: 10.1007/s10461-018-2289-9. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24.Jones DL, Echenique M, Potter J, Rodriguez VJ, Weiss SM, Fischl MA. Adolescent girls and young women living with HIV: preconception counseling strategies. Int J Womens Health. 2017;9:657–663. doi: 10.2147/IJWH.S136668. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 25.Kalichman SC, Cherry C, Kalichman MO, Eaton LA, Kohler JJ, Montero C, et al. Mobile health intervention to reduce HIV transmission: a randomized trial of behaviorally enhanced HIV treatment as prevention (B-TasP) JAIDS. 2018;78(1):34–42. doi: 10.1097/QAI.0000000000001637. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 26.Lovejoy TI, Heckman TG. Depression moderates treatment efficacy of an HIV secondary-prevention intervention for HIV-positive late middle-age and older adults. Behav Med. 2014;40(3):124–133. doi: 10.1080/08964289.2014.893982. [DOI] [PubMed] [Google Scholar]
  • 27.Mashaphu S, Wyatt GE, Zhang M, Mthiyane T, Liu H, Gomo E. Effectiveness of an HIV-risk reduction intervention to reduce HIV transmission among serodiscordant couples in Durban, South Africa. A randomized controlled trial. AIDS Care. 2020;32(5):537–545. doi: 10.1080/09540121.2019.1634785. [DOI] [PubMed] [Google Scholar]
  • 28.Nostlinger C, Platteau T, Bogner J, Buyze J, Dec-Pietrowska J, Dias S, et al. Implementation and operational research: computer-assisted intervention for safer sex in HIV-positive men having sex with men: findings of a European randomized multi-center trial. JAIDS. 2016;71(3):E63–E72. doi: 10.1097/QAI.0000000000000882. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 29.Parsons JT, Rendina HJ, Moody RL, Gurung S, Starks TJ, Pachankis JE. Feasibility of an emotion regulation intervention to improve mental health and reduce HIV transmission risk behaviors for HIV-positive gay and bisexual men with sexual compulsivity. AIDS Behav. 2017;21(6):1540–1549. doi: 10.1007/s10461-016-1533-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 30.Pettifor A, Corneli A, Kamanga G, McKenna K, Rosenberg NE, Yu X, et al. HPTN 062: a pilot randomized controlled trial exploring the effect of a motivational-interviewing intervention on sexual behavior among individuals with acute HIV infection in Lilongwe, Malawi. PLoS ONE. 2015;10(5):e124452. doi: 10.1371/journal.pone.0124452. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 31.Poudel KC, Buchanan DR, Poudel-Tandukar K. Effects of a community-based HIV risk reduction intervention among HIV-positive individuals: results of a quasi-experimental study in Nepal. AIDS Educ Prev. 2015;27(3):240–256. doi: 10.1521/aeap.2015.27.3.240. [DOI] [PubMed] [Google Scholar]
  • 32.Teti M, Bowleg L, Cole R, Lloyd L, Rubinstein S, Spencer S, et al. A mixed methods evaluation of the effect of the protect and respect intervention on the condom use and disclosure practices of women living with HIV/AIDS. AIDS Behav. 2010;14(3):567–579. doi: 10.1007/s10461-009-9562-x. [DOI] [PubMed] [Google Scholar]
  • 33.Williams M, Bowen A, Atkinson JS, Nilsson-Schnnesson L, Diamond PM, Ross MW, et al. An assessment of brief group interventions to increase condom use by heterosexual crack smokers living with HIV infection. AIDS. 2012;24(2):220–231. doi: 10.1080/09540121.2011.597707. [DOI] [PubMed] [Google Scholar]
  • 34.Hart TA, Stratton N, Coleman TA, Wilson HA, Simpson SH, Julien RE, et al. A pilot trial of a sexual health counseling intervention for HIV-positive gay and bisexual men who report anal sex without condoms. PLoS ONE. 2016;11(4):e0152762. doi: 10.1371/journal.pone.0152762. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 35.Crepaz N, Marks G, Liau A, et al. HIV/AIDS prevention research synthesis (PRS) team prevalence of unprotected anal intercourse among HIV-diagnosed MSM in the United States: a meta-analysis. AIDS. 2009;23(13):1617–1629. doi: 10.1097/QAD.0b013e32832effae. [DOI] [PubMed] [Google Scholar]
  • 36.Pantalone DW, Huh D, Nelson KM, Pearson CR, Simoni JM. Prospective predictors of unprotected anal intercourse among HIV-seropositive men who have sex with men initiating antiretroviral therapy. AIDS Behav. 2014;18(1):78–87. doi: 10.1007/s10461-013-0477-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 37.Wahle F, Kowatsch T, Fleisch E, Rufer M, Weidt S. Mobile sensing and support for people with depression: a pilot trial in the wild. JMIR Mhealth Uhealth. 2016;4:e111. doi: 10.2196/mhealth.5960. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 38.East ML, Havard BC. Mental health mobile apps: from infusion to diffusion in the mental health social system. JMIR Ment Health. 2015;2:e10. doi: 10.2196/mental.3954. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 39.Berrouiguet S, Baca-Garcia E, Brandt S, Walter M, Courtet P. Fundamentals for future mobile-health (mhealth): a systematic review of mobile phone and web-based text messaging in mental health. J Med Internet Res. 2016;18:e135. doi: 10.2196/jmir.5066. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 40.Berry N, Lobban F, Emsley R, Bucci S. Acceptability of interventions delivered online and through mobile phones for people who experience severe mental health problems: a systematic review. J Med Internet Res. 2016;18:e121. doi: 10.2196/jmir.5250. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 41.Free C, Phillips G, Galli L, Watson L, Felix L, Edwards P, et al. The effectiveness of mobile-health technology-based health behaviour change or disease management interventions for health care consumers: a systematic review. PLOS Med. 2013;10:e1001362. doi: 10.1371/journal.pmed.1001362. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 42.Wang C, Hua Y, Hua Fu, et al. Effects of a mutual recovery intervention on mental health in depressed elderly community-dwelling adults: a pilot study. BMC Public Health. 2017 doi: 10.1186/s12889-016-3930-z. [DOI] [PMC free article] [PubMed] [Google Scholar]

Articles from AIDS and Behavior are provided here courtesy of Nature Publishing Group

RESOURCES