Skip to main content
NIHPA Author Manuscripts logoLink to NIHPA Author Manuscripts
. Author manuscript; available in PMC: 2020 Nov 1.
Published in final edited form as: AIDS Behav. 2019 Nov;23(11):2956–2965. doi: 10.1007/s10461-019-02619-0

High Levels of Syndemics and Their Association with Adherence, Viral Non-suppression, and Biobehavioral Transmission Risk in Miami, a U.S. City with an HIV/AIDS Epidemic

Tiffany R Glynn 1, Steven A Safren 1, Adam W Carrico 2, Noelle A Mendez 1, Lunthita M Duthely 3, Sannisha K Dale 1, Deborah L Jones 4, Daniel J Feaster 2, Allan E Rodriguez 5
PMCID: PMC6803095  NIHMSID: NIHMS1536847  PMID: 31392443

Abstract

Miami is a Southeastern United States (U.S.) city with high health, mental health, and economic disparities, high ethnic/racial diversity, low resources, and the highest HIV incidence and prevalence in the country. Syndemic theory proposes that multiple, psychosocial comorbidities synergistically fuel the HIV/AIDS epidemic. People living with HIV/AIDS in Miami may be particularly affected by this due to the unique socioeconomic context. From April 2017-October 2018, 800 persons living with HIV/AIDS in a public HIV clinic in Miami completed an interviewer-administered behavioral and chart-review cross-sectional assessment to examine the prevalence and association of number of syndemics (unstable housing, low education, depression, anxiety, binge drinking, drug use, violence, HIV-related stigma) with poor ART adherence, unsuppressed HIV viral load (≥ 200 copies/mL), and biobehavioral transmission risk (condomless sex in the context of unsuppressed viral load). Overall, the sample had high prevalence of syndemics (M=3.8), with almost everyone (99%) endorsing at least one. Each syndemic endorsed was associated with greater odds of: less than 80% ART adherence (aOR = 1.64, 95% CI 1.38, 1.98); having unsuppressed viral load (aOR = 1.16, 95% CI 1.01, 1.33); and engaging in condomless sex in the context of unsuppressed viral load (1.78, 95% CI 1.30, 2.46). The complex syndemic of HIV threatens to undermine the benefits of HIV care and are important to consider in comprehensive efforts to address the disproportionate burden of HIV/AIDS in the Southern U.S. Achieving the 90-90-90 UNAIDS and the recent U.S. “ending the epidemic” targets will require efforts addressing the structural, social, and syndemic determinants of HIV treatment and prevention.

Keywords: HIV/AIDS, syndemics, adherence, unsuppressed virus, biobehavioral transmission risk

INTRODUCTION

Human immunodeficiency virus (HIV) infections have shown overall declining rates in the United States (U.S.) (1) and advances in antiretroviral treatment (ART) have made it possible for adherent persons living with HIV/AIDS to maintain HIV viral suppression. Virally suppressed individuals are not able to transmit the virus and have markedly improved life expectancies (27). In addition to ART treatment as prevention (TasP), the advent of pre-exposure prophylaxis (PrEP) has made a significant contribution to primary prevention of HIV (8). Despite the overall decreasing rates and unprecedented developments in care and prevention, select geographic regions continue to struggle with continued high rates of HIV and poor HIV/AIDS treatment outcomes.

In particular, the Southern region of the U.S. makes up the majority of new HIV diagnoses (52%) with incidence remaining stable from 2012 to 2016 (9). The South also has significant prevalence and HIV mortality; in 2015, the South contained 46% of individuals living with HIV in the U.S. and about half of the deaths among people living with HIV (47%). Examining differences within this high-risk geographic area, people of color are disproportional burdened by HIV making up 77% of new diagnoses in 2017. Specifically, Black, non-Hispanic/Latinx individuals had the highest burden followed by Hispanic/Latinx individuals. Additionally, the Southeastern states of Florida, Georgia, and Louisiana have even higher rates of HIV diagnoses compared to their Southern state counterparts with the state of Florida containing the majority of the HIV “hot spots” (i.e., ranked within the top 10 for incidence and prevalence) including Miami, Orlando, and Jacksonville (9, 10). Notably, Miami has the highest HIV incidence, the highest HIV prevalence, and is among the top three U.S. cities with the highest AIDS prevalence (9). In addition, Miami is a city with high health and economic disparities, high ethnic/racial diversity, and relatively low resources compared to other areas of the U.S. making the HIV/AIDS epidemic similar to many developing regions with uncontrolled HIV across the globe (11, 12). Given this increasing epidemic, understanding factors driving HIV/AIDS within Miami’s unique context is urgent to begin to intervene and mitigate the current public health crisis.

Syndemic theory proposes that multiple, co-occurring psychosocial comorbidities act synergistically to fuel the HIV/AIDS epidemic (13). In other words, HIV is not a siloed issue, but rather driven by the interrelatedness of disease, mental health, behavior, and social and structural conditions. The complexity of syndemic factors results from the fact that syndemic conditions operate on multiple levels including intrapersonal, interpersonal, community, societal, and structural levels. Examples of syndemic conditions that have been explored as reinforcing HIV risk include depression, substance use, violence (abuse/trauma), stigma, unstable housing, food insecurity, and poverty (1416). To date, syndemic theory has primarily been used to contextualize HIV acquisition risk among high-risk groups, especially among men who have sex with men (17, 18). Such research has established a well-supported link between syndemic conditions and HIV risk, including a positive dose-response relationship between number of syndemic conditions and seroconversion (16, 19, 20).

The syndemic conditions of depression, substance use, stigma, trauma, violence, and socioeconomic marginalization have been established as independent risk factors for poor HIV outcomes (2126). For example, in a prospective study, depression was a significant predictor of a greater rate of CD4+ T-cell count decline and increase in HIV viral load (27). Compared to non-users, all individuals who were using drugs, regardless of pattern of use (e.g., intermittent use, persistent use), had greater odds of having unsuppressed viral load (28) and increases in alcohol drinking significantly predicted lower odds of improving ART adherence and being virally suppressed (29). Further, stigma, experiencing intimate partner violence, and trauma exposure have also been associated with poor ART adherence and lower odds of viral suppression (21, 30, 31). Low education and housing instability, indicators of low socioeconomic status, have been associated with faster disease progression, difficulty sustaining viral suppression, poor ART adherence, and overall greater risk of forward transmission (32, 33). Although these factors have been associated with poor HIV outcomes and subsequent consequences for secondary prevention, research examining the prevalence and correlates of syndemics in people living with HIV/AIDS is relatively understudied. Among persons living with HIV/AIDS, the number of experienced syndemic conditions is associated with lower rates of viral suppression, detectable viral load, decreased medication adherence, and increased healthcare utilization (3443). It is especially noteworthy that only one of these studies (43) has been conducted in the Southeastern U.S., and, as discussed above, the Southeastern region of the U.S. is an area in which psychosocial syndemics are high, resources are low, and there is a disproportionate burden of HIV compared to other regions of the country (10).

The present study sought to address this gap by examining the prevalence and correlates of syndemics among persons living with HIV/AIDS who may be at risk for falling off different components of the HIV care continuum: patients receiving care at a public HIV care clinic in Miami. Specifically, we examined the association between the number of syndemics experienced and ART adherence, viral nonsuppression, and, given the importance of treatment as prevention, HIV transmission risk behavior in the context of unsuppressed viral load (i.e., biobehavioral transmission risk).

METHODS

Participants and Procedures

From April 2017 through October 2018, 800 persons living with HIV/AIDS in a public, non-profit tertiary care hospital in downtown Miami completed a one-time interviewer-administered psychosocial assessment in either English or Spanish. Inclusion criteria included: (a) clinic patient receiving HIV care, (b) able to give consent, (c) 18 years of age or older, and (d) able to speak and understand either English or Spanish. Viral load data was extracted from medical charts per consent from patients. All study procedures received approval from the University of Miami Institutional Review Board prior to study onset. Informed consent was obtained from all individual participants included in the study.

Measures

Demographics.

Age, race/ethnicity, gender, sexual orientation, and relationship status were collected.

HIV biomarkers.

Viral load was extracted from electronic medical records and unsuppressed virus was defined as ≥ 200 copies/mL, the clinical point at which transmission may potentially occur (i.e., individuals with < 200 copies/mL cannot transmit the virus) per the Prevention Access Campaign’s Undetectable = Untransmittable consensus statement (44).

Syndemic conditions.

Conditions chosen reflect the syndemic framework which posits that factors at multiple levels, such as intrapersonal (i.e., depression, anxiety, alcohol use, drug use), interpersonal (violence, abuse, trauma), societal (stigma), and structural (low education, unstable housing), drive disease outcomes. Further, conditions were chosen because they have shown independent associations with HIV disease outcomes including poor ART adherence, greater HIV symptoms, decreased CD4+ T-cell count, and increased viral load (21, 2733, 45).

  1. Depression. The 9-item Patient Health Questionnaire (46) was used to assess depressive symptoms reflecting major depression diagnostic criteria in the Diagnostic and Statistical Manual of Mental Disorders V (47). Participants endorsed how often a symptom bothered them on a scale from 0 (not at all) to 3 (nearly every day). Items are summed with greater scores indicating greater depressive symptoms. A dichotomous depression syndemic condition variable was created by scoring an individual positive if they indicated clinically relevant depression (score of 5 or greater).

  2. Anxiety. The anxiety thermometer was adapted from the National Comprehensive Cancer Network Distress Thermometer (48), a single item self-report measure assessing distress using a visual analog scale from 0 (no distress) to 10 (extreme distress). For the current study, the word distress was replaced with “anxiety” so as not to overlap with the questions on the Patient Health Questionnaire. A dichotomous anxiety syndemic condition variable was created by scoring an individual positive if they indicated clinically relevant anxiety (a score of 4 or greater) (49, 50).

  3. Alcohol use. Substance use was assessed using a measure adapted from the Addiction Severity Index - Lite (51). Frequency of use in the past 30 days was assessed for alcohol, marijuana, crack, cocaine, heroin, other opioids, amphetamines, hallucinogens, ecstasy/MDMA, sedatives/tranquilizers, and other drugs (0 = no use, 1 = 1 to 2 times, 2 = about once a week, 3 = several times a week, 4 = about every day). Additionally, for those reporting drinking, average number of daily drinks was assessed. An alcohol use syndemic condition variable was created by scoring an individual positive if they reported any binge drinking (4 or more daily drinks) in the past 30 days.

  4. Drug use. A drug use syndemic condition variable was created by scoring an individual positive if they reported any drug use in the past 30 days.

  5. Violence. A 9-item adaptation of the Intimate Partner Violence Screening Tool (52) was used to assess lifetime childhood abuse, abuse experienced as an adult, and abuse in the context of a romantic relationship. An adaptation of the Brief Trauma Questionnaire (53) assessed lifetime trauma exposure. A violence syndemic condition variable was created by scoring an individual positive if they reported any abuse or trauma.

  6. HIV-related stigma. The 6-item Internalized AIDS-Related Stigma Scale (54) was used to assess participant’s perceived stigma associated with their own HIV status. Participants endorsed whether they agreed or not with statements regarding how they feel about their HIV status (e.g., Being HIV positive makes me feel dirty, I am ashamed that I am HIV positive). Patients endorsing at least one stigma item scored positive for the stigma syndemic condition variable.

  7. Unstable housing. Patients were identified as positive for unstable housing if they reported homelessness or temporary/transitional housing in the past 12 months.

  8. Low education. Patients were identified positive for low education if they reported less than a high school education.

    Number of syndemic conditions. All dichotomous syndemic condition variables were summed (range 0 to 8) with greater scores indicating greater conditions experienced.

ART adherence.

A single item from Wilson et al.’s (18) 3-item adherence measure (In the last 30 days, on how many days did you miss at least one dose of any of your HIV medicines?) was used to calculate percentage of ART adherence for the past month. Patient’s past month adherence was rated on a scale from 0% (missed all doses) to 100% (perfect adherence). A dichotomous variable representing nonadherence (< 80%) was created.

Biobehavioral transmission risk behavior.

A sexual behavior questionnaire assessed types of sexual partners (partner’s gender identity and anatomy), type of sex (anal insertive, anal receptive, or vaginal), condom use, and partner HIV status for the past 4 months. A dichotomous variable was created to identify patients with unsuppressed viral load reporting condomless sex. Any condomless sex with unsuppressed viral load was counted as risk behavior, including those acts with HIV-positive partners, given the risk for HIV reinfection with a second strain (“superinfection”) and associated detrimental effects on clinical outcomes including increased viral load and disease progression (5557).

Data Analysis Plan

Statistical analyses were conducted using R, version 3.5.0 (58).Three logistic regression models, using Firth penalized likelihood method due to separation of binary outcomes, were used to test the association between number of syndemics and: 1. less than 80% ART adherence, 2. unsuppressed viral load (≥ 200 copies/mL), and 3. condomless sex in the context of unsuppressed viral load. All models controlled for age, gender (entered as a dummy variable for cisgender male [vs. cisgender females & gender minorities]), sexual minority status, partnered status (entered as a dummy variable for being in a relationship [vs. those endorsing single, divorced, separated, loss of long term partner, or widowed]), and race/ethnicity (entered as a dummy variable for Black, non-Hispanic/Latinx [vs. everyone else]). For model 2 (outcome = unsuppressed viral load), the model was run in stepwise fashion with the first iteration omitting ART adherence as a covariate, and the second iteration including ART adherence in order to examine the strength of the effect of syndemics on unsuppressed viral load both with and without accounting for adherence. Significant coefficients were transformed and reported in text as odds ratios with 95% confidence intervals. The models were fit using the logistf function in the logistf package (version 1.22).

RESULTS

Sample Characteristics

Table 1 presents patient characteristics. Overall, the sample was a mean of 50 years of age (range 22 to 80), Black, non-Hispanic/Latinx (66%), cisgender male (56%), heterosexual (76%), and single (59%). Patients had an average viral load of 10,499 (range 0 to 1,066,671). Compared to 2018 population estimates for Miami (72% Hispanic/Latinx, 18% Black, non-Hispanic/Latinx, 10% White, non-Hispanic/Latinx) (59), our sample reflects the racial disparities in HIV in Miami. Specifically, despite being 17% of the population of Florida, Black non-Hispanic/Latinx individuals made up 42% of all new HIV diagnoses in Florida (60); such disparity is reflected in the current sample’s proportions (i.e., 66% Black, non-Hispanic/Latinx). The sample had high prevalence of syndemic factors (range 0–8, M = 3.8, SD = 1.5) including unstable housing (18%), low education (37%), depression (75%), anxiety (50%), drug use (27%), binge drinking (11%), violence (trauma/abuse, 86%), and HIV-related stigma (77%). Figure 1 presents the distribution of syndemic conditions for the sample. Almost the entire sample (99%) experienced 1+ syndemic condition, 95% experienced 2+ conditions, 82% experienced 3+ conditions, 56% experienced 4+ conditions, 32% experienced 5+ conditions, 13% experienced 6+ conditions, 4% experienced 7 conditions, and 1% experienced all 8 syndemic conditions.

Table 1.

Patient characteristics N = 800

M or n (SD or %) range
Sociodemographics
Age 50.2 (11.3) 22 – 80
Race/ethnicity
 Black, non-Hispanic/Latinx 529 (66.1%)
 Black, Hispanic/Latinx 28 (3.5%)
 White, non-Hispanic/Latinx 32 (4.0%)
 White, Hispanic/Latinx 192 (24.0%)
 multi, non-Hispanic/Latinx 3 (0.4%)
 multi, Hispanic/Latinx 6 (0.8%)
 other, non-Hispanic/Latinx 5 (0.1%)
 other, Hispanic/Latinx 4 (0.1%)
Gender
 cisgender male 450 (56.3%)
 cisgender female 341 (42.6%)
 transgender male 1 (0.1%)
 transgender female 8 (1.0%)
Sexual orientation
 straight/heterosexual 609 (76.1%)
 gay/lesbian/homosexual 126 (15.8%)
 bisexual 57 (7.1%)
 different identity 6 (0.8%)
Relationship status
 Married or living with someone 150 (18.8%)
 Non-cohabitating relationship 46 (5.8%)
 Single 475 (59.4%)
 Divorced or separated 98 (12.3%)
 Loss of long-term partner/widowed 30 (3.8%)
HIV biomarkers
 viral load (copies/mL) 10,499.3 (63,056.0) 0 – 1,066,671
 unsuppressed viral load 143 (17.9%)
Risk behaviors
 <80% ART adherence 67 (8.4%)
 condomless sex in the context of unsuppressed viral load 18 (2.3%)
Syndemic factors
1. unstable housing 146 (18.3%)
2. less than high school education 293 (36.6%)
3. depression 598 (74.8%)
4. anxiety 403 (50.4%)
5. drug use 217 (27.1%)
6. 4+ drinks on drinking day 88 (11.0%)
7. violence 686 (85.8%)
  trauma 596 (74.5%)
  abuse as a child 373 (46.6%)
  abuse as an adult 248 (31.0%)
  relationship abuse 348 (43.5%)
8. HIV related stigma 616 (77.0%)
Number of syndemic factors endorsed 3.8 (1.5) 0 – 8

Figure 1.

Figure 1.

Distribution of number of syndemic conditions

Syndemics predicting biobehavioral transmission risk

Model 1.

In examining the association of the number of syndemic conditions with ART adherence, the overall model was significant, χ2(6) = 56.61, p < .001. Specifically, each one unit increase in number of syndemic conditions was associated with an expected 64% increase in the odds of having less than 80% ART adherence (b = 0.49, SE = 0.09, χ2 = 31.78, aOR = 1.64, 95% CI 1.38, 1.98, p < .001) while controlling for age, gender, sexual minority status, partner status, and race/ethnicity.

Model 2a.

In examining the association of the number of syndemic conditions with unsuppressed viral load, the overall model that did not include ART adherence as a covariate was significant χ2(6) = 55.48, p < .001. Specifically, each one unit increase in number of syndemic conditions was associated with an expected 33% increase in the odds of having an unsuppressed viral load (b = 0.29, SE = 0.07, χ2 = 19.78, aOR = 1.33, 95% CI 1.17, 1.52, p < .001) while controlling for age, gender, sexual minority status, partner status, and race/ethnicity.

Model 2b.

When including ART adherence as a covariate, the overall model continued to remain significant, χ2(7) = 103.38, p < .001. Specifically, each one unit increase in number of syndemic conditions was associated with an expected 16% increase in the odds of having an unsuppressed viral load (b = 0.15, SE = 0.07, χ2 = 4.70, aOR = 1.16, 95% CI 1.01, 1.33, p = .030) while also controlling for age, gender, sexual minority status, partner status, and race/ethnicity.

Model 3.

In examining the association of the number of syndemic conditions with condomless sex in the context of unsuppressed viral load, the overall model indicated a significant association, χ2(6) = 28.48, p < .001. Specifically, each one unit increase in number of syndemic conditions was associated with an expected 78% increase in the odds of engaging in biobehavioral transmission risk (b = 0.58, SE = 0.15, χ2 = 13.43, aOR = 1.78, 95% CI 1.30, 2.46, p < .001) while controlling for age, gender, sexual minority status, partner status, and race/ethnicity. Results from all models are presented in Table 2.

Table 2.

Logistic regression models predicting # of syndemics on transmission risk

Model 1:< 80% ART Adherence b (SE) χ2 aOR 95% CI p
N = 795, χ2(6) = 56.61, p < .001
# of syndemics 0.49 (0.09) 31.78 1.64 1.38, 1.98 < .001
age −0.04 (0.01) 9.36 0.97 0.94, 0.99 .002
cisgender male −0.40 (0.27) 2.08 0.67 0.39, 1.15 .150
sexual minority 0.31 (0.33) 0.84 1.36 0.69, 2.60 .360
partnered −0.75 (0.39) 4.33 0.47 0.21, 0.96 .037
Black, non-Hispanic/Latinx 0.71 (0.32) 5.18 2.04 1.10, 3.97 .023
Model 2a: Unsuppressed Viral Load b (SE) χ2 aOR 95% CI p
N = 772, χ2(6) = 55.48, p < .001
# of syndemics 0.29 (0.07) 19.78 1.33 1.17, 1.52 < .001
age −0.04 (0.01) 17.22 0.97 0.95, 0.98 < .001
cisgender male 0.58 (0.21)’ 8.05 1.78 1.17, 2.67 .005
sexual minority −0.44 (0.26) 2.97 0.64 0.38, 1.06 .085
partnered −0.48 (0.25) 4.07 0.62 0.37, 0.99 .044
Black, non-Hispanic/Latinx 0.48 (0.23) 4.67 1.61 1.05, 2.54 .031
Model 2b: Unsuppressed Viral Load b (SE) χ2 aOR 95% CI p
N = 771, χ2(7)=103.38, p < .001
# of syndemics 0.15 (0.07) 4.70 1.16 1.01, 1.33 .030
age −0.03 (0.01) 12.25 0.97 0.95, 0.99 < .001
cisgender male 0.70 (0.22) 10.83 2.02 1.33, 3.12 .001
sexual minority −0.52 (0.27) 3.72 0.60 0.35, 1.01 .053
partnered −0.36 (0.25) 2.17 0.70 0.42, 1.12 .141
Black, non-Hispanic/Latinx 0.32 (0.24) 1.91 1.38 0.87, 2.22 .167
ART adherence −0.03 (0.00) 48.07 0.97 0.96, 0.98 <.001
Model 3: Condomless Sex in the Context of Unsuppressed Viral Load b (SE) χ2 aOR 95% CI p
N = 793, χ2(6) = 28.48, p < .001
# of syndemics 0.58 (0.15) 13.43 1.78 1.30, 2.46 < .001
age −0.07 (0.02) 11.43 0.93 0.90, 0.97 .001
cisgender male 0.11 (0.47) 0.05 1.12 0.43, 3.01 .822
sexual minority 0.05 (0.58) 0.01 1.05 0.29, 3.23 .935
partnered 0.29 (0.55) 0.25 1.34 0.39, 3.84 .616
Black, non-Hispanic/Latinx 0.97 (0.61) 2.68 2.63 0.84, 10.85 .102

Post-hoc Analysis

In post-hoc analyses, we examined if number of syndemic conditions were significantly different among certain subgroups shown to have HIV outcome disparities using independent samples t tests and one-way ANOVA. In examining syndemic distribution among groups, no significant differences emerged between age groups (under 25 years old vs. 25 years+; t[11.86] = −0.69, p = .502), gender groups (cisgender males vs. cisgender females and gender minorities; t[798] = −0.29, p = .774), sexual orientations (sexual minorities vs. heterosexual; t[796] = 0.82, p = .414), or race/ethnicity groups (F[10, 188] = 0.91, p = .527).

DISCUSSION

Findings from the present study of people living with HIV/AIDS in Miami, Florida provided consistent support for the association of greater syndemic burden and ART non-adherence, lower odds of viral suppression, and engagement in biobehavioral HIV transmission risk. In this public HIV clinic in Miami, a domestic epicenter of the HIV epidemic in the U.S., the prevalence of these syndemic conditions was exceptionally high. To date, few studies have examined syndemic theory in the context of persons living with HIV/AIDS, and almost none have been conducted in the Southeast region of the U.S. where HIV rates are disproportionately high compared to other regions of the country. Syndemic theory offers a compelling framework to contextualize Miami’s increasing HIV/AIDS epidemic. In the one study conducted in Miami (43), number of individual level barriers to HIV care (e.g., substance use) and number of system level barriers (e.g., transportation) were investigated as separate predictors of viral suppression. Results showed that only individual levels barriers (having 2+ factors) significantly predicted higher odds of detectable viral load. However, as first conceptualized, syndemic theory suggests that both the individual level syndemic factors and the structural level syndemic factors interact to produce worse disease outcomes (13). Thus, the current study included multiple levels of syndemic conditions within the same syndemic count to examine the combined effects across levels.

Given the findings that intrapersonal (mental health, substance use), interpersonal (violence), societal (stigma), and structural (low education, unstable housing) level syndemic conditions were associated with factors that contribute to HIV transmission, it would be beneficial to explore intervention designs and theories that are able to address the HIV/AIDS epidemic across levels. In considering how to approach an HIV/AIDS epidemic within a complex environment, such as Miami, it is important to explore multilevel, simultaneous interventions. For example, the modified social ecological model (61) posits that individual, interpersonal, community, and public policy levels all influence the course of HIV/AIDS epidemics in specific regions and should be intervened on with a multipronged approach. Notably, the model posits that the stage of the epidemic (i.e., HIV incidence and prevalence) within an individual’s network and community determines the risk of disease acquisition. Considering the Southeast’s disproportionate rates of HIV, taking this into account may be necessary to reduce HIV incidence. Indeed, examining HIV prevention 25+ years into the epidemic, scholars have brought attention to the notion that employing single level interventions are not sufficient and do not produce substantial nor lasting effects (62, 63). Although multifaceted interventions are complicated to design and implement, they have the potential to produce large-scale achievements in risk reduction. In conjunction with a multilevel intervention method, promoting a combination of behavioral and biomedical intervention strategies is necessary for maximum impact (6466) given that HIV acquisition and transmission risk depend on both of these factors.

Although this is among the first known studies to examine how syndemic conditions are associated with HIV outcomes in a city with an HIV/AIDS epidemic, limitations should be noted. Data is cross-sectional, limiting the conclusions of temporality. Given that patients were recruited from a public HIV clinic in Miami, the generalizability is limited and may not reflect individuals connected to other types of care in Miami. However, it should be noted that this is an urban safety-net clinic serving the socially marginalized and underserved individuals not consistently connected to care (43). There is also increasing recognition that an additive model, depending on a summation of binary variables, may not fully capture the dynamic interplay (e.g., severity of each condition) among syndemic conditions that is theorized to fuel the HIV/AIDS epidemic. Although the current study was able to establish additive effects of syndemic conditions, it did not examine multiplicative relationships as some have argued for as needed following a syndemic framework (67). However, the current study did not have the sample size to test a fully saturated interaction model with the number of interaction terms that would be required. Further, despite the theoretical strength of potentially examining interaction effects (67), additive models provide practical and clinical significance (68). The binary outcomes in the current sample had low prevalence; although this was statistically adjusted for in the analysis, this should also be considered a limitation and analysis should be replicated with samples with higher rates. Limitations notwithstanding, findings provide evidence for considering the impact of the occurrence of multiple epidemics happening within the HIV/AIDS epidemic in Miami and other afflicted regions.

Additionally, the sample had representation of important subgroups shown to have disparities in HIV risk and outcomes (6972) including Black, non-Hispanic/Latinx individuals (66%), Hispanic/Latinx individuals (29%), Black-non-Hispanic/Latinx cisgender women (34%), transgender women (1%), men who have sex with men (21%), and those younger than 25 years old (1.5%). In post-hoc analyses, we examined if number of syndemic conditions were significantly different among certain subgroups shown to have HIV outcome disparities. In examining syndemic distribution among age group (under 25 years old vs. 25 years+), gender groups (cisgender males vs. cisgender females and gender minorities), sexual orientations (sexual minorities vs. heterosexual), and race/ethnicities, results showed no significant differences. Findings may reflect the dire and complex HIV epidemic in Miami such that experiencing multiple psychosocial issues is synonymous with HIV infection. Indeed, 95% of the sample experienced 2+ syndemic conditions. However, it remains important to continuously consider moderated analyses to examine groups with greater HIV disparities in order to appropriately contextualize HIV epidemics in other regions of the U.S.

Despite the unprecedented developments in HIV prevention and care that essentially make HIV a chronic disease, certain geographic areas continue to not fully benefit from such advances. In a region of the U.S. with high HIV incidence and relatively high structural barriers to treatment, the complex syndemic of HIV threatens to undermine the benefits of care and are important in attaining public health HIV treatment goals. Achieving the 90-90-90 UNAIDS targets (73) and the recent U.S. “ending the epidemic” (74) targets will require comprehensive efforts addressing the structural, social, and syndemic determinants of HIV transmission and progression.

ACKNOWLEDGEMENTS

Funding:

The project described was supported by the University Of Miami Developmental HIV/AIDS Mental Health Research Center (D-ARC) funded by P30MH116867 (Safren), the Miami Center for AIDS Research (CFAR) at the University of Miami Miller School of Medicine funded by P30AI073961 (Rodriguez [Behavioral, Social Sciences and Community Outreach Core]), the Department of Psychology at the University of Miami, and from K24DA040489 (Safren). The content is solely the responsibility of the authors and does not necessarily represent the official views of the National Institutes of Health or any of the other funders.

Footnotes

Ethical approval: All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional research committee (University of Miami Institutional Review Board; study #20160911) and with the 1964 Helsinki declaration and its later amendments or comparable ethical standards.

Conflict of Interest: The authors declare that they have no conflict of interest.

REFERENCES

  • 1.Centers for Disease Control and Prevention (CDC). HIV/AIDS: Basic Statistics Atlanta, GA 2019. Available from: https://www.cdc.gov/hiv/basics/statistics.html Accessed on: [05/17/19].
  • 2.Teeraananchai S, Kerr S, Amin J, Ruxrungtham K, Law M. Life expectancy of HIV- positive people after starting combination antiretroviral therapy: a meta-analysis. HIV Med. 2017; 18(4):256–66. [DOI] [PubMed] [Google Scholar]
  • 3.May MT, Gompels M, Delpech V, Porter K, Orkin C, Kegg S, et al. Impact on life expectancy of HIV-1 positive individuals of CD4+ cell count and viral load response to antiretroviral therapy. AIDS. 2014; 28(8):1193–202. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4.Bavinton BR, Pinto AN, Phanuphak N, Grinsztejn B, Prestage GP, Zablotska-Manos IB, et al. Viral suppression and HIV transmission in serodiscordant male couples: an international, prospective, observational, cohort study. Lancet. 2018; 5(8):e438–e47. [DOI] [PubMed] [Google Scholar]
  • 5.Rodger A, Cambiano V, Bruun T, Vernazza P, Collins S, Corbelli GM, et al. Risk of HIV transmission through condomless sex in MSM couples with suppressive ART: the PARTNER2 Study extended results in gay men. 22nd International AIDS Conference; July 23–27; Amsterdam, Netherlands 2018. [Google Scholar]
  • 6.Rodger AJ, Cambiano V, Bruun T, Vernazza P, Collins S, van Lunzen J, et al. Sexual activity without condoms and risk of HIV transmission in serodifferent couples when the HIV-positive partner is using suppressive antiretroviral therapy. JAMA. 2016; 316(2):171–81. [DOI] [PubMed] [Google Scholar]
  • 7.Cohen MS, Chen YQ, McCauley M, Gamble T, Hosseinipour MC, Kumarasamy N, et al. Antiretroviral therapy for the prevention of HIV-1 transmission. N Engl J Med. 2016; 375(9):830–9. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8.Spinner CD, Boesecke C, Zink A, Jessen H, Stellbrink H-J, Rockstroh JK, et al. HIV pre-exposure prophylaxis (PrEP): a review of current knowledge of oral systemic HIV PrEP in humans. Infection. 2016; 44(2):151–8. [DOI] [PubMed] [Google Scholar]
  • 9.Centers for Disease Control and Prevention (CDC). HIV Surveillance Report, 2017; vol. 29 Atlanta, GA; 2018. [Google Scholar]
  • 10.Centers for Disease Control and Prevention (CDC). HIV in the United States by Region Atlanta, GA 2018. Available from: https://www.cdc.gov/hiv/statistics/overview/geographicdistribution.html Accessed on: [5/15/18].
  • 11.Matters Miami. 2018. Demographics: Summary data for county: Miami-Dade: Health Council of South Florida 2018. Available from: https://tinyurl.com/miamimatters Accessed on: [10/31/2018].
  • 12.Foster S, Lu W. Atlanta ranksworst in income inequality in the U.S 2018. Available from: https://www.bloomberg.com/news/articles/2018-10-10/atlanta-takes-top-income-inequality-spot-among-american-cities Accessed on: [10/31/18].
  • 13.Singer M, Bulled N, Ostrach B, Mendenhall E. Syndemics and the biosocial conception of health. Lancet. 2017; 389(10072):941–50. [DOI] [PubMed] [Google Scholar]
  • 14.Okafor CN, Christodoulou J, Bantjes J, Qondela T, Stewart J, Shoptaw S, et al. Understanding HIV risk behaviors among young men in South Africa: A syndemic approach. AIDS Behav. 2018; 22(12):3962–70. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15.Koblin BA, Grant S, Frye V, Superak H, Sanchez B, Lucy D, et al. HIV sexual risk and syndemics among women in three urban areas in the United States: Analysis from HVTN 906. J Urban Health. 2015; 92(3):572–83. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16.Santos G-M, Do T, Beck J, Makofane K, Arreola S, Pyun T, et al. Syndemic conditions associated with increased HIV risk in a global sample of men who have sex with men. Sex Transm Infect. 2014; 90(3):250. [DOI] [PubMed] [Google Scholar]
  • 17.Mustanski B, Phillips G, Ryan DT, Swann G, Kuhns L, Garofalo R. Prospective effects of a syndemic on HIV and STI incidence and risk behaviors in a cohort of young men who have sex with men. AIDS Behav. 2017; 21(3):845–57. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18.Poteat T, Scheim A, Xavier J, Reisner S, Baral S. Global epidemiology of HIV infection and related syndemics affecting transgender people. JAIDS. 2016; 72 Suppl 3(Suppl 3):S210–S9. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19.Guadamuz TE, McCarthy K, Wimonsate W, Thienkrua W, Varangrat A, Chaikummao S, et al. Psychosocial health conditions and HIV prevalence and incidence in a cohort of men who have sex with men in Bangkok, Thailand: evidence of a syndemic effect. AIDS Behav. 2014; 18(11):2089–96. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20.Mimiaga MJ, OʼCleirigh C, Biello KB, Robertson AM, Safren SA, Coates TJ, et al. The effect of psychosocial syndemic production on 4-year HIV incidence and risk behavior in a large cohort of sexually active men who have sex with men. JAIDS. 2015; 68(3):329–36. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21.Vanable PA, Carey MP, Blair DC, Littlewood RA. Impact of HIV-related stigma on health behaviors and psychological adjustment among HIV-positive men and women. AIDS Behav. 2006; 10(5):473–82. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22.Leserman J Role of depression, stress, and trauma in HIV disease progression. Psychosom Med. 2008; 70(5):539–45. [DOI] [PubMed] [Google Scholar]
  • 23.Carrico AW. Substance use and HIV disease progression in the HAART era: implications for the primary prevention of HIV. Life Sci. 2011; 88(21–22):940–7. [DOI] [PubMed] [Google Scholar]
  • 24.Weiser SD, Fernandes KA, Brandson EK, Lima VD, Anema A, Bangsberg DR, et al. The association between food insecurity and mortality among HIV-infected individuals on HAART. JAIDS. 2009; 52(3):342–9. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 25.Joy R, Druyts EF, Brandson EK, Lima VD, Rustad CA, Zhang W, et al. Impact of neighborhood-level socioeconomic status on HIV disease progression in a universal health care setting. JAIDS. 2008; 47(4):500–5. [DOI] [PubMed] [Google Scholar]
  • 26.Jewkes R, Dunkle K, Jama-Shai N, Gray G. Impact of exposure to intimate partner violence on CD4+ and CD8+ T Cell decay in HIV infected women: Longitudinal study. PLoS One. 2015; 10(3):e0122001. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 27.Ironson G, O’Cleirigh C, Kumar M, Kaplan L, Balbin E, Kelsch CB, et al. Psychosocial and Neurohormonal Predictors of HIV Disease Progression (CD4 Cells and Viral Load): A 4 Year Prospective Study. AIDS Behav. 2015; 19(8):1388–97 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28.Feldman MB, Kepler KL, Irvine MK, Thomas JA. Associations between drug use patterns and viral load suppression among HIV-positive individuals who use support services in New York City. Drug Alcohol Depen. 2019; 197:15–21 [DOI] [PubMed] [Google Scholar]
  • 29.Barai N, Monroe A, Lesko C, Lau B, Hutton H, Yang C, et al. The Association Between Changes in Alcohol Use and Changes in Antiretroviral Therapy Adherence and Viral Suppression Among Women Living with HIV. AIDS Behav. 2017; 21(7):1836–45. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 30.Hatcher AM, Smout EM, Turan JM, Christofides N, Stockl H. Intimate partner violence and engagement in HIV care and treatment among women: a systematic review and meta-analysis. AIDS. 2015; 29(16):2183–94. [DOI] [PubMed] [Google Scholar]
  • 31.Brezing C, Ferrara M, Freudenreich O. The Syndemic Illness of HIV and Trauma: Implications for a Trauma-Informed Model of Care. Psychosomatics. 2015; 56(2):107–18. [DOI] [PubMed] [Google Scholar]
  • 32.Aidala AA, Wilson MG, Shubert V, Gogolishvili D, Globerman J, Rueda S, et al. Housing Status, Medical Care, and Health Outcomes Among People Living With HIV/AIDS: A Systematic Review. Am J Public Health. 2015; 106(1):e1–e23. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 33.Poorolajal J, Molaeipoor L, Mohraz M, Mahjub H, Ardekani MT, Mirzapour P, et al. Predictors of progression to AIDS and mortality post-HIV infection: a long-term retrospective cohort study. AIDS Care. 2015; 27(10):1205–12. [DOI] [PubMed] [Google Scholar]
  • 34.Mizuno Y, Purcell DW, Knowlton AR, Wilkinson JD, Gourevitch MN, Knight KR. Syndemic vulnerability, sexual and injection risk behaviors, and HIV continuum of care outcomes in HIV-positive injection drug users. AIDS Behav. 2015; 19(4):684–93. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 35.Sullivan KA, Messer LC, Quinlivan EB. Substance abuse, violence, and HIV/AIDS (SAVA) syndemic effects on viral suppression among HIV positive women of color. AIDS Patient Care and STDS. 2015; 29(S1):S42–S8. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 36.Friedman MR, Stall R, Silvestre AJ, Wei C, Shoptaw S, Herrick A, et al. Effects of syndemics on HIV viral load and medication adherence in the multicentre AIDS cohort study. AIDS. 2015; 29(9):1087–96. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 37.Kuhns LM, Hotton AL, Garofalo R, Muldoon AL, Jaffe K, Bouris A, et al. An index of multiple psychosocial, syndemic conditions Is associated with antiretroviral medication adherence among HIV-positive youth. AIDS Patient Care and STDS. 2016; 30(4):185–92. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 38.Pantalone DW, Valentine SE, Woodward EN, O’Cleirigh C. Syndemic indicators predict poor medication adherence and increased healthcare utilization for urban HIV-positive men who have sex with men. J Gay Lesbian Ment Health 2018; 22(1):71–87. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 39.Harkness A, Bainter SA, O’Cleirigh C, Albright C, Mayer KH, Safren SA. Longitudinal effects of psychosocial syndemics on HIV-positive sexual minority men’s sexual health behaviors. Arch Sex Behav. 2019; 48(4):1159–70. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 40.Harkness A, Bainter SA, O’Cleirigh C, Mendez NA, Mayer KH, Safren SA. Longitudinal effects of syndemics on ART non-adherence among sexual minority men. AIDS Behav. 2018; 22(8):2564–74. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 41.Blashill AJ, Bedoya CA, Mayer KH, O’Cleirigh C, Pinkston MM, Remmert JE, et al. Psychosocial syndemics are additively associated with worse ART adherence in HIV-infected individuals. AIDS Behav. 2015; 19(6):981–6. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 42.Biello KB, Oldenburg CE, Safren SA, Rosenberger JG, Novak DS, Mayer KH, et al. Multiple syndemic psychosocial factors are associated with reduced engagement in HIV care among a multinational, online sample of HIV-infected MSM in Latin America. AIDS Care. 2016; 28(sup1):84–91. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 43.Wawrzyniak AJ, Rodríguez AE, Falcon AE, Chakrabarti A, Parra A, Park J, et al. Association of individual and systemic barriers to optimal medical care in people living with HIV/AIDS in Miami-Dade County. JAIDS. 2015; 69:S63–S72. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 44.Prevention Access Campaign. Consensus Statement: Risk of sexual transmission of hiv from a person living with HIV who has an undetectable viral load 2018. Available from: https://www.preventionaccess.org/consensus Accessed on: [10/31/2018].
  • 45.Lynn C, Chenneville T, Bradley-Klug K, Walsh ASJ, Dedrick RF, Rodriguez CA. Depression, anxiety, and posttraumatic stress as predictors of immune functioning: differences between youth with behaviorally and perinatally acquired HIV. AIDS Care. 2019:1–10. [DOI] [PubMed] [Google Scholar]
  • 46.Spitzer RL. Validation and utility of a self-report version of PRIME-MD: the PHQ primary care study. JAMA. 1999; 282(18):1737. [DOI] [PubMed] [Google Scholar]
  • 47.American Psychiatric Association. Diagnostic and statistical manual of mental disorders (5th ed.). Arlington, VA: American Psychiatric Publishing; 2013. [Google Scholar]
  • 48.National Comprehensive Cancer Network. NCCN Distress Thermometer and Problem List for Patients 2018. Available from: https://www.nccn.org/patients/resources/life_with_cancer/pdf/nccn_distress_thermometer.pdf Accessed on: [10/31/2018]. [Google Scholar]
  • 49.Jacobsen PB, Donovan KA, Trask PC, Fleishman SB, Zabora J, Baker F, et al. Screening for psychologic distress in ambulatory cancer patients. Cancer. 2005; 103(7):1494–502. [DOI] [PubMed] [Google Scholar]
  • 50.Beck KR, Tan SM, Lum SS, Lim LE, Krishna LK. Validation of the emotion thermometers and hospital anxiety and depression scales in Singapore: Screening cancer patients for distress, anxiety and depression. Asia Pac J Clin Oncol. 2016; 12(2):e241–9. [DOI] [PubMed] [Google Scholar]
  • 51.McLellan AT, Luborsky L, O’Brien CP, Woody GE. An improved diagnostic evaluation instrument for substance abuse patients. The Addiction Severity Index. J Nerv Ment Dis. 1980; 168(1):26–33. [DOI] [PubMed] [Google Scholar]
  • 52.Kalokhe AS, Paranjape A, Bell CE, Cardenas GA, Kuper T, Metsch LR, et al. Intimate partner violence among HIV-infected crack cocaine users. AIDS Patient Care and STDS. 2012; 26(4):234–40. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 53.Schnurr P, Vielhauer M, Weathers F, Findler M. The Brief Trauma Questionnaire [Measurement Instrument] 1999. Available from: http://www.ptsd.va.gov Accessed on: [10/31/18]. [Google Scholar]
  • 54.Kalichman SC, Simbayi LC, Cloete A, Mthembu PP, Mkhonta RN, Ginindza T. Measuring AIDS stigmas in people living with HIV/AIDS: the Internalized AIDS-Related Stigma Scale. AIDS Care. 2009; 21(1):87–93. [DOI] [PubMed] [Google Scholar]
  • 55.Redd AD, Quinn TC, Tobian AAR. Frequency and implications of HIV superinfection. Lancet Infect Dis. 2013; 13(7):622–8. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 56.Wagner GA, Chaillon A, Liu S, Franklin DR Jr., Caballero G, Kosakovsky Pond SL, et al. HIV-associated neurocognitive disorder is associated with HIV-1 dual infection. AIDS. 2016; 30(17):2591–7. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 57.Sheward DJ, Ntale R, Garrett NJ, Woodman ZL, Abdool Karim SS, Williamson C. HIV-1 superinfection resembles primary infection. J Infect Dis. 2015; 212(6):904–8. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 58.R Development Core Team. R: A language and environment for statistical computing. Vienna, Austria: R Foundation for Statistical Computing; 2018. [Google Scholar]
  • 59.United States Census Bureau. Miami city, Florida; Miami-Dade County, Florida Washington, DC. 2018. Available from: https://www.census.gov/quickfacts/fact/table/miamicityflorida,miamidadecountyflorida/PST045218# Accessed on: [05/17/2019].
  • 60.Florida Department of Health. Blacks Living with an HIV Diagnosis in Florida, 2017 Tallahassee, FL 2019. Available from: http://www.floridahealth.gov/diseases-and-conditions/aids/surveillance/_documents/fact-sheet/Black_Factsheet.pdf Accessed on: [06/27/19].
  • 61.Baral S, Logie CH, Grosso A, Wirtz AL, Beyrer C. Modified social ecological model: a tool to guide the assessment of the risks and risk contexts of HIV epidemics. BMC Public Health. 2013; 13(1). [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 62.Coates TJ, Richter L, Caceres C. Behavioural strategies to reduce HIV transmission: how to make them work better. Lancet. 2008; 372(9639):669–84. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 63.Safren SA, Blashill AJ, O’Cleirigh CM. Promoting the sexual health of MSM in the context of comorbid mental health problems. AIDS Behav. 2011; 15 Suppl 1(0 1):S30–S4. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 64.Rotheram-Borus MJ, Swendeman D, Chovnick G. The past, present, and future of HIV prevention: integrating behavioral, biomedical, and structural intervention strategies for the next generation of HIV prevention. Annu Rev Clin Psychol. 2009; 5(1):143–67. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 65.Bekker L-G, Beyrer C, Quinn TC. Behavioral and biomedical combination strategies for HIV prevention. Cold Spring Harb Perspect Med. 2012. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 66.UNAIDS. Combination HIV prevention: tailoring and coordinating biomedical, behavioural and structural strategies 10 to reduce new HIV infections. Geneva, Switzerland: Joint United Nations Programme on HIV/AIDS; 2010. [Google Scholar]
  • 67.Tsai AC, Burns BFO. Syndemics of psychosocial problems and HIV risk: A systematic review of empirical tests of the disease interaction concept. Soc Sci Med. 2015; 139:26–35. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 68.Stall R, Coulter RW, Friedman MR, Plankey MW. Commentary on “Syndemics of psychosocial problems” by A. Tsai and B. Burns. Soc Sci Med 2015; 145:129–31. [DOI] [PubMed] [Google Scholar]
  • 69.Centers for Disease Control and Prevention (CDC). Risk by Racial/Ethnic Groups Atlanta, GA 2018. Available from: https://www.cdc.gov/hiv/group/racialethnic/index.html Accessed on: [10/31/18].
  • 70.Centers for Disease Control and Prevention (CDC). HIV and Transgender People Atlanta, GA 2019. Available from: https://www.cdc.gov/hiv/group/gender/transgender/index.html Accessed on: [05/17/19].
  • 71.Centers for Disease Control and Prevention (CDC). HIV Among Women Atlanta, GA 2019. Available from: https://www.cdc.gov/hiv/group/gender/women/index.html Accessed on: [05/17/19].
  • 72.Centers for Disease Control and Prevention (CDC). HIV and Gay and Bisexual Men Atlanta, GA 2018. Available from: https://www.cdc.gov/hiv/group/msm/index.html Accessed on: [05/17/19].
  • 73.UNAIDS. 90-90-90: an ambitious treatment target to help end the AIDS epidemic. Geneva, Switzerland: UNAIDS; 2014. [Google Scholar]
  • 74.Azar A. Ending the HIV Epidemic: A Plan for America. Accessed on 03/22/19 at: https://wwwhhsgov/blog/2019/02/05/ending-the-hiv-epidemic-a-plan-for-americahtml 2019.

RESOURCES