Skip to main content
Springer logoLink to Springer
. 2020 May 23;24(12):3533–3544. doi: 10.1007/s10461-020-02929-8

Patient-Reported Outcomes in ATLAS and FLAIR Participants on Long-Acting Regimens of Cabotegravir and Rilpivirine Over 48 Weeks

Miranda Murray 1, Antonio Antela 2, Anthony Mills 3, Jenny Huang 4, Hans Jäger 5,6, Enrique Bernal 7, Johan Lombaard 8, Harold Katner 9, Sharon Walmsley 10, Marie-Aude Khuong-Josses 11, Krischan Hudson 12, David Dorey 4, Sandy Griffith 12, William Spreen 12, Simon Vanveggel 13, Mark Shaefer 12, David Margolis 12, Vasiliki Chounta 14,
PMCID: PMC7667137  PMID: 32447500

Abstract

The phase 3 ATLAS and FLAIR studies demonstrated that maintenance with Long-Acting (LA) intramuscular cabotegravir and rilpivirine is non-inferior in efficacy to current antiretroviral (CAR) oral therapy. Both studies utilized Patient-Reported Outcome instruments to measure treatment satisfaction (HIVTSQ) and acceptance (ACCEPT general domain), health status (SF-12), injection tolerability/acceptance (PIN), and treatment preference. In pooled analyses, LA-treated patients (n = 591) demonstrated greater mean improvements from baseline than the CAR group (n = 591) in treatment satisfaction (Week 44, + 3.9 vs. +0.5 HIVTSQs-points; p < 0.001) and acceptance (Week 48, +8.8 vs. +2.0 ACCEPT-points; p < 0.001). The acceptability of injection site reactions (PIN) significantly improved from week 5 (2.10 points) to week 48 (1.62 points; p < 0.001). In both studies, ≥ 97% of LA group participants with recorded data preferred LA treatment compared with prior oral therapy. These results further support the potential of a monthly injectable option for people living with HIV seeking an alternative to daily oral treatment.

Electronic supplementary material

The online version of this article (10.1007/s10461-020-02929-8) contains supplementary material, which is available to authorized users.

Keywords: Patient-reported outcomes, Antiretroviral therapy, Cabotegravir, Rilpivirine, Long-acting treatment

Introduction

Combination antiretroviral therapy (cART) has dramatically reduced mortality and improved the quality of life of people living with HIV (PLWHIV) [12], but HIV treatment currently requires a lifelong commitment to daily oral therapy. Emotional and adherence-related challenges associated with daily cART impact many PLWHIV which in turn has led to significant interest in antiretroviral therapy (ART) with less frequent dosing [39]. As a result, a clinical development program has been dedicated to introducing a long-acting (LA) alternative to daily oral cART, providing an additional treatment option that may improve treatment adherence and satisfaction for PLWHIV.

LA injectable formulations have been developed for cabotegravir (CAB), an integrase strand transfer inhibitor (INSTI), and rilpivirine (RPV), a non-nucleoside reverse transcriptase inhibitor (NNRTI) [10, 11]. It has been shown in both individual and pooled analyses from two pivotal phase 3 studies in treatment-experienced patients (ATLAS; NCT02951052) and in previously treatment-naïve patients (FLAIR; NCT02938520) that monthly dosing of CAB+RPV LA is non-inferior to daily oral ART for maintaining HIV suppression [1214]. In addition, other than injection-site reactions (ISRs), which declined over time, the overall incidence of adverse events was comparable between the oral and LA treatment groups [1214].

Similarly, in the phase 2b LATTE-2 study (NCT02120352), CAB+RPV LA maintenance every 1 or 2 months resulted in similar rates of virologic suppression to continuing on the oral induction regimen of oral CAB with nucleoside analogues through 96 weeks [15]. In qualitative interviews to assess their preference for LA injections over oral medications, LATTE-2 participants in Spain and the US cited both the convenience of LA injections vs. daily pills, and psychosocial benefits of LA treatment such as confidentiality, the lack of a daily reminder of living with HIV, and the reduced risk of stigma associated with disease disclosure as reasons supporting their preference for an LA therapy [16].

Patient-reported outcomes (PROs) are important for the holistic assessment of new medicines and innovative treatment options. In ATLAS, PROs were assessed in participants who had been virologically suppressed (HIV-1 RNA < 50 c/mL) on oral regimens for a median of 4 years, allowing participants to compare their experiences of LA treatment against prior oral therapies. In contrast, the assessment of PROs in FLAIR presented an opportunity to assess switching to the LA treatment vs. remaining on first-line oral treatment in patients who were treatment-naïve prior to study enrollment. Both studies assessed patient satisfaction with, and acceptance of, the oral or LA treatment received; the acceptability and tolerability of CAB+RPV LA injections, and overall patient health status. Treatment preference and reason for wishing to switch from oral to LA therapy were assessed as exploratory endpoints. Herein, we present both pooled and individual PRO data from the ATLAS and FLAIR studies.

Methods

Study Design

ATLAS and FLAIR (Fig. 1) are ongoing, phase 3, randomized, open-label, parallel-group studies comparing the efficacy and safety of monthly intramuscular (IM) CAB+RPV LA (400 mg CAB+600 mg RPV) vs. continuation of an oral cART regimen—the current antiretroviral regimen (CAR) group—consisting of either a pre-existing stable daily oral therapy of at least 6 months’ prior duration (ATLAS) or a defined oral induction treatment comprising a single-tablet coformulation of dolutegravir, abacavir, and lamivudine (FLAIR). Participant recruitment and study designs have been fully described in the primary clinical manuscripts [12, 13].

Fig. 1.

Fig. 1

The ATLAS [12] and FLAIR [13] study design. Eligible individuals were randomly assigned (1:1) to continue their current antiretroviral regimen (CAR arm) or switch to the long-acting regimen (LA arm). Those assigned to the LA arm initially received 4 weeks of oral CAB+RPV QD, then transitioned to the injectable regimen. aUninterrupted ART for 6 months and VL < 50 c/mL at screening, 2 × VL < 50 c/mL for ≤ 12 months. bINSTI-based regimen capped at 40% of enrollment; Triumeq excluded from study. cOptional switch to CAB+RPV LA at week 52 for those on CAR. dParticipants who withdraw/complete CAB+RPV LA must complete 52 weeks of follow-up. eParticipants received an initial loading dose of CAB LA (600 mg) and RPV LA (900 mg) at week 4b. From week 8 onwards, participants received CAB LA (400 mg)+RPV LA (600 mg) injections every 4 weeks. fNNRTI RAMs but not K103N were exclusionary. gOf the 631 participants who entered the induction phase, two withdrew prior to receiving study drug. DTG plus two alternative non-ABC NRTIs was permitted if participant was intolerant or HLA-B*5701-positive (n = 30 as last regimen during induction: n = 2 discontinued during induction, n = 14 randomized to CAB+RPV LA, n = 14 randomized to DTG/ABC/3TC arm and continued on DTG plus two alternative non-ABC NRTIs in the maintenance phase). hParticipants who withdraw/complete CAB+RPV LA enter 52-week long-term follow-up. 3TC lamivudine, ABC abacavir, ART antiretroviral therapy, CAB cabotegravir, CAR current antiretroviral regimen, DTG dolutegravir, IM intramuscular, INSTI integrase strand transfer inhibitor, HBsAg hepatitis B surface antigen, LA long-acting, NNRTI non-nucleoside reverse transcriptase inhibitor, NRTI nucleoside reverse transcriptase inhibitor, PI protease inhibitor, RAM resistance-associated mutation, RPV rilpivirine, VL viral load

Both studies were conducted in accordance with the principles founded in the Declaration of Helsinki and with Good Clinical Practice. All participants provided written informed consent, and the protocol was approved by an institutional review board or ethics committee of each study site. The authors can attest for adherence to the study protocol and for the accuracy and completeness of the data and analyses.

Assessments and Endpoints

PRO instruments (Table 1) were included at specific timepoints in each study to assess health status, treatment satisfaction, acceptance and preference, and the tolerability and acceptability of injections. These instruments were selected based on qualitative interviews and PRO data from patients enrolled on the phase 2b LATTE-2 study [16].

Table 1.

The PRO instruments conducted in ATLAS and FLAIR

PRO instrument Assessment Timepoints measured Pooled analysis
HIVTSQs/ca Patient satisfaction with HIV treatment Status version: maintenance baseline, week 4, week 24, week 44 Change version: week 48
ACCEPT Patient acceptance of treatment Maintenance baseline, week 8, week 24, week 48
PIN questionnaire Perception of pain and injection site reactions Week 5, week 41, week 48
SF-12 General health status and degree of mental health distress Maintenance baseline, week 24, week 48
Preference of HIV treatment (single question) Patient preference for CAB + RPV LA vs. their current oral therapy Week 48
Reason for switch (single question) Patient reasoning for switching to LA therapy from oral therapy for ATLAS study only Week 52
HAT-QoLb Overall function and wellbeing. Only 3 out of 9 dimensions were assessed Maintenance baseline, week 24, week 48
Numeric Rating Scalec Intensity of post-injection pain Week 4, week 5, week 40, week 41

ACCEPT Chronic Treatment Acceptance questionnaire, CAB cabotegravir, HAT-QoL HIV/AIDS-targeted quality of life, HIVTSQs/c HIV Treatment Satisfaction Questionnaire (status version)/(change version), LA long-acting, PIN Perception of Injection questionnaire, PRO patient-reported outcome, RPV rilpivirine, SF-12 12-Item Short Form Health Survey

aHIVTSQc only administered to participants receiving LA therapy

bNo meaningful differences between arms were reported with the three dimensions included in the phase 3 studies. Results are not discussed here

cConsistent with the PIN, numerical reduction in post-injection pain was reported in the Numeric Rating Scale over time. No significance testing was preplanned for this measure. Results are not discussed here

The PRO instruments used in ATLAS and FLAIR included:

Treatment Satisfaction: HIVTSQ

Treatment satisfaction was assessed using a recent adaptation of the validated 10-item HIV Treatment Satisfaction Questionnaire (HIVTSQ) [17, 18], which included two additional items to account for LA dosing [19, 20], specifically:

  • 11.

    How easy or difficult have you been finding your treatment to be recently?

  • 12.

    How satisfied are you with the amount of discomfort or pain involved with your present form of treatment?

Extensive psychometric analyses on the 12-item HIVTSQ suggest that these two additional items do not reduce the overall validity of the questionnaire [19, 20]. Item 11 contributes to the structure of the scale, improving the outcomes of confirmatory factor analysis, and preserves the option of calculating the total score with items 1 through 11. Item 12 can be reported individually and is not included in the total score [1921]. Two versions exist of the HIVTSQ: the status version (HIVTSQs), which was the first to be developed, and the subsequent change version (HIVTSQc) developed to mitigate ceiling effects common in treatment satisfaction measures [18]. The HIVTSQs asked patients to rank their response on a 6-point Likert scale, from 6 (very satisfied) to 0 (very dissatisfied), while the HIVTSQc asked patients to rank their response from 3 (much more satisfied now) to − 3 (much less satisfied now) [18]. On both versions, the scores are added together, to provide the total summary score. The HIVTSQs was assessed at maintenance baseline (MBL) and weeks 4, 24, and 44 in the LA treatment group and the CAR group in both studies, while the HIVTSQc was applied only at week 48 to both treatment groups in FLAIR and to the LA group only in ATLAS.

Treatment Acceptance: ACCEPT Questionnaire

Participants in both treatment groups completed the General Acceptance domain of the Chronic Treatment Acceptance (ACCEPT) questionnaire [22], a generic medication acceptance instrument validated for chronic conditions that was administered at MBL and weeks 8, 24, and 48. This domain consists of three questions:

  • Do you agree with the following statement: “My medication has more advantages than disadvantages”?

  • Given the advantages and disadvantages of your medication, do you consider it to be an acceptable solution?

  • Are you convinced that in the long term, it is worth taking your medications?

Responses were rated on a 5-point Likert scale with a score of 5 representing “I don’t know” for all three questions, and scores of 1 through 4 representing increasing levels of agreement or acceptance from “Totally disagree/Not at all acceptable/Not at all convinced” through to “Totally agree/Totally acceptable/Totally convinced”. Item scores were grouped together to form an aggregate that was linearly transformed to range from 0 to 100, with a higher score suggesting greater acceptance [23].

Injection Acceptability and Tolerability: PIN Questionnaire

The acceptability and tolerability of monthly injections and ISRs at early (week 5) and later stages of treatment (weeks 41 and 48) was assessed in the LA treatment groups of both studies using the Perception of Injection (PIN) questionnaire. This instrument was adapted for gluteal IM administration from the earlier Vaccinees’ Perception of Injection (VAPI) questionnaire [24], while retaining the same scoring system. The questionnaire contains 21 items in total and consists of four dimensions: “acceptance of ISRs”, “bother of ISRs”, “sleep”, and “leg movement”, and five individually reported items related to anxiety before and after the injection, willingness to receive an HIV injectable treatment at the following visit, pain during injection, and satisfaction with the mode of treatment administration. Participants were asked to score their responses from 1 to 5, where scores of 1 through 3 refer to, in order, “totally acceptable”, “very acceptable”, and “moderately acceptable”; a score of 4 is “a little acceptable”, and 5 is “not at all acceptable”. To avoid multiplicity issues, hypothesis testing was preplanned only for the “acceptance of ISRs” dimension of the PIN.

General Health Status: SF-12

General health was assessed in both studies using the generic validated 12-Item Short Form Health Survey (SF-12) questionnaire [2528]. The SF-12 includes the same eight domains as the older SF-36 questionnaire [29], but with fewer questions, making it more practical, especially for larger and more complex populations [30]. The physical component score (PCS) and mental component score (MCS) of the SF-12 are norm-based and range from 0 to 100, with higher scores indicating better health. In the US population, the mean SF-12 score is 50 with a standard deviation of 10 [31]. SF-12 was administered at MBL, week 24, and week 48 to participants on both treatment arms.

Preference Question

For both studies, a single-item preference question was developed to assess participants’ preference for CAB+RPV LA compared with the oral cART received prior to randomization. This was administered, at week 48, to participants in the LA arm only. The question reads: “For the past 44 weeks you have received Long Acting injectable HIV medication every month. Today we would like you to compare your experience on the Long Acting injections with the oral medication you received during the induction phase of the study. Which therapy do you prefer?” Participants had the option of selecting either daily oral treatment or monthly injections.

Reason for Switch

Additionally, in the ATLAS study only, a single-question “Reason for switch” questionnaire with six response options was administered to all participants (including those continuing on oral CAR) on day 1 to explore the reasons why participants wished to enter an LA trial. A similar questionnaire was also administered at week 52 to participants in the oral CAR arm who had opted to switch to CAB+RPV LA after the primary analysis at week 48, under the study protocol.

Statistical Analysis

Descriptive statistics summarize questionnaire scores for each timepoint. Statistical comparisons between treatment groups in change from MBL for prespecified endpoints was performed with an ANCOVA model adjusting for covariates selected a priori: MBL score, sex at birth, age, race (white, non-white), third agent class (integrase inhibitors, protease inhibitors, NNRTI) for ATLAS only, and induction baseline HIV RNA for FLAIR only. P values and 95% CI for the treatment difference between groups were reported. Within-group comparisons in change over time for the “Acceptance of ISRs” dimension of the PIN was based on the Wilcoxon signed-rank test. The significance threshold was set at 0.05. In addition to individual study analyses, pooled analyses combining data from both ATLAS and FLAIR were performed post hoc for instruments assessing treatment satisfaction, treatment acceptance, and the tolerability of injections and ISRs, adjusting for baseline score, sex at birth, age (< 50, ≥ 50 years) and race (white, non-white). For the exploratory endpoints (preference question and reason for switch) proportions are reported for observed cases without imputation, statistical modeling, or testing. Missing data for non-exploratory PROs were imputed using a last-observation-carried-forward approach including measures assessed at time of withdrawal.

Results

Baseline Characteristics

The pooled intention-to-treat-exposed (ITT-E) population of all randomized participants who received at least one dose of study medication in either ATLAS or FLAIR consisted of 1182 individuals: 591 in each treatment group (LA or CAR). MBL characteristics were generally similar between groups in each study and were also similar between the two studies [12, 13], although ATLAS had a numerically higher percentage of participants in the CAR group aged over 50 years compared with the LA group (31% vs. 21%, respectively) [12]. More than 20% of patients enrolled in each study were female, exceeding the recruitment goals for both. Of note, participants enrolled in ATLAS had been on previous cART for a median of 4 years (range 1–21) [12], while participants in FLAIR had no cART experience prior to the induction phase of the study [13].

PROs with both Individual and Pooled Study Data (HIVTSQ, ACCEPT, PIN)

HIVTSQ

Mean HIVTSQs total score values at MBL were high and similar between the oral and LA treatment groups in both ATLAS and FLAIR, with higher mean scores in FLAIR. Out of a maximum of 66 points, mean MBL values in the pooled dataset were 57.1 (SD 8.4) for the CAR group and 57.1 (8.6) for the LA group; while individually these values were, in ATLAS, 55.4 (8.7) and 55.3 (9.1), respectively, and in FLAIR, 59.1 (7.6) and 59.3 (7.4), respectively.

Pooled data at weeks 24 and 44 showed a statistically significant greater improvement in treatment satisfaction from MBL on LA treatment compared with the CAR group (Fig. 2). This difference was mainly driven by ATLAS data, where LA-treated participants showed a large and stable 5.4 (95% CI 4.2–6.6) to 5.7 (95% CI 4.4–7.0)-point treatment difference in the adjusted mean change from MBL in HIVTSQs total score vs. the CAR group at both timepoints that meets the minimum clinically important difference threshold using the distribution-based approach, with the mean difference between the two groups exceeding one half of the standard deviation at baseline [32, 33]. Changes from MBL in ATLAS were greater for LA dosing across all individual items in the HIVTSQs, particularly for items related to overall regimen satisfaction; the ease, convenience, and flexibility of treatment; and satisfaction at the prospect of continuing current treatment (Supplementary Fig. 1).

Fig. 2.

Fig. 2

Change from maintenance baseline HIVTSQs total score through week 44. Adjusted mean change from maintenance baseline is estimated from an ANCOVA model. Covariates are: ATLAS: baseline score, sex at birth, age (< 50 vs. ≥ 50 years), race, and third agent class, FLAIR: maintenance baseline score (day 1), sex at birth, age (< 50 vs. ≥ 50 years), race, and induction baseline (week –20) HIV-1 RNA (< 105 vs. ≥ 105 c/mL) Pooled: maintenance baseline score, sex at birth, age (< 50 vs. ≥ 50 years), and race. CAB cabotegravir, CAR current antiretroviral treatment (oral), CI confidence interval, HIVTSQs HIV Treatment Satisfaction Questionnaire (status version), LA long-acting, RPV rilpivirine, SD standard deviation

A smaller LA treatment effect for HIVTSQs total score was reported in the FLAIR study. A statistically significant greater improvement from MBL of 2.2 (95% CI 1.0–3.4) points in the adjusted mean HIVTSQs total score favoring the LA group vs. CAR was observed at week 24 that was not maintained at week 44 (Fig. 2).

Inter-group comparative data for the HIVTSQ change instrument in FLAIR, allowed for a direct comparison of LA maintenance with the oral induction regimen at week 48, with mitigation of ceiling effects caused by high MBL satisfaction. Here, a statistically significant difference (p < 0.001) in mean HIVTSQc total score was observed in favor of the LA arm, with an LA adjusted mean of 29.6 (SE 0.49) and a CAR adjusted mean of 25.2 (SE 0.48) giving an adjusted mean treatment difference of 4.1 (95% CI 2.8–5.5).

ACCEPT

Mean general acceptance domain scores were high and similar in both studies between the LA and CAR treatment groups at MBL. Pooled mean (SD) MBL values were 80.5 (24.8) for the LA arm and 78.8 (25.3) for the CAR arm, out of a maximum 100 points. In ATLAS, the mean (SD) baseline score was 75.9 (26.5) in the LA group, and 74.7 (26.1) in the CAR group, while in FLAIR these MBL values were 86.0 (21.3) and 83.4 (23.7), respectively.

Significantly greater (p < 0.001) improvement in the adjusted mean general acceptance domain score change from MBL was noted for LA treatment vs. oral cART in pooled data at weeks 24 and 48 (Fig. 3). Consistent with HIVTSQs data, this improvement was driven largely by ATLAS, in which increases of 16–18% over MBL were seen on LA treatment at weeks 24 and 48 (week 24 adjusted mean change 12.3 [95% CI 9.9–14.8] points; week 48 adjusted mean change 13.7 [95% CI 11.2–16.3] points) compared with lesser changes in the CAR group (week 24 adjusted mean change 5.5 [95% CI 3.0–8.0] points; week 48 adjusted mean change 3.0 [95% CI 0.4–5.6] points). The treatment difference in FLAIR was smaller and non-significant, partly due to the similarly high MBL values noted also in the HIVTSQs.

Fig. 3.

Fig. 3

Change from maintenance baseline General Acceptance domain scores through week 48. Adjusted mean change from maintenance baseline is estimated from an ANCOVA model. Covariates are: ATLAS: treatment, baseline score, sex at birth, age (< 50 vs. ≥ 50 years), race, and third agent class, FLAIR: maintenance baseline score (day 1), sex at birth, age (< 50 vs. ≥ 50 years), race, and induction baseline (week –20) HIV-1 RNA (< 105 vs. ≥ 105 c/mL) Pooled: maintenance baseline score, sex at birth, age (< 50 vs. ≥ 50 years), and race. ACCEPT Chronic Treatment Acceptance questionnaire, CAB cabotegravir, CAR current antiretroviral treatment (oral), CI confidence interval, LA long-acting, RPV rilpivirine, SD standard deviation

PIN

According to the “Acceptance of ISRs” dimension of the PIN, most participants in both studies reported that pain and ISRs were “very acceptable” or “totally acceptable” when questioned a week after their first injections of CAB+RPV LA (week 5). In pooled data, the mean (SD) score for the acceptance domain at week 5 was 2.10 (1.04), with favorable scores also reported for the other domains and individual PIN items after the first injection (Supplementary Fig. 2). A statistically significant (p < 0.001) mean improvement from week 5 in the acceptance domain was observed in pooled data at weeks 41 (mean 1.67 [SD 0.86]) and 48 (1.62 [0.81]) indicating improved acceptability of ISRs over time, alongside high initial acceptance rates (Fig. 4). For the two items generating the “Acceptance of ISRs” dimension, 90% and 86% of participants in ATLAS and FLAIR, respectively, reported that their ISRs were either “totally acceptable” or “very acceptable” at week 48, while 86% and 84% of participants, respectively, reported that the level of pain experienced was either “totally acceptable” or “very acceptable” at week 48. Consistent results were observed in all remaining domains and individual item scores, although hypothesis testing was not undertaken for other components of the PIN to avoid multiplicity.

Fig. 4.

Fig. 4

Summary of PIN “Acceptability of ISRs” scores through week 48. Week 48 was compared with the 1st visit (week 5) based on Wilcoxon signed-rank test, respectively. P values are derived for ‘Acceptance’ only and not adjusted for multiple testing. ISR injection site reaction, PIN perception of injection, SD standard deviation

PROs with Individual Study Data Only

SF-12

No LA vs. CAR difference was observed in either ATLAS or FLAIR for the SF-12 MCS or PCS at MBL or later. In each study, MBL scores were above the US national average of 50 [31] and no significant change from MBL was observed or expected in either domain over 48 weeks. ATLAS patients receiving LA therapy had a mean adjusted treatment difference of 0.64 (95% CI, − 0.64, 1.91; p = 0.327) in the MCS domain and 0.70 (95% CI, − 0.11, 1.51; p = 0.092) in the PCS domain at 48 weeks. In FLAIR, patients receiving LA therapy had a mean adjusted treatment difference of 1.10 (95% CI [− 0.25, 2.45]; p = 0.109) in the MCS domain and − 0.17 (95% CI [− 0.99, 0.66]; p = 0.689) in the PCS domain at 48 weeks (Fig. 5).

Fig. 5.

Fig. 5

The SF-12 component scores adjusted treatment difference through 48 weeks. Adjusted mean is the estimated mean change from maintenance baseline score by visit in each treatment calculated from an ANCOVA model including the covariates, which are: ATLAS: baseline score, sex at birth, age, race (white, non-white), and third agent class (integrase inhibitors, protease inhibitors, NNRTI), FLAIR: maintenance baseline (day 1) score, induction baseline (week –20) HIV-1 RNA (< 100,000 vs. 100,000 c/mL), sex at birth, age (< 50 vs. ≥ 50 years), and race (white vs. non-white). CI confidence interval, SF-12 12-Item Short Form Health Survey

Preference Question (Exploratory)

In the ITT-E population, 86% (266/308) of LA arm participants in ATLAS and 91% (257/283) of LA arm participants in FLAIR rated the LA treatment as their preferred option over daily oral therapy after 48 weeks of treatment. Only 2% (7/308) in ATLAS and 1% (2/283) in FLAIR preferred daily oral treatment, with the remaining 11% (35/308) and 8% (24/283), respectively, classified as missing data. A post hoc observed analysis of participants with response data at week 48 showed that almost all responders preferred the LA regimen over CAR: 97% (266/273) in ATLAS and 99% (257/259) in FLAIR. No participant refused to respond to the preference question.

Reason for Switch in ATLAS (Exploratory)

At day 1 (randomization), ATLAS participants indicated “I am interested in research of new therapies” (82%; 505/616) and “My clinician asked me to participate” (25%; 151/616) as the top two reasons for wanting to enter the study and receive an LA regimen. At week 52, those opting to switch from continued oral CAR to open-label CAB+RPV LA in the extension phase indicated that “Interest in the convenience of a monthly injectable treatment” (53%; 164/308) and “Discretion associated with a monthly injectable treatment” (32%; 98/308) were the top two reasons for choosing LA treatment.

Discussion

Monthly CAB+RPV LA injections have demonstrated similar efficacy vs. daily oral ART in the pivotal phase 3 clinical trials ATLAS and FLAIR [1214]. Although ISRs were common, they declined over time [1214] and LA participants reported significantly higher levels of treatment satisfaction and preference for the LA regimen over previous daily oral ART, with respect to baseline, after almost 1 year of follow-up. Discontinuations due to ISRs were very uncommon (1%; 6/489), supporting these findings.

Treatment satisfaction with LA therapy, as assessed by the HIVTSQs instrument, reached similarly high scores in both studies, highlighting very high levels of satisfaction with LA treatment irrespective of prior ART experience. Differences in the change from MBL in treatment satisfaction were observed between ATLAS and FLAIR which could be explained by a difference in baseline satisfaction between the two studies. Changes from MBL in scores for the individual items within the HIVTSQs were higher in the LA group in ATLAS, showing the extent to which LA treatment contributes to improvement across almost all aspects of treatment satisfaction compared with oral therapy. Changes from baseline in FLAIR were generally smaller, particularly in the LA group, due to the ceiling effects caused by very high MBL scores. This observation is consistent with the assumption that the previously treatment-naïve patient group in FLAIR, who were virologically suppressed prior to LA maintenance by a short course of oral treatment with a well-tolerated, single-tablet dolutegravir-based modern regimen, would tend to be inherently more satisfied with their experience of their first oral treatment compared with those in ATLAS, who had already spent a number of years on oral therapies and were better able to compare treatment modalities.

Similarly, treatment acceptance scores for participants receiving CAB+RPV LA also reached the same levels at weeks 24 and 48 in both ATLAS and FLAIR, consistent with what was previously observed with the HIVTSQ. The lack of a statistically significant change from MBL in FLAIR was again mostly driven by high initial treatment acceptance and suggests that these newly treated patients are likely to find monthly LA treatment and daily oral treatment with a modern and well-established single-tablet regimen similarly acceptable. By contrast, those with more extensive experience of daily oral therapies over many years in ATLAS appeared to show a stronger predisposition in favor of LA therapy.

The results of the PIN questionnaire, assessing patient acceptability of injections, showed very similar attitudes towards IM administration between the two studies. Despite the common occurrence of ISRs, most participants indicated that the level of pain and ISRs was “very acceptable” 1 week after the initial LA injections, and scores improved significantly by 48 weeks of treatment. These trends are consistent with both the low discontinuation rate for ISRs and a declining incidence of ISRs across the maintenance phase of both studies [12, 13], similar to the time-dependent declines in ISRs seen with chronic LA parenteral treatment for other conditions, including infusions of ocrelizumab [34], rituximab [35], or ofatumumab [36] for multiple sclerosis, or IM injections of paliperidone [37] for treatment of schizophrenia.

In terms of general health outcomes, as measured by the SF-12 instrument, neither study showed statistically relevant changes from baseline in the physical or mental component subdomains for either oral or LA treatment. This is consistent with both the generally healthy baseline status of the two patient populations, and the noninferior efficacy of LA vs. oral treatment shown in both studies. The data also suggest that monthly injection therapy did not significantly alter participants’ general perceptions of their overall health status or functioning compared with oral therapy.

The results of the preference question were striking in both studies: 97% (ATLAS) and 99% (FLAIR) of responding participants preferred the LA regimen over prior oral therapy at week 48. Although willingness to participate in these studies assumes a predisposition to at least consider injectable therapy, the continued preference for the LA regimen is reassuring, suggesting that the LA regimen met participants’ expectations despite the challenges of monthly clinic visits and the prevalence of ISRs. Missing assessments, which contribute to the difference between ITT-E and per-responder analysis, are attributed to malfunctioning of PRO devices used for capturing data, scheduling of visits that fall within the dosing window but outside of the data collection window for PROs, and study withdrawals prior to week 48.

Specific factors driving the individual preferences in ATLAS may be multifaceted and vary between patients; however, convenience (53% of responders) and discretion (32%) were reported as the primary reasons for switching to LA therapy in the ATLAS study extension among those who had remained on oral treatment during the comparative treatment period.

Cognizance must be made of the limitations of these data in terms of the generalizability of the ATLAS and FLAIR study datasets to important sociodemographic groups chronically underrepresented in all HIV randomized trials—for whom the experience of LA vs. oral treatment may be different either in degree or in kind. Relevant sociodemographic factors such as employment, socioeconomic stratum, access to care, disability status, and drug use were not statistically captured in these studies. Also of note, even though both studies exceeded their female recruitment targets, which were set with high thresholds, this number was still low compared with the female proportion in the overall HIV population. While subgroup analyses may help provide additional clarity, for the more difficult-to-recruit groups it is likely that large observational cohorts will provide more robust future data on patient experience with LA treatment, including data on how well these trial results reflect the routine clinic situation. Also, the effect of longer (more than 48 weeks) LA treatment on PROs will be explored in forthcoming 96-week data from FLAIR, and from the results of the ATLAS-2M trial (NCT03299049) of 8-weekly vs. 4-weekly LA treatment, which included a high proportion of patients who rolled over from ATLAS after the 48-week primary analysis.

In addition, although treatment satisfaction has been shown to be positively correlated with adherence [3840], the very high adherence rates in both studies do not allow for demonstration of potential adherence benefits with an LA treatment, with the additional caveat that adherence in a clinical trial may not always reflect that in the routine clinic. In ATLAS and FLAIR, 98% of LA dosing visits took place within the 7-day dosing window. Also, although pill counts were not provided, no protocol deviation was marked for patients in the CAR groups in terms of adherence to oral medication, signifying that total number of days with daily oral treatment interruptions did not exceed 10% per patient [41]. To address these evidence gaps, an ongoing clinical trial of CAB LA+RPV LA vs. oral treatment (LATITUDE; NCT03635788) is currently recruiting a more difficult-to-treat population with adherence challenges and a wider range of clinical, behavioral and demographic characteristics, where satisfaction with treatment and adherence with the LA regimen might be more pronounced.

While treatment differences for any individual PRO in an open-label trial may be subject to selection bias, there was a clear preference to continue with LA treatment in both the FLAIR and ATLAS patient groups randomized to receive it. In ATLAS, there was a clear advantage for LA treatment satisfaction and acceptance among patients who had previously received oral cART. Real-world uptake of LA treatment would in fact be driven by patient choice. The data suggest that availability of an alternative to daily oral treatment option will address the needs of a number of PLWHIV, including those who have challenges with remaining adherent to daily pills despite their efforts, medical conditions interfering with oral administration, those who wish to reduce the daily reminder of their HIV status, or those who simply prefer the convenience and flexibility associated with an LA treatment schedule.

In summary, these PRO analyses of participants in the FLAIR and ATLAS studies provide a patient-oriented perspective of the LA regimen. The results indicate a high degree of satisfaction, acceptance, tolerability, and preference for the LA regimen in multiple dimensions, supporting the therapeutic potential of monthly injectable LA therapy.

Electronic supplementary material

Below is the link to the electronic supplementary material.

10461_2020_2929_MOESM1_ESM.tif (829.8KB, tif)

Supplementary file1 (TIF 829 kb) Supplementary Fig. 1. Change from baseline in individual HIVTSQs item score over 44 weeks in ATLAS. BL baseline, CAB cabotegravir, CAR current antiretroviral regimen, HIVTSQs HIV Treatment Satisfaction Questionnaire (status version), LA long-acting, RPV rilpivirine

10461_2020_2929_MOESM2_ESM.tif (464.7KB, tif)

Supplementary file2 (TIF 464 kb) Supplementary Fig. 2. PIN individual item domains and items in ATLAS. ISR injection site reaction, PIN Perception of Injection questionnaire, SD standard deviation

Acknowledgements

The authors thank all study participants and their families, the ATLAS and FLAIR clinical investigators and their staff, and study team members at ViiV Healthcare, GlaxoSmithKline, and Janssen. The PIN questionnaire is a modified version of the VAPI © Sanofi Pasteur, 2009 All Rights Reserved. VAPI contact information and permission to use: Mapi Research Trust, Lyon, France. Email: PROinformation@mapi-trust.org—internet: www.mapi-trust.org. Financial support for these studies was provided by ViiV Healthcare and Janssen. Editorial assistance with the preparation of the manuscript was provided by Nicole Ogbonnaya and Nick Fitch, PhD, of ArticulateScience (London, UK) with funding from ViiV Healthcare.

Compliance with Ethical Standards

Conflict of interest

Vasiliki Chounta, Krischan Hudson, Sandy Griffith, William Spreen, Mark Shaefer and David Margolis are employees of ViiV Healthcare and own company stocks of GlaxoSmithKline (GSK). Jenny Huang and David Dorey are employees of GSK and own company stocks of GSK. Anthony Mills has received honoraria for consulting for the following companies: Merck, ViiV Healthcare, Janssen, and Gilead Sciences. The Men’s Health Foundation receives research support for clinical trials for which Anthony Mills is an investigator. Hans Jäger has received lecture sponsorship or has served on advisory boards for the following companies: AbbVie, Gilead, GSK, Janssen, MSD Sharp & Dohme, TAD and ViiV Healthcare. Sharon Walmsley has served on advisory boards, speaking engagements, meetings, symposiums, and clinical studies for the following companies: ViiV Healthcare, GSK, Merck, Janssen, and Gilead Sciences. Simon Vanveggel is an employee and shareholder of Janssen, Pharmaceutical Companies of Johnson & Johnson. All other authors declare that they have no conflicts of interest.

Ethical Approval

All procedures performed in studies involving human participants were in accordance with the ethical standards of a national, regional, or investigational center ethics committee, or institutional review board, and with the 1964 Helsinki declaration and its later amendments or comparable ethical standards.

Informed Consent

Informed consent was obtained from all individual participants included in the study.

Footnotes

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

References

  • 1.May M, Gompels M, Sabin C. Life expectancy of HIV-1-positive individuals approaches normal conditional on response to antiretroviral therapy: UK collaborative HIV cohort study. J Int AIDS Soc. 2012;15(Suppl 4):18078. [Google Scholar]
  • 2.Bor J, Herbst AJ, Newell ML, Barnighausen T. Increases in adult life expectancy in rural South Africa: valuing the scale-up of HIV treatment. Science. 2013;339(6122):961–965. doi: 10.1126/science.1230413. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3.Ortego C, Huedo-Medina TB, Llorca J, et al. Adherence to highly active antiretroviral therapy (HAART): a meta-analysis. AIDS Behav. 2011;15(7):1381–1396. doi: 10.1007/s10461-011-9942-x. [DOI] [PubMed] [Google Scholar]
  • 4.Gardner EM, Sharma S, Peng G, et al. Differential adherence to combination antiretroviral therapy is associated with virological failure with resistance. AIDS. 2008;22(1):75–82. doi: 10.1097/QAD.0b013e3282f366ff. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5.Bangsberg DR, Perry S, Charlebois ED, et al. Non-adherence to highly active antiretroviral therapy predicts progression to AIDS. AIDS. 2001;15(9):1181–1183. doi: 10.1097/00002030-200106150-00015. [DOI] [PubMed] [Google Scholar]
  • 6.Weld ED, Rana MS, Dallas RH, et al. Interest of youth living with HIV in long-acting antiretrovirals. J Acquir Immune Defic Syndr. 2019;80(2):190–197. doi: 10.1097/QAI.0000000000001896. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.Williams J, Sayles HR, Meza JL, et al. Long-acting parenteral nanoformulated antiretroviral therapy: interest and attitudes of HIV-infected patients. Nanomedicine (Lond) 2013;8(11):1807–1813. doi: 10.2217/nnm.12.214. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8.Iacob SA, Iacob DG, Jugulete G. Improving the adherence to antiretroviral therapy, a difficult but essential task for a successful HIV treatment–clinical points of view and practical considerations. Front Pharmacol. 2017;8:831. doi: 10.3389/fphar.2017.00831. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9.Been SK, Schadé A, Bassant N, Kastelijns M, Pogány K, Verbon A. Anxiety, depression and treatment adherence among HIV-infected migrants. AIDS Care. 2019;31(8):979–987. doi: 10.1080/09540121.2019.1601676. [DOI] [PubMed] [Google Scholar]
  • 10.Trezza C, Ford SL, Spreen W, Pan R, Piscitelli S. Formulation and pharmacology of long-acting cabotegravir. Curr Opin HIV AIDS. 2015;10(4):239–245. doi: 10.1097/COH.0000000000000168. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11.Edurant (rilpivirine) prescribing information. 2018. Janssen Therapeutics. https://www.janssenlabels.com/package-insert/product-monograph/prescribing-information/EDURANT-pi.pdf. Accessed March 25 2020.
  • 12.Swindells S, Andrade-Villanueva J-F, Richmond GJ, et al. Long-acting cabotegravir and rilpivirine for maintenance of HIV-1 suppression. N Engl J Med. 2020;382(12):1112–1123. doi: 10.1056/NEJMoa1904398. [DOI] [PubMed] [Google Scholar]
  • 13.Orkin C, Arasteh K, Hernández-Mora MG, et al. Long-acting cabotegravir and rilpivirine after oral induction for HIV-1 infection. N Engl J Med. 2020;382(12):1124–1135. doi: 10.1056/NEJMoa1909512. [DOI] [PubMed] [Google Scholar]
  • 14.Overton E, Orkin C, Swindells S, et al. Monthly long-acting cabotegravir and rilpivirine is noninferior to oral ART as maintenance therapy for HIV-1 infection: Week 48 pooled analysis from the Phase 3 ATLAS and FLAIR studies. IAS Conference on HIV Science. Mexico City, Mexico, 2019 [poster MOPEB257].
  • 15.Margolis DA, Gonzalez-Garcia J, Stellbrink H-J, et al. Long-acting intramuscular cabotegravir and rilpivirine in adults with HIV-1 infection (LATTE-2): 96-week results of a randomised, open-label, phase 2b, non-inferiority trial. Lancet. 2017;390(10101):1499–1510. doi: 10.1016/S0140-6736(17)31917-7. [DOI] [PubMed] [Google Scholar]
  • 16.Kerrigan D, Mantsios A, Gorgolas M, et al. Experiences with long acting injectable ART: a qualitative study among PLHIV participating in a phase II study of cabotegravir + rilpivirine (LATTE-2) in the United States and Spain. PLoS ONE. 2018;13(1):e0190487. doi: 10.1371/journal.pone.0190487. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.Woodcock A, Bradley C. Validation of the HIV treatment satisfaction questionnaire (HIVTSQ) Qual Life Res. 2001;10(6):517–531. doi: 10.1023/A:1013050904635. [DOI] [PubMed] [Google Scholar]
  • 18.Woodcock A, Bradley C. Validation of the revised 10-item HIV Treatment Satisfaction Questionnaire status version and new change version. Value Health. 2006;9(5):320–333. doi: 10.1111/j.1524-4733.2006.00121.x. [DOI] [PubMed] [Google Scholar]
  • 19.Romaine J, Murray M, Bradley C. Psychometric evaluation of the revised HIV treatment satisfaction questionnaire (HIVTSQ) Value Health. 2016;19(7):A420. doi: 10.1016/j.jval.2016.09.426. [DOI] [Google Scholar]
  • 20.Romaine J, Murray M, Bradley C. Investigating the responsiveness to change of the HIV Treatment Satisfaction Questionnaire change version (HIVTSQc) in overcoming ceiling effects in the HIV Treatment Satisfaction Questionnaire status version (HIVTSQs). ISPOR Europe. Copenhagen, Denmark, 2019 [abstract PIH62].
  • 21.Murray M, Dorey D, Griffith S, et al. Satisfaction, tolerability, and acceptability of cabotegravir (CAB) + rilpivirine (RPV) long-acting therapy: LATTE-2 results. International AIDS Conference. Durban, South Africa, 2016 [poster THPEB052].
  • 22.Marant C, Longin J, Gauchoux R, et al. Long-term treatment acceptance: what is it, and how can it be assessed? Patient. 2012;5(4):239–249. doi: 10.1007/BF03262496. [DOI] [PubMed] [Google Scholar]
  • 23.Lambert J, Chekroun M, Gilet H, Acquadro C, Arnould B. Assessing patients' acceptance of their medication to reveal unmet needs: results from a large multi-diseases study using a patient online community. Health Qual Life Outcomes. 2018;16(1):134. doi: 10.1186/s12955-018-0962-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24.Chevat C, Viala-Danten M, Dias-Barbosa C, Nguyen VH. Development and psychometric validation of a self-administered questionnaire assessing the acceptance of influenza vaccination: the Vaccinees' Perception of Injection (VAPI) questionnaire. Health Qual Life Outcomes. 2009;7:21. doi: 10.1186/1477-7525-7-21. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 25.Ware J, Jr, Kosinski M, Keller SD. A 12-Item Short-Form Health Survey: construction of scales and preliminary tests of reliability and validity. Med Care. 1996;34(3):220–233. doi: 10.1097/00005650-199603000-00003. [DOI] [PubMed] [Google Scholar]
  • 26.Failde I, Medina P, Ramírez C, Arana R. Assessing health-related quality of life among coronary patients: SF-36 vs SF-12. Public Health. 2009;123(9):615–617. doi: 10.1016/j.puhe.2009.07.013. [DOI] [PubMed] [Google Scholar]
  • 27.Webster KE, Feller JA. Comparison of the short form-12 (SF-12) health status questionnaire with the SF-36 in patients with knee osteoarthritis who have replacement surgery. Knee Surg Sports Traumatol Arthrosc. 2016;24(8):2620–2626. doi: 10.1007/s00167-015-3904-1. [DOI] [PubMed] [Google Scholar]
  • 28.Wukich DK, Sambenedetto TL, Mota NM, Suder NC, Rosario BL. Correlation of SF-36 and SF-12 component scores in patients with diabetic foot disease. J Foot Ankle Surg. 2016;55(4):693–696. doi: 10.1053/j.jfas.2015.12.009. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 29.Ware JE, Jr, Sherbourne CD. The MOS 36-item short-form health survey (SF-36). I. Conceptual framework and item selection. Med Care. 1992;30(6):473–483. doi: 10.1097/00005650-199206000-00002. [DOI] [PubMed] [Google Scholar]
  • 30.Huo T, Guo Y, Shenkman E, Muller K. Assessing the reliability of the Short Form 12 (SF-12) Health survey in adults with mental health conditions: a report from the wellness incentive and navigation (WIN) study. Health Qual Life Outcomes. 2018;16(1):34. doi: 10.1186/s12955-018-0858-2. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 31.King JT, Jr, Horowitz MB, Kassam AB, Yonas H, Roberts MS. The short form-12 and the measurement of health status in patients with cerebral aneurysms: performance, validity, and reliability. J Neurosurg. 2005;102(3):489–494. doi: 10.3171/jns.2005.102.3.0489. [DOI] [PubMed] [Google Scholar]
  • 32.Rai SK, Yazdany J, Fortin PR, Aviña-Zubieta JA. Approaches for estimating minimal clinically important differences in systemic lupus erythematosus. Arthritis Res Ther. 2015;17(1):143. doi: 10.1186/s13075-015-0658-6. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 33.Ousmen A, Touraine C, Deliu N, et al. Distribution- and anchor-based methods to determine the minimally important difference on patient-reported outcome questionnaires in oncology: a structured review. Health Qual Life Outcomes. 2018;16(1):228. doi: 10.1186/s12955-018-1055-z. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 34.Mayer L, Kappos L, Racke MK, et al. Ocrelizumab infusion experience in patients with relapsing and primary progressive multiple sclerosis: results from the phase 3 randomized OPERA I, OPERA II, and ORATORIO studies. Mult Scler Relat Disord. 2019;30:236–243. doi: 10.1016/j.msard.2019.01.044. [DOI] [PubMed] [Google Scholar]
  • 35.Hawker K, O'Connor P, Freedman MS, et al. Rituximab in patients with primary progressive multiple sclerosis: results of a randomized double-blind placebo-controlled multicenter trial. Ann Neurol. 2009;66(4):460–471. doi: 10.1002/ana.21867. [DOI] [PubMed] [Google Scholar]
  • 36.Sorensen PS, Lisby S, Grove R, et al. Safety and efficacy of ofatumumab in relapsing-remitting multiple sclerosis: a phase 2 study. Neurology. 2014;82(7):573–581. doi: 10.1212/WNL.0000000000000125. [DOI] [PubMed] [Google Scholar]
  • 37.Savitz AJ, Xu H, Gopal S, et al. Efficacy and safety of paliperidone palmitate 3-month formulation for patients with schizophrenia: a randomized, multicenter, double-blind, noninferiority study. Int J Neuropsychopharmacol. 2016;19(7):pyw018. doi: 10.1093/ijnp/pyw018. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 38.Boretzki J, Wolf E, Wiese C, et al. Highly specific reasons for nonadherence to antiretroviral therapy: results from the German adherence study. Patient Prefer Adherence. 2017;11:1897–1906. doi: 10.2147/PPA.S141762. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 39.Jordan J, Cahn P, Goebel F, Matheron S, Bradley C, Woodcock A. Abacavir compared to protease inhibitors as part of HAART regimens for treatment of HIV infection: patient satisfaction and implications for adherence. AIDS Patient Care STDs. 2005;19(1):9–18. doi: 10.1089/apc.2005.19.9. [DOI] [PubMed] [Google Scholar]
  • 40.Delestras S, Roustit M, Mazet R, et al. Patient satisfaction with medication as an outcome for clinical pharmacists. Presented at 39th ESCP European symposium on clinical pharmacy & 13th SFPC congress: clinical pharmacy at the front line of innovations. 21–23 October 2010, Lyon, France. Int J Clin Pharm. 2011;33:285–467.
  • 41.Teichner P, Cutrell A, D’Amico R, et al. Patient adherence to long-acting injectable cabotegravir + rilpivirine through 48 weeks of maintenance therapy in the Phase 3 ATLAS and FLAIR studies. Open Forum Infect Dis. 2019;6(Suppl 2):S20. doi: 10.1093/ofid/ofz359.043. [DOI] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

10461_2020_2929_MOESM1_ESM.tif (829.8KB, tif)

Supplementary file1 (TIF 829 kb) Supplementary Fig. 1. Change from baseline in individual HIVTSQs item score over 44 weeks in ATLAS. BL baseline, CAB cabotegravir, CAR current antiretroviral regimen, HIVTSQs HIV Treatment Satisfaction Questionnaire (status version), LA long-acting, RPV rilpivirine

10461_2020_2929_MOESM2_ESM.tif (464.7KB, tif)

Supplementary file2 (TIF 464 kb) Supplementary Fig. 2. PIN individual item domains and items in ATLAS. ISR injection site reaction, PIN Perception of Injection questionnaire, SD standard deviation


Articles from AIDS and Behavior are provided here courtesy of Springer

RESOURCES