Abstract
Background
We aimed to evaluate the analytic performance of three rapid HIV viral load assays: the novel Xpert HIV-1 VL XC (Xpert XC), the Xpert HIV-1 VL (Xpert VL), and the m-PIMA HIV-1/2 VL (m-PIMA).
Setting
Two South African clinics.
Methods
We conducted a prospective diagnostic accuracy study. Site-laboratory technicians and nurses used the Xpert XC, Xpert VL and m-PIMA to test plasma samples from people with HIV receiving antiretroviral therapy. We compared results with the Roche Cobas HIV-1 reference assay. We determined accuracy to detect viraemia at the World Health Organization (WHO) failure threshold of 1000 copies/mL on all three assays, and 50 and 200 copies/mL on the Xpert assays. We assessed agreement using Bland-Altman plots.
Results
We enrolled 140 participants (98 [70%] women, median age 37 years), who provided 189 paired samples at one or more timepoints. We tested 174 samples with the Xpert XC, 188 with the Xpert VL, and 128 with the m-PIMA. At 1000 copies/mL, sensitivity and specificity (95% confidence intervals) were 97% (82-100) and 98% (93-99) (Xpert XC), 100% (87-100) and 96% (91-98) (Xpert VL), and 92% (72-99) and 99% (93-100) (m-PIMA) respectively. At 50 copies/mL, sensitivity and specificity were 93% (81-98) and 96% (91-99) (Xpert XC), and 95% (84-99) and 95% (90-98) (Xpert VL) respectively. Mean bias was -0.10 (-0.54 to 0.34) log10 copies/mL (Xpert XC), 0.07 (-0.37 to 0.52) log10 copies/mL (Xpert VL) and -0.26 (-0.83 to 0.31) log10 copies/mL (m-PIMA).
Conclusions
In these South African clinics, the accuracy of all three assays was clinically acceptable to detect viraemia at the WHO failure threshold, while both Xpert assays were also accurate at detecting low level viraemia.
Keywords: HIV, point-of-care, viral load testing
Introduction
The World Health Organization (WHO) recommends antiretroviral therapy (ART) for all people living with HIV, to suppress the HIV viral load.1 This prevents immunosuppression and related morbidity and mortality,2,3 as well as onward HIV transmission. Regular HIV viral load testing is a key component for monitoring the effectiveness of ART in current WHO guidelines, which recently endorsed the use of point-of-care viral load assays, where testing is conducted at the clinical site by laboratory professionals or specifically-trained healthcare workers.4 These assays can reduce the time from blood draw to results being available, allowing clinicians to take decisions on the same day in one clinic visit, rather than having to schedule follow up appointments to discuss the results.5,6 A randomised trial conducted by our team in South Africa, using the Xpert HIV-1 VL assay(Cepheid, Sunnyvale, USA), found that point-of-care testing improved the primary outcome of HIV viral suppression and retention in care by 13.7%.7
Currently, there are two point-of-care HIV viral load assays that are approved by the WHO for use in low and middle-income countries. The m-PIMA HIV 1/2 VL (Abbott, Chicago, USA) received WHO pre-qualification in 2019,8 and has been found to perform well in one laboratory-based9 and two clinic-based evaluation studies.10,11 The Xpert HIV-1 VL received WHO pre-qualification in 2017,12 and has also been found to perform well in 19 studies, which have been summarised in two systematic reviews.13,14 Only three of these studies reported conducting Xpert HIV-1 VL testing in clinics, as opposed to centralised laboratories. Because the assay was not able to detect certain recombinant HIV-1 sub-types,15 Cepheid have recently released a next generation dual target assay, the Xpert HIV-1 Viral Load XC (HIV VL XC), that detects a wider range of HIV subtypes.16 This assay recently received CE-IVD clearance,17 but has not yet been evaluated in any published studies that we are aware of.
Objectives
In this study, we aimed to assess the analytic performance of the novel, dual target Xpert HIV-1 VL XC, the existing Xpert HIV-1 VL and the m-PIMA HIV 1/2 VL, when used in South African clinics, compared to an established laboratory reference assay.
Methods
Study design and participants
We conducted a prospective diagnostic accuracy evaluation as a sub-study within the Point-Of-care HIV viral load testing to Enhance Resuppression (POwER) study, and the Centre for the AIDS Program of Research in South Africa (CAPRISA) 002 Acute Infection study. POwER is a randomised feasibility study in one urban and one rural public sector, primary care clinic in KwaZulu-Natal, South Africa, and the study protocol has been published elsewhere.18 In summary, approximately 100 non-pregnant adults aged 18 and over, receiving first-line ART and with HIV viraemia >1000 copies/mL in the past 6 weeks, are randomised to receive a second viral load test after 12 weeks by point-of-care test, or by standard laboratory based viral load testing. The primary outcome of viral suppression <50 copies/mL is assessed after 24 weeks. The CAPRISA 002 study is taking place in the same two clinics, and is a long-term cohort study of women living with HIV who are on ART.19 For this sub-study, POwER and CAPRISA 002 participants who provided written informed consent, had additional 4 to 8mLs of venous blood drawn for point-of-care assay evaluation, taken alongside the main study blood draws at enrolment or during follow up. We initially planned to use consecutive participants enrolling in POwER and attending follow up in CAPRISA 002, but disruptions in test cartridge supply chains, assay training and staffing due to the COVID-19 pandemic meant that there were periods where various assay cartridges were not available or rarely nurses did not have time to conduct testing. We therefore used a convenience sampling strategy instead, where consenting patients enrolling or attending follow up in either study had samples tested on whichever assays were available at that time in the respective clinic. This meant that some participants in POwER had multiple samples taken for this evaluation at up to three different visits.
Test methods
Assay manufacturers provided point-of-care training to both research laboratory technicians and research nurses, as well as ongoing testing support. Initially, laboratory technicians conducted testing in a dedicated on-site point-of-care laboratory in the clinics. Once laboratory technician testing was established, research nurses conducted testing in a dedicated space in the clinic, with ongoing troubleshooting support from the manufacturer and on-site laboratory staff. For point-of-care viral load testing, 4 to 8mLs whole blood was obtained by venepuncture into an EDTA tube and centrifuged (by laboratory technicians or nurses respectively) to obtain plasma, which was transferred into the test cartridge and loaded into the respective assay platform. The m-PIMA HIV 1/2 platform is a single module instrument which requires 50 µL of plasma, and provides a quantitative viral load result between 800 to 1,000,000 copies/mL in approximately 70 minutes. The manufacturer states that the m-PIMA HIV 1/2 has a lower limit of detection of 342 (95% confidence interval [CI] 279 - 451) copies/mL for HIV-1 group M, and 228 (95% CI 187-295) copies/mL for HIV-1 group O.20 The new Xpert HIV 1 VL XC and existing Xpert HIV 1 VL use the same GeneXpert platform (Cepheid, Sunnyvale, USA) and both require 1 mL of plasma to provide a quantitative viral load result between 40 and 10,000,000 copies/mL in approximately 90 minutes. The lower limit of detection as stated by the manufacturer is 13.6 (95% CI 11.1-15.6) copies/mL for the Xpert HIV-1 VL XC,16 and 15.3 (95% CI 13.5-17.0) copies/mL for the Xpert HIV-1 VL.21 We used research use only cartridges of the same version as the now commercially released Xpert XC, and single module GXP I and four module GXP IV instruments. If a point-of-care assay resulted in an error or an invalid result, the test was repeated using remaining plasma, if available. Point-of-care viral load results from this evaluation were not provided to patients and were not used for clinical decision making.
For reference laboratory testing, a nurse drew whole blood in an EDTA tube at the same timepoint, which was centrifuged to plasma and stored at -80°C in the CAPRISA bio-repository. These samples were then defrosted and tested in two batches (study mid-point and study end) on the cobas® HIV-1 reference assay using the cobas 6800 platform (Roche, Basel, Switzerland) at the Inkosi Albert Luthuli Hospital National Health Laboratory Service in Durban, KwaZulu-Natal. We chose this assay because it is one of the standard viral load assays which has been widely validated and used in the South African National Health Laboratory Service. Staff performing laboratory reference testing were blinded to results of the point-of-care testing and vice versa.
Analysis
For the Xpert assays, we evaluated sensitivity and specificity to detect viraemia at thresholds of 50 copies/mL, 200 copies/mL and 1000 copies/mL. Because the m-PIMA HIV 1/2 VL does not provide a quantitative viral load below 800 copies/mL, we only evaluated the 1000 copies/mL threshold. We evaluated accuracy at these thresholds as they are used in national and international guidelines to define viraemia and treatment failure.4,22–24 We assessed agreement with the laboratory reference assay using Bland-Altman plots, and association using Pearson correlation coefficients, restricted to paired samples with a quantifiable viral load on both the point of care and reference laboratory assay.
We conducted sensitivity analyses using bootstrap methods (see supplementary material for methods) to account for repeat testing in the same participants at different time points, which could introduce clustering of errors. For example, if a participant had a viral sub-type that was not detected by a particular assay, inaccurate results would be more common among repeat tests in that participant, compared to tests in the general sample.
We estimated that with the resources and time available, we could test approximately 150 samples on each assay. However, the COVID-19 pandemic interrupted cartridge supply chains for the m-PIMA HIV 1/2 VL, meaning fewer tests were possible for this assay. Because not all samples were tested on all point-of-care assays, we did not directly compare the performance of the point-of-care assays against each other.
Ethical approval
The POwER and CAPRISA 002 protocols, including use of samples for point-of-care viral load assay evaluation, were approved by the University of KwaZulu-Natal Biomedical Research Ethics Committee (BREC/00000836/2019 and E013/04 respectively), and POwER has also been approved by the University of Oxford Tropical Research Ethics Committee (OxTREC 66-19) and is registered with the Pan-African Clinical Trials Registry (PACTR202001785886049).
Results
Participants
Between June 26, 2020 and September 15, 2021, 140 participants provided paired samples, at one or more timepoints, for testing in this evaluation. Testing was conducted in the rural clinic for 25 participants, and at the urban clinic for 115 participants. 98 (70%) were women, median age was 37 years (interquartile range [IQR] 33-43), median time on ART was 4.6 years (IQR 2.9-6.0) and median CD4 count was 569 cells/µL (IQR 356-792).
Test results
Overall, 189 samples were tested on at least one point-of-care viral load assay. 174 samples were tested using the Xpert HIV-1 VL XC, 188 samples using the Xpert HIV-1 VL, and 128 samples using the m-PIMA HIV 1/2 VL (Table 1). Nurses conducted testing for 54/174 (31%) of Xpert HIV-1 VL XC samples, 26/188 (14%) Xpert HIV-1 VL samples, and 23/128 (18%) m-PIMA HIV 1/2 VL samples. Initial errors were produced for eight (4.6%) Xpert HIV-1 VL XC samples, two (1.1%) Xpert HIV-1 VL samples, and three (2.5%) m-PIMA HIV 1/2 VL samples. In some cases, tests were successfully repeated, meaning that final results were not available due to assay errors for eight (4.6%) Xpert HIV-1 VL XC samples, one (0.5%) Xpert HIV-1 VL sample, and two (1.7%) m-PIMA HIV 1/2 VL samples (see Table 1 for total number of errors and Table S1 for error codes). Four of the Xpert HIV-1 VL XC errors occurred at the beginning of the nurse testing process; this was the first assay that the nurses were trained to use.
Table 1. Samples tested on point-of-care viral load assays.
| Xpert HIV-1 VL XC | Xpert HIV-1 VL | m-PIMA HIV 1/2 VL | |
|---|---|---|---|
| Samples from one timepoint per participant | 84 (48.3) | 97 (51.6) | 67 (56.8) |
| Samples from two timepoints per participant | 70 (40.2) | 78 (41.5) | 46 (39.0) |
| Samples from 3 timepoints per participant | 12 (6.9) | 12 (6.4) | 3 (2.5) |
| No result due to assay errors a | 8 (4.6) b | 1 (0.5) c | 2 (1.7) d |
| Total | 174 | 188 | 118 |
See Table S1 for error codes
Eight samples (4.6%) produced an error. Four were retested, with the repeat test also producing an error meaning no result was available. Four were not retested meaning no result was available
Two samples (1.1%) produced an error, and both were retested. One repeat test also produced an error meaning no result was available, the other produced a valid result.
Three samples (2.5%) produced an error, and all were retested. Two repeat tests also produced an error meaning no result was available, the other produced a valid result.
Sensitivity and specificity
Sensitivity and specificity at 1000 copies/mL, compared to the Cobas 6800, were 97% and 98% (Xpert XC), 100% and 96% (Xpert VL), and 92% and 99% (m-PIMA) respectively. For the Xpert assays, sensitivity and specificity at 50 copies/mL were 93% and 96% (Xpert XC), and 95% and 95% (Xpert VL) respectively (Table 2). The m-PIMA was not assessed at 50 and 200 copies/mL because the lower limit of quantitation is 800 copies/mL.
Table 2. Raw numbers, sensitivity, and specificity (95% confidence intervals) of three point-of-care viral load assays at different viral load thresholds.
| Roche Cobas 6800 | Roche Cobas 6800 | Roche Cobas 6800 | ||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| <50 | ≥50 | Total | <50 | ≥50 | Total | <50 | ≥50 | Total | ||||||
| Xpert HIV-1 VL XC | <50 | 108 | 4 | 112 | Xpert HIV-1 VL | <50 | 125 | 3 | 128 | m-PIMA HIV 1/2 VL | <50 | - | - | - |
| ≥50 | 4 | 50 | 54 | ≥50 | 6 | 53 | 59 | ≥50 | - | - | - | |||
| Total | 112 | 54 | 166 | Total | 131 | 56 | 187 | Total | - | - | - | |||
| Sensitivity: 0.93 (0.81, 0.98) Specificity: 0.96 (0.91, 0.99) |
Sensitivity: 0.95 (0.84, 0.99) Specificity: 0.95 (0.90, 0.98) |
Sensitivity: NA Specificity: NA |
||||||||||||
| <200 | ≥200 | Total | <200 | ≥200 | Total | <200 | ≥200 | Total | ||||||
| Xpert HIV-1 VL XC | <200 | 116 | 4 | 120 | Xpert HIV-1 VL | <200 | 137 | 2 | 139 | m-PIMA HIV 1/2 VL | <200 | - | - | - |
| ≥200 | 3 | 43 | 46 | ≥200 | 1 | 47 | 48 | ≥200 | - | - | - | |||
| Total | 119 | 47 | 166 | Total | 138 | 49 | 187 | Total | - | - | - | |||
| Sensitivity: 0.91 (0.79, 0.97) Specificity: 0.97 (0.92, 0.99) |
Sensitivity: 0.96 (0.85, 0.99) Specificity: 0.99 (0.95, 1.00) |
Sensitivity: NA Specificity: NA |
||||||||||||
| <1000 | ≥1000 | Total | <1000 | ≥1000 | Total | <1000 | ≥1000 | Total | ||||||
| Xpert HIV-1 VL XC | <1000 | 131 | 1 | 132 | Xpert HIV-1 VL | <1000 | 148 | 0 | 148 | m-PIMA HIV 1/2 VL | <1000 | 90 | 2 | 92 |
| ≥1000 | 3 | 31 | 34 | ≥1000 | 6 | 33 | 39 | ≥1000 | 1 | 23 | 24 | |||
| Total | 134 | 32 | 166 | Total | 154 | 33 | 187 | Total | 91 | 25 | 116 | |||
| Sensitivity: 0.97 (0.82, 1.00) Specificity: 0.98 (0.93, 0.99) |
Sensitivity: 1.00 (0.87, 1.00) Specificity: 0.96 (0.91, 0.98) |
Sensitivity: 0.92 (0.72-0.99) Specificity: 0.99 (0.93-1.00) |
||||||||||||
Correlation and agreement
When restricted to paired samples quantifiable at ≥40 copies/mL, the Xpert HIV-1 VL XC had a mean bias of -0.10 log10 copies/mL (95% limits of agreement -0.54 to 0.34,Fig 1A) and a Pearson correlation co-efficient of 0.97 (95% CI 0.95 to 0.99, p < 0.001, r2 = 0.95, Fig 2A), while the Xpert HIV-1 VL had a mean bias of +0.07 log10 copies/mL (95% limits of agreement -0.37 to 0.52, Fig 1B) and Pearson correlation co-efficient of 0.98 (95% CI 0.96-0.99, p <0.001, r2 = 0.95, Fig 2B). For the m-PIMA HIV 1/2 VL, when restricted to paired samples quantifiable at ≥800 copies/mL, the mean bias was -0.26 log10 copies/mL (95% limits of agreement -0.83 to 0.31, Fig 1C) and the Pearson correlation co-efficient was 0.93 (95% CI 0.85-0.97, p <0.001, r2 = 0.87, Fig 2C).
Fig 1. Bland Altman plots of Xpert HIV-1 VL XC, Xpert HIV-1 VL & m-PIMA HIV 1/2 vs Cobas 6800.
Restricted to paired samples quantifiable on both the point-of-care and laboratory reference assay. The point estimate of the mean difference (bias) between the point-of-care and laboratory reference assay was within +/- 0.3 log10 copies/mL for all three assays.
Fig 2. Correlation of Xpert HIV-1 VL XC, Xpert HIV-1 VL & m-PIMA HIV 1/2 VL vs Cobas 6800.
Restricted to paired samples quantifiable on both the point-of-care and laboratory reference assay
Nurse-led testing
Accuracy, correlation and agreement of the assays were comparable when conducted by nurses and laboratory technicians, but numbers of nurse tested samples were small, particularly for the Xpert HIV-1 VL and the m-PIMA HIV-1/2 VL (Tables S2 and S3).
Sensitivity analyses
In sensitivity analyses using bootstrap methods to account for some participants having samples drawn for evaluation at repeated timepoints, results were relatively similar (Table S4).
Discussion
Summary
We found that the novel Xpert HIV-1 VL XC, the Xpert HIV-1 VL and the m-PIMA HIV-1/2 VL had clinically acceptable performance when used in a South African clinic. At the WHO threshold for treatment failure of 1000 copies/mL, both the Xpert HIV-1 VL XC and Xpert HIV-1 VL had >95% sensitivity and specificity, while the m-PIMA HIV-1/2 VL had sensitivity of 92% and specificity of 99%. Both Xpert assays were also accurate at detecting low level viraemia.
Related literature
Our findings are similar to other studies of these three point-of-care assays, the majority of which have been conducted in centralised laboratory settings.
Xpert HIV-1 VL XC
Our study is the first to evaluate the Xpert HIV-1 VL XC in a clinical setting. In a centralised laboratory-based study, 513 fresh, frozen and diluted samples, were tested on the Xpert HIV-1 VL XC and compared with the Alinity m HIV-1 reference assay (Abbott, Chicago, USA).25 The Xpert HIV-1 VL XC had a mean bias of +0.10 log10 copies/mL (95% CI -0.54 to 0.35), compared to the reference assay, and r2 was 0.9788. Taken together, these results suggest that the Xpert HIV-1 VL XC performs well when used in centralised laboratory and clinic-based settings.
Xpert HIV-1 VL
For the Xpert HIV-1 VL, our findings were similar to a meta-analysis of 13 studies including 3790 patients,14 which found a mean bias of 0.04 (95% CI: 0.02-0.07) copies/mL, and r2 of 0.941 (P<0.001). Sensitivity and specificity was >95% at 200 and 1000 copies/mL, but was not evaluated at 50 copies/mL. Instead, a threshold of ‘detectable’ was used (40 copies/mL on the Xpert HIV-1 VL assay versus 20, 25 and 40 copies/mL in the different comparator assays used in the studies), with sensitivity of 93.3% (88.2–96.3), and much lower specificity at 80.6% (64.6–90.4). Specificity was particularly poor (69.3%) when compared to the Abbott RealTime HIV-1 VL assay. We used the 50 copies/mL threshold as this is used in South African guidelines.22 Our finding that both the Xpert HIV-1 VL XC and Xpert HIV-1 VL performed well at this threshold contrasts slightly with the systematic review findings, but suggests that these assays are appropriate for use in the South African setting.
m-PIMA HIV-1/2 VL
Three published studies have evaluated the m-PIMA HIV-1/2 VL assay. Two of these were clinic-based; one multi-site study in Mozambique compared 686 samples tested by nurses with the m-PIMA HIV-1/2 VL versus the Cobas AmpliPrep/Cobas TaqMan 96 HIV-1 v2 (Roche) assay,10 while another multi-site study from Kenya compared 555 samples tested by laboratory technicians on the m-PIMA HIV-1/2 VL in clinics, with the RealTime HIV-1 assay (Abbott).11 The final study was a centralised laboratory evaluation comparing 413 frozen samples tested on the m-PIMA HIV -1/2 VL with results from fresh samples tested on the RealTime HIV-1 assay. At 1000 copies/mL, sensitivity and specificity were above 95% in all studies, except for the laboratory evaluation where specificity was 76.9 % (95% CI: 69.8–83.1). The correlation coefficients were 0.92, 0.92 and 0.93 respectively, with mean bias of -0.20, +0.16 and +0.26 log10 copies/mL respectively versus the laboratory reference assay. The WHO prequalification report found a bias of -0.21 log10 copies/mL versus the COBAS AmpliPrep/COBAS TaqMan HIV-1 Test, v2.0, with sensitivity of 95.1% and specificity of 99% at 1000 copies/mL8. Overall, these findings, particularly when using Roche reference laboratory assays, are similar to our results, although reasons for the low specificity in the laboratory study are not clear, but could be related to the use of frozen samples for m-PIMA testing.
Nurse testing
There is only one published study which has evaluated nurse-led quantitative point-of-care viral load testing, with good results using the m-PIMA HIV1/2 viral load in Mozambique, as described above.10 Our data suggest that the Xpert HIV-1 VL XC performs well when used by nurses, and results with the Xpert HIV-1 VL and m-PIMA HIV-1/2 VL were relatively similar, although numbers were small. However, our study was not explicitly designed to compare nurse versus laboratory testing, and research nurses had support available to them from on-site laboratory technicians, which does not reflect conditions across South African primary care. Nurses and/or midwives have accurately used qualitative viral load assays (that use the GeneXpert and m-PIMA platforms) for early infant diagnosis of HIV,26,27 and there is increasing interest in task-shifting point-of-care HIV diagnostics to non-laboratory staff in low and middle income countries.28–30 As these assays require plasma, venous blood samples had to be centrifuged by nurses in the study clinic. This required specific training and may not be feasible for nurses in many settings, which could limit use at the clinical point-of-care. A whole blood fingerstick assay would circumvent this problem, and point-of-care early infant diagnosis assays, which also use whole blood, have demonstrated clear benefits in clinical outcomes.26,31 This highlights the potential benefits of providing same day results using point-of-care technologies.
Strengths and limitations
Strengths of our study include the assessment of clinic-based testing in a setting with high HIV prevalence, and the inclusion of multiple point-of-care assays. As well as assessing correlation and mean bias, we focussed our analysis on sensitivity and specificity to detect viraemia at viral load thresholds that are directly relevant for patient management in South Africa and internationally. Most viral load testing was conducted by laboratory technicians, but we included some nurse led viral load testing, which has not been widely evaluated previously. Supply chain and operational disruptions due to the COVID-19 pandemic meant that our sample size was smaller than anticipated for some assays, and we were unable to test samples on all three assays concurrently. Instead, we allowed paired samples from repeat timepoints in the same participant, and conducted sensitivity analyses to account for potential clustering, with similar results. Nevertheless, the sample size of this study is relatively small, meaning confidence intervals for sensitivity estimates are wide for all assays at all viraemia thresholds, and for sensitivity and specificity estimates for nurse testing. Reference laboratory testing was conducted retrospectively using frozen plasma samples, in accordance with manufacturer’s instructions, which should not have affected results.32
Implications
A previous cost-effectiveness modelling study found that a sensitivity and specificity of 90% or more at a threshold of 1000 copies/mL would be acceptable for a point-of-care viral load assay in Southern Africa,33 while mean bias should ideally be within 0.3 log10 copies/mL of reference laboratory assays.6,34 In our evaluation, all three evaluated assays fell within these criteria.
Balancing assay analytic performance and other characteristics that influence clinical outcomes, such as ease of use, turn-around time and result availability will depend on the context of where the assay is being implemented. We found that the Xpert HIV-1 VL XC performed well at both the 50 copies/mL and 1000 copies/mL thresholds, which are the two key thresholds for ART management in South Africa, suggesting that the clinical performance is appropriate for this setting. The m-PIMA HIV-1/2 VL is not able to quantitate viral loads <800 copies/mL, making it less suited to assessment of low level viraemia. More recent evidence has found that low level viraemia among people receiving efavirenz-based ART regimens predicts subsequent treatment failure,35 although whether this remains true on dolutegravir based regimens is not yet known.36 South African guidelines currently use 50 copies/mL to define viraemia, and determine whether a patient is eligible for down-referral into streamlined ART delivery programmes,37,38 or whether they need enhanced adherence counselling to encourage resuppression,37 meaning the m-PIMA is less suited for use in these situations. However, the m-PIMA has a simple interface, shorter run time, and may be more suited to implementation in clinic-based settings, particularly in settings where access to viral load testing is poor. Further work is needed to confirm the performance of these assays when used by nurses, and we are conducting qualitative work with nurses and other healthcare workers, to explore feasibility and acceptability of implementing nurse testing in clinical settings. Using these assays to provide same-day, point-of-care results is crucial to achieving the reported benefits of expedited clinical decision-making, and reduced clinic visits and patient travel costs.39
Conclusions
The diagnostic accuracy of the Xpert HIV-1 VL XC, Xpert HIV-1 VL and m-PIMA HIV-1/2 VL assays was clinically acceptable when testing was conducted in these South African clinics. The Xpert assays have the added benefit of accurately detecting low level viraemia. However, further clinical studies are needed to determine if these assays can be implemented in routine primary healthcare settings, and whether there are operational and clinical benefits to patients and providers when used at the clinical point-of-care.
Supplementary Material
Acknowledgements
We would like to acknowledge the staff and participants of the CAPRISA 002 Acute infection study and the CAPRISA 255 POwER study. JD, NG, GH, CCB conceptualised the study. FS administered the project. JN, PM, NS, NM, and SM oversaw or conducted laboratory procedures and testing. JD, NG, FS, YS, NN, PKD, RJL, HN, GH and CCB conducted the POwER and CAPRISA 002 AI studies. JD and TF analysed the data. JD drafted the manuscript. All authors critically reviewed and edited the manuscript and approved publication. TF and GH receive funding from the National Institute for Health Research (NIHR) Community Healthcare MedTech and In Vitro Diagnostics Co-operative at Oxford Health NHS Foundation Trust (MIC-2016-018). TF receives funding from the NIHR Applied Research Collaboration Oxford and Thames Valley at Oxford Health NHS Foundation Trust. The views expressed in this publication are those of the authors and not necessarily those of the UK NHS, the NIHR or the Department of Health and Social Care.
Source of Funding
This work is supported by grants from the Wellcome Trust PhD Programme for Primary Care Clinicians (216421/Z/19/Z), the University of Oxford’s Research England QR Global Challenges Research Fund (0007365), the Africa Oxford Initiative (AfiOx-119) and the Tropical Health Education Trust (THET). Cepheid and Abbott provided the assays and cartridges for this evaluation at no cost.
Footnotes
Conflicts of Interest
The authors declare that they have no other competing financial interests or personal relationships that could have appeared to influence the work reported in this paper. For the purpose of Open Access, the author has applied a CC BY public copyright licence to any Author Accepted Manuscript version arising from this submission. The research materials supporting this publication may be accessed by contacting the corresponding author.
This is a pre-copyedited, author-produced version of an article accepted for publication in Journal of Acquired Immune Deficiency Syndromes. The published version of record, Dorward et al. Diagnostic accuracy of the rapid Xpert HIV-1 Viral Load XC, Xpert HIV-1 Viral Load & m-PIMA HIV-1/2 Viral Load in South African clinics, JAIDS, 2022, is available online at: https://journals.lww.com/jaids/Abstract/9900/Diagnostic_accuracy_of_the_rapid_Xpert_HIV_1_Viral.66.aspx doi:10.1097/QAI.0000000000003037
References
- 1.World Health Organization. Consolidated guidelines on the use of antiretroviral drugs for treating and preventing HIV infection: Recommendations for a public health approach - Second edition. 2016. https://www.who.int/hiv/pub/arv/arv-2016/en/ [PubMed]
- 2.Group TAS, Danel C, Moh R, et al. A Trial of Early Antiretrovirals and Isoniazid Preventive Therapy in Africa. N Engl J Med. 2015 Aug 27;373(9):808–22. doi: 10.1056/NEJMoa1507198. [DOI] [PubMed] [Google Scholar]
- 3.Group ISS, Lundgren JD, Babiker AG, et al. Initiation of Antiretroviral Therapy in Early Asymptomatic HIV Infection. N Engl J Med. 2015 Aug 27;373(9):795–807. doi: 10.1056/NEJMoa1506816. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.World Health Organization. Updated recommendations on HIV prevention, infant diagnosis, antiretroviral initiation and monitoring. 2021. [Accessed 30 July 2021]. https://www.who.int/publications/i/item/9789240022232 . [PubMed]
- 5.Dorward J, Drain PK, Garrett N. Point-of-care viral load testing and differentiated HIV care. The Lancet HIV. 2018;5(1) doi: 10.1016/S2352-3018(17)30211-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Drain PK, Dorward J, Bender A, et al. Point-of-Care HIV Viral Load Testing: an Essential Tool for a Sustainable Global HIV/AIDS Response. Clinical Microbiology Reviews. 2019;32(3):e00097-18. doi: 10.1128/CMR.00097-18. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Drain PK, Dorward J, Violette LR, et al. Point-of-care HIV viral load testing combined with task shifting to improve treatment outcomes (STREAM): findings from an open-label, non-inferiority, randomised controlled trial. The Lancet HIV. 2020;7(4):e229–e237. doi: 10.1016/s2352-3018(19)30402-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.World Health Organization. WHO Prequalification of In Vitro Diagnostics Product: m-PIMA HIV-1/2 VL. 2019.
- 9.Mariani D, de Azevedo M, Vasconcellos I, et al. The performance of a new point-of-care HIV virus load technology to identify patients failing antiretroviral treatment. J Clin Virol. 2020 Jan;122(April):104212. doi: 10.1016/j.jcv.2019.104212. [DOI] [PubMed] [Google Scholar]
- 10.Meggi B, Bollinger T, Zitha A, et al. Performance of a True Point-of-Care Assay for HIV-1/2 Viral Load Measurement at Antenatal and Postpartum Services. J Acquir Immune Defic Syndr. 2021 May 1;87(1):693–699. doi: 10.1097/QAI.0000000000002621. [DOI] [PubMed] [Google Scholar]
- 11.Bwana P, Ageng’o J, Danda J, Mbugua J, Handa A, Mwau M. Performance and usability of mPIMA™ HIV 1/2 viral load test in point of care settings in Kenya. Journal of Clinical Virology. 2019;121:104202. doi: 10.1016/j.jcv.2019.104202. [DOI] [PubMed] [Google Scholar]
- 12.World Health Organization. WHO prequalification of in vitro diagnostics Product: Xpert® HIV-1 Viral Load with GeneXpert® Dx GeneXpert® Infinity-,GeneXpert® Infinity-48s and GeneXpert® Infinity-80. Geneva: World Health Organization; 2017. [Google Scholar]
- 13.Nash M, Huddart S, Badar S, Baliga S, Saravu K, Pai M. Performance of the Xpert HIV-1 Viral Load Assay: a Systematic Review and Meta-analysis. Journal of Clinical Microbiology. 2018;56(4):e01673-17. doi: 10.1128/JCM.01673-17. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Sacks JA, Fong Y, Gonzalez MP, et al. Performance of Cepheid Xpert HIV-1 viral load plasma assay to accurately detect treatment failure. AIDS. 2019;33(12):1881–1889. doi: 10.1097/QAD.0000000000002303. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Avidor B, Matus N, Girshengorn S, et al. Comparison between Roche and Xpert in HIV-1 RNA quantitation: A high concordance between the two techniques except for a CRF02_AG subtype variant with high viral load titters detected by Roche but undetected by Xpert. Journal of Clinical Virology. 2017;93(May):15–19. doi: 10.1016/j.jcv.2017.05.014. [DOI] [PubMed] [Google Scholar]
- 16.Cepheid. Xpert® HIV-1 Viral Load XC package insert. 2021. https://www.cepheid.com/en/tests/Virology/Xpert-HIV-1-Viral-Load-XC .
- 17.Cepheid. Cepheid Receives CE-IVD Clearance for Two Next-Generation Xpert® HIV-1 Tests. Updated July 29, 2021 https://cepheid.mediaroom.com/2021-07-29-Cepheid-Receives-CE-IVD-Clearance-for-Two-Next-Generation-Xpert-R-HIV-1-Tests.
- 18.Dorward J, Sookrajh Y, Ngobese H, et al. Protocol for a randomised feasibility study of Point-Of-care HIV viral load testing to Enhance Re-suppression in South Africa: the POwER study. BMJ Open. 2021;11(2):e045373. doi: 10.1136/bmjopen-2020-045373. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Loggerenberg FV, Mlisana K, Williamson C, et al. Establishing a Cohort at High Risk of HIV Infection in South Africa: Challenges and Experiences of the CAPRISA 002 Acute Infection Study. 2008;3(4):1–8. doi: 10.1371/journal.pone.0001954. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Abbott. m-PIMA™ HIV-1/2 VL Cartridge Guide. 2018.
- 21.Cepheid. Xpert® HIV-1 Viral Load Brochure. 2017. [Accessed May 17, 2022]. https://cepheid.widen.net/content/xwv1mxvmlp/pdf/Cepheid-Xpert-HIV-1-Viral-Load-Brochure-CE-IVD-3039-English.pdf?u=bk12mm .
- 22.The South African National Department of H. 2019 ART Clinical Guidelines for the management of HIV in Adults, Pregnancy, Adolescents, Children, Infants and Neonates. 2019.
- 23.Panel on Antiretroviral Guidelines for Adults and Adolescents. Guidelines for the Use of Antiretroviral Agents in Adults and Adolescents with HIV. Department of Health and Human Services; https://clinicalinfo.hiv.gov/sites/default/files/inline-files/AdultandAdolescentGL.pdf . [Google Scholar]
- 24.British HIV Association (BHIVA) BHIVA guidelines for the treatment of HIV-1-positive adults with antiretroviral therapy 2015 (2016 interim update) [Accessed Sepember 01, 2021]. https://www.bhiva.org/HIV-1-treatment-guidelines .
- 25.Ehret R, Dusek M, Harb K, Breuer S, Obermeier M. Comparison of the new HIV VL XC Assay with the established Alinity m in HIV-1 viral load measurement. presented at 31st European Congress of Clinical Microbiology & Infectious Diseases (ECCMID) Virtual. 2021 [Google Scholar]
- 26.Jani IV, Meggi B, Loquiha O, et al. Effect of point-of-care early infant diagnosis on antiretroviral therapy initiation and retention of patients. AIDS. 2018;32(11):1453–1463. doi: 10.1097/QAD.0000000000001846. [DOI] [PubMed] [Google Scholar]
- 27.Hiv P. Outcomes of point-of-care maternal HIV viral load testing and early infant diagnosis at delivery: experience from four tertiary obstetric units in Gauteng. 2019;(June) [Google Scholar]
- 28.Ndlovu Z, Ellman T. Lay testing cadres and point-of-care diagnostic tests for HIV and other diseases: An essential combination in health service delivery. PLoS Med. 2021 Nov;18(11):e1003867. doi: 10.1371/journal.pmed.1003867. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.World Health Organization. Updated recommendations on service delivery for the treatment and care of people living with HIV. 2021. [Accessed May 18, 2022]. https://www.who.int/publications/i/item/9789240023581 . [PubMed]
- 30.Vojnov L, Taegtmeyer M, Boeke C, et al. Performance of non-laboratory staff for diagnostic testing and specimen collection in HIV programs: A systematic review and meta-analysis. PLoS One. 2019;14(5):e0216277. doi: 10.1371/journal.pone.0216277. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.Ehrenkranz PD, Baptiste SL, Bygrave H, et al. The missed potential of CD4 and viral load testing to improve clinical outcomes for people living with HIV in lower-resource settings. PLOS Medicine. 2019;16(5):e1002820. doi: 10.1371/journal.pmed.1002820. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32.Roche Diagnostics. cobas HIV-1: Quantitative nucleic acid test for use on the cobas® 6800/8800 Systems. [Accessed 14 Jan, 2022]. https://pim-eservices.roche.com/eLD/web/gb/en/documents/download/4a8ad62b-3e38-ec11-0b91-005056a772fd .
- 33.Phillips AN, Cambiano V, Nakagawa F, et al. Point-of-Care Viral Load Testing for Sub-Saharan Africa: Informing a Target Product Profile. Open Forum Infectious Diseases. 2016;3(3):ofw161. doi: 10.1093/ofid/ofw161. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34.The International Diagnostics Centre. Target Product Profile (TPP) – Point-of-Care HIV Viral Load Test. [Accessed 21 January 2022]. https://idc-dx.net/resource/target-product-profile-tpp-point-of-care-hiv-viral-load-test-2013/
- 35.Hermans LE, Moorhouse M, Carmona S, et al. Effect of HIV-1 low-level viraemia during antiretroviral therapy on treatment outcomes in WHO-guided South African treatment programmes: a multicentre cohort study. Lancet Infect Dis. 2018 Feb;18(2):188–197. doi: 10.1016/S1473-3099(17)30681-3. [DOI] [PubMed] [Google Scholar]
- 36.Dorward J, Lessells R, Drain PK, et al. Dolutegravir for first-line antiretroviral therapy in low-income and middle-income countries: uncertainties and opportunities for implementation and research. Lancet HIV. 2018 Jul;5(7):e400–e404. doi: 10.1016/S2352-3018(18)30093-6. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37.South African National Department of Health. Adherence Guidelines for HIV TB and NCDs. Updated March 2020. https://www.knowledgehub.org.za/elibrary/adherence-guidelines-hiv-tb-and-ncds-standard-operating-procedures-2020.
- 38.Dorward J, Msimango L, Gibbs A, et al. Understanding how community antiretroviral delivery influences engagement in HIV care: a qualitative assessment of the Centralised Chronic Medication Dispensing and Distribution programme in South Africa. BMJ Open. 2020;10(5):e035412. doi: 10.1136/bmjopen-2019-035412. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 39.Msimango L, Gibbs A, Shozi H, et al. Acceptability of point-of-care viral load testing to facilitate differentiated care: a qualitative assessment of people living with HIV and nurses in South Africa. BMC Health Serv Res. 2020 Nov 25;20(1):1081. doi: 10.1186/s12913-020-05940-w. [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.


