COUNTERPOINT
The use of rapid influenza A/B direct tests (RIDTs) versus nucleic acid amplification tests (NAATs) was first debated in the inaugural January 2010 Point-Counterpoint (1), in response to reports of poor performance of RIDTs during the 2009 influenza A H1N1 pandemic (pH1N1) (2, 3). Since 2009, the number of U.S. Food and Drug Administration-cleared RIDTs has risen to 16 (4). Advantages of the newer RIDTs include improved yet variable reactivity to circulating influenza strains and detection technologies with the potential to bridge the performance gap between RIDTs and NAATs.
Are the newer RIDTs an improvement over the older RIDTs, and are they more comparable to NAATs? A 2012 evaluation of 11 RIDTs by the U.S. Centers for Disease Control and Prevention (CDC; Atlanta, GA) using dilutions of 23 circulating influenza A and B virus strains demonstrated that the number of positive tests varied by influenza type (A or B) and influenza A subtype (5). Overall, there were no performance differences with influenza B virus lineages. Conversely, there was high variability in the analytical results of the influenza A test among the strains tested, especially at lower viral concentrations. Additional studies have shown that RIDT clinical sensitivity is less optimal for detection of pH1N1 (55.8%) than for detection of H3N2 (71.0%) and the previous seasonal H1N1 strain (69.4%) due to their lower virus burden rather than a diminished capacity of the test to detect strains (6, 7). A combination of lower analytical and clinical sensitivities can have a significant impact on RIDT performance.
Two new immunofluorescence assays, the Sofia system for influenza A and B fluorescence immunoassay (Quidel, San Diego, CA) and the Veritor System for Flu A+B (BD Diagnostics, Sparks, MD), with automated reading, were developed to enhance performance. The assays were designed to detect the current strains influenza virus B/Victoria/Yamagata, pH1N1, and influenza virus A (H3N2) and a variety of influenza A subtypes, including variations of H2 to H9, H11 to H14, and H16, depending on the assay. Clinical trial performance data varied by specimen type and age of the patients tested (8, 9). Compared to viral culture, Sofia demonstrated (in groups with ≥10 samples) sensitivities for influenza A virus detection ranging from 78% (nasal swabs [NS]; patient ages, 22 to 59 years) to 99% (nasopharyngeal wash specimens/aspirates [NPW/A]; patient age, <6 years) and for influenza B virus detection ranging from 73% (NS; patient ages, 22 to 59 years) to 94% (NP swabs [NPS]; patient ages, 6 to 21 years) (8). Compared to values for an FDA-cleared RT-PCR assay in the prospective arm of the Veritor clinical trial study, the percentages of positive agreement for influenza A ranged from 81.3% (NPS) to 83% (NPW/A) and for influenza B ranged from 81.3% (NPS) to 85.6% (NPW/A) (9). Both assays demonstrated high specificities for influenza A and B. However, the overall performance of both assays was heavily weighted by patient age, a factor known to effect assay performance, since younger patients shed larger amounts of virus and for longer periods, whereas geriatric patients show the lowest viral titers. In total, 96% of samples tested with Sophia and 77% tested with Veritor were from patients <22 years old, and only 1% of the samples tested by Sophia and 0.1% tested by Veritor were from patients ≥60 years. Therefore, assay performance was not well established for an advanced age group that has the highest rates of influenza-associated morbidity and mortality. Gao et al. evaluated the effect of age on the clinical sensitivity of other RIDTs in comparison to RT-PCR and demonstrated that increasing age was negatively associated with RIDT sensitivity (<2 years, 85.7%; 2 to 39 years, 60.3%; ≥40 years, 33.3%) (10).
Independent studies compared the performances of Sophia and Veritor to those of other RIDTs, using either NAAT or NAAT plus viral culture as the reference methods (11–16). Sophia testing yielded sensitivities for influenza A and B virus detection ranging from 78.9% to 95.8% and 62.5% to 98.1%, respectively (11–14), whereas nonfluorescent RIDTs demonstrated sensitivities for influenza A and B virus detection ranging from 54.8% to 79.2% and 40.7% to 97.3%, respectively. Veritor sensitivities for influenza A and B virus detection ranged from 72.0% to 93.8% and 69.3% to 94.2%, respectively, whereas nonfluorescent RIDTs demonstrated sensitivities for influenza A and B virus detection ranging from 56.0% to 85.7% and 57.3% to 80.8%, respectively (14–16). The sensitivities of Sophia and Veritor were better than those of some RIDTs, were inferior to those of NAATs, and varied depending on the influenza strain, specimen type, and patient population, with pediatric studies yielding the best results.
Another CDC study evaluated seven RIDTs, including Sophia and Veritor, in comparison to the CDC Flu rRT-PCR Dx panel (CDC) for detection of an influenza A (H3N2) virus variant (H3N2v) (17). Four of seven RIDTs (Directigen EZ Flu A+B [BD], Sofia, Veritor, and Xpect Flu A&B [Remel, Lenexa, KS]) detected all seven H3N2v strains, BinaxNOW influenza A&B (Alere, Waltham, MA) detected five of seven strains, Quick View Influenza A+B test (Quidel) detected three of seven strains, and SAS FluAlert A&B (SA Scientific, San Antonio, TX) detected only one strain. This study highlights the variable performances of RIDTs for emerging strains, indicating that several viruses and subtypes should be evaluated with each RIDT on a regular basis. Currently, RIDT manufacturers are not required to reevaluate the performance of their assays once they are FDA cleared. However, the emergence of novel or variant influenza strains requires a more stringent oversight of RIDTs to provide reasonable assurance of the safety and effectiveness of RIDTs. Consequently, the FDA has proposed that all RIDTs regulated under §866.3330 of the Code of Federal Regulations (18) be reclassified as class II with special controls. This would include mandatory annual analytical reactivity testing of contemporary influenza strains, including newly emerging strains that pose a danger to public health.
Despite the suboptimal performance of RIDTs, studies have shown that RIDTs improve seasonal influenza diagnostic sensitivity above unaided clinical diagnosis and affects clinical decision-making, thereby reducing diagnostic testing, antibiotic use, and emergency department utilization while increasing antiviral prescription rates (19).
If these benefits are realized for RIDTs, why would we not want to use more sensitive and specific NAATs in lieu of RIDTs to further enhance the above-named benefits? Currently, there are 26 FDA-cleared NAATs for the detection of influenza A and B (4). Please refer to Table 1 in the CDC reference (20) for specifics on each assay and reviews (21, 22), as a comprehensive overview is beyond the scope of this commentary. Eleven assays detect influenza A and B, without influenza A virus subtyping, eight assays detect influenza A and B, with influenza A virus subtyping, six detect just influenza A, with subtyping, and one detects influenza B virus, with subtyping. Ten assays detect additional respiratory viruses (1 to 15), and one assay detects three additional bacterial pathogens, allowing for a more comprehensive syndromic diagnostic screening. NPS, preferably flocked swabs, since they have been demonstrated to collect more cellular material, are approved for all tests, with various additional sample types, including NS, NPW/A, tracheal aspirates, and lower respiratory tract specimens (LRTS), approved depending on the test (20). Virus detection in LRTS is essential in severe cases of pneumonia since upper respiratory tract samples may test negative. NAAT clinical performance has been consistently better than those of RIDTs, including those developed after 2009, when used in a variety of clinical settings and patient populations (2, 3, 9, 10, 21, 22). NAAT sensitivities range from 90.5% to 97.6%, thereby improving the diagnosis, especially in older patients and if suboptimal samples are collected. The majority of studies demonstrate a specificity close to 100% (21, 22), providing confidence in a positive result, especially outside the influenza season.
Considering the limitations of RIDTs and the better performance of NAATs, I pose several questions relating to test features which are consistently used to promote the use of RIDTs. These include questions related to ease of use, rapid turnaround time, and low cost compared to those of NAATs. Finally, I question the argument that the detection of influenza A or B is sufficient since there no treatments for other respiratory viruses and their identification does not necessarily change patient management.
Are RIDTs easier to perform than all NAATs? NAATs vary in format (although all include steps to extract, amplify, and detect nucleic acid), ease of use (hands-on times, 2 min to several hours), and times to results (<30 min to 8 or more hours). The only FDA CLIA-waived NAAT, the Alere iNAT FluA/B (Alere, Waltham, MA), takes approximately 15 min to perform. The Liat Influenza A/B assay (IQuum, Marlborough, MA) has a <30-min test time, the Xpert Flu assay (Cepheid, Sunnyvale, CA) and the FilmArray RP assay (BioFire/bioMérieux, Salt Lake City, UT) provide results in approximately 1 h, and the Simplexa FluA/B+RSV Direct assay (Focus Diagnostics, 3M, Cyprus, CA) provides results in <2 h. All four NAATs, like RIDTs, require minimal hands-on time (one step and less than 2 min to perform), and they are listed as being of moderate complexity. The Verigene respiratory virus nucleic acid test and Verigene respiratory virus plus nucleic acid test (Nanosphere, Northbrook, IL) are also listed as being of moderate complexity, with results in 3.5 h and a minimal 2-step process (addition of sample and reading of results).
Is a 15-min RIDT with a 72% to 85% sensitivity better for facilitating rapid patient care than a 98%-sensitive NAAT with a 15- to 60-min time to results? A very minimal gain in the time to results cannot justify an incorrect or missed diagnosis. Diagnostic accuracy has been shown to reduce ancillary testing, assist in decisions to admit or not admit, and facilitate appropriate therapeutic decisions (antiviral, antibiotic, or none). Incorrect treatment is expensive and can result in greater risk of toxicity, adverse effects, and development of drug resistance (21–23). Optimal test performance is essential for infection control to reduce the risk of nosocomial outbreaks and their associated morbidity and mortality and to reduce the significant costs to health care systems, including health care worker (HCW) absenteeism, medication costs, and staff time spent in outbreak control. Yassi et al. investigated an influenza A outbreak that resulted in infection of 17 HCWs (34% servicing the ward) and 16 chronic geriatric patients (47% of patients), of whom 3 died (24). Another study relating to an influenza A H3N2 outbreak among geriatric patients and HCWs identified six nosocomial infections and three independent clusters, with an HCW source identified in at least two (25). Nosocomial outbreaks of influenza/parainfluenza have been significantly associated (P = <0.001) with complete closure of medical units (26). Outbreaks are especially dangerous for immunocompromised patients, for whom there is a risk of prolonged shedding and development of oseltamivir resistance. An outbreak in a hematologic/oncologic unit resulted in 23/76 patients (32%) developing nosocomial influenza, three patients being identified with oseltamivir-resistant virus, and 3 patients expiring (27). An outbreak investigation in the Netherlands found nosocomial transmission of oseltamivir-resistant virus, leading to three cases of pneumonia and two mortalities (28).
Is the detection of just influenza A and/or B by RIDTs sufficient in a hospitalized patient, especially since antiviral treatment is available only for influenza? Despite the fact that treatment is limited to influenza, identification of other respiratory viruses as the cause of disease will reduce unnecessary use of antivirals and antibiotics, promoting good stewardship practices. A study by Rodgers et al. found that use of a rapid comprehensive respiratory panel that detected 21 viruses and 3 bacterial pathogens resulted is significant improvements by reducing the mean time to results, increasing the percentage of patients in the emergency department (ED) with a result, and shortening the duration of antibiotic use if results were provided within 4 h (23). A positive result decreased inpatient length of stay and time in isolation. Additionally, one must consider the potential for mixed viral infections and the impact of cohorting during a busy respiratory season. One study identified coinfections with other respiratory viruses in 7.2% of patients with influenza (29), and another study found that 3.39% of all specimens and 9.55% of all positive specimens contained more than one virus, with influenza virus present in 52.17% of the mixed infections (30). A secondary viral infection in an already-compromised patient can result in severe outcomes.
Most NAATs can subtype influenza A virus strains. This is important for surveillance and to identify potential new variants. Testing positive for influenza A matrix but negative for the current hemagglutinin types would result in an “unsubtypeable” strain, as was the case with pH1N1 (31). Subtyping may be relevant for treatment, as different subtypes can have different antiviral drug susceptibilities, as noted with prepandemic seasonal influenza A(H1N1), which was oseltamivir resistant whereas the cocirculating H3N2 strain was susceptible. Although in the 2013-2014 season, 98.2% of pH1N1, 100% of H3N2, and 100% of influenza B virus strains were oseltamivir susceptible, pH1N1 oseltamivir resistance occurred, and under these conditions, if resistant subtypes predominate, subtyping would be essential (32).
Is performing an inexpensive RIDT (average cost, $10 to $15) really less expensive than performing NAATs? The cost of a NAAT can range from approximately $40 to $150 or more. A RIDT would be less expensive in an outreach setting if no further testing was required. However, for inpatients or for persons at risk for severe disease, in accordance with CDC guidelines, negative sample results for a patient suspected of having influenza should be reflexed to more-sensitive methodologies, such as viral culture and NAAT, with significant additional testing costs and a delay in the time to results. Delays in results lead to additional ancillary testing and prolonged hospital stays. The study by Rodgers et al. determined that a positive viral test result decreased the inpatient length of stay and time in isolation (23). Cost savings were estimated at $231 in hospital costs, $17 in antibiotic usage per patient, and $178 per patient for testing if a panel of various PCRs had to be run in lieu of the single rapid comprehensive respiratory panel. The extra cost of a NAAT can be justified by the prevention of nosocomial outbreaks with significant impact on hospital finances, particularly if an entire ward must be closed, HCWs must be furloughed, and patients must receive antiviral prophylaxis.
Have RIDTs, compared to NAATs, improved to an extent that we should support their use alone or as a primary screening test in all clinical settings? Better-performing RIDTs could be used under circumstances of financial constraint, in circumstances where there are no other options, in appropriate outpatient and ED discharge settings for specific patient populations, such as nonimmunocompromised pediatric patients, and when only influenza is documented in the community. Even in these settings, clinicians must be aware that RIDT performances are not equivalent among all tests for all strains, and manufacturer claims do not necessarily reflect real performance that correlates with sample type, time of sample collection, and virus burden (33). Despite the known poor sensitivities of some RIDTs or a lack of knowledge about their performance in community settings, Williams et al. found that clinicians in outpatient settings often relied on RIDTs for deciding antiviral therapy rather than following CDC recommendations for patients at higher risk for complications (34). Many clinicians do not follow the CDC recommendations for reflex testing to confirm positive results when the prevalence of influenza is low or when the test is negative for a patient highly suspected of having influenza and/or with an increased risk for severe disease when disease prevalence is high. For hospitalized patients, only NAATs should be performed, preferably with a comprehensive respiratory panel. Additionally, monitoring of critically ill patients using a quantitative NAAT has been shown to help evaluate responses to antiviral therapy. Performing a one-step NAAT is as simple as performing a RIDT, can be performed on demand 24 h a day/7 days per week, in all-size laboratories, with minimal technical expertise required. A missed diagnosis can have a significant impact on patient clinical outcome and a financial impact on laboratory services and the utilization of health care resources.
Christine C. Ginocchio