Skip to main content
Journal of Clinical Microbiology logoLink to Journal of Clinical Microbiology
. 2018 Apr 25;56(5):e01874-17. doi: 10.1128/JCM.01874-17

Accuracy of High-Throughput Nanofluidic PCR-Based Pneumococcal Serotyping and Quantification Assays Using Sputum Samples for Diagnosing Vaccine Serotype Pneumococcal Pneumonia: Analyses by Composite Diagnostic Standards and Bayesian Latent Class Models

Satoshi Kakiuchi a,b, Motoi Suzuki a,b, Bhim Gopal Dhoubhadel c, Akitsugu Furumoto a, Hiroyuki Ito d, Kei Matsuki d, Yoshiko Tsuchihashi d, Norichika Asoh d, Michio Yasunami c,*, Koya Ariyoshi a,b, Konosuke Morimoto a,b,, on behalf of the Adult Pneumonia Study Group—Japan (APSG-J)
Editor: Paul Bourbeau
PMCID: PMC5925721  PMID: 29444834

ABSTRACT

The lack of reliable diagnostic tests for detecting vaccine serotype pneumococcal pneumonia (VTPP) remains a challenging issue in pneumococcal vaccine studies. This study assessed the performances of high-throughput nanofluidic PCR-based pneumococcal serotyping and quantification assay methods using sputum samples (the nanofluidic sputum quantitative PCR [Sp-qPCR] assay) to diagnose 13-valent pneumococcal conjugate VTPP compared with the performance of the serotype-specific urinary antigen detection (UAD) assay using urine samples. Adult pneumonia patients from Japan were enrolled in this study between September 2012 and August 2014. Sputum samples were subjected to the nanofluidic Sp-qPCR assay, quantitatively cultured, and serotyped by the Quellung reaction (SpQt). Urine samples were tested by the UAD method. The diagnostic performances of these tests were assessed using composite reference standards and Bayesian latent class models (BLCMs). Among 244 total patients, 27 (11.1%) tested positive with the UAD assay, while 16 (6.6%) and 34 (13.9%) tested positive with the SpQt and nanofluidic Sp-qPCR assays, respectively, with a cutoff value of ≥104 DNA copies/ml, which showed the maximum value of the Youden index. Using BLCMs, the estimated prevalence for VTPP was 12.9%, and the nanofluidic Sp-qPCR assay demonstrated the best performance (sensitivity, 90.2%; specificity, 96.9%), followed by UAD (sensitivity, 75.6%; specificity, 97.9%) and SpQt (sensitivity, 45.8%; specificity, 99.5%). However, when a higher cutoff value of ≥107 DNA copies/ml was applied, the performance of UAD became comparable to that of Sp-qPCR. The vaccine serotype-specific pneumococcal DNA load in sputum among UAD-positive patients was 3 logs higher than that among UAD-negative patients (P = 0.036). The nanofluidic Sp-qPCR assay may be accurate and useful for detecting VTPP among adults.

KEYWORDS: Bayesian latent class models, Streptococcus pneumoniae, adult pneumonia, sputum culture, sputum real-time PCR, urinary antigen detection

INTRODUCTION

Streptococcus pneumoniae, or the pneumococcus, is the leading bacterial cause of morbidity and mortality among adults (14). Invasive pneumococcal disease (IPD) is the most severe form of pneumococcal infection, while pneumonia is the most common pneumococcal disease in this age group. More than 90 pneumococcal serotypes have been identified, and they vary in their virulence and transmissibility (57). Currently, two types of polyvalent pneumococcal vaccines are available for adults, the 23-valent pneumococcal polysaccharide vaccine (PPSV23) and the 13-valent pneumococcal polysaccharide conjugate vaccine (PCV13). Although these two vaccines demonstrate moderate to high protective efficacy against invasive pneumococcal disease (810), their efficacy and effectiveness against adult pneumococcal pneumonia (PP) vary by study (1113).

The lack of reliable diagnostic tests for vaccine serotype pneumococcal pneumonia (VTPP) remains a challenging issue in pneumococcal vaccine studies. Blood cultures are considered a reference standard for diagnosing pneumococcal bacteremia, and the proportion of bacteremia cases among PP cases is only 5 to 20% (14, 15). A urinary capsule antigen immunochromatographic test (ICT; BinaxNOW S. pneumoniae; Alere, USA) is sufficiently specific (97.2%) but less sensitive (74.0%) according to a meta-analysis, but its test performance substantially varies by study because of its use of different reference standards (i.e., cultures of blood, sputum, pleural fluid, and bronchoalveolar lavage fluid) (16). Moreover, the ICT does not differentiate pneumococcal serotypes. Recently, a serotype-specific urinary antigen detection (UAD) assay was developed and used in a PCV13 trial conducted in the Netherlands (17). This multiplex immunoassay can detect in urine samples 13 capsular polysaccharides corresponding to the PCV13 serotypes. Although this assay demonstrated a high sensitivity (97.1%) and specificity (100%) for the detection of bacteremia (17), its performance regarding the detection of VTPP remains to be established.

We recently established a high-throughput pneumococcal serotyping and quantification method based on a nanofluidic real-time PCR assay and applied this method to pneumonia studies using sputum samples (the nanofluidic sputum quantitative PCR [Sp-qPCR] assay) (1820). A few studies have investigated the accuracy of a PCR-based method using sputum samples for diagnosing PP, but its performance varied by study (sensitivity and specificity, 77.8 to 94.0% and 66.7 to 96.0%, respectively) (21, 22). These studies used composite diagnostics (i.e., a combination of blood cultures, sputum cultures, and ICT) as the reference standard, but none of these tests were perfect; thus, the performance of PCR-based methods may be underestimated. No study has investigated the implications of serotype-specific pneumococcal DNA loads in respiratory samples in diagnosing PP.

We conducted this study to establish the accuracy and usefulness of a high-throughput PCR-based pneumococcal serotyping and quantification method using sputum samples (Sp-qPCR) for diagnosing VTPP caused by a PCV13 type in comparison with those of other methods, including UAD. Test performance was evaluated by the conventional method using a composite reference standard and Bayesian latent class models (BLCMs), assuming an imperfect gold standard (23).

MATERIALS AND METHODS

Study patients and outline.

This study was conducted as part of a prospective study for adult pneumonia in Japan by the Adult Pneumonia Study Group—Japan (20) at Juzenkai Hospital, a community-based hospital located in the center of Nagasaki, Japan, from 10 September 2012 to 22 August 2014. Patients who fulfilled the following criteria were enrolled in the study: (i) an age of ≥15 years, (ii) the presence of symptoms compatible with pneumonia (e.g., fever, cough, sputum, pleuritic chest pain, and dyspnea), and (iii) the presence of new infiltrates on chest radiography or computed tomography scan films. Patients who developed pneumonia after 48 h of admission were excluded.

Diagnostic tests.

Sputum and urine samples were collected from the enrolled patients upon their first hospital visit or admission. Quantitative sputum culture (SpCx) was performed at the hospital laboratory using the conventional method. According to a previous report (24), we used 1 × 105 CFU/ml as the cutoff value for diagnosing PP. Pneumococcal isolates were transported to the Institute of Tropical Medicine at Nagasaki University for serotyping by the capsular Quellung reaction (SpQt) using antisera from the Statens Serum Institut (Denmark). Sputum samples were further tested by an in-house qPCR for lytA for pneumococcal detection (18) and by an in-house nanofluidic Sp-qPCR. Details of the methods and primers used were described previously (18, 19). In brief, DNA was extracted from sputum samples using a QIAamp DNA minikit (Qiagen) according to the manufacturer's instructions. All samples were screened by qPCR for the lytA gene to identify the presence of the pneumococcus (25). The lytA-positive samples (corresponding to ≥103 DNA copies/ml) were subjected to the nanofluidic Sp-qPCR assay for detecting 29 serogroups/50 serotypes and measuring their pneumococcal DNA loads.

In the current study, a common primer set was used to identify serotypes 6A and 6B in our PCR-based serotyping system. Moreover, the UAD assay cannot discriminate serotypes 6C and 6D from serotypes 6A and 6B, respectively (17). According to previous studies, cross-immunological reactions have been observed between serotypes 6A and 6C and between serotypes 6B and 6D (2628). We therefore grouped these serotypes into serogroup 6 and included them as PCV13 serotypes. We also grouped serotypes 18A, 18B, 18C, and 18F into serogroup 18 and included them as PCV13 serotypes.

The presence of the pneumococcal urinary antigen in urine samples was tested by ICT, and all urine samples were transported to Pfizer Vaccine Research (Pearl River, NY, USA) for the UAD assay. Details regarding the assay were described previously (17). Prior to the current study, UAD assay cutoffs were updated from the original cutoffs established according to the results for 400 control samples collected in the United States (29). To validate the updated cutoffs for Japanese patients, we collected 202 urine samples from age-matched afebrile inpatients and outpatients at our study site, and only 1 sample showed a positive result (false-positive rate, 0.5%). Therefore, the updated cutoffs were applied to all samples in the current study.

Analysis.

The characteristics of the enrolled patients were described using a simple tabulation. The prevalence of PP and VTPP (i.e., PP caused by serotypes 1, 3, 4, 5, 7F, 9V, 14, 19A, 19F, and 23F and serogroups 6 and 18) determined by diagnostic tests was summarized. Two approaches were used to estimate the diagnostic accuracies of the qPCR for lytA for PP and the nanofluidic Sp-qPCR assay for VTPP. We first considered (i) the urinary antigen test (ICT for PP, UAD for VTPP) and (ii) composite diagnostics (a combination of ICT and SpCx for PP, a combination of UAD and SpQt for VTPP) as the reference standard. Then, we estimated the accuracies of all tests using BLCMs (30). BLCMs do not assume that any test is perfect and estimate the accuracy of each test on the basis of the observed frequency of the possible combinations of test results. The models assumed that a correlation existed between the sputum cultures and both the qPCR assay for lytA and the nanofluidic Sp-qPCR assay. The mean values of disease prevalence, sensitivity, and specificity with 95% credible intervals (CrI) were determined using the WinBUGS (version 1.4) program (31). In this analysis, we focused each test identification result on PCV13 serotypes and not on the concordance of the serotype identification result of each test. Different cutoff values were examined to evaluate the accuracy of the qPCR assay for lytA and the nanofluidic Sp-qPCR assay. We used receiver operating characteristic analysis and the Youden index (sensitivity + specificity − 1) to explore the optimal cutoff values for the qPCR for lytA and the nanofluidic Sp-qPCR assay (32). The point that gave the maximum Youden index value was considered the optimal cutoff (33).

Ethics.

This study was conducted in accordance with the Guidelines for Ethical Aspects in Epidemiological Study (Ministry of Health, Labor and Welfare of Japan, 2008) and was approved by the Institutional Review Board (IRB) of the Institute of Tropical Medicine at Nagasaki University and the IRB of Juzenkai Hospital. The requirement for obtaining written consent from all participants was waived by both IRBs because of the study's observational nature with no deviation from the current medical practice. Anonymized data were used for our analyses.

RESULTS

Patients' backgrounds.

During the study period, a total of 288 pneumonia patients were enrolled, among which 44 were excluded from the study, 39 were not tested by sputum culturing, and 5 were not tested by the nanofluidic Sp-qPCR. Finally, 244 were eligible for analysis (see Fig. S1 in the supplemental material).

The baseline characteristics of the study patients are shown in Table 1. In total, 151 (62%) participants were male, and most (70.5%) were 75 years old or older, with the median age being 80 years. A total of 147 (60%) patients were classified as having community-acquired pneumonia, and the remaining patients were classified as having health care-associated pneumonia. Twenty (8%) patients had received PPSV23, while none had received PCV13. Sixty (25%) patients were prescribed antibiotics before enrollment, and 11 (5%) patients died before discharge.

TABLE 1.

Characteristics of the study populationa

Characteristic Values
Median (range) age (yr) 80 (22–99)
No. (%) of male patients 151 (61.9)
No. (%) of patients who received PPSV23 20 (8.2)
No. (%) of patients with community-acquired pneumonia 147 (60.3)
No. (%) of inpatients 226 (92.6)
No. (%) of patients with the following underlying disease:
    Diabetes 47 (19.3)
    Hypertension 113 (46.3)
    Hyperlipidemia 22 (9.0)
    Asthma 24 (9.8)
    COPDb 63 (25.8)
No. (%) of patients who used antibiotics before enrollment 60 (24.6)
No. (%) of patients who died 11 (4.5)
a

Data are for a total of 244 patients.

b

COPD, chronic obstructive pulmonary disease.

Overall pneumococcus-positive rates.

Among the 244 patients, 30 (12.3%) tested positive by ICT. The pneumococcus-positive rates differed by the cutoff values for the detection of pneumococcus by SpCx and lytA by qPCR; 3.3% to 11.5% were positive for pneumococcus by SpCx, and 2.5% to 21.7% were positive for lytA by qPCR (Table S1). Blood samples for culture were collected from 58 patients (23.8%), and one yielded S. pneumoniae (1.7% of the tested patients). The prescription of antibiotics did not change the pneumococcus-positive rates.

The prevalence of VTPP was 11.1%, based on UAD results, and it varied from 2.5% to 6.6%, based on SpQt, according to the cutoff value. When the nanofluidic Sp-qPCR assay was applied, the VTPP prevalence ranged widely from 3.3% to 14.8%, according to the cutoff value (Table S2). The prescription of antibiotics was also not associated with the rates of positivity for a vaccine serotype pneumococcus except when the cutoff value of 1.0 × 109 DNA copies/ml was used for Sp-qPCR. The most frequent vaccine serotype was serotype 3, followed by 6 and 19A, regardless of the method (Table S3). Among 53 patients who tested positive for any pneumococcal serotype by the nanofluidic Sp-qPCR (cutoff value, 1.0 × 104 DNA copies/ml), 25 (47%) tested positive for multiple serotypes and 11 (21%) tested positive for three serotypes. Serotypes 4 and 5 were detected more frequently by the nanofluidic Sp-qPCR than by the other tests. All serotypes identified by SpQt were compatible with the dominant serotypes identified by the nanofluidic Sp-qPCR, except in two samples (samples 32 and 50). The serotypes identified by UAD were also compatible with those identified by nanofluidic Sp-qPCR, except in two samples which were positive for serotype 23F by UAD (samples 25 and 52).

Diagnostic accuracy of nanofluidic Sp-qPCR, UAD, and SpQt.

The disease prevalence in the study population as well as the sensitivity and specificity of the nanofluidic Sp-qPCR assay with different cutoffs for VTPP were estimated according to different reference standards (Table 2). The disease prevalence based on the combined results of UAD and SpQt (cutoff value, 1 × 105 CFU/ml) was 12.3%. The Youden index demonstrated a maximum value of 1.0 × 104 DNA copies/ml regardless of the reference standard. When this value was used as the cutoff for the nanofluidic Sp-qPCR, the sensitivity and specificity were 81.5% (95% confidence interval [CI], 61.9 to 93.7%) and 94.5% (95% CI, 90.5 to 97.1%), respectively, in comparison with the results of UAD; they were 83.3% (95% CI, 65.3 to 94.4%) and 95.9% (95% CI, 92.2 to 98.1%), respectively, using composite diagnostics as the reference. When the higher cutoff value was used, the sensitivity became lower and the specificity became higher.

TABLE 2.

Estimated disease prevalence and sensitivity and specificity of using serotype-specific qPCR to diagnose VTPPa

Serotype-specific pneumococcal DNA load cutoff value (no. of copies/ml) UAD assay
UAD assay + sputum cultureb
Disease prevalence (%)c Sensitivity (%) Specificity (%) Youden index Disease prevalence (%) Sensitivity (%) Specificity (%) Youden index
≥103 11.1 (7.4–15.7) 81.5 (61.9–93.7) 93.5 (89.4–96.4) 0.75 12.3 (8.4–17.1) 83.3 (65.3–94.4) 94.9 (91.0–97.4) 0.782
≥104 81.5 (61.9–93.7) 94.5 (90.5–97.1) 0.76 83.3 (65.3–94.4) 95.9 (92.2–98.1) 0.792
≥105 74.1 (53.7–88.9) 95.4 (91.7–97.8) 0.695 76.7 (57.7–90.1) 96.7 (93.4–98.7) 0.734
≥106 70.4 (49.8–86.2) 97.7 (94.7–99.2) 0.681 70.0 (50.6–85.3) 98.6 (96.0–99.7) 0.686
≥107 63.0 (42.4–80.6) 98.2 (95.3–99.5) 0.612 63.3 (43.9–80.1) 99.1 (96.6–99.9) 0.624
≥108 51.9 (31.9–71.3) 99.1 (96.7–99.9) 0.51 46.7 (28.3–65.7) 99.1 (96.6–99.9) 0.458
≥109 22.2 (8.6–42.3) 99.1 (96.7–99.9) 0.213 20.0 (7.7–38.6) 99.1 (96.7–99.9) 0.191
a

qPCR, quantitative PCR; UAD, serotype-specific urinary antigen detection assay. Values in parentheses are 95% confidence intervals.

b

Determined by conventional sputum culture and by use of the Quellung reaction's bacterial load cutoff value of 1.0 × 105 CFU/ml.

c

Estimated from the reference standard or the composite reference standard result assuming 100% specificity.

We then estimated the accuracies of all tests using BLCMs (Table 3). When the cutoff value of 1.0 × 104 DNA copies/ml with the maximum Youden index was used, the nanofluidic Sp-qPCR was the most sensitive test for VTPP (sensitivity, 90.2%; 95% credible interval [CrI], 71.2 to 99.7%), followed by UAD (sensitivity, 75.6%; 95% CrI, 55.4 to 92.4%) and SpQt (sensitivity, 45.8%; 95% CrI, 27.5 to 65.8%), while the three tests showed comparable specificities (96.9% [95% CrI, 93.4 to 99.7%], 97.9% [95% CrI, 95.1 to 99.9%], and 99.5% [95% CrI, 98.2 to 100%], respectively). Notably, the accuracy of UAD was almost comparable to that of the nanofluidic Sp-qPCR when the cutoff value was 1.0 × 107 DNA copies/ml or higher.

TABLE 3.

Estimated disease prevalence and sensitivity and specificity of using serotype-specific qPCR, sputum culture, and UAD to diagnose VTPP by BLCM analysisa

Serotype-specific pneumococcal DNA load cutoff value (no. of copies/ml) Disease prevalence Serotype-specific qPCR
Quellung reactionb
UAD
Youden index of PCR
Sensitivity (%) Specificity (%) Sensitivity (%) Specificity (%) Sensitivity (%) Specificity (%)
≥103 13.0 (8.3–18.8) 89.9 (71.5–99.7) 96.1 (92.2–99.4) 45.2 (26.9–65.1) 99.5 (98.2–100) 75.0 (54.1–92.4) 97.9 (95.0–99.9) 0.860
≥104 12.9 (8.3–18.5) 90.2 (71.2–99.7) 96.9 (93.4–99.7) 45.8 (27.5–65.8) 99.5 (98.2–100) 75.6 (55.4–92.4) 97.9 (95.1–99.9) 0.871
≥105 12.1 (7.5–17.8) 87.7 (63.9–99.7) 97.5 (94.3–99.8) 49.0 (28.7–70.2) 99.5 (98.3–100) 75.6 (55.1–92.3) 97.2 (94.0–99.8) 0.852
≥106 10.7 (6.5–16.0) 86.0 (61.4–99.6) 98.7 (96.5–99.9) 51.4 (30.7–72.6) 99.1 (97.5–99.9) 82.0 (62.9–95.6) 97.0 (93.7–99.9) 0.847
≥107 9.9 (5.8–15.3) 84.0 (55.4–99.6) 99.0 (97.0–100) 56.0 (32.7–78.2) 99.1 (97.5–99.9) 81.7 (62.3–95.7) 96.3 (92.6–99.6) 0.830
≥108 7.7 (3.9–13.4) 78.5 (43.2–99.3) 98.7 (96.8–99.9) 61.4 (31.6–87.6) 98.3 (96.2–99.6) 91.7 (72.4–99.8) 95.3 (91.2–99.5) 0.772
≥109 7.7 (3.4–14.3) 35.6 (13.8–64.6) 98.6 (96.7–99.8) 67.8 (33.6–97.5) 98.5 (96.3–99.9) 86.9 (61.7–99.6) 94.9 (90.4–99.4) 0.342
a

qPCR, quantitative PCR; UAD, serotype-specific urinary antigen detection assay; BLCM, Bayesian latent class model. Values in parentheses are 95% credible intervals.

b

Determined by conventional sputum culture and by use of the Quellung reaction's bacterial load cutoff value of 1.0 × 105 CFU/ml.

Serotype-specific pneumococcal DNA load.

Serotype-specific pneumococcal DNA loads were compared by the UAD result statuses (Fig. S2). The median pneumococcal serotype-specific DNA load in UAD-positive patients (1.1 × 108 DNA copies/ml) was substantially higher than that in UAD-negative patients (1.2 × 105 DNA copies/ml) (P = 0.036, Wilcoxon rank-sum test).

Diagnosing pneumococcal pneumonia.

We also investigated the performances of assaying sputum for pneumococcal DNA (lytA) for diagnosing pneumococcal pneumonia in comparison with those of SpCx and ICT. The cutoff value for the qPCR detection of lytA determined from the maximum Youden index was also 1.0 × 104 DNA copies/ml. When composite diagnostics (ICT and SpCx) were used as the reference standard, the sensitivity and specificity of using qPCR to detect lytA were 85.4% (95% CI, 70.8 to 94.4%) and 94.6% (95% CI, 90.5 to 97.3%), respectively (Table S4). When we estimated the accuracy of these tests using BLCMs, the prevalence was 18.3%, and using qPCR to detect lytA was the most sensitive for the detection of PP (sensitivity, 91.4%; 95% CrI, 74.5 to 99.8%), followed by ICT (sensitivity, 60.0%; 95% CrI, 43.2 to 76.2%) and SpCx (sensitivity, 56.7%; 95% CrI, 39.4 to 74.2%); these tests also showed comparable specificities (97.0% [95% CrI, 92.7 to 99.8%], 97.8% [95% CrI, 94.8 to 99.8%], and 99.1% [95% CrI, 97.3 to 99.9%], respectively) (Table S5). The median pneumococcal DNA load in patients deemed positive by both ICT and qPCR for lytA (4.7 × 107 DNA copies/ml) was also substantially higher than that in patients deemed negative by ICT and positive by qPCR for lytA (2.6 × 106 DNA copies/ml) (P = 0.005, Wilcoxon rank-sum test).

DISCUSSION

The nanofluidic Sp-qPCR assay with a cutoff value of 1.0 × 104 DNA copies/ml demonstrated the highest degree of accuracy for diagnosing VTPP compared with UAD and conventional culture-based methods in the BLCM analysis; its sensitivity and specificity were 90.2% and 96.9%, respectively.

None of the existing diagnostic tests for VTPP and PP, such as blood culture, sputum culture, and ICT, are perfect; thus, composite reference standards using these tests are inaccurate. Using imperfect composite reference standards may underestimate the true accuracy of new tests (34). To overcome this limitation, we also estimated the accuracy of PCR-based methods using BLCMs. BLCMs have been used to evaluate the accuracy of tests when no reference standard tests exist (23, 30, 35). In the current study, the estimated sensitivities and specificities of the nanofluidic Sp-qPCR and qPCR assays for lytA were higher than those of sputum culture and urinary antigen tests. Our findings suggest that PCR-based methods (nanofluidic Sp-qPCR and qPCR for lytA) may be highly accurate in diagnosing VTPP and PP among adults.

The capsular Quellung test is a conventional method for pneumococcal serotyping and has been used as a gold standard for an extended period. However, this method is labor-intensive and time-consuming. Moreover, because this method requires pneumococcal isolates, its sensitivity is limited by that of the culture method. To conduct PCV13 vaccine efficacy surveys, the UAD assay was developed to diagnose VTPP. A validation study demonstrated good performance by the UAD assay (sensitivity, 97.1%; specificity, 100%); however, these values were estimated using a bacterial culture as the reference (17). In the current study, the UAD assay demonstrated a high specificity (97.6%) but a relatively low sensitivity (75.6%) for diagnosing VTPP when a cutoff of 1.0 × 104 DNA copies/ml was applied for the nanofluidic Sp-qPCR. Furthermore, the median sputum serotype-specific pneumococcal DNA load in the UAD-positive group was nearly 3 logs higher than that in the UAD-negative group. This result indicates that UAD can possibly identify VTPP with a relatively large amount of sputum pneumococcal serotype-specific DNA among adults. In fact, when the serotype-specific pneumococcal DNA cutoff value was 1.0 × 107 DNA copies/ml, the nanofluidic Sp-qPCR and UAD diagnostic accuracies were estimated to be at nearly the same level (sensitivities, 84.0% and 81.7%, respectively; specificities, 99.0% and 96.3%, respectively).

Although most serotypes identified by the nanofluidic Sp-qPCR, SpQt, and UAD assays were identical, some discordant findings were observed. Serotypes 23F and 1 were more frequently detected by UAD than by the nanofluidic Sp-qPCR or SpQt (see Table S3 in the supplemental material). Considering the low detection rate in sputum samples, these serotypes might have been causing bacteremia without pneumonia among our cases. In one case (case 25), serotype 22F was detected by the nanofluidic Sp-qPCR and SpQt and serotype 23F was detected by UAD. This finding might suggest that the focus of serotype 22F infection was limited to the respiratory tract, while that of 23F was outside the respiratory tract in this case. Further serotype-specific verification may be necessary.

The current study demonstrated an additional advantage of the nanofluidic Sp-qPCR assay, as it was capable of detecting multiple serotypes. The presence of multiple pneumococcal serotypes is difficult to recognize with conventional culture and the Quellung reaction methods, especially because the quantity of the second most dominant serotype is, on average, 2 logs less than that of the most dominant serotype (3638). In our study, multiple serotypes were detected in approximately half of the adult PP patients by the nanofluidic Sp-qPCR, but none of them were detected by the conventional culture-based method. UAD also had a capacity to detect multiple serotypes; one case was positive for both serogroups 6 and 18 by UAD in our study. We could not elucidate the clinical and epidemiological meanings of detection of multiple serotypes or the associations of secondary and tertiary serotypes with the primary serotype in adult PP patients because of the small sample size. Further studies are needed to establish the clinical implications of multiple serotypes.

We also evaluated the feasibility of detecting lytA by qPCR to diagnose PP. A few studies have evaluated the diagnostic accuracy of PCR-based assays for PP using respiratory samples and demonstrated inconsistent findings. Stralin et al. showed that the sensitivity and specificity of detecting sputum lytA by PCR were 94% and 96%, respectively (21), while Albrich et al. reported these values to be 77.8% and 66.7%, respectively (22). The low accuracy observed in the study of Albrich et al. (22) can be explained by two reasons. First, the characteristics of the patients were different in the two studies. The study of Stralin et al. (21) comprised 78 elderly patients (mean age, 78 years), while the study of Albrich et al. (22) comprised 222 HIV-infected young patients (mean age, 36 years). Second, the two studies used different combinations of diagnostic tests as their reference; the study of Stralin et al. (21) used a combination of blood cultures, sputum cultures, and ICT, while the study of Albrich et al. (22) used a combination of blood cultures, whole-blood lytA PCR, ICT, and sputum cultures. The current study recruited community-dwelling elderly patients (mean age, 77 years) and used sputum cultures and ICT as references, which was similar to the study of Stralin et al. (21). Therefore, the high accuracy of using qPCR to detect lytA observed in our study may be compatible with that in the study of Stralin et al. (21).

This study has some limitations. First, we did not have blood samples for culture from all of the participants. According to our previous study (19), only 14 of 1,310 cases (1%) were positive for pneumococcus by blood culturing. We also estimated the blood culture-positive rates to be quite low in this study population, so we presume that the low rates of blood culture positivity are not problematic. Second, we included all of the obtained sputum samples upon admission or upon the first visit to the outpatient department at the study site regardless of sputum quality. Some participants, especially the elderly patients, could not expectorate sputum of good quality in this clinical situation. However, we expected that the use of pneumococcal DNA loads with previously established cutoff values can discriminate infection from upper respiratory tract colonization regardless of sputum quality (21, 22). To verify this speculation, we analyzed the accuracy of the nanofluidic Sp-qPCR with only sputum samples that were Geckler group 3 or more (39). In BLCMs with 186 quality-controlled nanofluidic Sp-qPCR assays, the sensitivity and specificity did not differ much from those obtained using all sputum samples (data not shown). This finding may suggest that the quality of sputum does not affect the accuracy of nanofluidic Sp-qPCR assays; however, further studies are needed to establish the diagnostic value of sputum quality. Third, some nonpneumococcal streptococci which contain genes similar to pneumococcal capsule genes might have coexisted in our sputum samples and might have been detected by our serotype-specific PCR assays (40, 41). This detection might have increased the frequency of the observed multiple pneumococcal serotypes. However, we screened all samples by PCR for the lytA gene to identify the presence of pneumococcus and serotyped only lytA-positive samples. Moreover, our in silico analyses confirmed that none of our primer sequences used for pneumococcal serotyping amplified nonpneumococcal streptococci. We therefore believe that the potential impact of the existence of nonpneumococcal streptococci on our accuracy estimates was minimal.

In conclusion, the nanofluidic Sp-qPCR assay may be highly accurate and useful for detecting VTPP among adults. Further studies are needed to establish the clinical implication of the detection of multiple serotypes by the nanofluidic Sp-qPCR assay and the discrepancies between the nanofluidic Sp-qPCR and other diagnostic methods.

Supplementary Material

Supplemental material

ACKNOWLEDGMENTS

We thank Shigeharu Ogawa for supporting the study. This work was supported by JSPS KAKENHI (grant number 25460761), Pfizer, Nagasaki University, and Asahi Kasei Pharma.

The funding sources had no role in the design, data collection, analysis, or interpretation of the study.

The UAD assay was performed at Pfizer Vaccine Research (Pearl River, NY, USA).

Author contributions are as follows: S. Kakiuchi, M. Suzuki, A. Furumoto, K. Ariyoshi, and K. Morimoto conceived and designed the experiments. S. Kakiuchi, M. Suzuki, B. G. Dhoubhadel, H. Ito, K. Matsuki, Y. Tsuchihashi, N. Asoh, M. Yasunami, K. Ariyoshi, and K. Morimoto collected the data and performed the experiments. S. Kakiuchi, M. Suzuki, B. G. Dhoubhadel, K. Ariyoshi, and K. Morimoto analyzed the data. S Kakiuchi, M. Suzuki, K. Ariyoshi, and K. Morimoto wrote the manuscript.

K. Ariyoshi received speaker fees from Pfizer and Asahi Kasei Pharma. K. Morimoto received speaker fees from Taisho Toyama Pharmacy, Pfizer, and MSD.

Footnotes

Supplemental material for this article may be found at https://doi.org/10.1128/JCM.01874-17.

REFERENCES

  • 1.Welte T, Torres A, Nathwani D. 2012. Clinical and economic burden of community-acquired pneumonia among adults in Europe. Thorax 67:71–79. doi: 10.1136/thx.2009.129502. [DOI] [PubMed] [Google Scholar]
  • 2.Peto L, Nadjm B, Horby P, Ngan TT, van Doorn R, Van Kinh N, Wertheim HF. 2014. The bacterial aetiology of adult community-acquired pneumonia in Asia: a systematic review. Trans R Soc Trop Med Hyg 108:326–337. doi: 10.1093/trstmh/tru058. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3.Jain S, Self WH, Wunderink RG, Fakhran S, Balk R, Bramley AM, Reed C, Grijalva CG, Anderson EJ, Courtney DM, Chappell JD, Qi C, Hart EM, Carroll F, Trabue C, Donnelly HK, Williams DJ, Zhu Y, Arnold SR, Ampofo K, Waterer GW, Levine M, Lindstrom S, Winchell JM, Katz JM, Erdman D, Schneider E, Hicks LA, McCullers JA, Pavia AT, Edwards KM, Finelli L, CDC EPIC Study Team. 2015. Community-acquired pneumonia requiring hospitalization among U.S. adults. N Engl J Med 373:415–427. doi: 10.1056/NEJMoa1500245. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4.Drijkoningen JJ, Rohde GG. 2014. Pneumococcal infection in adults: burden of disease. Clin Microbiol Infect 20(Suppl 5):S45–S51. doi: 10.1111/1469-0691.12461. [DOI] [PubMed] [Google Scholar]
  • 5.Henrichsen J. 1995. Six newly recognized types of Streptococcus pneumoniae. J Clin Microbiol 33:2759–2762. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6.Park IH, Pritchard DG, Cartee R, Brandao A, Brandileone MC, Nahm MH. 2007. Discovery of a new capsular serotype (6C) within serogroup 6 of Streptococcus pneumoniae. J Clin Microbiol 45:1225–1233. doi: 10.1128/JCM.02199-06. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.Geno KA, Gilbert GL, Song JY, Skovsted IC, Klugman KP, Jones C, Konradsen HB, Nahm MH. 2015. Pneumococcal capsules and their types: past, present, and future. Clin Microbiol Rev 28:871–899. doi: 10.1128/CMR.00024-15. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8.Jackson LA, Neuzil KM, Yu O, Benson P, Barlow WE, Adams AL, Hanson CA, Mahoney LD, Shay DK, Thompson WW, Vaccine Safety Datalink. 2003. Effectiveness of pneumococcal polysaccharide vaccine in older adults. N Engl J Med 348:1747–1755. doi: 10.1056/NEJMoa022678. [DOI] [PubMed] [Google Scholar]
  • 9.Conaty S, Watson L, Dinnes J, Waugh N. 2004. The effectiveness of pneumococcal polysaccharide vaccines in adults: a systematic review of observational studies and comparison with results from randomised controlled trials. Vaccine 22:3214–3224. doi: 10.1016/j.vaccine.2003.08.050. [DOI] [PubMed] [Google Scholar]
  • 10.French N, Gordon SB, Mwalukomo T, White SA, Mwafulirwa G, Longwe H, Mwaiponya M, Zijlstra EE, Molyneux ME, Gilks CF. 2010. A trial of a 7-valent pneumococcal conjugate vaccine in HIV-infected adults. N Engl J Med 362:812–822. doi: 10.1056/NEJMoa0903029. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11.Huss A, Scott P, Stuck AE, Trotter C, Egger M. 2009. Efficacy of pneumococcal vaccination in adults: a meta-analysis. CMAJ 180:48–58. doi: 10.1503/cmaj.080734. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12.Kraicer-Melamed H, O'Donnell S, Quach C. 2016. The effectiveness of pneumococcal polysaccharide vaccine 23 (PPV23) in the general population of 50 years of age and older: a systematic review and meta-analysis. Vaccine 34:1540–1550. doi: 10.1016/j.vaccine.2016.02.024. [DOI] [PubMed] [Google Scholar]
  • 13.Ochoa-Gondar O, Vila-Corcoles A, Rodriguez-Blanco T, Gomez-Bertomeu F, Figuerola-Massana E, Raga-Luria X, Hospital-Guardiola I. 2014. Effectiveness of the 23-valent pneumococcal polysaccharide vaccine against community-acquired pneumonia in the general population aged ≥60 years: 3 years of follow-up in the CAPAMIS study. Clin Infect Dis 58:909–917. doi: 10.1093/cid/ciu002. [DOI] [PubMed] [Google Scholar]
  • 14.van der Eerden MM, Vlaspolder F, de Graaff CS, Groot T, Jansen HM, Boersma WG. 2005. Value of intensive diagnostic microbiological investigation in low- and high-risk patients with community-acquired pneumonia. Eur J Clin Microbiol Infect Dis 24:241–249. doi: 10.1007/s10096-005-1316-8. [DOI] [PubMed] [Google Scholar]
  • 15.Said MA, Johnson HL, Nonyane BA, Deloria-Knoll M, O'Brien KL, AGEDD Adult Pneumococcal Burden Study Team, Andreo F, Beovic B, Blanco S, Boersma WG, Boulware DR, Butler JC, Carratala J, Chang FY, Charles PG, Diaz AA, Dominguez J, Ehara N, Endeman H, Falco V, Falguera M, Fukushima K, Garcia-Vidal C, Genne D, Guchev IA, Gutierrez F, Hernes SS, Hoepelman AI, Hohenthal U, Johansson N, Kolek V, Kozlov RS, Lauderdale TL, Marekovic I, Masia M, Matta MA, Miro O, Murdoch DR, Nuermberger E, Paolini R, Perello R, Snijders D, Plecko V, Sorde R, Stralin K, van der Eerden MM, Vila-Corcoles A, Watt JP. 2013. Estimating the burden of pneumococcal pneumonia among adults: a systematic review and meta-analysis of diagnostic techniques. PLoS One 8:e60273. doi: 10.1371/journal.pone.0060273. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16.Sinclair A, Xie X, Teltscher M, Dendukuri N. 2013. Systematic review and meta-analysis of a urine-based pneumococcal antigen test for diagnosis of community-acquired pneumonia caused by Streptococcus pneumoniae. J Clin Microbiol 51:2303–2310. doi: 10.1128/JCM.00137-13. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.Pride MW, Huijts SM, Wu K, Souza V, Passador S, Tinder C, Song E, Elfassy A, McNeil L, Menton R, French R, Callahan J, Webber C, Gruber WC, Bonten MJ, Jansen KU. 2012. Validation of an immunodiagnostic assay for detection of 13 Streptococcus pneumoniae serotype-specific polysaccharides in human urine. Clin Vaccine Immunol 19:1131–1141. doi: 10.1128/CVI.00064-12. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18.Dhoubhadel BG, Yasunami M, Yoshida LM, Thi HA, Thi TH, Thi TA, Watanabe K, Suzuki M, Morimoto K, Dang DA, Ariyoshi K. 2014. A novel high-throughput method for molecular serotyping and serotype-specific quantification of Streptococcus pneumoniae using a nanofluidic real-time PCR system. J Med Microbiol 63:528–539. doi: 10.1099/jmm.0.071464-0. [DOI] [PubMed] [Google Scholar]
  • 19.Suzuki M, Dhoubhadel BG, Ishifuji T, Yasunami M, Yaegashi M, Asoh N, Ishida M, Hamaguchi S, Aoshima M, Ariyoshi K, Morimoto K, Adult Pneumonia Study Group—Japan. 2017. Serotype-specific effectiveness of 23-valent pneumococcal polysaccharide vaccine against pneumococcal pneumonia in adults aged 65 years or older: a multicentre, prospective, test-negative design study. Lancet Infect Dis 17:313–321. doi: 10.1016/S1473-3099(17)30049-X. [DOI] [PubMed] [Google Scholar]
  • 20.Morimoto K, Suzuki M, Ishifuji T, Yaegashi M, Asoh N, Hamashige N, Abe M, Aoshima M, Ariyoshi K, Adult Pneumonia Study Group—Japan. 2015. The burden and etiology of community-onset pneumonia in the aging Japanese population: a multicenter prospective study. PLoS One 10:e0122247. doi: 10.1371/journal.pone.0122247. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21.Stralin K, Herrmann B, Abdeldaim G, Olcen P, Holmberg H, Molling P. 2014. Comparison of sputum and nasopharyngeal aspirate samples and of the PCR gene targets lytA and Spn9802 for quantitative PCR for rapid detection of pneumococcal pneumonia. J Clin Microbiol 52:83–89. doi: 10.1128/JCM.01742-13. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22.Albrich WC, Madhi SA, Adrian PV, Telles JN, Paranhos-Baccala G, Klugman KP. 2014. Genomic load from sputum samples and nasopharyngeal swabs for diagnosis of pneumococcal pneumonia in HIV-infected adults. J Clin Microbiol 52:4224–4229. doi: 10.1128/JCM.01553-14. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 23.Limmathurotsakul D, Jamsen K, Arayawichanont A, Simpson JA, White LJ, Lee SJ, Wuthiekanun V, Chantratita N, Cheng A, Day NP, Verzilli C, Peacock SJ. 2010. Defining the true sensitivity of culture for the diagnosis of melioidosis using Bayesian latent class models. PLoS One 5:e12485. doi: 10.1371/journal.pone.0012485. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24.Kalin M, Lindberg AA, Tunevall G. 1983. Etiological diagnosis of bacterial pneumonia by gram stain and quantitative culture of expectorates. Leukocytes or alveolar macrophages as indicators of sample representativity. Scand J Infect Dis 15:153–160. [DOI] [PubMed] [Google Scholar]
  • 25.Greve T, Moller JK. 2012. Accuracy of using the lytA gene to distinguish Streptococcus pneumoniae from related species. J Med Microbiol 61:478–482. doi: 10.1099/jmm.0.036574-0. [DOI] [PubMed] [Google Scholar]
  • 26.Cooper D, Yu X, Sidhu M, Nahm MH, Fernsten P, Jansen KU. 2011. The 13-valent pneumococcal conjugate vaccine (PCV13) elicits cross-functional opsonophagocytic killing responses in humans to Streptococcus pneumoniae serotypes 6C and 7A. Vaccine 29:7207–7211. doi: 10.1016/j.vaccine.2011.06.056. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 27.McEllistrem MC, Nahm MH. 2012. Novel pneumococcal serotypes 6C and 6D: anomaly or harbinger. Clin Infect Dis 55:1379–1386. doi: 10.1093/cid/cis691. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28.Lee H, Cha JH, Nahm MH, Burton RL, Kim KH. 2013. The 7-valent pneumococcal conjugate vaccine elicits cross-functional opsonophagocytic killing responses to Streptococcus pneumoniae serotype 6D in children. BMC Infect Dis 13:474. doi: 10.1186/1471-2334-13-474. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 29.Pride MW, Jansen KU. 2017. Reevaluation of positivity cutoff values for the pneumococcal urinary antigen detection assay. Clin Vaccine Immunol 24:e00239-17. doi: 10.1128/CVI.00239-17. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 30.Limmathurotsakul D, Turner EL, Wuthiekanun V, Thaipadungpanit J, Suputtamongkol Y, Chierakul W, Smythe LD, Day NP, Cooper B, Peacock SJ. 2012. Fool's gold: why imperfect reference tests are undermining the evaluation of novel diagnostics: a reevaluation of 5 diagnostic tests for leptospirosis. Clin Infect Dis 55:322–331. doi: 10.1093/cid/cis403. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 31.Lunn D, Spiegelhalter D, Thomas A, Best N. 2009. The BUGS project: evolution, critique and future directions. Stat Med 28:3049–3067. doi: 10.1002/sim.3680. [DOI] [PubMed] [Google Scholar]
  • 32.Youden WJ. 1950. Index for rating diagnostic tests. Cancer 3:32–35. [DOI] [PubMed] [Google Scholar]
  • 33.Perkins NJ, Schisterman EF. 2006. The inconsistency of “optimal” cutpoints obtained using two criteria based on the receiver operating characteristic curve. Am J Epidemiol 163:670–675. doi: 10.1093/aje/kwj063. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 34.Schiller I, van Smeden M, Hadgu A, Libman M, Reitsma JB, Dendukuri N. 2016. Bias due to composite reference standards in diagnostic accuracy studies. Stat Med 35:1454–1470. doi: 10.1002/sim.6803. [DOI] [PubMed] [Google Scholar]
  • 35.Moore CE, Pan-Ngum W, Wijedoru LP, Sona S, Nga TV, Duy PT, Vinh PV, Chheng K, Kumar V, Emary K, Carter M, White L, Baker S, Day NP, Parry CM. 2014. Evaluation of the diagnostic accuracy of a typhoid IgM flow assay for the diagnosis of typhoid fever in Cambodian children using a Bayesian latent class model assuming an imperfect gold standard. Am J Trop Med Hyg 90:114–120. doi: 10.4269/ajtmh.13-0384. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 36.Hare KM, Morris P, Smith-Vaughan H, Leach AJ. 2008. Random colony selection versus colony morphology for detection of multiple pneumococcal serotypes in nasopharyngeal swabs. Pediatr Infect Dis J 27:178–180. doi: 10.1097/INF.0b013e31815bb6c5. [DOI] [PubMed] [Google Scholar]
  • 37.Huebner RE, Dagan R, Porath N, Wasas AD, Klugman KP. 2000. Lack of utility of serotyping multiple colonies for detection of simultaneous nasopharyngeal carriage of different pneumococcal serotypes. Pediatr Infect Dis J 19:1017–1020. doi: 10.1097/00006454-200010000-00019. [DOI] [PubMed] [Google Scholar]
  • 38.Dhoubhadel BG, Yasunami M, Nguyen HA, Suzuki M, Vu TH, Thi Thuy Nguyen A, Dang DA, Yoshida LM, Ariyoshi K. 2014. Bacterial load of pneumococcal serotypes correlates with their prevalence and multiple serotypes is associated with acute respiratory infections among children less than 5 years of age. PLoS One 9:e110777. doi: 10.1371/journal.pone.0110777. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 39.Geckler RW, Gremillion DH, McAllister CK, Ellenbogen C. 1977. Microscopic and bacteriological comparison of paired sputa and transtracheal aspirates. J Clin Microbiol 6:396–399. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 40.Carvalho MDG, Pimenta FC, Moura I, Roundtree A, Gertz RE Jr, Li Z, Jagero G, Bigogo G, Junghae M, Conklin L, Feikin DR, Breiman RF, Whitney CG, Beall BW. 2013. Non-pneumococcal mitis-group streptococci confound detection of pneumococcal capsular serotype-specific loci in upper respiratory tract. PeerJ 1:e97. doi: 10.7717/peerj.97. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 41.Skov Sorensen UB, Yao K, Yang Y, Tettelin H, Kilian M. 2016. Capsular polysaccharide expression in commensal Streptococcus species: genetic and antigenic similarities to Streptococcus pneumoniae. mBio 7:e01844-16. doi: 10.1128/mBio.01844-16. [DOI] [PMC free article] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

Supplemental material

Articles from Journal of Clinical Microbiology are provided here courtesy of American Society for Microbiology (ASM)

RESOURCES