Abstract
The intra- and interlaboratory reproducibilities of a commercial sandwich enzyme-linked immunosorbent assay (ELISA) for the detection of Aspergillus galactomannan in serum (Platelia Aspergillus; Sanofi Diagnostics Pasteur, Marnes-La-Coquette, France) were evaluated in six laboratories of university hospitals. Twenty serum samples were obtained from 12 neutropenic patients including 6 with invasive aspergillosis. These samples were blinded and sent to each center together with eight blinded ELISA-negative serum samples spiked with known concentrations of galactomannan. The centers were provided with ELISA microtiter plates from a single batch and a detailed protocol. Ten clinical samples showed ELISA reactivity, while 10 samples were ELISA negative. The mean coefficient of variation (CV) of the optical density values was 4.24% within a single assay and 25.6% between runs. The interassay CV of the ratios for the serum samples tested was 18.6%. Analysis of ordinal interpretation of the ELISA result (i.e., negative, gray zone, or positive) showed excellent reproducibility. Recalculation of the cutoff values for positive and negative samples suggested that the cutoff level recommended by the manufacturer could be lowered from 1.0 to 0.8 for negative samples and from 1.5 to 1.0 for positive samples. The intra- and interlaboratory reproducibilities were excellent when the ELISA results were interpreted as ordinal data, but considerable variation in optical density values and, to a lesser extent, in the ratios for the serum samples tested, was observed between runs. High assay variability was also found for serum samples spiked with known concentrations of galactomannan. Therefore, antigen titers in serum samples from a single patient, measured in different runs, should be compared with caution.
Aspergillus species are saprophytic filamentous fungi which may cause invasive pulmonary infections in patients with compromised host defenses. The number of patients infected with this organism is increasing, and in some institutes Aspergillus species have now become the most frequent cause of invasive fungal infection (5). Establishing a diagnosis is often difficult, and the majority of infections remain undetected during life (5). The performance of several new diagnostic tests and procedures is under investigation, including the detection of Aspergillus DNA by PCR (2, 8, 9, 19) and of fungal antigens by serological methods (11, 17). A commercially available sandwich enzyme-linked immunosorbent assay (ELISA; Platelia Aspergillus; Sanofi Diagnostics Pasteur, Marnes-La-Coquette, France) which detects galactomannan (14), a cell wall constituent of Aspergillus species which is released during growth (13), has been developed. The assay has been evaluated in several institutes with serum mainly from patients with hematological malignancies, and a high sensitivity of 67 to 100% and a specificity of 81 to 100% were found, especially when a series of serum samples was used (10, 14, 15, 21). The detection of galactomannan at an early stage of disease (10, 15, 21, 22) and the quantitative titers produced by the sandwich ELISA offer new approaches to the management of invasive aspergillosis (12). Sera from patients may be screened for the presence of galactomannan during periods of high risk of invasive aspergillosis (12), and once galactomannan is detected, the antigen titer may be monitored during antifungal treatment since preliminary investigations have shown that at least in some patients the course of the titer corresponded to the clinical outcome (10, 23). As a consequence, series of serum samples from single patients collected at regular intervals over a long period of time will be tested by sandwich ELISA. However, although data on the accuracy of the assay are accumulating, little is known about the reproducibility of the sandwich ELISA, both within one laboratory and between laboratories. The present investigation was performed to establish the intra- and interlaboratory reproducibilities of the sandwich ELISA in order to develop tentative quality control guidelines for using the sandwich ELISA as a tool for monitoring serum galactomannan levels in patients at high risk for invasive aspergillosis.
MATERIALS AND METHODS
Sample preparation.
Serum samples from 12 patients who had been admitted to the Hematology Department of the University Hospital Nijmegen were used to prepare 20 test samples. The characteristics of the patients and the samples used are presented in Table 1. The serum samples had been routinely tested by sandwich ELISA and stored at −80°C. Since 4.2 ml of each test sample was required, serum from single patients samples were pooled. For 19 test samples no more than two consecutive samples were pooled, and for one test sample three samples were pooled. The 20 test samples included eight samples with ELISA reactivity and eight ELISA-negative samples (Table 1). For three patients both ELISA-negative and ELISA-positive serum samples were available (Table 1, patients 1, 2, and 3). Among the test samples were included four ELISA-positive samples which were thought to be false positive because a single positive sample was obtained among a series of at least six negative samples (Table 1, patients 9, 10, and 11) or consecutive samples were positive for a patient with no clinical or radiological evidence of invasive aspergillosis (Table 1, patient 12). In addition to these clinical samples eight serum samples without ELISA reactivity were prepared; these samples were spiked with known concentrations of galactomannan, i.e., 0, 0.35, 0.7, 1.0, 1.5, 2.0, 2.5, and 5.0 ng of galactomannan per ml. For each of the 28 test samples 700-μl aliquots were prepared and frozen at −80°C and were sent to the participating laboratories on dry ice.
TABLE 1.
Characteristics of patients from whom serum samples were used for the study
Patient no. | Underlying diseasea | Aspergillus infection | No. of positive serum samples/ total no. of serum samples | ELISA result for pooled serum samplesb |
---|---|---|---|---|
1 | PNH, BMT | Cerebral; probable | 5/22 | Negative, 0.4 and 0.6; positive, 4.8 and 12.7 |
2 | Aplastic anemia, BMT | Sinus, lung; proven | 28/36 | Negative, 0.7; positive, 5.4 and 7.0 |
3 | ALL | Lung; probable | 4/15 | Negative, 0.9; positive, 1.9 |
4 | ALL | Sinus; proven | 2/6 | Positive, 5.3 |
5 | AML | Lung; probable | 5/12 | Positive, 3.1 and 3.4 |
6 | Aplastic anemia | Lung; possible | 2/9 | Negative, 0.3 |
7 | AML | No | 0/9 | Negative, 0.4 and 0.9 |
8 | AML | No | 0/15 | Negative, 0.4 |
9 | NHL | No | 1/13 | False positive, 2.4 |
10 | AML, BMT | No | 2/42 | False positive, 1.7 |
11 | HL | No | 1/18 | False positive, 1.6 |
12 | AML, BMT | No | 3/11 | False positive, 2.7 |
PNH, paroxysmal nocturnal hemoglobinemia; BMT, bone marrow transplantation; ALL, acute lymphoblastic leukemia; AML, acute myeloid leukemia; NHL, non-Hodgkin’s lymphoma; HL, Hodgkin’s lymphoma.
The numbers are ratios for the serum samples tested.
Sandwich ELISA.
The sandwich ELISA was performed as described previously (14). Briefly, 300 μl of each sample was mixed with 100 μl of treatment solution and the mixture was subsequently boiled for 3 min. After centrifugation, the supernatant was used for further testing. Fifty microliters of conjugate was added to each well of an anti-galactomannan immunoglobulin M-coated microtiter plate (Platelia Aspergillus; Sanofi Diagnostics Pasteur), followed by the addition of 50 μl of the treated sample. After 90 min of incubation at 37°C, the plates were washed and 100 μl of substrate buffer containing ortho-phenylenediamine hydrochloride was added to each well, and the plates were incubated for 30 min at room temperature in darkness. The optical density at 450 nm was measured, and each plate contained a positive control (5 ng of galactomannan per ml), a threshold control (1 ng of galactomannan per ml), and a negative control (no galactomannan). The optical density of the threshold control was recommended by the manufacturer to be between 0.3 and 0.8, the ratio between the negative control and the threshold control was recommended to be below 0.5, and that of the positive control and the threshold control was recommended to be greater than 2. The ratio between the optical density of the test sample and that of the threshold control was calculated for each serum sample. A ratio of less than 1.0 was negative, a value greater than 1.5 was positive, and those between 1.0 and 1.5 were undetermined (gray zone), which is recommended by the manufacturer.
Study design.
Six laboratories (coded as laboratories 1, 2, 3, 4, 5, and 6) of university hospitals in The Netherlands participated in the study. Each laboratory received the same 28 blinded test samples in 700-μl aliquots and a detailed protocol. Twenty-four sandwich ELISA plates from a single batch were kindly donated by the manufacturer, and four plates were sent to each participating center. Each laboratory used two plates to familiarize the investigators with the assay, and the remaining two plates were used to test 20 test samples in duplicate on 2 different days. The eight serum samples which were spiked with galactomannan were tested in duplicate in a single run at five institutes. The assays were performed within 4 weeks of receipt of the samples and plates. Each institute reported the optical density, the ratio calculated for each serum sample, and the interpretation of the result. Thus, a total of 24 optical density values were available for each of the 20 test samples and 10 were available for each of those spiked with galactomannan.
Statistical analysis.
The objectives of this study were (i) to determine the intra- and interassay variabilities of the sandwich ELISA with identical serum samples and microtiter plates in each of six laboratories, (ii) to determine the interlaboratory reproducibility of the sandwich ELISA with respect to both quantitative and qualitative assay results, (iii) to calculate the optimal cutoff values for negative and positive samples and compare the calculated cutoff values to those recommended by the manufacturer, and (iv) to determine the level of agreement between the known and measured concentrations of galactomannan in serum.
Since the ELISA results can be interpreted clinically as continuous data or as ordinal data, the intra- and interassay reproducibilities were assessed for both situations. The level of variation of optical density values which may occur in a continuous scale were determined by calculating the coefficient of variation (CV), defined as the respective standard deviation (SD) divided by the overall mean and expressed as a percentage (18). The variability in the ratios for serum within and between laboratories was determined by calculation of the SD.
For those patients for whom the interpretation of the test result (negative, gray zone, or positive) is of greater interest than the actual ratio for the serum sample, the proportion of repeat tests that were reclassified into different diagnostic categories was assessed. The most suitable measure for repeatability for ordinal data is the weighted kappa statistic (Kw) because it weighs the degree of disagreement and takes into consideration chance agreement (1). For calculation of Kw test results were scored as negative (score of 0), as being in the gray zone (nonconclusive; score of 1), and as positive (score of 2), and patients were scored as negative (score of 0) and positive (score of 2). Agreement was considered to be poor for a Kw less than 0.40, fair to good for a Kw of 0.41 to 0.75, and excellent for a Kw greater than 0.75 (4). Kw equals 1.0 for perfect agreement and equals 0.0 for no agreement. Confidence intervals around Kw were calculated by standard methods.
The cutoff value for negative and positive ELISA reactivities was calculated by use of the following formula:
![]() |
in which OD represents the optical density.
The level of agreement for the serum samples spiked with galactomannan was calculated by use of correlation coefficients. For this a reference line was calculated by using the optical densities of the control samples from each laboratory. The optical densities of the test samples were compared to the reference line, and the concentration of galactomannan was deduced.
RESULTS
For the clinical samples a total of 480 optical density values were evaluated, e.g., 192 for each of the ELISA-positive and -negative samples and 96 for the false-positive samples. Two of the false-positive samples showed ELISA reactivity, while the remaining false-positives samples were negative; thus, 10 samples showed ELISA reactivity and 10 samples were negative. The ranges of the optical density values and the ratios for the serum samples tested were 0.028 to 0.474 and 0.15 to 1.21, respectively, for the negative samples and 0.446 to 4.849 and 1.40 to 12.69, respectively, for the positive samples. Among the positive samples, because of one sample with the highest concentration of galactomannan, 9 of 24 optical density measurements were out of range. These off-scale optical density results were excluded from further analysis, leaving a total of 471 optical density values. The eight serum samples spiked with galactomannan were analyzed at five institutes, resulting in 80 optical density values.
Control samples.
The optical density value of the threshold control is critical to the calculated ratio for the serum sample result since the optical density value is used as a denominator. The reproducibilities of the optical densities of the threshold control samples obtained in duplicate are presented in Fig. 1. Although the duplicate values of the optical density were reproducible, 9 of 24 (38%) measurements were not within the recommended limits. Duplicate measurements of the optical density values of the threshold control were within the recommended limits on both days in only one laboratory. In one institute the optical density of the threshold control was above the upper limit, which resulted in low ratios for the serum samples. For this threshold control sample the optical density was measured 2 h after the optical densities of the test samples were measured. Therefore, only the optical density values of these serum samples and not the calculated ratios for serum were included in the analysis. The remaining 22 optical density values were below 0.5, including 7 that were below the lower limit of 0.3 (Fig. 1). Nevertheless, the ratios for serum, which were calculated by using these low threshold control values, were not significantly different from those calculated by using threshold control values within the recommended limits. The mean optical density of the 24 threshold control measurements was 0.38 (range, 0.24 to 0.82), which was significantly lower than the mean optical density of the threshold controls for 20 consecutive microtiter plates routinely used in one institute (mean optical density, 0.57; range, 0.24 to 0.83; P < 0.001).
FIG. 1.
Reproducibility of duplicate optical density measurements by sandwich ELISA of the threshold control which contains 1 ng of galactomannan per ml. For each institute optical density values measured on two different days are shown. ⧫, institute 1; •, institute 2; ▪, institute 3; ▴, institute 4; ×, institute 5; +, institute 6. The window represents the recommended limits of the optical density of the threshold control. The points situated inside the window represent threshold control measurements of which both (duplicate) optical density values were within the recommended limits.
Calculation of cutoff values.
Ninety-five percent of the optical density measurements of 10 serum samples without ELISA reactivity were below 0.76, 99% were below 0.97, and 99.8% were below 1.14. These results indicate that the cutoff values for negative, gray zone, and positive test results should be <0.8, 0.8 to 1.0, and >1.0, respectively.
Reproducibility.
The interassay reproducibility of the threshold control was calculated by using the CV. The mean CV was 9.5% for repeat testing of a single threshold control measurement and 6.7% for repeat testing of duplicate measurements. The intra- and interlaboratory reproducibilities for the test samples are presented in Table 2.
TABLE 2.
Reproducibility of Platelia Aspergillus sandwich ELISA
Laboratory | Reproducibility for 20 serum samplesa
|
Interassay reproducibility of ratios for the following:
|
Interassay reproducibility by interpretation of ratio for 20 samplesb | Interlaboratory reproducibility by interpretation of ratio for 20 samplesb | ||
---|---|---|---|---|---|---|
Intra-assay reproducibility | Interassay reproducibility | 10 ELISA-negative samplesc | 10 ELISA-positive samplesc | |||
1 | 3.00 | 34.3 | 0.470 | 16.7 | 1.00 | |
2 | 5.68 | 26.9 | 0.303 | 15.9 | 0.95 | |
3 | 3.06 | 27.3 | 0.196 | 11.6 | 1.00 | |
4 | 3.31 | 26.5 | 0.136 | 14.1 | 0.95 | |
5 | 5.74 | 20.3 | 0.171 | 22.6 | 0.90 | |
6 | 3.66 | 17.0 | 0.067 | 26.6 | 0.90 | |
Overall | 4.24 | 25.6 | 0.259 | 18.6 | 0.98 (0.982–0.992)d | 0.999 (0.998–0.999) |
The geometric mean CV method was used.
The Kw method was used.
The geometric mean SD method was used.
Values in parentheses are 95% confidence intervals.
Overall, 163 of 167 (98%) ratios for ELISA-positive serum samples were greater than 1.5. The ratios for the four remaining samples were within the gray zone. A total of 188 to 192 (98%) ratios for ELISA-negative serum samples were lower than 1.0. The ratios for the four remaining samples were in the gray zone, with the highest ratio being 1.23. In general, the analyses of data for both ELISA-positive and ELISA-negative serum samples indicated a greater consistency within one laboratory than between laboratories.
Serum samples spiked with galactomannan.
The correlation coefficients between the known and measured galactomannan concentrations were 0.975, 0.957, 0.987, 0.796, and 0.883 for institutes 1, 2, 3, 4, and 6, respectively. Overall, the mean correlation coefficient was 0.949 (95% confidence interval, 0.918 to 0.968).
DISCUSSION
Until recently, the detection of Aspergillus antigens has not played a major role in the diagnosis of invasive aspergillosis in neutropenic patients. This is partly due to the low sensitivity of commercial tests such as the latex agglutination test (Pastorex Aspergillus; Sanofi Diagnostics Pasteur), which detects the Aspergillus antigen galactomannan (6, 20, 21). Since in most cases antigen was detected at an advanced stage of infection, the latex agglutination test did not contribute to the decision to treat patients with antifungal agents (6, 20). The development of a sandwich ELISA with a significantly improved sensitivity offers new approaches to managing the disease (12). Several studies performed in Europe have shown that the sandwich ELISA contributes to the early diagnosis of invasive aspergillosis and adds to the certainty of the diagnosis, at least for patients receiving cytotoxic treatment for hematological malignancies (10, 15, 22). Since the optimal use of the sandwich ELISA probably involves analysis of a series of serum samples from individual patients, we investigated the reproducibilities of the assay both within and between runs in a single institute and between institutes.
Our investigation indicates that the cutoff values which are recommended by the manufacturer may be too high. On the basis of our results, cutoff values for negative, gray zone, and positive ELISA results should be <0.80, 0.80 to 1.0, and >1.0, respectively. Samples with values between 0.80 and 1.0 would require retesting. Previous studies have also suggested that lower cutoff values can be used. In one study the threshold of positivity was estimated to be 0.93 ng of galactomannan per ml on the basis of more than 100 measurements for children without invasive aspergillosis (10). In another study the threshold of positivity was estimated to be 0.8 from the mean optical density plus 5 SDs, which corresponds to a concentration of 1 ng of galactomannan per ml (15). However, for both studies it remains unclear if the controls were healthy blood donors or neutropenic patients without invasive aspergillosis. We found that the mean optical density among blood donors was significantly lower than that among neutropenic patients without evidence of invasive aspergillosis (3), and therefore, the choice of cutoff value may depend on the type of high-risk population under investigation. Both the number of false-positive ELISA results and the benefit of earlier positivity should be taken into account in choosing a cutoff value. For instance, lowering of the cutoff value from 1.5 to 1.0 may not result in an earlier positivity of the ELISA if the patients are sampled and analyzed once weekly, and therefore, the delay between diagnosis and treatment of the infection will not be shortened significantly. The manufacturer of the ELISA proposes that ratios for serum of between 1.0 and 1.5 be interpreted as nonconclusive (gray zone) regarding the absence or presence of infection. Further studies are needed to study optimal cutoff values in more detail by using receiver operating characteristic curves. For clinical purposes the result for a serum sample with a ratio within the gray zone is sometimes difficult to interpret. The ELISA result could be weakly positive due to inadequate storage of the serum sample (20), cross-reactivity with an unknown component in the serum sample (15, 16), or laboratory contamination (7), especially with airborne dust, which may carry spores from Aspergillus species or Penicillium species. Alternatively, the weakly positive ELISA result may reflect a gradual rise in the galactomannan titer in the patient. In both cases the sample should be retested together with a second sample from the patient, which is also recommended by the manufacturer (16). If both samples or only the second sample is ELISA negative, an infection in the patient is unlikely, while a rising titer in the serum strongly suggests the presence of an infection. Nevertheless, for some patients weakly positive ELISA results may be found for consecutive serum samples, and since at present the reason for this remains unclear, careful clinical and radiological observation of the patient, together with further monitoring of the serum, is required. In general, the interpretation of ELISA results is facilitated if series of serum samples from individual patients are available.
The reproducibility of the optical density of the threshold control among the six laboratories was good if the sample was tested in duplicate, which is also recommended by the manufacturer. The reproducibility of the sandwich ELISA was excellent when the results for the clinical samples were analyzed as ordinal data. The high Kw indicates that during repeated testing the samples were classified into the same diagnostic category. When it comes to clinical decision making, in most cases a categorical interpretation of the ELISA result is sufficient, since a test that detects antigen in the serum is usually only one of several diagnostic tests or procedures which are used to make the diagnosis. The presence of highly indicative signs by high-resolution computed tomography of the chest of a neutropenic patient combined with the ELISA reactivities of two serum samples strongly supports the diagnosis of invasive aspergillosis, irrespective of how high the actual ratios for the serum samples are. However, since false-positive results may occur, in some cases the course of the antigen titer may help to distinguish between false-positive reactivity and true antigenemia (16). Furthermore, for a number of patients the course of the antigen titer during antifungal therapy corresponds to treatment outcome (10, 23). To this end the ELISA results will be interpreted as continuous data and antigen levels from consecutive measurements will be compared. Although the diagnostic accuracy of the ELISA, as calculated by the use of kappa statistics, is very good, the analytical repeatability is not optimal. The correlation coefficients found for serum samples spiked with galactomannan indicate a suboptimal analytic recovery of the added galactomannan. This is not unexpected in the face of the considerable assay variability. The optical density values of the clinical samples showed considerable variation between runs within a single institute, even though in this study all samples were analyzed with ELISA plates from a single batch. For example, the ratio for a serum sample of 6 measured on one day could vary between 3.78 and 8.22 (95% confidence interval) when measured on another day. Of course, many factors may contribute to the observed variation, including pipetting errors, efficacy of washing of the microtiter plates, and the experience of the technician. Alternatively, the conditions of coating of the ELISA microtiter plate with monoclonal antibody may vary, and this variation may affect the efficacy of binding of galactomannan. Variations in coating conditions may account for the relatively low optical density values of the threshold control samples observed in this study. The interassay agreement was increased by calculating and comparing the ratio for serum, since some factors such as the efficacy of washing of the plates will affect the optical densities of both clinical samples and threshold controls. Nevertheless, the level of variation that we observed in this study suggests that changes in the antigen titer should be interpreted with caution unless consecutive serum samples are analyzed in a single run.
ACKNOWLEDGMENTS
We thank A. J. M. M. Rijs, University Hospital Nijmegen, Nijmegen, The Netherlands, and M. Brinker and R. Hoedemakers, University Hospital Groningen, Groningen, The Netherlands, for excellent technical assistance.
REFERENCES
- 1.Cohen J. Weighted kappa: nominal scale agreement with provision for scaled disagreement or partial credit. Psychol Bull. 1968;70:213–220. doi: 10.1037/h0026256. [DOI] [PubMed] [Google Scholar]
- 2.Einsele H, Hebart H, Roller G, Loffler J, Rothenhofer I, Muller C A, Bowden R A, vanBurik J, Engelhard D, Kanz L, Schumacher U. Detection and identification of fungal pathogens in blood using molecular probes. J Clin Microbiol. 1997;35:1353–1360. doi: 10.1128/jcm.35.6.1353-1360.1997. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.Erjavec, Z. Unpublished data.
- 4.Fleiss J L. Statistical methods for rates and proportions. 2nd ed. New York, N.Y: John Wiley & Sons, Inc.; 1982. [Google Scholar]
- 5.Groll A H, Shah P M, Mentzel C, Schneider M, Just-Nuebling G, Huebner K. Trends in the postmortem epidemiology of invasive fungal infections at a university hospital. J Infect. 1996;33:23–32. doi: 10.1016/s0163-4453(96)92700-0. [DOI] [PubMed] [Google Scholar]
- 6.Hopwood V, Johnson E M, Cornish J M, Foot A B M, Evans E G V, Warnock D W. Use of the Pastorex Aspergillus antigen latex agglutination test for the diagnosis of invasive aspergillosis. J Clin Pathol. 1995;48:210–213. doi: 10.1136/jcp.48.3.210. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Kappe R, Schulze-Berge A. New cause for false-positive results with the Pastorex Aspergillus antigen latex agglutination test. J Clin Microbiol. 1993;31:2489–2490. doi: 10.1128/jcm.31.9.2489-2490.1993. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Melchers W J G, Verweij P E, Van Den Hurk P, Van Belkum A, De Pauw B E, Hoogkamp-Korstanje J A A, Meis J F G M. General primer-mediated PCR for detection of Aspergillus species. J Clin Microbiol. 1994;32:1710–1717. doi: 10.1128/jcm.32.7.1710-1717.1994. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Reddy L V, Kumar A, Kurup V P. Specific amplification of A. fumigatus DNA by PCR. Mol Cell Probes. 1993;7:121–126. doi: 10.1006/mcpr.1993.1016. [DOI] [PubMed] [Google Scholar]
- 10.Rohrlich P, Sarfati J, Mariani P, Duval M, Carol A, Saint-Martin C, Bingen E, Latgé J P, Vilmer E. Prospective sandwich ELISA galactomannan assay: early predictive value and clinical use in invasive aspergillosis. Pediatr Infect Dis J. 1996;15:232–237. doi: 10.1097/00006454-199603000-00011. [DOI] [PubMed] [Google Scholar]
- 11.Sabetta J R, Miniter P, Andriole V T. The diagnosis of invasive aspergillosis by an enzyme-linked immunosorbent assay for circulating antigen. J Infect Dis. 1985;152:946–953. doi: 10.1093/infdis/152.5.946. [DOI] [PubMed] [Google Scholar]
- 12.Severens J L, Donnelly J P, Meis J F G M, De Vries Robbé P F, De Pauw B E, Verweij P E. Two strategies for managing invasive aspergillosis: a decision analysis. Clin Infect Dis. 1997;25:1148–1154. doi: 10.1086/516085. [DOI] [PubMed] [Google Scholar]
- 13.Stynen D, Sarfati J, Goris A, Prévost M C, Lesourd M, Kamphuis H, Darras V, Latgé J P. Rat monoclonal antibodies against Aspergillus galactomannan. Infect Immun. 1992;60:2237–2245. doi: 10.1128/iai.60.6.2237-2245.1992. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Stynen D, Goris A, Sarfati J, Latgé J P. A new sensitive sandwich enzyme-linked immunosorbent assay to detect galactofuran in patients with invasive aspergillosis. J Clin Microbiol. 1995;33:497–500. doi: 10.1128/jcm.33.2.497-500.1995. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Sulahian A, Tabouret M, Ribaud P, Sarfati J, Gluckman E, Latgé J P, Derouin F. Comparison of an enzyme immunoassay and latex agglutination test for detection of galactomannan in the diagnosis of invasive aspergillosis. Eur J Clin Microbiol Infect Dis. 1996;15:139–145. doi: 10.1007/BF01591487. [DOI] [PubMed] [Google Scholar]
- 16.Swanink C M A, Meis J F G M, Rijs A J M M, Donnelly J P, Verweij P E. Specificity of a sandwich enzyme linked immunosorbent assay for detecting Aspergillus galactomannan. J Clin Microbiol. 1997;35:257–260. doi: 10.1128/jcm.35.1.257-260.1997. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Talbot G H, Weiner M H, Gerson S L, Provencher M, Hurwitz S. Serodiagnosis of invasive aspergillosis in patients with hematologic malignancy: validation of the Aspergillus fumigatus antigen radioimmunoassay. J Infect Dis. 1987;155:12–27. doi: 10.1093/infdis/155.1.12. [DOI] [PubMed] [Google Scholar]
- 18.Tammemagi M C, Frank J W, Leblanc M, Artsob H, Steiner D L. Methodological issues in assessing reproducibility—a comparative study of various indices of reproducibility applied to repeat ELISA serologic tests for Lyme disease. J Clin Epidemiol. 1995;48:1123–1132. doi: 10.1016/0895-4356(94)00243-j. [DOI] [PubMed] [Google Scholar]
- 19.Tang C M, Holden D W, Aufavre-Brown A, Cohen J. The detection of Aspergillus species by PCR and its evaluation in BAL fluid. Am Rev Respir Dis. 1993;148:1313–1317. doi: 10.1164/ajrccm/148.5.1313. [DOI] [PubMed] [Google Scholar]
- 20.Verweij P E, Rijs A J M M, de Pauw B E, Horrevorts A M, Hoogkamp-Korstanje J A A, Meis J F G M. Clinical evaluation and reproducibility of the Pastorex Aspergillus antigen latex agglutination test for diagnosing invasive aspergillosis. J Clin Pathol. 1995;48:474–476. doi: 10.1136/jcp.48.5.474. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Verweij P E, Stynen D, Rijs A J M M, De Pauw B E, Hoogkamp-Korstanje J A A, Meis J F G M. Sandwich enzyme linked immunosorbent assay compared with Pastorex latex agglutination test for diagnosing invasive aspergillosis in immunocompromised patients. J Clin Microbiol. 1995;33:1912–1914. doi: 10.1128/jcm.33.7.1912-1914.1995. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Verweij P E, Latgé J P, Rijs A J M M, Melchers W J G, De Pauw B E, Hoogkamp-Korstanje J A A, Meis J F G M. Comparison of antigen detection and PCR assay using bronchoalveolar lavage fluid for diagnosing invasive pulmonary aspergillosis in patients receiving treatment for hematological malignancies. J Clin Microbiol. 1995;33:3150–3153. doi: 10.1128/jcm.33.12.3150-3153.1995. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Verweij P E, Dompeling E C, Donnelly J P, Schattenberg A V M B, Meis J F G M. Serial monitoring of Aspergillus antigen in the early diagnosis of invasive aspergillosis. Preliminary investigations with two examples. Infection. 1997;25:86–89. doi: 10.1007/BF02113581. [DOI] [PubMed] [Google Scholar]