Abstract
Background
The utility of tumor markers (TMs) for differentiating malignant pleural effusion (MPE) from benign pleural effusion (BPE) has been a subject of controversy. The majority of published studies are single center designed and lack validation. We performed a derivation and validation study in China to evaluate the diagnostic value of carcinoembryonic antigen (CEA) as well as carbohydrate antigen (CA) 15-3, CA 19-9 and CA 125 to differentiate between MPE and BPE.
Methods
Three hundred and twenty seven pleural effusion (PE) and paired serum samples were collected from consecutive patients with MPE or BPE in Beijing (174 patients, derivation) and Wuhan (153 patients, validation) during the same period. The concentrations of four TMs were tested using chemiluminescent microparticle immunoassay technology. The performance of the TMs was analyzed by standard receiver operating characteristic (ROC) curves.
Results
The levels of four TMs were significantly higher in MPE than in BPE and the corresponding serum. The concentrations of CEA and CA 15-3 were more stable than the concentrations of CA 125 and CA 19-9. CEA was the best single marker for discriminating MPE from BPE. With a specificity of 100% in the total population, the highest sensitivity (37.8%) using serum was found in CEA. In addition, CEA presented 19.8% sensitivity in PE and 18.0% sensitivity in the Δ(PE–serum). For CA 15-3, the sensitivity was 32.4% in PE, 15.3% in the PE/serum ratio and 25.2% in the Δ(PE–serum).
Conclusions
CEA and CA 15-3 rather than CA 125 and CA 19-9 are more reliable to differentiate between MPE and BPE. The use of the Δ(PE–serum) value in TMs, such as CEA and CA 15-3, may improve the sensitivity and specificity of the diagnosis etiology of PE.
Keywords: Pleural effusion (PE), tumor marker (TM), diagnosis, carcinoembryonic antigen (CEA), CA 125, CA 15-3, CA 19-9
Introduction
Malignant pleural effusion (MPE) is frequently observed in some malignancies, implying systemic spread of cancer and reduction of life expectancy and quality (1). The initial diagnostic approaches to differentiation between benign pleural effusions (BPEs) and MPEs include thoracocentesis and cytological, histological and biochemical examinations; however, the sensitivity of these non-invasive techniques is only 40–70% (2). Many studies have investigated the usefulness of a number of tumor markers (TMs), including carcinoembryonic antigen (CEA), carbohydrate antigen (CA) 125, CA 15-3, and CA 19-9, in pleural fluid for the diagnosis of MPE (3). Our previous meta-analyses indicated that current evidence does not recommend using a single TM for the diagnosis of MPE; a combination of two or more TMs seemingly is more sensitive (4,5). We, along with others, have demonstrated that the concentration ratios between pleural effusion (PE) and serum (PE/serum ratio) of several TMs show better sensitivity with specificity than a single determination for PE (6-8). However, a majority of the published studies are single center designed, which lack validation. Our aims were to test the effectiveness of simultaneous determination of CEA, CA 125, CA 15-3, and CA 19-9 in PE, serum and the PE/serum ratio in diagnosing MPE; and especially, to evaluate the diagnostic accuracy of the ∆(PE–serum) for MPE.
Methods
Study populations
Beijing cohort and Wuhan cohort were chosen as derivation and validation randomly. All adult patients with undiagnosed PEs admitted to the Department of Respiratory and Critical Care Medicine, Beijing Chao-Yang Hospital, Capital Medical University, Beijing (derivation) and determined as necessary by the attending physicians were enrolled in this study between January 2013 and June 2015. Ultimately, consecutive patients with the establishment of a definite cause of PE were included. This population allowed the evaluation of the diagnostic accuracy of TMs for MPE, which was subsequently validated in a separate cohort of consecutive patients with PE who were recruited during the same period from the Department of Respiratory and Critical Care Medicine, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan (validation). The patients with a cytologically negative PE but a history of malignancy or subsequent diagnosis of malignancy were not included in the study. Additionally, PEs without a definite known cause were excluded due to the potential that the PE was malignant but missed by cytology.
The study was approved by the ethics committees of both participating institutions, and all study participants provided written informed consent. The study outcomes would not affect the future management of the patients. The corresponding authors vouch for the accuracy and completeness of the data and analysis as well as the fidelity of the study to technological and biostatistical protocols.
Diagnostic criteria
All MPE were obtained from lung cancer patients. A diagnosis of MPE was established by the demonstration of malignant cells in PE and/or on a pleural biopsy specimen. Tuberculosis PE (TPE) was diagnosed if Ziehl-Neelsen stains or Lowenstein-Jensen cultures of pleural fluid, sputum, or pleural biopsy specimens were positive or if granulomas were found in the parietal pleural biopsies. Parapneumonic PE was diagnosed as any PE associated with bacterial pneumonia, lung abscess, or bronchiectasis, and an empyema was defined when pus was present within the pleural space. The presence of heart failure was based on well-established diagnostic criteria, with transudative PE classified by Light’s criteria (9).
Sample processing
PEs were collected via diagnostic thoracentesis before patients received any therapy. They were collected in sterile tubes without anticoagulant and rapidly transferred to our laboratory with a blood sample obtained simultaneously from the same patient. PE and blood samples were centrifuged at 1,500 rpm for 10 min at 4 °C, and the supernatants were aliquoted and stored at −80 °C awaiting analysis of TMs. Each aliquot was used only once to prevent enzyme activation due to freeze-thawing processes.
TM assays
The concentrations of CEA (Abbott Ireland Diagnostics Division, Sligo, Ireland), CA 125 (Abott Laboratories, Malvern, PA, USA), CA 15-3 (Abott Laboratories, Malvern, PA, USA) and CA 19-9 (Abott Laboratories, Malvern, PA, USA) in PEs and sera were measured using chemiluminescent microparticle immunoassay technology according to the manufacturer’s protocols. Briefly, a 10–30 µL sample and a 50 µL antibody coated paramagnetic particle were incubated for 18 min. After washing, 50 µL of antibody acridinium–labeled conjugate was added and incubated for 4 min to create a reaction mixture. Following another wash cycle, pre-trigger and trigger solutions were added to the reaction mixture. The resulting chemiluminescent reaction was measured as relative light units by the i2000 Optical System (Abbott, ARCHITECT Corporation, PA, USA). All assays were performed on coded samples by investigators who were unaware of the patient’s diagnosis in a single laboratory analysis. The minimum detectable concentration of CEA, CA 125, CA 15-3, and CA 19-9 were 0.50 ng/mL, 1.0 U/mL, 0.5 U/mL, and 2 U/mL, respectively. When a specimen’s value exceeded the measurement range for the reagent kits, the specimen was diluted using the manual dilution procedure. All samples were assayed in duplicate.
All TM measurements in blinded samples were performed one time by one trained technician at the Department of Clinical Examination, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan; and the results were then unblinded and analyzed by our investigators.
Statistical analysis
The concentrations of TMs are presented as medians (25th to 75th percentiles) because these data were normally distributed as determined by the Kolmogorov-Smirnov test. Changes of TMs in PE were adjusted for the serum by calculating the ∆(PE–serum) of each TM. Parametric tests were used because TMs data were normally distributed as determined by a normality test. Comparisons of TM data between MPEs and BPEs were performed using the Mann–Whitney U test. Comparisons of data in PEs and in corresponding sera were conducted using paired t-tests.
Receiver operating characteristics (ROCs) curves were drawn and the areas under the curve (AUC) were calculated to determine the diagnostic value of the concentrations of each marker in PE, serum, the PE/serum ratio as well as the ∆(PE–serum) values (10,11); the AUCs were compared using the Hanley and McNeil procedure (10). Optimum cut-off values were defined based on their highest diagnostic accuracy according to the ROC curves. Sensitivity, specificity, positive likelihood ratio (PLR), negative likelihood ratio (NLR), positive predictive value (PPV), and negative predictive value (NPV) (11) were calculated for each TM and for the combination of TMs. The parameters of diagnostic accuracy are shown together with their 95% confidence intervals (CI). Analysis was completed with SPSS Version 18.0 Statistical Software (Chicago, IL, USA), and P<0.05 was considered to indicate statistical significance.
Results
Clinical characteristics
The present study, which consists of derivation and validation studies, enrolled 327 patients recruited from 2013 to 2015 in China. The characteristics of the included patients are summarized in Table 1. In the Beijing cohort (derivation cohort), there were 174 patients, including 67 MPEs and 107 BPEs. Distribution of histological diagnoses in the MPE group was as follows: 50 lung adenocarcinoma patients, 3 squamous cell lung carcinoma patients, 2 small cell lung carcinoma patients, and 12 undetermined lung cancer patients. The etiologic diagnoses of the BPE group were as follows: 61 tuberculosis patients, 19 parapneumonic patients, 4 heart failure patients and 23 miscellaneous patients.
Table 1. Demographic and clinical characteristics according to the study cohort.
| Variable | Derivation cohort (n=174) | Validation cohort (n=153) | Total population (n=327) | |||||
|---|---|---|---|---|---|---|---|---|
| MPE | BPE | MPE | BPE | MPE | BPE | |||
| Patients (no.) | 67 | 107 | 52 | 101 | 119 | 208 | ||
| Age (year) | 62.5±12.6 | 52.2±19.4 | 58.6±10.1 | 47.3±18.4 | 60.8±11.7 | 49.8±19.0 | ||
| Sex | ||||||||
| Male | 35 | 77 | 29 | 71 | 64 | 148 | ||
| Female | 32 | 30 | 23 | 30 | 55 | 60 | ||
| MPE | ||||||||
| Adenocarcinoma | 50 | − | 29 | − | 79 | − | ||
| Squamous cell carcinoma | 3 | − | 4 | − | 7 | − | ||
| Small cell lung carcinoma | 2 | − | 4 | − | 6 | − | ||
| Unknown | 12 | − | 15 | − | 27 | − | ||
| BPE | ||||||||
| Tuberculosis | − | 61 | − | 78 | − | 139 | ||
| Parapneumonic | − | 19 | − | 8 | − | 27 | ||
| Heart failure | − | 4 | − | 13 | − | 17 | ||
| Miscellaneous | − | 23 | − | 2 | − | 25 | ||
MPE, malignant pleural effusion; BPE, benign pleural effusion.
Of the 153 PE patients in the Wuhan cohort (validation cohort), 29 had lung adenocarcinoma, 4 had squamous cell lung carcinoma, 4 had small cell lung carcinoma, 15 had undetermined lung cancer, 78 had tuberculosis, 8 had parapneumonic effusion, 13 had heart failure and 2 had miscellaneous BPE.
Concentrations of TMs in PEs
The PE concentrations of CEA, CA 125, CA 15-3, and CA 19-9 in MPE patients were all significantly higher than the concentrations in BPE patients (all P<0.001) in the Beijing cohort and the Wuhan cohort. The concentrations of four TMs were much higher in MPE than in the corresponding serum and BPE (P<0.001) in both cohorts. The concentrations of CEA, CA 15-3, and CA 19-9, but not CA 125, in sera in MPE patients were all significantly higher than those in BPE patients (all P<0.001) in the Beijing cohort and the Wuhan cohort. Additionally, a difference emerged from both PE/serum ratios and the ∆(PE–serum) values that were much higher in MPE than in BPE for CEA, CA 15-3, and CA 19-9 (all P<0.001), but not for CA 125 (Table 2).
Table 2. Concentrations of CEA, CA 125, CA 15-3 and CA 19-9 in pleural effusion and/or serum according to the study cohort*.
| Variable | Beijing cohort | Wuhan cohort | Total population | |||||
|---|---|---|---|---|---|---|---|---|
| MPE (n=67) | BPE (n=107) | MPE (n=52) | BPE (n=101) | MPE (n=119) | BPE (n=208) | |||
| CEA | ||||||||
| PE, ng/mL | 69.5 | 0.6 | 82.3 | 0.8 | 76.8 | 0.7 | ||
| (7.7‒919.1) | (0.5‒1.4) | (11.0‒832.8) | (0.5‒1.4) | (8.1‒861.4) | (0.5‒1.4) | |||
| Serum, ng/mL | 4.4 | 1.5 | 7.7 | 1.7 | 5.5 | 1.7 | ||
| (2.1‒29.5) | (1.0‒2.6) | (2.0‒43.9) | (1.0‒2.5) | (2.1‒35.3) | (1.0‒2.6) | |||
| PE/serum ratio | 10.2 | 0.6 | 7.2 | 0.6 | 9.0 | 0.6 | ||
| (1.1‒29.7) | (0.4‒0.8) | (1.5‒28.3) | (0.4‒0.7) | (1.4‒28.8) | (0.4‒0.8) | |||
| ∆(PE–serum), ng/mL | 46.6 | −0.6 | 53.7 | −0.7 | 47.1 | −0.6 | ||
| (0.3‒701.6) | (−1.2‒0.2) | (4.2‒804.2) | (−1.45‒0.29) | (1.6‒728.7) | (−1.3‒0.3) | |||
| CA 125 | ||||||||
| PE, U/mL | 946.7 | 352.3 | 657.8 | 596.4 | 781.5 | 452.3 | ||
| (374.0‒2835.7) | (173.6‒780.9) | (395.1‒1366.3) | (267.1‒986.1) | (394.7‒2126.0) | (193.5‒917.2) | |||
| Serum, U/mL | 90.7 | 98.7 | 85.2 | 131.2 | 90.4 | 119.0 | ||
| (40.6‒229.2) | (55.9‒176.3) | (44.1‒222.5) | (79.1‒219.7) | (42.4‒224.6) | (65.5‒186.2) | |||
| PE/serum ratio | 8.5 | 3.4 | 6.2 | 3.9 | 7.6 | 3.8 | ||
| (4.4‒19.0) | (4.1‒7.0) | (3.3‒12.7) | (1.9‒6.8) | (3.5‒14.7) | (1.8‒6.8) | |||
| ∆(PE–serum), U/mL | 895.0 | 215.7 | 425.4 | 401.9 | 663.4 | 293.2 | ||
| (280.2‒2046.8) | (62.6‒604.0) | (205.3‒1058.6) | (122.8‒715.2) | (254.0‒1831.1) | (86.2‒761.9) | |||
| CA 15-3 | ||||||||
| PE, U/mL | 30.1 | 5.3 | 47.6 | 7.0 | 39.9 | 6.2 | ||
| (5.4‒91.7) | (3.0‒10.1) | (11.8‒176.0) | (3.4‒9.3) | (8.7‒109.0) | (3.2‒9.7) | |||
| Serum, U/mL | 15.7 | 9.1 | 21.3 | 10.9 | 18.6 | 10.2 | ||
| (8.8‒33.6) | (6.8‒13.1) | (13.3‒70.8) | (6.9‒16.0) | (10.5‒47.2) | (6.8‒14.9) | |||
| PE/serum ratio | 1.3 | 0.6 | 1.1 | 0.7 | 1.2 | 0.6 | ||
| (0.6‒3.5) | (0.3‒0.9) | (0.5‒3.5) | (0.4‒0.9) | (0.6‒3.5) | (0.4‒0.9) | |||
| ∆(PE–serum), U/mL | 8.4 | −3.4 | 4.2 | −2.7 | 7.4 | −3.3 | ||
| (−4.1‒53.7) | (−6.80‒1.0) | (−6.6‒85.2) | (−7.9 to −1.2) | (−4.7‒74.0) | (−7.0‒1.2) | |||
| CA 19-9 | ||||||||
| PE, U/mL | 24.8 | 2.0 | 13.0 | 2.4 | 23.6 | 2.0 | ||
| (2.0‒1089.2) | (1.6‒3.1) | (2.0‒291.2) | (2.0‒6.1) | (2.0‒442.4) | (2.0‒4.0) | |||
| Serum, U/mL | 14.4 | 5.0 | 8.8 | 7.4 | 12.3 | 6.2 | ||
| (5.3‒61.3) | (2.6‒9.7) | (2.5‒58.8) | (3.9‒13.2) | (4.0‒61.3) | (2.9‒12.0) | |||
| PE/serum ratio | 1.0 | 0.5 | 1.0 | 0.4 | 1.0 | 0.5 | ||
| (0.6‒9.3) | (0.3‒1.0) | (0.8‒8.8) | (0.3‒0.7) | (0.6‒8.9) | (0.3‒0.8) | |||
| ∆(PE–serum), U/mL | 0 | −2.1 | 0.6 | −4.2 | 0 | −3.2 | ||
| (−3.8‒425.4) | (−6.1‒0) | (−0.9‒237.3) | (−8.0‒1.2) | (−2.4‒285.61) | (−7.1‒0.6) | |||
*, data are presented as medians (25th to 75th percentiles). CEA, carcinoembryonic antigen; MPE, malignant pleural effusion; BPE, benign pleural effusion; PE, pleural effusion.
Diagnostic values of TMs
The capacity of TMs to differentiate malignant from benign PE was assessed with ROC curve analyses (Table 3, Figure 1, Tables S1,S2, Figures S1,S2). CEA and CA 15-3 could discriminate MPE from BPE in PE, serum, the PE/serum ratio and the ∆(PE–serum) value in the Beijing cohort, the Wuhan cohort and in the combined population (P<0.05). In the combined population, the diagnostic threshold provided by the ROC analysis for CEA in PE, serum, the PE/serum ratio and the ∆(PE–serum) value was 2.42 ng/mL (AUC: 0.890), 3.54 ng/mL (AUC: 0.806), 1.1 (AUC: 0.862), and 0.4 ng/mL (AUC: 0.849), respectively; and CA 15-3 was 17.8 U/mL (AUC: 0.813), 17.6 U/mL (AUC: 0.731), 1.3 (AUC: 0.738), and 5.9 U/mL (AUC: 0.698), respectively.
Table 3. Diagnostic performance of CEA, CA 125, CA 15-3 and CA 19-9 in differentiating malignant from benign pleural effusions in the total population studied (n=327).
| Variable | Cut-off | AUC (95% CI) | Sensitivity (%) | Specificity (%) | PLR | NLR | PPV (%) | NPV (%) |
|---|---|---|---|---|---|---|---|---|
| CEA | ||||||||
| PE | 2.42 | 0.890* | 84.7 | 90.9 | 9.3 | 0.2 | 83.2 | 91.7 |
| (0.851‒0.923) | (76.6‒90.8) | (86.1‒94.4) | (6.0‒14.3) | (0.1‒0.3) | (75.0‒89.6) | (87.1‒95.1) | ||
| Serum | 3.54 | 0.806* | 64.0 | 88.0 | 5.3 | 0.4 | 74.0 | 82.1 |
| (0.759‒0.848) | (54.3‒72.9) | (82.8‒92.1) | (3.6‒7.9) | (0.3‒0.5) | (64.0‒82.4) | (76.4‒86.9) | ||
| PE/serum ratio | 1.1 | 0.862* | 79.3 | 92.8 | 11.0 | 0.2 | 85.4 | 89.4 |
| (0.819‒0.898) | (70.5‒86.4) | (88.4‒95.9) | (6.7‒18.1) | (0.2‒0.3) | (77.1‒91.6) | (84.5‒93.1) | ||
| ∆(PE–serum) | 0.4 | 0.849* | 78.4 | 94.7 | 14.8 | 0.2 | 88.8 | 89.1 |
| (0.805‒0.887) | (69.6‒85.6) | (90.7‒97.3) | (8.3‒26.6) | (0.2‒0.3) | (80.8‒94.3) | (84.3‒92.9) | ||
| CA 125 | ||||||||
| PE | 855.7 | 0.653* | 49.6 | 73.1 | 1.8 | 0.7 | 49.5 | 73.1 |
| (0.598‒0.705) | (39.9‒59.2) | (66.5‒79.0) | (1.4‒2.5) | (0.6‒0.8) | (39.9‒59.2) | (66.5‒79.0) | ||
| Serum | 108.2 | 0.544 | 60.4 | 54.8 | 1.3 | 0.7 | 41.6 | 72.2 |
| (0.488‒0.600) | (50.6‒69.5) | (47.8‒61.7) | (1.1‒1.7) | (0.6‒0.9) | (33.9‒49.6) | (64.5‒79.0) | ||
| PE/serum ratio | 7.2 | 0.696* | 54.1 | 78.4 | 2.5 | 0.6 | 57.1 | 76.2 |
| (0.643‒0.746) | (44.3‒63.6) | (72.1‒83.8) | (1.8‒3.4) | (0.5‒0.7) | (47.1‒66.8) | (69.9‒81.7) | ||
| ∆(PE–serum) | 361.1 | 0.661* | 69.4 | 56.3 | 1.6 | 0.5 | 45.8 | 77.5 |
| (0.606‒0.713) | (59.9‒77.8) | (49.2‒63.1) | (1.3‒1.9) | (0.4‒0.7) | (38.1‒53.7) | (70.0‒83.9) | ||
| CA 15-3 | ||||||||
| PE | 17.8 | 0.813* | 63.1 | 97.6 | 26.2 | 0.4 | 93.3 | 83.2 |
| (0.765‒0.854) | (53.4‒72.0) | (94.5‒99.2) | (10.9‒63.1) | (0.3‒0.5) | (85.1‒97.8) | (77.9‒87.7) | ||
| Serum | 17.6 | 0.731* | 55.0 | 85.1 | 3.7 | 0.5 | 66.3 | 78.0 |
| (0.679‒0.779) | (45.2‒64.4) | (79.5‒89.6) | (2.6‒5.3) | (0.4‒0.7) | (55.7‒75.8) | (72.0‒83.2) | ||
| PE/serum ratio | 1.3 | 0.738* | 49.6 | 92.3 | 6.4 | 0.6 | 77.5 | 77.4 |
| (0.686‒0.785) | (39.9‒59.2) | (87.8‒95.5) | (3.9‒10.7) | (0.5‒0.7) | (65.9‒86.6) | (71.7‒82.5) | ||
| ∆(PE–serum) | 5.9 | 0.698* | 51.4 | 98.6 | 35.6 | 0.5 | 95.0 | 79.2 |
| (0.644‒0.748) | (41.7‒61.0) | (95.8‒99.7) | (11.4‒111.1) | (0.4‒0.6) | (86.0‒99.0) | (73.7‒83.9) | ||
| CA 19-9 | ||||||||
| PE | 10.9 | 0.721* | 57.7 | 92.8 | 8.0 | 0.5 | 81.0 | 80.4 |
| (0.669‒0.770) | (47.9‒67.0) | (88.4‒95.9) | (4.8‒13.4) | (0.4‒0.6) | (70.6‒89.0) | (74.8‒85.2) | ||
| Serum | 24.8 | 0.646* | 38.7 | 92.3 | 5.0 | 0.7 | 72.9 | 73.8 |
| (0.591‒0.698) | (29.6‒48.5) | (87.8‒95.5) | (3.0‒8.5) | (0.6‒0.8) | (59.6‒83.7) | (68.1‒79.1) | ||
| PE/serum ratio | 0.9 | 0.771* | 66.7 | 79.3 | 3.2 | 0.4 | 63.2 | 81.7 |
| (0.700‒0.800) | (57.1‒75.3) | (73.2‒84.6) | (2.4‒4.3) | (0.3‒0.6) | (53.8‒72.0) | (75.6‒86.8) | ||
| ∆(PE–serum) | 2.0 | 0.758* | 48.7 | 96.2 | 12.7 | 0.5 | 87.1 | 77.8 |
| (0.708‒0.804) | (39.0‒58.3) | (92.6‒98.3) | (6.2‒25.6) | (0.4‒0.6) | (76.0‒94.3) | (72.2‒82.7) | ||
*, P<0.05. CEA, carcinoembryonic antigen; PE, pleural effusion; AUC, area under curve; PLR, positive likelihood ratio; NLR, negative likelihood ratio; PPV, positive predictive value; NPV, negative predictive value.
Figure 1.
ROC curves for each tumor marker in PE, serum, the PE/serum ratio and the ∆(PE–serum) value in the combined population. AUC: CEA (PE), 0.890; CEA (Serum), 0.806; CEA (PE/serum ratio), 0.862; CEA [∆(PE–serum)], 0.849; CA 125 (PE), 0.653; CA 125 (Serum), 0.544; CA 125 (PE/serum ratio), 0.696; CA 125 [∆(PE–serum)], 0.661; CA 15-3 (PE), 0.813; CA 15-3 (Serum), 0.731; CA 15-3 (PE/serum ratio), 0.738; CA 15-3 [∆(PE–serum)], 0.698; CA 19-9 (PE), 0.721; CA 19-9 (Serum), 0.646; CA 19-9 (PE/serum ratio), 0.771; CA 19-9 [∆(PE–serum)], 0.758. ROC, receiver operating characteristic; PE, pleural effusion; AUC, area under curve; CEA, carcinoembryonic antigen.
Table S1. Diagnostic performance of CEA, CA 125, CA 15-3, and CA 19-9 in differentiating malignant from benign pleural effusions in the Beijing cohort (derivation)* (n=174).
| Variable | Cut-off | AUC (95% CI) | Sensitivity (%) | Specificity (%) | PLR | NLR | PPV (%) | NPV (%) |
|---|---|---|---|---|---|---|---|---|
| CEA | ||||||||
| PE | 2.4 | 0.880† | 82.1 | 87.9 | 6.8 | 0.2 | 80.9 | 88.7 |
| (0.822‒0.924) | (70.8‒90.4) | (80.1‒93.4) | (4.0‒11.4) | (0.1‒0.3) | (69.5‒89.4) | (81.1‒94.0) | ||
| Serum | 3.0 | 0.801† | 68.7 | 83.2 | 4.1 | 0.4 | 71.9 | 80.9 |
| (0.734‒0.858) | (56.2‒79.4) | (74.7‒89.7) | (2.6‒6.4) | (0.3‒0.5) | (59.2‒82.4) | (72.3‒87.8) | ||
| PE/serum ratio | 1.0 | 0.858† | 76.1 | 91.6 | 9.1 | 0.3 | 85.0 | 86.0 |
| (0.785‒0.897) | (64.1‒85.7) | (84.6‒96.1) | (4.8‒17.2) | (0.2‒0.4) | (73.3‒93.0) | (78.2‒91.8) | ||
| ∆(PE–serum) | 0.2 | 0.827† | 76.1 | 92.5 | 10.2 | 0.3 | 86.4 | 86.1 |
| (0.763‒0.880) | (64.1‒85.7) | (85.8‒96.7) | (5.2‒20.1) | (0.2‒0.4) | (74.9‒94.0) | (78.4‒91.8) | ||
| CA125 | ||||||||
| PE | 558.7 | 0.723† | 68.7 | 67.3 | 2.1 | 0.5 | 56.8 | 77.4 |
| (0.650‒0.788) | (56.2‒79.4) | (57.5‒76.0) | (1.5‒2.9) | (0.3‒0.7) | (45.3‒67.8) | (67.6‒85.4) | ||
| Serum | 216.1 | 0.511 | 28.4 | 85.1 | 1.9 | 0.8 | 54.3 | 65.5 |
| (0.435‒0.588) | (18.0‒40.7) | (76.9‒91.2) | (1.1‒3.4) | (0.7‒1.0) | (36.6‒71.2) | (56.9‒89.7) | ||
| PE/serum ratio | 6.1 | 0.737† | 64.2 | 74.8 | 2.5 | 0.5 | 61.4 | 76.9 |
| (0.666‒0.801) | (51.5‒75.5) | (65.4‒82.7) | (1.8‒3.7) | (0.3‒0.7) | (49.0‒72.8) | (67.6‒84.6) | ||
| ∆(PE–serum) | 492.5 | 0.731† | 65.7 | 72.0 | 2.3 | 0.5 | 59.5 | 77.0 |
| (0.658‒0.795) | (53.1‒76.8) | (62.5‒80.2) | (1.7‒3.3) | (0.3‒0.7) | (47.4‒70.7) | (67.5‒84.8) | ||
| CA15-3 | ||||||||
| PE | 15.9 | 0.782† | 64.2 | 96.3 | 17.2 | 0.4 | 91.5 | 81.1 |
| (0.714‒0.841) | (51.5‒75.5) | (90.7‒99.0) | (6.5‒45.7) | (0.3‒0.5) | (79.4‒97.7) | (73.2‒87.5) | ||
| Serum | 17.6 | 0.695† | 46.3 | 88.8 | 4.1 | 0.6 | 72.1 | 72.5 |
| (0.621‒0.763) | (34.0‒58.9) | (81.2‒94.1) | (2.3‒7.5) | (0.5‒0.8) | (56.3‒84.7) | (64.0‒80.0) | ||
| PE/serum ratio | 1.3 | 0.748† | 50.8 | 93.5 | 7.8 | 0.5 | 82.9 | 75.2 |
| (0.677‒0.811) | (38.2‒63.2) | (87.0‒97.3) | (3.6‒16.5) | (0.4‒0.7) | (67.9‒92.8) | (67.0‒82.3) | ||
| ∆(PE–serum) | 5.9 | 0.720† | 53.7 | 99.1 | 57.5 | 0.5 | 97.3 | 77.4 |
| (0.647‒0.785) | (41.1‒66.0) | (94.9‒100.0) | (8.1‒409.6) | (0.4‒0.6) | (85.8‒99.9) | (69.4‒84.1) | ||
| CA19-9 | ||||||||
| PE | 9.3 | 0.759† | 61.2 | 91.6 | 7.3 | 0.4 | 82.0 | 79.0 |
| (0.688‒0.820) | (48.5‒72.9) | (84.6‒96.1) | (3.8‒14.0) | (0.3‒0.6) | (68.6‒91.4) | (70.8‒85.8) | ||
| Serum | 10.7 | 0.710† | 55.2 | 79.4 | 2.7 | 0.6 | 62.7 | 73.9 |
| (0.637‒0.776) | (42.6‒67.4) | (70.5‒86.6) | (1.7‒4.1) | (0.4‒0.7) | (49.1‒75.0) | (64.9‒81.7) | ||
| PE/serum ratio | 1.0 | 0.732† | 49.3 | 93.5 | 7.5 | 0.5 | 82.5 | 74.6 |
| (0.660‒0.796) | (36.8‒61.8) | (87.0‒97.3) | (3.5‒16.0) | (0.4‒0.7) | (67.2‒92.7) | (66.4‒81.7) | ||
| ∆(PE–serum) | 2.9 | 0.703† | 49.3 | 96.3 | 13.2 | 0.5 | 89.2 | 75.2 |
| (0.658‒0.795) | (36.8‒61.8) | (90.7‒99.0) | (4.9‒35.5) | (0.4‒0.7) | (74.6‒97.0) | (67.1‒82.2) | ||
*, data are presented as medians (25th to 75th percentiles); †, P<0.05. CEA, carcinoembryonic antigen; PE, pleural effusion; AUC, area under curve; PLR, positive likelihood ratio; NLR, negative likelihood ratio; PPV, positive predictive value; NPV, negative predictive value.
Table S2. Diagnostic performance of CEA, CA 125, CA 15-3 and CA 19-9 in differentiating malignant from benign pleural effusions in the Wuhan cohort (validation)* (n=153).
| Variable | Cut-off | AUC (95% CI) | Sensitivity (%) | Specificity (%) | PLR | NLR | PPV (%) | NPV(%) |
|---|---|---|---|---|---|---|---|---|
| CEA | ||||||||
| PE | 2.3 | 0.886† | 88.6 | 94.1 | 14.9 | 0.1 | 86.7 | 95.0 |
| (0.847‒0.948) | (75.4‒96.2) | (87.5‒97.8) | (6.8‒32.7) | (0.1‒0.3) | (73.2‒94.9) | (88.7‒98.4) | ||
| Serum | 5.2 | 0.812† | 59.1 | 95.1 | 11.9 | 0.4 | 83.9 | 84.2 |
| (0.739‒0.872) | (43.2‒73.7) | (88.8‒98.4) | (4.9‒29.0) | (0.3‒0.6) | (66.3‒94.5) | (76.2‒90.4) | ||
| PE/serum ratio | 1.1 | 0.882† | 84.1 | 94.1 | 14.2 | 0.2 | 86.0 | 93.1 |
| (0.818‒0.929) | (69.9‒93.4) | (87.5‒97.8) | (6.4‒31.1) | (0.1‒0.3) | (72.1‒94.7) | (86.4‒97.2) | ||
| ∆(PE–serum) | 0.4 | 0.881† | 84.1 | 96.0 | 21.2 | 0.2 | 90.2 | 93.3 |
| (0.817‒0.929) | (69.9‒93.4) | (90.2‒98.9) | (8.1‒56.0) | (0.1‒0.3) | (76.9‒97.3) | (86.6‒97.3) | ||
| CA125 | ||||||||
| PE | 383.9 | 0.548 | 77.3 | 36.6 | 1.2 | 0.6 | 34.7 | 78.7 |
| (0.463‒0.631) | (62.2‒88.5) | (27.3‒46.8) | (1.0‒1.5) | (0.3‒1.1) | (25.4‒45.0) | (64.3‒89.3) | ||
| Serum | 91.4 | 0.609 | 54.6 | 70.3 | 1.8 | 0.7 | 44.4 | 78.0 |
| (0.524‒0.688) | (38.8‒69.6) | (60.4‒79.0) | (1.2‒2.7) | (0.5‒0.9) | (30.9‒58.6) | (68.1‒86.0) | ||
| PE/serum ratio | 7.0 | 0.634† | 47.7 | 78.2 | 2.2 | 0.7 | 48.8 | 77.5 |
| (0.550‒0.712) | (32.5‒63.3) | (68.9‒85.8) | (1.4‒3.5) | (0.5‒0.9) | (33.3‒64.5) | (68.1‒85.1) | ||
| ∆(PE–serum) | 2765.3 | 0.557† | 11.4 | 100 | − | 0.9 | 100 | 72.1 |
| (0.473‒0.640) | (3.8‒24.6) | (96.4‒100) | − | (0.8‒1.0) | (47.8‒100) | (63.9‒79.4) | ||
| CA15-3 | ||||||||
| PE | 17.8 | 0.859† | 65.9 | 97.0 | 22.2 | 0.4 | 90.6 | 86.7 |
| (0.792‒0.912) | (50.1‒79.5) | (91.6‒99.4) | (7.1‒69.0) | (0.2‒0.5) | (75.0‒98.0) | (79.1‒92.4) | ||
| Serum | 18.0 | 0.797† | 65.9 | 84.2 | 4.2 | 0.4 | 64.4 | 85.0 |
| (0.722‒0.859) | (50.1‒79.5) | (75.6‒90.7) | (2.5‒6.8) | (0.3‒0.6) | (48.8‒78.1) | (76.5‒91.4) | ||
| PE/serum ratio | 1.0 | 0.722† | 59.1 | 85.2 | 4.0 | 0.5 | 63.4 | 82.7 |
| (0.641‒0.793) | (43.2‒73.7) | (76.7‒91.4) | (2.3‒6.7) | (0.3‒0.7) | (46.9‒77.9) | (74.0‒89.4) | ||
| ∆(PE–serum) | 4.9 | 0.669† | 50.0 | 98.0 | 25.3 | 0.5 | 91.7 | 81.8 |
| (0.586‒0.745) | (34.6‒65.4) | (93.0‒99.8) | (6.2‒102.8) | (0.4‒0.7) | (73.0‒99.0) | (73.8‒88.2) | ||
| CA19-9 | ||||||||
| PE | 11.1 | 0.667† | 54.6 | 94.1 | 9.2 | 0.5 | 80.0 | 82.6 |
| (0.584‒0.743) | (38.8‒69.6) | (87.5‒97.8) | (4.0‒20.9) | (0.3‒0.7) | (61.4‒92.3) | (74.4‒89.0) | ||
| Serum | 23.5 | 0.554 | 38.6 | 93.1 | 5.6 | 0.7 | 70.8 | 77.7 |
| (0.469‒0.637) | (24.4‒54.5) | (86.2‒97.2) | (2.5‒12.5) | (0.5‒0.8) | (48.4‒87.7) | (69.2‒84.8) | ||
| PE/serum ratio | 0.9 | 0.828† | 70.5 | 90.1 | 7.1 | 0.3 | 75.6 | 87.5 |
| (0.757‒0.886) | (54.8‒83.2) | (82.5‒95.1) | (3.8‒13.2) | (0.2‒0.5) | (59.7‒87.6) | (79.6‒93.2) | ||
| ∆(PE–serum) | −0.6 | 0.837† | 72.7 | 86.14 | 5.3 | 0.3 | 69.6 | 87.9 |
| (0.766‒0.893) | (57.2‒85.0) | (77.8‒92.2) | (3.1‒8.8) | (0.2‒0.5) | (54.2‒82.3) | (79.8‒93.6) | ||
*, data are presented as medians (25th to 75th percentiles); †, P<0.05. CEA, carcinoembryonic antigen; PE, pleural effusion; AUC, area under curve; PLR, positive likelihood ratio; NLR, negative likelihood ratio; PPV, positive predictive value; NPV, negative predictive value.
Figure S1.
ROC curves for each tumor marker in PE, serum, the PE/serum ratio and the ∆(PE–serum) value in the Beijing cohort. AUC: CEA (PE), 0.880; CEA (Serum), 0.801; CEA (PE/serum ratio), 0.858; CEA [∆(PE–serum)], 0.827; CA 125 (PE), 0.723; CA 125 (Serum), 0.511; CA 125 (PE/serum ratio), 0.737; CA 125 [∆(PE–serum)], 0.731; CA 15-3 (PE), 0.782; CA 15-3 (Serum), 0.695; CA 15-3 (PE/serum ratio), 0.748; CA 15-3 [∆(PE–serum)], 0.720; CA 19-9 (PE), 0.759; CA 19-9 (Serum), 0.710; CA 19-9 (PE/serum ratio), 0.732; CA 19-9 [∆(PE–serum)], 0.703. ROC, receiver operating characteristic; PE, pleural effusion; AUC, area under curve; CEA, carcinoembryonic antigen.
Figure S2.
ROC curves for each tumor marker in PE, serum, the PE/serum ratio and the ∆(PE–serum) value in the Wuhan cohort. AUC: CEA (PE), 0.886; CEA (Serum), 0.812; CEA (PE/serum ratio), 0.882; CEA [∆(PE–serum)], 0.881; CA 125 (PE), 0.548; CA 125 (Serum), 0.609; CA 125 (PE/serum ratio), 0.634; CA 125 [∆(PE–serum)], 0.557; CA 15-3 (PE), 0.859; CA 15-3 (Serum), 0.797; CA 15-3 (PE/serum ratio), 0.722; CA 15-3 [∆(PE–serum)], 0.669; CA 19-9 (PE), 0.667; CA 19-9 (Serum), 0.554; CA 19-9 (PE/serum ratio), 0.288; CA 19-9 [∆(PE–serum)], 0.837. ROC, receiver operating characteristic; PE, pleural effusion; AUC, area under curve; CEA, carcinoembryonic antigen.
Concentrations of CEA and CA 15-3 were stable, and the trend of best diagnostic parameters was consistent and similar in Beijing, Wuhan and the combined population in sensitivity, specificity, PLR, NLR, PPV and NPV. In the combined population, higher diagnostic accuracy (0.890) of CEA was shown by using PE (sensitivity, 84.7%; specificity, 90.9%), the PE/serum ratio (AUC, 0.862; sensitivity, 79.3%; specificity, 92.8%) and the ∆(PE–serum) (AUC, 0.849; sensitivity, 78.4%; specificity, 94.7%). Additionally, the greatest diagnostic accuracy (0.813) of CA 15-3 was shown by using PE (sensitivity, 63.1%; specificity, 97.6%). With the greatest cut-off value, the highest specificity was presented using the ∆(PE–serum): 94.7% specificity in CEA (sensitivity, 78.4%; PLR, 14.8; NLR, 0.2; PPV, 88.8%; NPV, 89.1%) and 98.6% specificity in CA 15-3 (sensitivity, 51.4%; PLR, 35.6; NLR, 0.5; PPV, 95.0%; NPV, 79.2%).
Although CA 125 and CA 19-9 could discriminate MPE from BPE in PE, serum, the PE/serum ratio and the ∆(PE–serum) value in the combined population (Table 3), the concentration of CA 125 in PE and serum as well as cut-off values differed greatly between the two cohorts, and the trend of best diagnostic parameters was in disaccord between Beijing, Wuhan and the combined population. Similar inconsistent data were also observed in CA 19-9, except for data in the PE/serum ratio (Table 2, Tables S1,S2).
For each TM to obtain a specificity of 100% in the total population, the sensitivity, NLR and NPV are shown in Table 4. The highest sensitivity (37.8%) using serum was presented in CEA, with 19.8% sensitivity in PE and 18.0% sensitivity in the ∆(PE–serum). For CA 15-3, the sensitivity was 32.4% in PE, 15.3% in the PE/serum ratio and 25.2% in the ∆(PE–serum).
Table 4. Diagnostic performance of different combinations of CEA, CA 125, CA 15-3 and CA 19-9 in differentiating malignant from benign pleural effusions in the total population studied (100% specificity) (n=327).
| Variable | Sensitivity (%) | NLR | NPV (%) |
|---|---|---|---|
| CEA | |||
| PE | 19.8 | 0.8 | 70.0 |
| (12.9‒28.5) | (0.7‒0.9) | (64.5‒75.2) | |
| Serum | 37.8 | 0.6 | 75.1 |
| (28.8‒47.5) | (0.5‒0.7) | (69.6‒80.1) | |
| PE/serum ratio | 0 | 1.0 | 65.1 |
| (0‒3.3) | (1.0‒1.0) | (59.6‒70.3) | |
| ∆(PE–serum) | 18.0 | 0.8 | 69.6 |
| (11.4‒26.4) | (0.8‒0.9) | (64.0‒74.7) | |
| CA 125 | |||
| PE | 7.2 | 0.9 | 66.9 |
| (3.2‒13.7) | (0.9‒1.0) | (61.3‒72.1) | |
| Serum | 0 | 1.0 | 65.2 |
| (0‒3.3) | (1.0‒1.0) | (59.7‒70.4) | |
| PE/serum ratio | 9.0 | 0.9 | 67.3 |
| (4.4‒15.9) | (0.9‒1.0) | (61.8‒72.5) | |
| ∆(PE–serum) | 7.2 | 0.9 | 66.9 |
| (3.2‒13.7) | (0.9‒1.0) | (61.3‒72.1) | |
| CA 15-3 | |||
| PE | 32.4 | 0.7 | 73.5 |
| (23.9‒42.0) | (0.6‒0.8) | (68.0‒78.5) | |
| Serum | 8.1 | 0.9 | 67.1 |
| (3.8‒14.8) | (0.9‒1.0) | (61.6‒72.3) | |
| PE/serum ratio | 15.3 | 0.9 | 68.9 |
| (9.2‒23.4) | (0.8‒0.9) | (63.3‒74.1) | |
| ∆(PE–serum) | 25.2 | 0.8 | 71.5 |
| (17.5‒34.4) | (0.7‒0.8) | (65.9‒76.6) | |
| CA 19-9 | |||
| PE | 34.2 | 0.7 | 74.0 |
| (25.5‒43.8) | (0.6‒0.8) | (68.5‒79.0) | |
| Serum | 10.8 | 0.9 | 67.8 |
| (5.7‒18.1) | (0.8‒1.0) | (62.2‒73.0) | |
| PE/serum ratio | 26.1 | 0.7 | 71.7 |
| (18.2‒35.3) | (0.7‒0.8) | (66.2‒76.8) | |
| ∆(PE–serum) | 31.5 | 0.7 | 73.2 |
| (23.0‒41.0) | (0.6‒0.8) | (67.7‒78.3) | |
CEA, carcinoembryonic antigen; PE, pleural effusion; NLR, negative likelihood ratio; NPV, negative predictive value.
Discussion
The diagnosis of MPE is a frequent problem in clinical practice, especially considering different etiologies of PEs, the treatments options and prognoses involved. Approximately 30–60% of MPEs have negative thoracentesis with cytopathologic study of the pleural fluid. However, conventional methods have been shown to have lower sensitivity and are inadequate (12). Although thoracoscopy and thoracotomy present approximately 90% diagnostic sensitivity for malignant patients (13), they are expensive and have a risk of death (14). The use of TMs offers the potential for a cost-effective and minimally invasive alternative in the diagnosis of pleural malignancy. Although several TMs have been repeatedly studied, a problem of insufficient overall diagnostic accuracy has consistently been encountered.
In our previous retrospective analysis, we investigated the association between the levels of CEA, CA 125, CA 15-3 and CA 19-9 in patients with BPE and MPE and the combined detection of TMs to diagnose etiology of PE (8). After reviewing the literature, we discovered that a majority of the published studies are single centered with no validated cohort. In the present study, we performed the first derivation and validation study in China to investigate diagnosis efficacy of CEA, CA 125, CA 15-3 and CA 19-9 in serum, PE, PE/serum and the ∆(PE–serum) in patients with BPE or MPE. Our results confirmed that TMs are useful tools in the differential diagnosis etiologies of effusions, with significantly higher concentrations in patients with MPE than in those with BPE (15). Additionally, we have shown that the sensitivity and specificity of each of the TMs for diagnose MPE. CEA and CA 15-3 are the two validated TMs that have performed consistently in this derivation and validation study. The present study was to assess the diagnostic value of TMs to differentiate between MPE and BPE other than MPE and a specific diseases such as tuberculosis. However, we also have compared the concentrations of TMs in groups of TPE and other BPE to find whether it’s necessary to compare TPE and other BPE separately (Table S3). The results show that there are no differences in concentrations of CEA, CA 125 and CA 19-9 in TPE and other BPE in Beijing cohort (derivation) and Wuhan cohort (validation). Although there are statistical differences in TPE and BPE in level of CA 15-3, these concentrations are far from that in MPE. Therefore, we calculated TPE and other BPE together.
Table S3. Comparison of concentrations of TMs in MPE, TPE and other BPE*.
| Variable | Beijing cohort (derivation) | Wuhan cohort (validation) | |||||||
|---|---|---|---|---|---|---|---|---|---|
| MPE (n=67) | TPE (n=61) | Other BPE (n=46) | P# | MPE (n=52) | TPE (n=78) | Non-TPE (n=23) | P# | ||
| CEA | |||||||||
| PE, ng/mL | 69.5 | 0.6 | 0.6 | − | 82.3 | 0.9 | 0.7 | − | |
| (7.7‒919.1) | (0.5‒1.0) | (0.5‒2.1) | (11.0‒832.8) | (0.5‒1.3) | (0.5‒1.6) | ||||
| Serum, ng/mL | 4.4 | 1.2 | 2.1 | − | 7.7 | 1.6 | 2.1 | − | |
| (2.1‒29.5) | (0.8‒2.2) | (1.3‒3.1) | (2.0‒43.9) | (0.9‒2.3) | (1.5‒3.1) | ||||
| PE/serum ratio | 10.2 | 0.6 | 0.5 | − | 7.2 | 0.6 | 0.4 | − | |
| (1.1‒29.7) | (0.5‒0.8) | (0.3‒0.8) | (1.5‒28.3) | (0.5‒0.7) | (0.2‒0.7) | ||||
| ∆PE–serum, ng/mL | 46.6 | −0.5 | −0.8 | − | 53.7 | −0.6 | −1.2 | − | |
| (0.3‒701.6) | (−0.9‒0.22) | (−1.4 to −0.3) | (4.2‒804.2) | (−1.2 to −0.3) | (−2.6 to −0.3) | ||||
| CA125 | |||||||||
| PE, U/mL | 946.7 | 407.9 | 298.7 | − | 657.8 | 637.1 | 543.6 | − | |
| (374.0‒2835.7) | (195.4‒831.2) | (90.8‒753.9) | (395.1‒1366.3) | (203.1‒983.7) | (320.3‒1209.5) | ||||
| Serum, U/mL | 90.7 | 112.2 | 86.8 | − | 85.2 | 132.1 | 124.1 | − | |
| (40.6‒229.2) | (66.1‒180.3) | (37.2‒168.3) | (44.1‒222.5) | (78.1‒214.8) | (92.0‒271.2) | ||||
| PE/serum ratio | 8.5 | 3.4 | 3.5 | − | 6.2 | 3.7 | 4.5 | − | |
| (4.4‒19.0) | (1.5‒7.3) | (1.2‒5.9) | (3.3‒12.7) | (1.9‒6.5) | (2.1‒7.4) | ||||
| ∆PE–serum, U/mL | 895.0 | 279.1 | 194.9 | − | 425.4 | 412.2 | 380.0 | − | |
| (280.2‒2046.8) | (72.1‒713.1) | (47.0‒482.0) | (205.3‒1058.6) | (119.4‒806.4) | (197.6‒1085.4) | ||||
| CA15-3 | |||||||||
| PE, U/mL | 30.1 | 6.6 | 3.5 | <0.001 | 47.6 | 7.7 | 2.2 | <0.001 | |
| (5.4‒91.7) | (4.6‒10.8) | (2.0‒7.6) | (11.8‒176.0) | (5.6‒10.1) | (1.4‒4.7) | ||||
| Serum, U/mL | 15.7 | 8.9 | 9.9 | − | 21.3 | 10.7 | 11.0 | − | |
| (8.8‒33.6) | (6.7‒12.5) | (6.8‒16.9) | (13.3‒70.8) | (6.8‒15.0) | (7.6‒18.0) | ||||
| PE/serum ratio | 1.3 | 0.7 | 0.4 | <0.001 | 1.1 | 0.8 | 0.3 | <0.001 | |
| (0.6‒3.5) | (0.6‒1.0) | (0.3‒0.6) | (0.5‒3.5) | (0.5‒0.9) | (0.1‒0.4) | ||||
| ∆PE–serum, U/mL | 8.4 | −1.9 | −6.1 | <0.001 | 4.2 | −2.1 | −6.4 | <0.001 | |
| (−4.1‒53.7) | (−4.9 to −0.1) | (−10.5 to −3.3) | (−6.6‒85.2) | (−5.3 to −0.7) | (−14.3 to −4.5) | ||||
| CA19-9 | |||||||||
| PE,U/mL | 24.8 | 2.0 | 2.0 | − | 13.0 | 2.8 | 2.0 | − | |
| (2.0‒1089.2) | (2.0‒3.0) | (2.0‒3.7) | (2.0‒291.2) | (2.0‒6.2) | (2.0‒3.5) | ||||
| Serum, U/mL | 14.4 | 4.3 | 6.9 | − | 8.8 | 7.2 | 7.7 | − | |
| (5.3‒61.3) | (2.2‒8.7) | (2.9‒16.1) | (2.5‒58.8) | (4.2‒12.6) | (2.7‒15.1) | ||||
| PE/serum ratio | 1.0 | 0.6 | 0.5 | − | 1.0 | 0.4 | 0.5 | − | |
| (0.6‒9.3) | (0.4‒1.0) | (0.3‒0.9) | (0.8‒8.8) | (0.3‒0.7) | (0.1‒0.9) | ||||
| ∆PE–serum, U/mL | 0 | −1.74 | −2.8 | − | 0.6 | −4.1 | −4.2 | − | |
| (−3.8‒425.4) | (−5.62‒0.0) | (−7.0 to −0.4) | (−0.9‒237.3) | (−7.6 to −1.4) | (−12.0 to −0.3) | ||||
*, data are presented as medians (25th to 75th percentiles); #, comparison between concentrations in TPE and other BPE. MPE, malignant pleural effusion; BPE, benign pleural effusion; PE, pleural effusion; TPE, tuberculosis pleural effusion; TMs, tumor markers; CEA, carcinoembryonic antigen.
Compared to the other three TMs, CEA has the greatest diagnostic accuracy to differentiate pleural malignancy, which is in accordance with a previous study (16). In the total population, the AUCs in the ROC analysis for PE, serum, PE/serum ratio and ∆(PE–serum) were 0.890, 0.806, 0.862 and 0.849, respectively. These parameters were similar in the Beijing and Wuhan cohorts, and they appear to have highly consistent performances in diagnosis. In the combined population, a higher accurate performance was shown, for example, 84.7% sensitivity and 90.9% specificity found in PE (cut-off: 2.42), 79.3% sensitivity and 92.8% specificity found in the PE/serum ratio (cut-off: 1.1), and 78.4% sensitivity and 94.7% specificity in the ∆(PE–serum) (cut-off: 0.4). CEA is a glycoprotein component of the glycocalyx of the epithelium that is expressed in various tumors especially those of epithelial origin. The application of a PE/serum ratio >1.1 could differentiate pleural malignancy, and it is suggested that an increased CEA level in MPE may be caused more by a more direct mechanism such as pleural invasion.
CA 15-3 is expressed in many normal and malignant tissues, including breast, lung and ovarian cancers, and its secretion is increased in the presence of a tumor. CA 15-3 is another TM with consistent performance validated in our two cohorts. In the total population, the specificity of PE samples was 97.6% indicating a potential role for CA 15-3 analysis in the confirmation of MPE. In contrast with the high specificity, the sensitivity of PE samples for CA 15-3 was only 63.1%, which is insufficient to exclude MPE. A specificity of 98.6% in the ∆(PE–serum) with a sensitivity of 51.4% also showed the same diagnostic performance. The results of one published meta-analysis, including 21 studies with a total of 2,861 cases, were similar to our study and showed that the sensitivity and specificity of CA 15-3 in the diagnosis of MPE were 0.58 (95% CI: 0.56–0.61) and 0.91 (95% CI, 0.90–0.93) (17). However, we suggest that CA 15-3 alone is not recommended due to its limited sensitivity.
CA 125 is particularly useful in diagnosing and detecting the recurrence of gynecologic tumors (18,19); this marker is also observed in patients with lung, breast and gastrointestinal tract cancer. Evaluated CA 19-9 is often found in patients with gastrointestinal tumors. In the present study, the levels of CA 125 and CA 19-9 were not similar in the Beijing and Wuhan populations. Further, the main problem in differential diagnosis is the cut-off value. For example, the cut-off value of CA 125 in PE, serum, and the ∆(PE–serum) ranges from 558.7 to 383.9 U/mL, 216.1 to 91.4 U/mL and 492.5 to 2765.3 U/mL in the Beijing and Wuhan populations, respectively. The cut-off value of CA 19-9 in PE, serum, and the ∆(PE–serum) ranges from 9.3 to 11.1 U/mL, 10.7 to 23.5 U/mL and 2.9 to −0.6 U/mL in the Beijing and Wuhan populations, respectively. Reasons to explain these discrepancies may be related to tumor heterogeneity and other known or unknown metastases. Because data for CA 125 and CA 19-9 are inconsistent between the two cohorts, this indicates that CA 125 and CA 19-9 may be not appropriate to diagnose the etiology of PE.
To the best of our knowledge, this is the first study to use the ∆(PE–serum) to diagnose MPE. Interestingly, this parameter is very useful to differentiate MPE. In the total population using CEA the sensitivity and specificity was 0.78 (95% CI, 0.70–0.86) and 0.95 (95% CI, 0.91–0.97) for the ∆(PE–serum) compared with 0.85 (95% CI, 0.77–0.91) and 0.91 (95% CI, 0.86–0.94) for PE. For CA 15-3, sensitivity was 0.51 (95% CI, 0.42–0.61) and specificity was 0.99 (95% CI, 0.96–1.00) in the ∆(PE–serum) compared with the parameters for PE with a sensitivity of 0.63 (95% CI, 0.53–0.72) and a specificity of 0.98 (95% CI, 0.95–1.00). With a specificity of 100%, the diagnosis performance of CEA in the ∆(PE–serum) was similar to that of PE. For CA 15-3, with a specificity of 100%, the performance of the ∆(PE–serum) was also better than the value of serum and only next to the value of PE to diagnose the etiology of MPE.
The present study demonstrated that TMs are useful in the differential diagnosis of MPE and BPE. After derivation and validation, we concluded that compared to CA 125 and CA 19-9, CEA and CA 15-3 are more reliable to perform diagnostic tests. The use of the ∆(PE–serum) in TMs, such as CEA and CA 15-3, may improve the sensitivity and specificity of the diagnosis etiology of PE.
Acknowledgements
We thank Miss. Fang Wang at the department of clinical examination, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, China, for excellent technical assistance with the measurement of TMs. We also thank physicians and nurses at the participating departments for inclusion of patients in the present study. We also thank the patients for their participation in this study.
Funding: This work was supported in part by grants from National Natural Science Foundation of China (No. 91442109, No. 31470883, and No. 81470274), in part by the Beijing Municipal Administration of Hospitals’ Mission Plan (No. SML20150301), and in part by Chinese Ministry of Science and Technology for the establishment of GCP evaluation system in respiratory diseases (2014ZX09303302).
Ethical Statement: The study was approved by the ethics committees of Beijing Chao-Yang Hospital (No. 2012-Ke-53) and Union Hospital (No. [2012]Lunshenzi(S092)), and all study participants provided written informed consent.
Footnotes
Conflicts of Interest: The authors have no conflicts of interest to declare.
References
- 1.Light RW. Clinical practice. Pleural effusion. N Engl J Med 2002;346:1971-7. 10.1056/NEJMcp010731 [DOI] [PubMed] [Google Scholar]
- 2.Maskell NA, Butland RJ, Pleural Diseases Group, et al BTS guidelines for the investigation of a unilateral pleural effusion in adults. Thorax 2003;58 Suppl 2:ii8-17. 10.1136/thx.58.suppl_2.ii8 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.Light RW. Tumor markers in undiagnosed pleural effusions. Chest 2004;126:1721-2. 10.1378/chest.126.6.1721 [DOI] [PubMed] [Google Scholar]
- 4.Shi HZ, Liang QL, Jiang J, et al. Diagnostic value of carcinoembryonic antigen in malignant pleural effusion: a meta-analysis. Respirology 2008;13:518-27. 10.1111/j.1440-1843.2008.01291.x [DOI] [PubMed] [Google Scholar]
- 5.Liang QL, Shi HZ, Qin XJ, et al. Diagnostic accuracy of tumour markers for malignant pleural effusion: a meta-analysis. Thorax 2008;63:35-41. 10.1136/thx.2007.077958 [DOI] [PubMed] [Google Scholar]
- 6.Trapé J, Molina R, Sant F. Clinical evaluation of the simultaneous determination of tumor markers in fluid and serum and their ratio in the differential diagnosis of serous effusions. Tumour Biol 2004;25:276-81. 10.1159/000081392 [DOI] [PubMed] [Google Scholar]
- 7.Trapé J, Molina R, Sant F, et al. Diagnostic accuracy of tumour markers in serous effusions: a validation study. Tumour Biol 2012;33:1661-8. 10.1007/s13277-012-0422-3 [DOI] [PubMed] [Google Scholar]
- 8.Gu Y, Zhai K, Shi HZ. Clinical Value of Tumor Markers for Determining Cause of Pleural Effusion. Chin Med J (Engl) 2016;129:253-8. 10.4103/0366-6999.174501 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Light RW, Macgregor MI, Luchsinger PC, et al. Pleural effusions: the diagnostic separation of transudates and exudates. Ann Intern Med 1972;77:507-13. 10.7326/0003-4819-77-4-507 [DOI] [PubMed] [Google Scholar]
- 10.Hanley JA, McNeil BJ. A method of comparing the areas under receiver operating characteristic curves derived from the same cases. Radiology 1983;148:839-43. 10.1148/radiology.148.3.6878708 [DOI] [PubMed] [Google Scholar]
- 11.Deeks JJ, Altman DG. Diagnostic tests 4: likelihood ratios. BMJ 2004;329:168-9. 10.1136/bmj.329.7458.168 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Sriram KB, Relan V, Clarke BE, et al. Diagnostic molecular biomarkers for malignant pleural effusions. Future Oncol 2011;7:737-52. 10.2217/fon.11.45 [DOI] [PubMed] [Google Scholar]
- 13.Gourgoulianis KI, Hatzoglou CH, Molyvdas PA. The major route for absorption of fluid from the pleural space. Lymphology 2002;35:97-8. [PubMed] [Google Scholar]
- 14.Maturu VN, Dhooria S, Bal A, et al. Role of medical thoracoscopy and closed-blind pleural biopsy in undiagnosed exudative pleural effusions: a single-center experience of 348 patients. J Bronchology Interv Pulmonol 2015;22:121-9. 10.1097/LBR.0000000000000145 [DOI] [PubMed] [Google Scholar]
- 15.Shitrit D, Zingerman B, Shitrit AB, et al. Diagnostic value of CYFRA 21-1, CEA, CA 19-9, CA 15-3, and CA 125 assays in pleural effusions: analysis of 116 cases and review of the literature. Oncologist 2005;10:501-7. 10.1634/theoncologist.10-7-501 [DOI] [PubMed] [Google Scholar]
- 16.Korczynski P, Krenke R, Safianowska A, et al. Diagnostic utility of pleural fluid and serum markers in differentiation between malignant and non-malignant pleural effusions. Eur J Med Res 2009;14 Suppl 4:128-33. 10.1186/2047-783X-14-S4-128 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Wu Q, Li M, Zhang S, et al. Clinical diagnostic utility of CA 15-3 for the diagnosis of malignant pleural effusion: A meta-analysis. Exp Ther Med 2015;9:232-8. 10.3892/etm.2014.2039 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Osman N, O'Leary N, Mulcahy E, et al. Correlation of serum CA125 with stage, grade and survival of patients with epithelial ovarian cancer at a single centre. Ir Med J 2008;101:245-7. [PubMed] [Google Scholar]
- 19.Hirsch M, Duffy J, Davis CJ, et al. Diagnostic accuracy of cancer antigen 125 for endometriosis: a systematic review and meta-analysis. BJOG 2016;123:1761-8. 10.1111/1471-0528.14055 [DOI] [PubMed] [Google Scholar]