Abstract
Introduction
Circulating tumor cells (CTCs) have been studied in breast cancer with the CellSearch® system. Given the low CTC counts in non-metastatic breast cancer, it is important to evaluate the inter-reader agreement.
Methods
CellSearch® images (N = 272) of either CTCs or white blood cells or artifacts from 109 non-metastatic (M0) and 22 metastatic (M1) breast cancer patients from reported studies were sent to 22 readers from 15 academic laboratories and 8 readers from two Veridex laboratories. Each image was scored as No CTC vs CTC HER2- vs CTC HER2+. The 8 Veridex readers were summarized to a Veridex Consensus (VC) to compare each academic reader using % agreement and kappa (κ) statistics. Agreement was compared according to disease stage and CTC counts using the Wilcoxon signed rank test.
Results
For CTC definition (No CTC vs CTC), the median agreement between academic readers and VC was 92% (range 69 to 97%) with a median κ of 0.83 (range 0.37 to 0.93). Lower agreement was observed in images from M0 (median 91%, range 70 to 96%) compared to M1 (median 98%, range 64 to 100%) patients (P < 0.001) and from M0 and <3CTCs (median 87%, range 66 to 95%) compared to M0 and ≥3CTCs samples (median 95%, range 77 to 99%), (P < 0.001). For CTC HER2 expression (HER2- vs HER2+), the median agreement was 87% (range 51 to 95%) with a median κ of 0.74 (range 0.25 to 0.90).
Conclusions
The inter-reader agreement for CTC definition was high. Reduced agreement was observed in M0 patients with low CTC counts. Continuous training and independent image review are required.
Introduction
Circulating tumor cells (CTCs) can be identified in the peripheral blood of patients with solid tumors even in early disease stages and their detection and characterization have the potential to lead towards personalized treatment strategies in breast and other cancers [1-3].
Several technologies exist for CTC detection, but CellSearch® (Veridex, Raritan, NJ, USA) is the only one that has received Food and Drug Administration (FDA) clearance to be used as an aid in monitoring patients with metastatic breast, colorectal and prostate cancer. Compared to other CTC assays [4], CellSearch® is so far the only semi-automated system and has contributed considerably to the development of standards for CTC enumeration. In breast cancer, a multicenter study has shown that ≥5 CTCs/7.5 ml of blood were detected in 49% of 177 patients before starting a new treatment for metastatic disease and their detection was independently associated with worse progression-free and overall survival (PFS and OS) [5]. Subsequently, other studies have confirmed these results [6-8]. The value of CTC detection by CellSearch® in non-metastatic breast cancer has recently been emerging. Indeed, detection of ≥1 CTC/7.5 ml was reported in 23% of 115 patients with large operable and locally advanced breast cancer before neoadjuvant chemotherapy and was independently associated with worse outcome [9]. In another study, detection of ≥1 CTC/7.5 ml by CellSearch® at the time of surgery and before the administration of adjuvant chemotherapy in 24% of 302 patients was associated with decreased PFS and OS [10]. In the SUCCESS study, ≥1 CTC/23 ml were detected by CellSearch® in 21.5% of 2,026 patients with early breast cancer before adjuvant chemotherapy and the detection was independently associated with poor outcome [11]. In another study ≥1 CTC/30 ml of blood were detected in 19% of 404 patients with stage-I to -III breast cancer before surgery and their detection was independently associated with shorter distant disease-free survival [12]. Beyond enumeration, CTC characterization holds the promise to serve as a liquid biopsy to tailor treatment decisions [1,2]. As an example, as HER2 protein overexpression or gene amplification in the primary tumor is currently required for administering anti-HER2 treatment in breast cancer [13], HER2 status on CTCs has also been investigated in breast cancer using CellSearch® and other technologies [14-18].
More than 400 studies have included CTCs as a biomarker [19]. These include interventional studies assessing the value of CTCs as a treatment decision tool in the metastatic and non-metastatic setting [20,21]. Two studies have validated the analytical performance of CellSearch® for CTC detection in metastatic breast cancer [22,23]. In the metastatic setting, the main contributor to inter-laboratory variation was variability among the readers in image interpretation [23,24]. In non-metastatic breast cancer (BC) more than half of women with detectable CTCs have only 1 CTC/blood volume processed [9-12]. Therefore, in this setting, image interpretation is crucial, especially if CTC detection is to be used as a tool to decide on secondary adjuvant treatment strategies in the context of a clinical trial. Moreover, no study has addressed potential problems in image interpretation when HER2 expression on CTCs is investigated using CellSearch®, which is an important prerequisite for interventional studies using CTCs in trials testing HER2-directed therapies.
Therefore, we performed an international study to evaluate the inter-reader agreement in the classification of CellSearch® images as CTC and interpretation of HER2-staining on these images. Moreover, we came up with consensus guidelines for image interpretation in the non-metastatic breast cancer setting that were subsequently endorsed by CTC experts participating in this study.
Methods
Patient and samples
CellSearch® images from blood samples used for the detection of CTCs and characterization of CTC HER2 protein expression by CellSearch® from breast cancer patients were retrieved for this study. The blood samples were processed at one of the three different laboratories; the Institut Jules Bordet, Belgium (IJB), the Institut Curie, France (IC), and the University of Hamburg, Germany (UH), respectively. The IJB dataset included CellSearch® images from women with non-metastatic (M0) and metastatic (M1) breast cancer treated according to the standard of care in Belgium [17]. The IC dataset consisted of CellSearch® images from women with inflammatory M0 breast cancer participating in the BEVERLY-I and -II phase-2 trials [25,26]. The UH dataset included CellSearch® images from women receiving neoadjuvant chemotherapy in the GeparQuattro and GeparQuinto studies (M0 cohort) [16,27] and women from the Detect Study (M1 cohort) [18]. From each patient sample, a subset of CellSearch® images (images of either CTCs or white blood cells or artifacts) and not the full set of CellSearch® images were provided by investigators from the three independent, academic labs to the principal investigator at IJB who was responsible for the central coordination of the study. Due to technology limitations, at the time the study was initiated, it was not possible to send the full set of CellSearch® images from each patient sample. All CellSearch® images used in the present study are from previously reported studies of CTC detection in breast cancer [16-18,25-27]. All women participating in these studies provided informed consent and each study was approved by the respective institutions' ethical committees. The present study was approved by the IJB ethical committee (CE 2035). Informed consent for the present study was waived by the IJB ethical committee.
Readers
The IJB lab sent the blinded CellSearch® images by email to twenty-two readers from one US and fourteen European academic laboratories as well as to eight readers from two Veridex laboratories. Each CellSearch® image was evaluated independently of the other images. All readers had already received the appropriate training provided by Veridex for the CellSearch® system, which includes training in image interpretation.
Definition of CTC and HER2-positive CTC
In CellSearch®, a CTC is defined as an epithelial cell adhesion molecule (EpCAM)-positive cell (round to oval and sometimes polygonal or elongated in shape and at least 4 μm in size) that has positive immunofluoresence staining for a Cytokeratin (CK) (clone C11 and A53-B/A2) epithelial marker and positive staining for the nuclear dye 4',6-diamidino-2-phenylindole (DAPI) (the nuclear area should be smaller than the cytoplasmic area and at least 50% of the nucleus should be co-located with the cytoplasm). The CTC must also be negative for the leukocyte marker CD45. For this study, the readers were asked to score CTCs with HER2 immunofluoresence staining intensity of 2+, 3+ as HER2-positive and were provided with reference CellSearch® images from breast cancer cell lines (MCF7, BT20, T47D, MDA-MB-453, SKBR3, BT474) with different levels of HER2 expression according to Riethdorf et al. [16]. The readers scored each image as follows: No CTC, CTC/HER2-negative (CTC HER2-), or CTC/HER2-positive (CTC HER2+).
Statistics
Results from the eight Veridex readers were summarized to a Veridex consensus (VC) in order to compare each academic reader using percentage (%) agreement and kappa (κ) statistics. We followed the Koch and Landis classification to interpret obtained κ values: concordance was considered bad if κ was less than 0.20, poor if κ was 0.20 to 0.40, moderate if κ was 0.40 to 0.60, good if κ was 0.60 to 0.80, and almost perfect if κ was above 0.81 [28]. VC was reached when there was >60% agreement between Veridex readers as to whether or not an image was a CTC. When there was <60% agreement by the Veridex readers for an image, this image was not included in any of the subsequent comparisons. If the VC was that the image was a CTC, then there had to be >60% agreement on the CTC being either HER2- or HER2+. If there was <60% agreement about the HER2 positivity or negativity among the Veridex readers for a CTC, this image was not included in any of the subsequent comparisons.
For each of the 22 academic readers, percentage (%) agreement with VC was calculated for the CTC detection question (no CTC versus CTC) and for the question of HER2 expression on CTCs (CTC HER2- versus CTC HER2+). In order to understand problems related to CellSearch® image interpretation, we compared the locations in the distributions of the agreement (%) between VC and the academic readers according to the dataset (IJB versus IC versus UH), disease stage (M0 versus M1), number of detected CTCs in the entire sample (≥5 CTCs versus <5 CTCs) and administration of systemic treatment before blood sampling (yes versus no) using non-parametric tests (Wilcoxon signed rank and Freedman test). Moreover, within M0 patient samples, we interrogated whether there was different agreement according to the number of CTCs detected in the entire sample (≥3 CTCs versus <3 CTCs) using the Wilcoxon signed rank test. Finally, we studied CellSearch® images with <70% agreement between VC and academic readers in order to understand reasons for discordance between readers.
Results
CellSearch® images and patient characteristics
A total of 272 CellSearch® images from 131 patients were analyzed. Table 1 provides information on relevant study demographics. The majority of CellSearch® images analyzed were from patients with M0 breast cancer, with <5 CTCs in their blood sample and from patients for whom blood sampling for CTC detection was performed before the administration of systemic treatment (Table 1).
Table 1.
CellSearch® images and patient characteristics
| |
Patients, number (%) |
CellSearch® images, number (%) |
|---|---|---|
| n = 131 (100%) | n = 272 (100%) | |
|
Dataset |
|
|
| Institute Jules Bordet |
34 (26) |
60 (22) |
| Institute Curie |
60 (46) |
114 (42) |
| University of Hamburg |
37 (28) |
98 (36) |
|
Age, years |
|
|
| ≤50 |
58 (44) |
108 (40) |
| >50 |
66 (51) |
147 (54) |
| Unknown |
7 (5) |
17 (6) |
|
ER |
|
|
| Negative |
54 (41) |
106 (39) |
| Positive |
68 (52) |
139 (51) |
| Unknown |
9 (7) |
27 (10) |
|
HER2 |
|
|
| Negative |
103 (79) |
193 (71) |
| Positive |
15 (11) |
44 (16) |
| Unknown |
13 (10) |
35 (13) |
|
Histology grade |
|
|
| 1 |
5 (4) |
6 (2) |
| 2 |
46 (35) |
85 (31) |
| 3 |
69 (53) |
147 (54) |
| Unknown |
11 (8) |
34 (13) |
|
Histology |
|
|
| Ductal |
99 (76) |
202 (74) |
| Lobular |
10 (8) |
12 (4) |
| Other |
7 (5) |
18 (7) |
| Unknown |
15 (11) |
40 (15) |
|
Stage |
|
|
| M0 |
109 (83) |
215 (79) |
| M1 |
22 (17) |
57 (21) |
|
CTC count
1
|
|
|
| <5 CTCs |
90 (69) |
150 (55) |
| ≥5 CTCs |
40 (30) |
120 (44) |
| Unknown |
2 (1) |
2 (1) |
|
Systemic therapy before blood sample collection
2
|
|
|
| No |
87 (65) |
168 (62) |
| Yes |
31 (24) |
62 (23) |
| Unknown | 15 (11) | 42 (15) |
1One patient with two samples (<5 CTCs and ≥ 5CTCs) was included; 2two patients with samples before and after treatment were included. ER, estrogen receptor; CTC, circulating tumor cell; M0, non-metastatic; M1, metastatic.
Veridex consensus (VC)
For each image, the results from the eight Veridex readers were summarized to a VC, as explained in the Methods section. For CTC detection, VC was reached for 267 (98%) of 272 images with an average percent agreement for CTC versus no CTC between the eight Veridex readers of 97% (median 100%, range 63% to 100%). Of the 267 images, 157 (59%) were considered CTCs. For interpretation of HER2 staining on the CTC, VC was obtained for 155 (99%) out of 157 CTCs with an average percent agreement for HER2- versus HER2+ between the eight Veridex readers of 98% (median 100%, range 63% to 100%): 71 (46%) of 155 CTCs were considered as HER2 + .
Agreement between academic readers and Veridex consensus for CTC definition
For the question of whether an image was a CTC (no CTC versus CTC), the median agreement between the academic readers and VC was 92% (range 69% to 97%), with a median κ statistic of 0.83 (range 0.37 to 0.93) (Table 2). We then asked whether agreement between the academic readers and VC was different according to the dataset (IJB versus IC versus UH), disease stage (M0 versus M1), CTC counts (<5 versus ≥5) and administration of systemic treatment before blood sampling (yes versus no). We observed significantly lower agreement between academic readers and VC for CellSearch® images from patients of the IJB dataset compared to the other datasets, from patients with M0 compared to M1 disease, <5 CTCs compared to ≥5 CTCs, and blood samples drawn after the administration of systemic treatment as compared to samples drawn before systemic treatment (Table 3, Additional file 1: Table S1 and Additional file 2: Table S2, online). CellSearch® images from samples with <5 CTCs were present more frequently in M0 (146 of 213 images, 68%) compared to M1 patients (4 of 57 images, 7%) (Pearson chi-square test, P <0.001) and in the IJB dataset, (52 of 60 images, 87%) compared to the UH (22 of 96 images, 22%) and the IC dataset (76 of 114 images, 67%) (P <0.001). When only images from M0 patients samples were analyzed, lower agreement was observed for images from samples with <3 CTCs (median 87%, range 66% to 95%) compared to those from samples where ≥ 3CTCs were detected (median 95%, range 77% to 99%), (P <0.001).
Table 2.
Agreement (%) between academic readers and Veridex consensus (VC)
| |
No CTC versus CTC |
|
|
CTC HER2- versus CTC HER2+ |
|
|||
|---|---|---|---|---|---|---|---|---|
| RDs | N | Agreement (%) | Kappa statistic | Kappa agreement | N | Agreement (%) | Kappa statistic | Kappa agreement |
| A |
267 |
91.8% |
0.83 |
Almost perfect |
155 |
81.3% |
0.63 |
Substantial |
| B |
267 |
91.4% |
0.82 |
Almost perfect |
155 |
81.3% |
0.63 |
Substantial |
| C |
267 |
92.5% |
0.84 |
Almost perfect |
155 |
90.3% |
0.81 |
Almost perfect |
| D |
267 |
91.8% |
0.83 |
Almost perfect |
155 |
71.6% |
0.47 |
Moderate |
| E |
266 |
95.1% |
0.90 |
Almost perfect |
154 |
93.5% |
0.87 |
Almost perfect |
| F |
267 |
92.1% |
0.84 |
Almost perfect |
155 |
87.1% |
0.75 |
Substantial |
| G |
267 |
91.4% |
0.82 |
Almost perfect |
155 |
91.0% |
0.82 |
Almost perfect |
| H |
267 |
91.4% |
0.82 |
Almost perfect |
155 |
88.4% |
0.78 |
Substantial |
| I |
267 |
92.1% |
0.84 |
Almost perfect |
155 |
91.6% |
0.84 |
Almost perfect |
| J |
267 |
83.9% |
0.65 |
Substantial |
155 |
76.8% |
0.55 |
Moderate |
| K |
220 |
87.3% |
0.74 |
Substantial |
117 |
79.5% |
0.59 |
Moderate |
| L |
266 |
92.9% |
0.85 |
Almost perfect |
154 |
94.8% |
0.90 |
Almost perfect |
| M |
220 |
87.3% |
0.74 |
Substantial |
117 |
90.6% |
0.82 |
Almost perfect |
| N |
267 |
95.9% |
0.92 |
Almost perfect |
155 |
92.3% |
0.85 |
Almost perfect |
| O |
267 |
96.6% |
0.93 |
Almost perfect |
155 |
92.9% |
0.86 |
Almost perfect |
| P |
267 |
94.4% |
0.88 |
Almost perfect |
155 |
85.2% |
0.72 |
Substantial |
| Q |
218 |
91.7% |
0.83 |
Almost perfect |
113 |
84.1% |
0.69 |
Substantial |
| R |
218 |
91.7% |
0.83 |
Almost perfect |
113 |
85.8% |
0.73 |
Substantial |
| S |
220 |
92.7% |
0.85 |
Almost perfect |
117 |
86.3% |
0.73 |
Substantial |
| T |
266 |
69.2% |
0.37 |
Fair |
154 |
51.3% |
0.25 |
Fair |
| U |
267 |
91.4% |
0.82 |
Almost perfect |
155 |
91.0% |
0.82 |
Almost perfect |
| V | 220 | 91.8% | 0.84 | Almost perfect | 117 | 82.1% | 0.66 | Substantial |
CTC, circulating tumor cell; RDs, readers; N, number of images. Kappa Agreement, below 0.00 Poor; 0.00 to 0.20 Slight; 0.21 to 0.40 Fair; 0.41 to 0.60 Moderate; 0.61 to 0.80 Substantial; 0.81 to 1.00 Almost Perfect.
Table 3.
Percent agreement between academic readers and Veridex consensus (VC) overall and according to dataset, disease stage, circulating tumor cell (CTC) count and administration of systemic therapy before blood sample collection
| |
Agreement, % |
|
|
|---|---|---|---|
| Median | Range | P -value | |
|
All |
92 |
69 to 97 |
|
|
Dataset |
|
|
|
| Institute Jules Bordet |
81 |
61 to 97 |
<0.001 |
| Institute Curie |
97 |
73 to 99 |
|
| University of Hamburg |
94 |
69 to 98 |
|
|
Stage |
|
|
|
| M0 |
91 |
70 to 96 |
<0.001 |
| M1 |
98 |
64 to 100 |
|
|
CTC count |
|
|
|
| <5 CTCs |
88 |
66 to 95 |
<0.001 |
| ≥5 CTCs |
97 |
74 to 100 |
|
|
Systemic therapy before blood sample collection |
|
|
|
| No |
92 |
74 to 96 |
<0.001 |
| Yes | 89 | 55 to 97 | |
CTC, circulating tumor cell; M0, Non-metastatic, M1, metastatic.
Agreement between academic readers and Veridex consensus (VC) for HER2 expression on CTCs
When only the images that were CTCs according to VC were analyzed for HER2 protein expression (CTC HER2- versus CTC HER2+), the median agreement between the academic readers and VC was 87% (range 51% to 95%), with a median κ statistic of 0.74 (range 0.25 to 0.90) (Table 2).
Analysis of CellSearch® images with <70% agreement between academic readers and Veridex consensus (VC)
There were many images with excellent agreement between academic readers and VC, such as images of intact CTCs (Figure 1A). In order to understand the reasons for discordance in image interpretation, we focused on images with <70% agreement between the academic readers and VC. We identified 25 images with <70% agreement for the CTC question (CTC versus no CTC) and 14 images with <70% agreement for the HER2 expression question (HER2- versus HER2+ CTCs). Disagreement was observed for images of CTCs with CK staining that surrounded the nucleus but was either incomplete or granular (Figure 1B). A total of 16 of the 25 images with <70% agreement for the CTC question were considered by some academic readers as CTCs, whereas the VC was that these images were not CTCs. These included images displaying the same morphology in all channels (Figure 1C,D) or a nucleus larger than the cytoplasm or <50% inside the cytoplasm and with cytokeratin (CK) staining not surrounding the nucleus (Figure 1E,F). Images with <70% agreement between academic readers and VC for the HER2 expression question were images from CTCs with intermediate HER2 staining (neither too strong nor absent).
Figure 1.
Example of an intact circulating tumor cell (CTC) (A), a granular CTC (B) and of images with no CTCs (C,D,E,F) as they display the same morphology in all channels (C,D) or have a nucleus larger than the cytoplasm or not 50% inside the cytoplasm and cytokeratin staining not surrounding the nucleus (E,F). DAPI, 4',6-diamidino-2-phenylindole.
Discussion
To our knowledge, this is the first study to evaluate the inter-reader agreement for CTC detection in both M1 and M0 breast cancer in a large international multicenter study comprising 15 centers from Europe and the United States. Our results show that the inter-reader agreement is high for CTC definition and for characterizing HER2 expression on CTCs.
Lower inter-reader agreement for CTC definition was observed for CellSearch® images of samples from patients with M0 disease, with low CTC counts, samples from the IJB dataset, and samples drawn after the administration of systemic treatment. CellSearch® images of samples with low CTC counts were more frequently observed in the IJB compared to the other datasets and in M0 compared to M1 disease and this can partly explain the lower inter-reader agreement in these groups. In a recently reported study of CTC detection by CellSearch® at the time of surgery in patients with early breast cancer, increasing CTC counts were associated with increasing hazard ratio (HR) for disease progression. The presence of ≥1 CTC, ≥2 CTCs and ≥3 CTCs was associated with a HR of 4.6, 5.5 and 6.7, respectively [10]. Although, this increase in HRs can be attributed to the increase in the number of CTCs, the data from the present analysis imply that this might be also due to the lower false CTC-positive cases in women with increasing CTC counts. Finally, a possible explanation for the lower inter-reader agreement in samples drawn after the administration of systemic treatment is the presence in these samples of granular CTCs that have been demonstrated to be mainly apoptotic, and to be a source of inter-reader disagreement in a previous study [23].
There are some limitations in the way the present validation study was conducted. Although CellSearch® image selection was performed by three independent, academic laboratories, a selection bias towards either CellSearch® images that are easy (typical CTC images) or difficult to interpret (not typical CTC images) cannot be excluded. Moreover, the readers were provided with a subset of CellSearch® images (images of either CTCs or white blood cells or artifacts) and not the full set of CellSearch® images from each patient sample. Therefore, a bias in image selection cannot be excluded. Moreover, the readers were scoring images but were not able to use the Cell Select tool of the CellSearch® system, which allows relocation of a cellular image in the cartridge and study of its characteristics in more detail. As the technology evolves, one can imagine that the exchange of CellSearch® images for central image review will be more easily performed.
The above limitations may partly explain some of the discrepancies observed between readers. Although overall inter-reader agreement was high, agreement was lower in images from M0 patients with <3 CTCs. In order to improve the performance of academic readers, especially in the setting of non-metastatic breast cancer with low CTC counts, we propose the following: 1) images displaying identical morphology in all channels (CK, DAPI and HER2 if performed) or images with a nucleus larger than the cytoplasm or <50% inside the cytoplasm should not be considered as CTCs; 2) the authors reporting studies on CTCs using CellSearch® should clearly indicate whether their CTC definition includes only intact CTCs (complete CK staining surrounding the nucleus) or whether it also includes granular CTCs (CK staining that surrounds the nucleus but is either granular or incomplete); 3) in cases of blood samples from M0 patients with low CTC counts (<3 CTCs) evaluation of images by at least two independent readers - ideally from different labs - should be performed. Such an independent image review is applied in the ongoing European Organization for Research and Treatment of Cancer (EORTC) Treat CTC trial (ClinicalTrials.gov Identifier: NCT01548677). This trial is testing the value of CTC detection to decide for secondary adjuvant treatment in BC.
We propose that investigators conducting studies on CTCs in non-metastatic breast cancer follow these guidelines for CellSearch® image interpretation. The present study might also be a model for similar experiments regarding other image-based CTC technologies. This could facilitate consistent result interpretation across studies on CTC detection and characterization, and accelerate the clinical development of CTC-related biomarkers.
Conclusions
This is the first study to evaluate the inter-reader agreement for CTC detection in both metastatic and non-metastatic BC in a large international multicenter study comprising 15 centers from Europe and the United States. We demonstrated that inter-reader agreement using CellSearch® was high overall but was reduced in non-metastatic breast cancer patients with low CTC counts. This study resulted in consensus guidelines for image interpretation for CTC detection in non-metastatic breast cancer. Continuous training, independent image review and adherence to these consensus guidelines should be considered in studies evaluating the clinical utility of CTC-related biomarkers in non-metastatic breast cancer.
Abbreviations
BC: breast cancer; CK: cytokeratin; CTCs: circulating tumor cells; DAPI: 4',6-diamidino-2-phenylindole; EORTC: European Organization for Research and Treatment of Cancer; EpCAM: epithelial cell adhesion molecule; FDA: Food and Drug Administration; HR: hazard ratio; IC: Institut Curie; IJB: Institut Jules Bordet; M0: non-metastatic; M1: metastatic; OS: overall survival; PFS: progression-free survival; UH: University of Hamburg; VC: Veridex consensus.
Competing interests
Michail Ignatiadis, Francois-Clement Bidard, Stefan Sleijfer, Wolfgang Janni, Brigitte Rack, Leon Terstappen, Jean-Yves Pierga and Klaus Pantel have received research support from CellSearch®, Veridex. Michail Ignatiadis, Francois-Clement Bidard, Stefan Sleijfer, Leon Terstappen, Jean-Yves Pierga and Klaus Pantel have received consultancy fees from CellSearch®, Veridex. All other authors have no conflict of interest to declare.
Authors’ contributions
MI, CM, SM, KP were involved in study conception and design. All authors were involved in acquisition, analysis, or interpretation of data for this study. MI wrote the manuscript. All authors provided input by revising the manuscript critically for important intellectual content. All authors read and approved the final version of the manuscript.
Supplementary Material
Agreement (%) between academic readers and Veridex consensus (VC) according to dataset and disease stage. Description of data: we observed significantly lower agreement between academic readers and VC for CellSearch® images from patients of the Institut Jules Bordet (IJB) dataset compared to the other datasets and from patients with non-metastatic (M0) compared to metastatic (M1) disease.
Agreement (%) between academic readers and Veridex consensus (VC) according to circulating tumor cell (CTC) count and administration of systemic therapy before blood sample collection. Description of data: we observed significantly lower agreement between academic readers and VC for CellSearch® images from patients with <5 CTCs compared to ≥5 CTCs and blood samples drawn after the administration of systemic treatment as compared to samples drawn before systemic treatment.
Contributor Information
Michail Ignatiadis, Email: michail.ignatiadis@bordet.be.
Sabine Riethdorf, Email: s.riethdorf@uke.uni-hamburg.de.
François-Clement Bidard, Email: Francois-Clement.Bidard@curie.fr.
Isabelle Vaucher, Email: isabelle.vaucher@curie.net.
Mustapha Khazour, Email: mustapha.khazour@curie.net.
Françoise Rothé, Email: francoise.rothe@bordet.be.
Jessica Metallo, Email: jessouille@hotmail.com.
Ghizlane Rouas, Email: ghizlane.rouas@bordet.be.
Rachel E Payne, Email: rachel_e_payne@hotmail.com.
Raoul Charles Coombes, Email: c.coombes@imperial.ac.uk.
Ingrid Teufel, Email: Ingrid.Teufel@med.uni-tuebingen.de.
Ulrich Andergassen, Email: Ulrich.Andergassen@med.uni-muenchen.de.
Stella Apostolaki, Email: sapostolakh@yahoo.gr.
Eleni Politaki, Email: lenapolitaki@yahoo.gr.
Dimitris Mavroudis, Email: mavrudis@med.uoc.gr.
Silvia Bessi, Email: sbessi@usl4.toscana.it.
Marta Pestrin, Email: mpestrin@usl4.toscana.it.
Angelo Di Leo, Email: adileo@usl4.toscana.it.
Michael Campion, Email: Campion.Michael@mayo.edu.
Monica Reinholz, Email: monica.reinholz@ventana.roche.com.
Edith Perez, Email: perez.edith@mayo.edu.
Martine Piccart, Email: martine.piccart@bordet.be.
Elin Borgen, Email: Elin.Borgen@oslo-universitetssykehus.no.
Bjorn Naume, Email: Bjorn.Naume@radiumhospitalet.no.
Jose Jimenez, Email: jjimenez@vhebron.net.
Claudia Monica Aura, Email: cmaura@vhebron.net.
Laura Zorzino, Email: laura.zorzino@ieo.it.
Maria Cristina Cassatella, Email: maria.cassatella@ieo.it.
Maria Teresa Sandri, Email: maria.sandri@ieo.it.
Bianca Mostert, Email: b.mostert@erasmusmc.nl.
Stefan Sleijfer, Email: s.sleijfer@erasmusmc.nl.
Jaco Kraan, Email: j.kraan@erasmusmc.nl.
Wolfgang Janni, Email: wolfgang.janni@uniklinik-ulm.de.
Tanja Fehm, Email: tanja.fehm@med.uni-duesseldorf.de.
Brigitte Rack, Email: Brigitte.Rack@med.uni-muenchen.de.
Leon Terstappen, Email: l.w.m.m.terstappen@utwente.nl.
Madeline Repollet, Email: MRepolle@its.jnj.com.
Jean-Yves Pierga, Email: jean-yves.pierga@curie.net.
Craig Miller, Email: CMiller3@ITS.jnj.com.
Christos Sotiriou, Email: christos.sotiriou@bordet.be.
Stefan Michiels, Email: stefan.michiels@igr.fr.
Klaus Pantel, Email: pantel@uke.uni-hamburg.de.
Acknowledgements
Michail Ignatiadis has received grants from Breast Cancer Research Foundation (BCRF), Fonds de la recherche scientifique FNRS, MEDIC foundation and Les Amis de l’ Institut Bordet. No further funding was provided for this study.
References
- Pantel K, Brakenhoff RH, Brandt B. Detection, clinical relevance and specific biological properties of disseminating tumour cells. Nat Rev Cancer. 2008;8:329–340. doi: 10.1038/nrc2375. [DOI] [PubMed] [Google Scholar]
- Ignatiadis M, Reinholz MM. Minimal residual disease and circulating tumor cells in breast cancer. Breast Cancer Res. 2011;13:222. doi: 10.1186/bcr2906. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Zhang L, Riethdorf S, Wu G, Wang T, Yang K, Peng G, Liu J, Pantel K. Meta-analysis of the prognostic value of circulating tumor cells in breast cancer. Clin Cancer Res. 2012;18:5701–5710. doi: 10.1158/1078-0432.CCR-12-1587. [DOI] [PubMed] [Google Scholar]
- Alix-Panabieres C, Schwarzenbach H, Pantel K. Circulating tumor cells and circulating tumor DNA. Annu Rev Med. 2012;63:199–215. doi: 10.1146/annurev-med-062310-094219. [DOI] [PubMed] [Google Scholar]
- Cristofanilli M, Budd GT, Ellis MJ, Stopeck A, Matera J, Miller MC, Reuben JM, Doyle GV, Allard WJ, Terstappen LW, Hayes DF. Circulating tumor cells, disease progression, and survival in metastatic breast cancer. N Engl J Med. 2004;351:781–791. doi: 10.1056/NEJMoa040766. [DOI] [PubMed] [Google Scholar]
- Nolé F, Munzone E, Zorzino L, Minchella I, Salvatici M, Botteri E, Medici M, Verri E, Adamoli L, Rotmensz N, Goldhirsch A, Sandri MT. Variation of circulating tumor cell levels during treatment of metastatic breast cancer: prognostic and therapeutic implications. Ann Oncol. 2008;19:891–897. doi: 10.1093/annonc/mdm558. [DOI] [PubMed] [Google Scholar]
- Liu MC, Mego M, Nakamura S, Nole F, Pierga J, Toi M, Munzone E, Yagata H, Sandri MT, Bidard F, Wang H, Hayes DF, Cristofanilli M. Clinical validity of circulating tumor cell (CTC) enumeration in 841 subjects with metastatic breast cancer (MBC) J Clin Oncol. 2011;29:10592. [Google Scholar]
- Pierga JY, Hajage D, Bachelot T, Delaloge S, Brain E, Campone M, Diéras V, Rolland E, Mignot L, Mathiot C, Bidard FC. High independent prognostic and predictive value of circulating tumor cells compared with serum tumor markers in a large prospective trial in first-line chemotherapy for metastatic breast cancer patients. Ann Oncol. 2012;23:618–624. doi: 10.1093/annonc/mdr263. [DOI] [PubMed] [Google Scholar]
- Bidard FC, Mathiot C, Delaloge S, Brain E, Giachetti S, de Cremoux P, Marty M, Pierga JY. Single circulating tumor cell detection and overall survival in nonmetastatic breast cancer. Ann Oncol. 2010;21:729–733. doi: 10.1093/annonc/mdp391. [DOI] [PubMed] [Google Scholar]
- Lucci A, Hall CS, Lodhi AK, Bhattacharyya A, Anderson AE, Xiao L, Bedrosian I, Kuerer HM, Krishnamurthy S. Circulating tumour cells in non-metastatic breast cancer: a prospective study. Lancet Oncol. 2012;13:688–695. doi: 10.1016/S1470-2045(12)70209-7. [DOI] [PubMed] [Google Scholar]
- Rack B, Andergassen U, Janni W, Neugebauer J. CTCs in primary breast cancer (I) Recent Results Cancer Res. 2012;195:179–185. doi: 10.1007/978-3-642-28160-0_16. [DOI] [PubMed] [Google Scholar]
- Franken B, de Groot MR, Mastboom WJ, Vermes I, van der Palen J, Tibbe AG, Terstappen LW. Circulating tumor cells, disease recurrence and survival in newly diagnosed breast cancer. Breast Cancer Res. 2012;14:R133. doi: 10.1186/bcr3333. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Wolff AC, Hammond ME, Schwartz JN, Hagerty KL, Allred DC, Cote RJ, Dowsett M, Fitzgibbons PL, Hanna WM, Langer A, McShane LM, Paik S, Pegram MD, Perez EA, Press MF, Rhodes A, Sturgeon C, Taube SE, Tubbs R, Vance GH, van de Vijver M, Wheeler TM, Hayes DF. American Society of Clinical Oncology; College of American Pathologists. American Society of Clinical Oncology/College of American Pathologists guideline recommendations for human epidermal growth factor receptor 2 testing in breast cancer. J Clin Oncol. 2007;25:118–145. doi: 10.1200/JCO.2006.09.2775. [DOI] [PubMed] [Google Scholar]
- Hayes DF, Walker TM, Singh B, Vitetta ES, Uhr JW, Gross S, Rao C, Doyle GV, Terstappen LW. Monitoring expression of HER-2 on circulating epithelial cells in patients with advanced breast cancer. Int J Oncol. 2002;21:1111–1117. doi: 10.3892/ijo.21.5.1111. [DOI] [PubMed] [Google Scholar]
- Meng S, Tripathy D, Shete S, Ashfaq R, Haley B, Perkins S, Beitsch P, Khan A, Euhus D, Osborne C, Frenkel E, Hoover S, Leitch M, Clifford E, Vitetta E, Morrison L, Herlyn D, Terstappen LW, Fleming T, Fehm T, Tucker T, Lane N, Wang J, Uhr J. HER-2 gene amplification can be acquired as breast cancer progresses. Proc Natl Acad Sci USA. 2004;101:9393–9398. doi: 10.1073/pnas.0402993101. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Riethdorf S, Müller V, Zhang L, Rau T, Loibl S, Komor M, Roller M, Huober J, Fehm T, Schrader I, Hilfrich J, Holms F, Tesch H, Eidtmann H, Untch M, von Minckwitz G, Pantel K. Detection and HER2 expression of circulating tumor cells: prospective monitoring in breast cancer patients treated in the neoadjuvant GeparQuattro trial. Clin Cancer Res. 2010;16:2634–2645. doi: 10.1158/1078-0432.CCR-09-2042. [DOI] [PubMed] [Google Scholar]
- Ignatiadis M, Rothé F, Chaboteaux C, Durbecq V, Rouas G, Criscitiello C, Metallo J, Kheddoumi N, Singhal SK, Michiels S, Veys I, Rossari J, Larsimont D, Carly B, Pestrin M, Bessi S, Buxant F, Liebens F, Piccart M, Sotiriou C. HER2-positive circulating tumor cells in breast cancer. PLoS One. 2011;6:e15624. doi: 10.1371/journal.pone.0015624. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Fehm T, Müller V, Aktas B, Janni W, Schneeweiss A, Stickeler E, Lattrich C, Löhberg CR, Solomayer E, Rack B, Riethdorf S, Klein C, Schindlbeck C, Brocker K, Kasimir-Bauer S, Wallwiener D, Pantel K. HER2 status of circulating tumor cells in patients with metastatic breast cancer: a prospective, multicenter trial. Breast Cancer Res Treat. 2010;124:403–412. doi: 10.1007/s10549-010-1163-x. [DOI] [PubMed] [Google Scholar]
- Alix-Panabieres C, Pantel K. Circulating tumor cells: liquid biopsy of cancer. Clin Chem. 2013;59:110–118. doi: 10.1373/clinchem.2012.194258. [DOI] [PubMed] [Google Scholar]
- Pestrin M, Bessi S, Puglisi F, Minisini AM, Masci G, Battelli N, Ravaioli A, Gianni L, Di Marsico R, Tondini C, Gori S, Coombes CR, Stebbing J, Biganzoli L, Buyse M, Di Leo A. Final results of a multicenter phase II clinical trial evaluating the activity of single-agent lapatinib in patients with HER2-negative metastatic breast cancer and HER2-positive circulating tumor cells. A proof-of-concept study. Breast Cancer Res Treat. 2012;134:283–289. doi: 10.1007/s10549-012-2045-1. [DOI] [PubMed] [Google Scholar]
- Bidard FC, Fehm T, Ignatiadis M, Smerage JB, Alix-Panabières C, Janni W, Messina C, Paoletti C, Müller V, Hayes DF, Piccart M, Pierga JY. Clinical application of circulating tumor cells in breast cancer: overview of the current interventional trials. Cancer Metastasis Rev. 2013;32:179–188. doi: 10.1007/s10555-012-9398-0. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Riethdorf S, Fritsche H, Müller V, Rau T, Schindlbeck C, Rack B, Janni W, Coith C, Beck K, Jänicke F, Jackson S, Gornet T, Cristofanilli M, Pantel K. Detection of circulating tumor cells in peripheral blood of patients with metastatic breast cancer: a validation study of the Cell Search system. Clin Cancer Res. 2007;13:920–928. doi: 10.1158/1078-0432.CCR-06-1695. [DOI] [PubMed] [Google Scholar]
- Kraan J, Sleijfer S, Strijbos MH, Ignatiadis M, Peeters D, Pierga JY, Farace F, Riethdorf S, Fehm T, Zorzino L, Tibbe AG, Maestro M, Gisbert-Criado R, Denton G, de Bono JS, Dive C, Foekens JA, Gratama JW. External quality assurance of circulating tumor cell enumeration using the Cell Search((R)) system: A feasibility study. Cytometry B Clin Cytom. 2011;80:112–118. doi: 10.1002/cyto.b.20573. [DOI] [PubMed] [Google Scholar]
- Tibbe AG, Miller MC, Terstappen LW. Statistical considerations for enumeration of circulating tumor cells. Cytometry A. 2007;71:154–162. doi: 10.1002/cyto.a.20369. [DOI] [PubMed] [Google Scholar]
- Pierga J, Bidard F, Andre F, Petit T, Dalenc F, Delozier T, Romieu G, Bonneterre J, Ferrero J, Kerbrat P, Martin A, Viens P. Early drop of circulating tumor cells (CTC) and increase of circulating endothelial cells (CEC) during neoadjuvant chemotherapy (CT) combined with bevacizumab in HER2-negative inflammatory breast cancer (IBC) in multicenter phase II trial BEVERLY 1. J Clin Oncol. 2011;29:10510. [Google Scholar]
- Pierga JY, Petit T, Delozier T, Ferrero JM, Campone M, Gligorov J, Lerebours F, Roché H, Bachelot T, Charafe-Jauffret E, Pavlyuk M, Kraemer S, Bidard FC, Viens P. Neoadjuvant bevacizumab, trastuzumab, and chemotherapy for primary inflammatory HER2-positive breast cancer (BEVERLY-2): an open-label, single-arm phase 2 study. Lancet Oncol. 2012;13:375–384. doi: 10.1016/S1470-2045(12)70049-9. [DOI] [PubMed] [Google Scholar]
- Riethdorf S, Mueller V, Mauermann O, Rau T, Loibl S, Eidtmann H, Solbach C, Tesch H, Schrader I, Kittel K, Fehm T, Holms F, Untch M, von Minckwitz G, Pantel K. Changes in circulating tumor and endothelial cells in peripheral blood of patients treated in the Neoadjuvant Chemotherapy Plus Targeted Treatment Breast Cancer Study “GeparQuinto”. Cancer Res. 2010;70:PD04–6. [Google Scholar]
- Landis J, Koch G. A one-way component of variance model for categorical data. Biometrics. 1977;33:671–679. doi: 10.2307/2529465. [DOI] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
Agreement (%) between academic readers and Veridex consensus (VC) according to dataset and disease stage. Description of data: we observed significantly lower agreement between academic readers and VC for CellSearch® images from patients of the Institut Jules Bordet (IJB) dataset compared to the other datasets and from patients with non-metastatic (M0) compared to metastatic (M1) disease.
Agreement (%) between academic readers and Veridex consensus (VC) according to circulating tumor cell (CTC) count and administration of systemic therapy before blood sample collection. Description of data: we observed significantly lower agreement between academic readers and VC for CellSearch® images from patients with <5 CTCs compared to ≥5 CTCs and blood samples drawn after the administration of systemic treatment as compared to samples drawn before systemic treatment.