Skip to main content
NPJ Breast Cancer logoLink to NPJ Breast Cancer
. 2026 May 6;12:124. doi: 10.1038/s41523-026-00957-6

Enabling DCIS subtyping: leveraging foundation models for robust grading and molecular biomarker scoring

S Doyle 1,2,#, M A Oerlemans 1,3,#, J Brunekreef 1,2, E Marcus 1,2, L Mulder 3, Y Liu 3, I Bouybayoune 4, E J Sawyer 4, A M Thompson 5, S E Pinder 4; Grand Challenge PRECISION Consortium, Jelle Wesseling 9, Alastair Thompson 10, Serena Nik-Zainal 11, Elinor J Sawyer 12, Helen Davies 11, Andrew Futreal 13, Nicholas Navin 13, E Shelley Hwang 14, Jos Jonkers 9, Jacco van Rheenen 9, Fariba Behbod 15, Esther H Lips 9, Marjanka Schmidt 9, Lodewyk F A Wessels 9, Daniel Rea 16, Proteeti Bhattacharjee 9, Hilary Stobart 17, Deborah Collyar 18, Donna Pinto 19, Ellen Verschuur 20, Marja van Oirsouw 20, C I Sánchez 2, J Teuwen 1,6, J Wesseling 3,7,8, E H Lips 3,✉
PMCID: PMC13623920  PMID: 42091907

Abstract

Ductal Carcinoma In Situ (DCIS) is a non-obligate precursor of invasive breast cancer. Due to a lack of reliable prognostic markers, nearly all women with DCIS undergo intensive treatment—often unnecessarily. The LORD trial addresses this by offering active surveillance to women with screen-detected, ER-positive, HER2-negative, grade 1 or 2 DCIS, aiming to reduce overtreatment. To support this, we developed a deep learning pipeline based on foundation models to predict grade, ER, and HER2 status directly from H&E-stained digitized pathology slides. Models were trained and tested on a Dutch multicenter dataset (n = 887) and externally validated on a UK dataset (n = 259). On the Dutch data, the models achieved mean AUROCs of 0.90 (ER), 0.84 (HER2), and 0.86 (grade); external validation yielded 0.80, 0.74, and 0.75, respectively. Using these outputs, we stratified patients according to active surveillance criteria, reaching balanced accuracies of 0.81 (Dutch) and 0.64 (UK), with corresponding NPVs of 0.86 and 0.76. Our models generalize across cohorts and reliably predict key biomarkers, supporting the identification of DCIS patients eligible for less aggressive management.

Subject terms: Cancer, Biomarkers, Medical research, Oncology, Cancer, Breast cancer, Cancer imaging

Introduction

Ductal carcinoma in situ (DCIS) is a breast lesion frequently detected through population-based breast cancer screening, with the European standardized rate of 10.48 per 100.000 women for 2023. DCIS can progress to ipsilateral invasive breast cancer (iIBC), but at least 75% of DCIS lesions never progress or cause symptoms1–3. However, due to a lack of means to reliably distinguish non-progressive from potentially progressive DCIS, almost all women with DCIS are treated similarly to those with early stage invasive breast cancer (IBC). Depending on tumor and breast size, and patients’ preferences, this treatment typically includes breast-conserving surgery followed by radiotherapy or mastectomy4. Consequently, women with non-progressive DCIS carry the burden of overtreatment.

In pathology, DCIS is classified using a three-tier grading system, i.e., grade 1 (well differentiated), grade 2 (intermediately differentiated) and grade 3 (poorly differentiated), mainly based on the degree of nuclear atypia5. Ongoing trials, including COMET and LORD6,7, are investigating whether active surveillance is a safe alternative for women with screen-detected, grade 1 or 2 DCIS. There is some evidence for a link between higher grades and increased recurrence risk8,9, but it is unclear whether this applies only to recurrence as ipsilateral DCIS or also to iIBC. Additionally, grading is subject to inter-observer variability5,10.

Besides grade, the expression of human epidermal growth factor receptor 2 (HER2) and estrogen receptor (ER) may help characterize DCIS. These markers are routinely measured via immunohistochemistry (IHC) for molecular subtyping in IBC but not yet in DCIS. If HER2 is positive, it is associated with higher grade and larger lesion size11–13, and may help to refine grading. It is potentially linked to an elevated risk of recurrence in DCIS8,12–16 and lack of ER expression12. In contrast, ER-positive DCIS is typically lower grade and less aggressive17,18. However, ER status does not predict local recurrence risk8,17,19. Similarly to HER2-positive DCIS, this finding may be confounded by factors related to more intensive treatment in ER-negative DCIS lesions. Currently, these markers, alongside grade, are used in the LORD and COMET trials to check the eligibility of women that might be included in these trials.

The LORD trial has shown that the majority of women with lower-grade DCIS opt for active surveillance over conventional treatment when presented with the choice6, underscoring the need for reliable tools to identify low-risk cases to support safe and informed decision-making. Currently, determining ER and HER2 status requires additional tissue slices, IHC stainings, and pathologist assessment, making it a costly and time-consuming process. Deep learning models applied to H&E-stained whole slide images (WSIs) could streamline this workflow by reducing variability from pathology assessments, improving efficiency, and lowering costs. Deep learning models have already demonstrated expert-level performance in predicting DCIS grade20, and have achieved robust results in predicting ER status and, to a lesser extent, HER2 status, in invasive breast cancer21–24. Some of these studies have employed the recently popularized foundation models, which leverage large, diverse histopathological datasets to further enhance robustness, scalability, and overall performance25–29.

In this study, we predicted ER status, HER2 status, and grade from H&E-stained WSIs of primary, pure DCIS lesions using a deep learning pipeline that includes a foundation model encoder. Our models were trained and evaluated on a large internal dataset (n = 935) and externally validated on an independent dataset (n = 276) acquired with a different scanner.

Results

In this study, we developed deep learning models to predict the biomarkers ER, HER2, and grade in DCIS directly from H&E-stained WSIs, trained and tested on the Dutch dataset and externally validated on the UK-based Sloane dataset (see Table 1 for cohorts). We assessed model performance for each biomarker individually using optimized thresholds and combined model outputs to predict active surveillance trial inclusion parameters,’ where patients predicted as lower-risk (ER-positive, HER2-negative, and grade 1 or 2) are considered eligible for active surveillance in the LORD trial.

Table 1.

Patient characteristics of the Dutch and Sloane external test cohort with fraction of total in brackets if applicable

Patient characteristics Precision_NKI_89_05 Sloane
Total patients 935 260
Age patient mean 57.6 59.6
Age Patient std 10.6 6.4
FFPE block age mean 26.8
FFPE block age std 3.8
GRADE 1 132 (0.14) 31 (0.12)
GRADE 2 479 (0.51) 78 (0.3)
GRADE 3 276 (0.3) 150 (0.58)
GRADE missing 48 (0.05) 1 (0.0)
HER2 negative 564 (0.61) 144 (0.55)
HER2 positive 222 (0.24) 74 (0.28)
HER2 missing 149 (0.16) 42 (0.16)
ER negative 155 (0.17) 64 (0.25)
ER positive 642 (0.69) 182 (0.70)
ER missing 138 (0.15) 14 (0.05)

Stable biomarker predictions on the Dutch dataset

We first assessed the performance of our biomarker models, derived from each outer fold of the nested cross-validation, on the Dutch dataset, as shown in Table 2 and Supplementary Fig. 2. The binarization thresholds applied to the biomarker predictions are provided in Supplementary Table 3. For ER prediction, the models achieved an AUROC of 0.90 (±0.06) and a balanced accuracy of 0.83 (±0.04). For HER2, the AUROC was 0.84 (±0.03), with a balanced accuracy of 0.75 (±0.03). For high-grade prediction, the models achieved an AUROC of 0.86 (±0.02) and a balanced accuracy of 0.79 (±0.02). The low standard deviations and minimal variability in ROC curves across folds indicate stable biomarker predictions.

Table 2.

Performance metrics of biomarker prediction models evaluated on the Dutch and Sloane datasets

Variable Balanced accuracy F1 Specificity Sensitivity PPV NPV AUROC
Dutch dataset
ER 0.83 (±0.04) 0.88 (±0.02) 0.84 (±0.07) 0.83 (±0.03) 0.95 (±0.03) 0.54 (±0.05) 0.90 (±0.06)
HER2 0.75 (±0.03) 0.64 (±0.04) 0.81 (±0.06) 0.70 (±0.05) 0.60 (±0.06) 0.87 (±0.01) 0.84 (±0.03)
High grade 0.79 (±0.02) 0.69 (±0.04) 0.78 (±0.06) 0.79 (±0.03) 0.62 (±0.08) 0.89 (±0.02) 0.86 (±0.02)
Sloane dataset
ER 0.71 (±0.05) 0.71 (±0.14) 0.81 (±0.09) 0.61 (±0.18) 0.90 (±0.02) 0.44 (±0.07) 0.80 (±0.02)
HER2 0.62 (±0.03) 0.57 (±0.02) 0.31 (±0.09) 0.93 (±0.06) 0.41 (±0.02) 0.91 (±0.06) 0.74 (±0.01)
High grade 0.68 (±0.03) 0.74 (±0.05) 0.60 (±0.13) 0.76 (±0.10) 0.73 (±0.04) 0.66 (±0.07) 0.75 (±0.02)

Values represent the mean and standard deviation (in brackets) across outer cross-validation folds.

NPV negative predictive value, PPV positive predictive value, AUROC area under the receiver operating characteristic curve.

Biomarker models generalize with low variability on external dataset

We further evaluated our biomarker models on the external dataset. For ER status, the AUROC was 0.80 (±0.02) and the balanced accuracy was 0.71 (±0.05). For HER2 status, the AUROC was 0.74 (±0.01) and the balanced accuracy was 0.62 (±0.03). Additionally, the HER2 models showed an increased propensity to predict positives on the external dataset, with specificity of 0.31 (±0.10) and a sensitivity of 0.93 (±0.06). For high-grade prediction, the AUROC was 0.75 (±0.02) and the balanced accuracy was 0.68 (±0.03). For all biomarkers, the models from different folds exhibited low variability in performance on the external dataset, with even less variability than the internal dataset, as indicated by the closely aligned ROC curves in Fig. 1 and the low standard deviations in Table 2.

Fig. 1. Receiver operating characteristic (ROC) curves for predictions on the external Sloane dataset.

Fig. 1

ROC curves from each model across outer cross-validation folds are shown. a ROC curves for ER status, with a mean AUROC of 0.80 ( ± 0.02); b ROC curves for HER2 status, with a mean AUROC of 0.73 (±0.01); and c ROC curves for grade, with a mean AUROC of 0.75 (±0.02).

Prediction of active surveillance trial criteria by combining model outputs

We also evaluated our models’ ability to identify patients eligible for active surveillance under the LORD trial criteria. Table 3 presents the results using binarized predictions from the individual biomarker models. In the Dutch dataset, the models achieved a balanced accuracy of 0.81 (±0.02), an NPV of 0.86 (±0.04), with a specificity of 0.79 (±0.03). Table 4 shows that on average 77.9 (±6.7) patients could be included in the LORD trial, 11.2 (±2.8) were misclassified, and 17.7 (±1.9) were missed.

Table 3.

Performance metrics for predicting the patients fit for active surveillance evaluated on the Dutch and Sloane datasets

Dataset Balanced accuracy F1 Specificity Sensitivity PPV NPV
Dutch 0.81 (±0.02) 0.79 (±0.02) 0.79 (±0.03) 0.83 (±0.04) 0.75 (±0.02) 0.86 (±0.04)
Sloane 0.64 (±0.03) 0.83 (±0.01) 0.33 (±0.10) 0.94 (±0.03) 0.74 (±0.02) 0.76 (±0.07)

Values represent the mean and standard deviation (in brackets) across outer cross-validation folds.

NPV negative predictive value, PPV positive predictive value.

Table 4.

Predicted LORD-groups in the Dutch and Sloane dataset

Dataset #Predicted LORD-positive #Predicted LORD-negative #Misclassified LORD-positive #Misclassified LORD-negative
Dutch 70.7 (±4.4) 77.9 (±6.7) 17.7 (±1.9) 11.2 (±2.8)
Sloane 180.0 (±10.9) 31.0 (±10.9) 46.3 (±6.5) 8.2 (±4.6)

Total predicted patients, and misclassified patients per LORD group are shown. Model predictions are presented as means over the outer folds, with standard deviations in brackets.

In the external dataset, the balanced accuracy was 0.64 (±0.03), with an NPV of 0.76 (±0.07) and a specificity of 0.33 (±0.10). The low specificity in the external dataset reflects the model’s conservative approach to predicting the negative class, which is also reflected in its high sensitivity of 0.94 (±0.03). Table 4 shows that, for the Sloane dataset, on average 31.0 (±10.9) patients could be included in the LORD trial, while 8.2 (±4.6) were misclassified, and 46.3 (±6.5) were missed.

Discussion

Our study demonstrates the potential of using deep learning models in predicting the status of ER and HER2 expression, as well as DCIS grade from WSIs. This could eliminate the need for labor-intensive IHC staining and pathology review. Our models, which incorporated a frozen foundation model encoder, achieved robust biomarker predictions when tested internally on a comprehensive Dutch national cohort and externally with the UK-based Sloane cohort. Specifically, the models yielded AUROCs of 0.90 and 0.80 for ER on the Dutch and external datasets, respectively, and 0.84 and 0.73 for HER2 and 0.86 and 0.75 for grade.

Previous studies have predicted IHC markers from WSIs, mainly in invasive breast cancer. Filiot et al. reported ER AUROCs up to 0.88 and HER2 AUROCs up to 0.74 using a similar methodology to ours22. In contrast, Shamai et al. and Farahmand et al. achieved higher AUROCs (0.93–0.96 for ER and 0.69–0.87 for HER2) by incorporating tumor area labeling23,24, with Farahmand et al. noting an 8% improvement in HER2 prediction from the labels. Our external AUROCs for ER and HER2 align with those of Filiot et al., indicating that tumor annotations may further enhance performance.

However, our models used tile embeddings generated by a foundation model, which may reduce the reliance on explicit tumor annotations. During training, the models learned to attend to tumor regions, as illustrated by WSI visualizations showing strong alignment between model-attended areas and DCIS regions (Supplementary Figs. 3–5). Additionally, Valieris et al. distinguished HER2-negative (IHC 0), HER2-low (IHC 1+ or 2+), and HER2-high (IHC 3+) cases with a model that encoded tiles using the UNI foundation model26, reported comparable performance when restricting input to tumor-enriched regions compared to using full-slide images30. While HER2 classification with three categories has emerging relevance in invasive breast cancer, our binary approach for DCIS aligns with active surveillance trial inclusion criteria.

The consistently higher performance of ER models compared to HER2 models suggests that predicting HER2 status from WSIs may be inherently more difficult or not consistently feasible. Further research is needed to identify which histopathological features enable accurate HER2 prediction from WSIs. Explainability techniques may help uncover these features, as shown by Valieris et al.30, who used CLAM, an attention-based multiple instance learning model with clustering constraints, to identify high-attention tiles. Applying PCA to these tiles revealed clustering by HER2 class, and visual inspection of representative tiles of the clusters showed that HER2-positive tiles often displayed apocrine features, including higher nuclear grade and infiltrative growth, whereas HER2-low tiles were enriched for chronic inflammation, fibrotic tissue, and lower nuclear grades. These findings highlight the potential of explainability-driven models to improve both interpretability and classification performance.

Wetstein et al. showed that deep learning models could predict DCIS grade with slightly higher inter-observer agreement compared to three reviewers20. Additionally, Huang et al. reported an AUROC of 0.97 on a held-out internal test set for nuclear grading of DCIS31, compared to our mean AUROC of 0.86. In our study, the grading system incorporated additional features beyond nuclear grade, which may have introduced greater ambiguity in the ground truth labels. Additionally, three pathologists, rather than two in Huang et al., collaborated to determine the ground truth labels, which could have contributed to label ambiguity, despite reducing the potential for inter-observer variability. Huang’s study also differed from ours in terms of patient characteristics, including a higher proportion of high-grade DCIS (54% vs. 36% in our dataset) and fewer -hard to assess- grade 2 cases (32% vs. 51%), along with inclusion of atypical ductal hyperplasia (10%) and DCIS with microinvasion (4%).

Using the biomarker predictions, we identified women with DCIS who would be eligible for active surveillance under the LORD trial criteria, achieving NPVs above 0.79. On the external dataset, however, specificity was low, likely due to the limited specificity of the HER2 model on this dataset. As thresholds are not optimized on the external set, additional calibration of thresholds on external sets is necessary to guarantee high performance.

In the presence of class imbalance, which is present in our dataset for ER (ER-negative: 14% in the Dutch dataset; 30% in Sloane dataset), HER2 (HER2-positive: 30% in the Dutch dataset; 42% in Sloane dataset) and grade (grade 3: 30% in Dutch dataset; 57% in Sloane dataset), a model may become biased toward the majority class. To address this, we optimized biomarker classification thresholds using balanced accuracy, a metric that accounts for both sensitivity and specificity and ensures an equal consideration of both classes. The optimized thresholds generally resulted in improved balanced accuracy compared to the commonly used threshold of 0.5 (Supplementary Tables 4 and 5). An exception was HER2 prediction, where the lower, optimized threshold resulted in reduced external performance. However, this was likely due to the model’s tendency to generate high prediction scores for HER2, combined with greater overlap between true positive and true negative scores in the external dataset. This finding highlights the need for further classification refinement, particularly in improving the calibration and discrimination of classes across dataset in the HER2 models.

The accurate prediction of ER status both in our DCIS datasets and in invasive breast cancer datasets, suggests that there are consistent ER-related signals in WSIs that deep learning models detect. This highlights the models’ potential for clinical integration. In clinical practice, ER status is routinely assessed for breast cancer subtyping and treatment decisions. In some countries, such as the U.S., ER status is furthermore used to identify candidates for endocrine therapy among women diagnosed with DCIS17.

Routine ER prediction could also help clarify its role in DCIS. While ER expression is negatively associated with aggressive features like microinvasion18 and higher histological grade17, it is not strongly predictive of invasive recurrence risk8,17,19. Similarly, routine HER2 assessment in DCIS could provide insights into its association with in-situ and invasive recurrence12,14, as well as its role in the DCIS-to-IBC transition32,33. Another opportunity lies in exploring the biological mechanisms underlying the notably higher frequency of HER2 overexpression in DCIS compared to IBC34,35 and the association between HER2-positive DCIS and immune microenvironmental features, such as tumor-infiltrating lymphocytes36.

The clinical utility of DCIS grading, which is based on histological features primarily reflecting nuclear atypia, is limited by interobserver variability, lesion heterogeneity, and a weak association with the risk of invasive recurrence. A robust AI model could address these issues improving diagnostic consistency. Furthermore, given the correlation between grade, ER, and HER2 status, routine automated prediction of ER and HER2 could refine grading5.

In settings where clinical treatment decisions rely on the combined output of multiple biomarkers, such as the active surveillance trials, the classification of each individual biomarker within the AI-based tool must be exceptionally robust and accurate, as errors can accumulate and undermine the overall risk assessment.

Our study demonstrates the potential of deep learning models for the automated assessment of ER, HER2, and grade in DCIS. However, several limitations remain. While we validated our models on one external dataset using a different scanner type, broader validation on larger, diverse external datasets is necessary before clinical implementation. Additionally, HER2 and grade prediction performance should be further optimized, potentially by leveraging explainable AI approaches, such as incorporating tumor-region annotations.

While the distribution of assessed biomarkers in our dataset was comparable to that of the broader DCIS population, the cohort was enriched for patients who developed invasive recurrence. This enrichment may have influenced the types of histopathological features presented to the model, potentially affecting the complexity of the biomarker prediction task. Furthermore, validation on biopsies could enhance the clinical applicability of the presented models.

Given the high interobserver variability in grade evaluation and the fact that ER and HER2 are not routinely assessed in DCIS, AI-driven predictions offer a more consistent and accessible alternative to manual scoring. Future studies should validate models like ours on large external cohorts and explore their integration into clinical practice, where their use would produce data to support further research and evaluation of clinical utility. Additionally, further research may focus on model explainability, enhancing both performance and interpretability while advancing our understanding of ER, HER2, and pathological characteristics in DCIS progression.

Methods

Data and study design

In our study, we used two cohorts, referred to as the Dutch and Sloane cohorts. The inclusion criteria were a primary, pure DCIS diagnosis and the availability of tissue resections. Detailed descriptions of the cohorts are provided in Table 1. This retrospective study was conducted in accordance with the Declaration of Helsinki. For the Dutch cohort, ethical approval was granted by the Institutional Review Board of the Netherlands Cancer Institute - Antoni van Leeuwenhoek (IRBd22-110), which waived the need for informed consent due to the retrospective nature of the study. Secondary data usage adhered to Dutch regulations and the Federa-COREON Code of Conduct under an opt-out regime. Data access was approved by the Netherlands Cancer Registry (K12.281) and PALGA (LZV990). The Sloane cohort, part of the United Kingdom National Health Service Breast Screening Programme, was approved by the UK Health Research Authority (ethical approval 19/LO/0648). Informed consent was obtained for the Sloane cohort.

From a Dutch nationwide cohort of 10,090 women diagnosed between 1989 and 2005 with follow-up until 20199, slides of good quality with confirmed pure DCIS were included in the case-control series used by Visser et al.14 and the case-cohort series used by Groen et al.37 (Supplementary Fig. 1). From these series, we selected 935 patients who met our inclusion criteria. Among these, 132 patients missed data for ER status, 149 patients missed data for HER2 status and 48 patients were missing data for grade. In total, 192 patients had data missing for one or more variables. Each WSI was manually reviewed for the exclusive presence of DCIS, and grading was performed and revised by three expert pathologists (J. Wesseling, E.J. Groen, and K. van de Vijver). They assessed slides on morphologic characteristics, including DCIS architecture and nuclear grade, the presence of calcifications and necrosis, and microenvironmental characteristics like stromal features and the presence of lymphocytes. Their interrater variability was judged to be within expected ranges.

The Sloane prospective cohort, which comprises 33% of DCIS patients diagnosed within the UK National Health Service Breast Screening Programme between 2003 and 201238, a selection of screen-detected pure DCIS cases with clear surgical margins >1 mm was made. We included a subset of 260 patient samples that fulfilled our inclusion criteria. Within this subset, 14 patients missed data for ER status, 42 for HER2 and 1 for grade, while 211 patients had complete clinicopathological variables.

Data preparation

Formalin-fixed paraffin-embedded tissue sections of DCIS lesions were stained with H&E. They were scanned at ×20 magnification. In the Dutch cohort a Leica Aperio AT2 scanner was used, and a Hamamatsu Nanozoomer 2.0-HT scanner was used for the Sloane cohort. We produced tissue masks for the WSIs using a U-Net segmentation model which was trained in-house. Following previously described procedures25, we tiled WSIs into non-overlapping patches of 224 × 224 pixels at a resolution of 0·5 μm/pixel, providing clear views of small-sized ducts and individual cells. Finally, we removed patches without segmented tissue.

For training and assessment, we binarized variables as follows: HER2 (negative = IHC 0, 1 + , 2 + ; positive = IHC 3 + ), grade (negative = grade 1, 2; positive = grade 3), and ER (negative = IHC 0-9%; positive = IHC 10-100%). To validate the HER2 classification, we performed CISH on 20 DCIS lesions with IHC 2+ staining; all cases were non-amplified, confirming that IHC 2+ typically corresponds to non-amplified HER2 in DCIS. In the Sloane cohort, HER2 status was determined through in-situ hybridization rather than immunohistochemistry, as was the case for the Dutch Cohort.

We also assessed a model for active surveillance trial inclusion, and used the LORD inclusion criteria: the combination of the following three biomarkers qualifies as LORD-inclusion criteria: ER-positive, HER2-negative, grade 1 or 2).

Model, training, and assessment

We evenly split the Dutch dataset into five outer folds, ensuring a similar distribution of covariates across folds (SupplementaryTable 1). For each outer fold, we performed an inner cross-validation (k = 5) using GroupStratifiedKFold (scikit-learn v.1.3.239), stratifying by the target biomarker and grouping by tissue block ID to ensure that all tiles from a patient’s WSI were assigned to the same fold.

Figure 2 illustrates the architecture and pipeline we used for training our DCIS biomarker prediction models. The pipeline consists of a frozen encoder and a classifier. The encoder is the Phikon model, an open-source Vision Transformer Base (ViT-B) trained on 40 million pan-cancer histology tiles from TCGA using the iBOT framework25. The classifier is a two-layer multi-layer perceptron (MLP) trained using attention-based multiple instance learning (AB-MIL)40. In this framework, each WSI is represented as a set of tiles, and the model learns to assign varying levels of importance (attention weights) to individual tiles when aggregating them into the WSI prediction. To train the classifier, we used the methods described in Filiot et al.27. We performed a grid search to tune the hyperparameters of our models with the AUROC as the evaluation metric. We present further details on model configurations in supplemental Table 2. We trained models on an NVIDIA RTX A6000 GPU with 48GB of memory.

Fig. 2. Pipeline of the DCIS biomarker prediction models.

Fig. 2

Whole slide images (WSIs) are segmented and tiled, with 1000 tiles randomly subsampled from each WSI. The tiles are processed through the frozen foundation model encoder, “Phikon” (Filiot et al.25). The resulting features are then passed to a multi-layer perceptron (MLP) for target biomarker prediction. During training, the MLP is optimized using attention-based multiple instance learning (AB-MIL)40 to account for tile importance.

For each fold of the outer cross-validation, we constructed an ensemble model using the best-performing checkpoints from the corresponding inner cross-validation folds. We selected optimal checkpoints based on the area under the receiver operating characteristic curve (AUROC), calculated using the “torchmetrics” library (v1.6.1)33. We assessed the performance of these ensemble models for clinical biomarkers individually, and for active surveillance trial inclusion. As evaluation metrics, we chose, next to the AUROC, the balanced accuracy, F1-score, positive predictive value (PPV), negative predictive value (NPV), sensitivity, and specificity, which are based on binarised predictions. We optimized the threshold for binarization in trained models for maximum balanced accuracy to ensure equal consideration of both positive and negative classes, addressing class imbalance. We defined the binarization threshold for each ensemble model as the average of the optimized thresholds derived from the individual models within the ensemble. To evaluate the active surveillance trial inclusions prediction, we used outputs from the individual biomarker models. We assessed the group prediction based on binary predictions for each biomarker.

Supplementary information

Supplementary Information (56.9MB, docx)

Acknowledgements

S.D., E.J.S., A.M.T., E.L., and J.W. acknowledge funding from Cancer Research UK and KWF Dutch Cancer Society—Funding Cancer Grand Challenge PRECISION (ref C38317/A24043). M.O., J.W., E.L., and J.T. acknowledge support from KWF-Project 14036 (Conquer overtreatment of Ductal Carcinoma In Situ (DCIS) using artificial intelligence on tissue slides). All authors acknowledge the institutional grant provided to the Netherlands Cancer Institute by the Dutch Cancer Society KWF and the Ministry of Health, Welfare and Sport. The funders of the study had no role in study design, data collection, analysis, interpretation, or writing of the report. The authors also wish to thank all the collaborating hospitals, and in particular, pathology departments, and all people who have helped in the process of data collection and analysis. The authors thank E.J. Groen and K. van de Vijver for their work in grading DCIS slides. The authors thank the registration team of the Netherlands Comprehensive Cancer Organization (IKNL) for the collection of data for the Netherlands Cancer Registry. The authors thank Palga, the nationwide network and registry of histo- and cytopathology in the Netherlands, for providing pathology data and for their help in the collection of the residual patient material. The authors acknowledge the staff of the NKI Core Facility Molecular Pathology & Biobanking (CFMPB) for providing the tissue samples. Finally, the authors thank the Grand Challenge PRECISION Consortium Steering Group.

Author contributions

S.D.: Literature research, model development, data analysis, data collection, data interpretation, figures, writing. M.O.: Literature research, model development, data analysis, data collection, data interpretation, figures, writing. JB: Supervision, data interpretation, review. E.L.: Supervision, data collection, data interpretation, review, funding acquisition, project administration. J.W.: Supervision, study design, review, funding acquisition, project administration. J.T.: Supervision, study design, software, supervision, review, funding acquisition, project administration. C.S.: Supervision, review, project administration. E.M.: Supervision, data interpretation, review. I.B.: Data collection, review. E.S.: Data collection, review. S.P.: Data collection, review. PRECISION consortium: Data collection, resources, review. L.M.: Data curation, review. Y.L.: data curation, review. A.T.: Data collection and review.

Data availability

The data used in this study were shared among members of the PRECISION Consortium under a unified funding initiative. Requests for access to the data may be accommodated upon reasonable inquiry directed to the corresponding author, subject to appropriate agreements. The underlying code for this study is not publicly available but may be made available to qualified researchers on reasonable request from the corresponding author.

Code availability

The underlying code for this study is publicly available at https://github.com/NKI-AI/dcis-biomarkers.

Competing interests

J.T. declares being a share owner of Glass Medical AI BV; consulting for ScreenPoint Medical (all active). J.T. received support to attend II-ON BMS conference. J.T. is also a member of the Dutch Cancer Foundation KWF – Smart Measurement committee, as well as Dutch organization for scientific research—Veni Committee. J.T. is Associate Editor of NPJ Breast Cancer. J.T. was not involved in the journal’s review of, or decisions related to, this manuscript. The other authors do not have a competing interest. The consortium was funded by Cancer Grand Challenges, an initiative from Cancer Research UK and the National Cancer Institute, under project Cancer Grand Challenge PRECISION (C38317/A24043).

Footnotes

Publisher’s note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

These authors contributed equally: S. Doyle, M. A. Oerlemans.

These authors jointly supervised this work: J. Teuwen, J. Wesseling, E. H. Lips.

A list of authors and their affiliations appears at the end of the paper.

Contributor Information

E. H. Lips, Email: e.lips@nki.nl

Grand Challenge PRECISION Consortium:

Jelle Wesseling, Alastair Thompson, Serena Nik-Zainal, Elinor J. Sawyer, Helen Davies, Andrew Futreal, Nicholas Navin, E. Shelley Hwang, Jos Jonkers, Jacco van Rheenen, Fariba Behbod, Esther H. Lips, Marjanka Schmidt, Lodewyk F. A. Wessels, Daniel Rea, Proteeti Bhattacharjee, Hilary Stobart, Deborah Collyar, Donna Pinto, Ellen Verschuur, and Marja van Oirsouw

Supplementary information

The online version contains supplementary material available at https://doi.org/10.1038/s41523-026-00957-6.

References

  • 1.Maxwell, A. J. et al. Unresected screen-detected ductal carcinoma in situ: outcomes of 311 women in the Forget-Me-Not 2 study. Breast Edinb. Scotl.61, 145–155 (2022). [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 2.Chen, Q. et al. Outcomes from low-risk ductal carcinoma in situ: a systematic review and meta-analysis. Breast Cancer Res. Treat.208, 237–251 (2024). [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3.Ryser, M. D. et al. Cancer outcomes in DCIS patients without locoregional treatment. J. Natl. Cancer Inst.111, 952–960 (2019). [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4.van Seijen, M. et al. Long-term risk of subsequent ipsilateral lesions after surgery with or without radiotherapy for ductal carcinoma in situ of the breast. Br. J. Cancer125, 1443–1449 (2021). [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5.van Seijen, M. et al. Variability in grading of ductal carcinoma in situ among an international group of pathologists. J. Pathol. Clin. Res.7, 233–242 (2021). [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6.Schmitz, R. S. J. M. et al. Active surveillance versus treatment in low-risk DCIS: Women’s preferences in the LORD-trial. Eur. J. Cancer192, 113276 (2023). [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.Kanbayashi, C. et al. The international collaboration of active surveillance trials for low-risk DCIS (LORIS, LORD, COMET, LORETTA). J. Clin. Oncol.37, TPS603 (2019).
  • 8.Visser, L. L. et al. Predictors of an invasive breast cancer recurrence after DCIS: a systematic review and meta-analyses. Cancer Epidemiol. Biomarkers Prev.28, 835–845 (2019). [DOI] [PubMed] [Google Scholar]
  • 9.Schmitz, R. S. J. M. et al. Association of DCIS size and margin status with risk of developing breast cancer post-treatment: multinational, pooled cohort study. BMJ383, e076022 (2023). [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10.Van Bockstal, M. R., Berlière, M., Duhoux, F. P. & Galant, C. Interobserver variability in ductal carcinoma in situ of the breast. Am. J. Clin. Pathol.154, 596–609 (2020). [DOI] [PubMed] [Google Scholar]
  • 11.Tamimi, R. M. et al. Comparison of molecular phenotypes of ductal carcinoma in situ and invasive breast cancer. Breast Cancer Res.10, R67 (2008). [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12.Miligy, I. M. et al. The clinical and biological significance of HER2 over-expression in breast ductal carcinoma in situ: a large study from a single institution. Br. J. Cancer120, 1075–1082 (2019). [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13.Borgquist, S. et al. The prognostic role of HER2 expression in ductal breast carcinoma in situ (DCIS); a population-based cohort study. BMC Cancer15, 468 (2015). [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.Visser, L. L. et al. Clinicopathological risk factors for an invasive breast cancer recurrence after ductal carcinoma in situ-A nested case-control study. Clin. Cancer Res J. Am. Assoc. Cancer Res.24, 3593–3601 (2018). [DOI] [PubMed] [Google Scholar]
  • 15.Rakovitch, E. et al. HER2/neu and Ki-67 expression predict non-invasive recurrence following breast-conserving therapy for ductal carcinoma in situ. Br. J. Cancer106, 1160–1165 (2012). [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16.Gong, D. et al. HER2 overexpression in ductal carcinoma in situ is associated with ipsilateral breast cancer recurrence after conservative surgery. Transl. Cancer Res. Available from: https://tcr.amegroups.org/article/view/39677 (2020). [DOI] [PMC free article] [PubMed]
  • 17.Miligy, I. M. et al. The clinical significance of oestrogen receptor expression in breast ductal carcinoma in situ. Br. J. Cancer123, 1513–1520 (2020). [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18.Wan, Z. B. et al. Expression of estrogen receptor, progesterone receptor, human epidermal growth factor receptor 2, and Ki-67 in ductal carcinoma in situ (DCIS) and DCIS with microinvasion. Medicines97, e13055 (2018). [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19.Zabrocka, E. et al. Estrogen receptor-negative ductal carcinoma in situ (DCIS) of the breast – an institutional review of outcomes. Anticancer Res. 43, 4031–4036 (2023). [DOI] [PubMed] [Google Scholar]
  • 20.Wetstein, S. C. et al. Deep learning-based grading of ductal carcinoma in situ in breast histopathology images. Lab Investig.101, 525–533 (2021). [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21.Naik, N. et al. Deep learning-enabled breast cancer hormonal receptor status determination from base-level H&E stains. Nat. Commun.11, 5727 (2020). [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22.Filiot, A., Jacob, P., Kain, A. M. & Saillard, C. Phikon-v2, a large and public feature extractor for biomarker prediction. Preprint at http://arxiv.org/abs/2409.09173 (2024).
  • 23.Shamai, G. et al. Clinical utility of receptor status prediction in breast cancer and misdiagnosis identification using deep learning on hematoxylin and eosin-stained slides. Commun. Med.4, 1–16 (2024). [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24.Farahmand, S. et al. Deep learning trained on hematoxylin and eosin tumor region of Interest predicts HER2 status and trastuzumab treatment response in HER2+ breast cancer. Mod. Pathol.35, 44–51 (2022). [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 25.Filiot, A. et al. Scaling self-supervised learning for histopathology with masked image modeling. Pathology 2023 Jul [cited 2023 Oct 22]. Available from: http://medrxiv.org/lookup/doi/10.1101/2023.07.21.23292757.
  • 26.Chen, R. J. et al. Towards a general-purpose foundation model for computational pathology. Nat. Med.30, 850–862 (2024). [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 27.Wang, X. et al. Transformer-based unsupervised contrastive learning for histopathological image classification. Med Image Anal.81, 102559 (2022). [DOI] [PubMed] [Google Scholar]
  • 28.Xu, H. et al. A whole-slide foundation model for digital pathology from real-world data. Nature630, 181–188 (2024). [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 29.Vorontsov, E. et al. A foundation model for clinical-grade computational pathology and rare cancers detection. Nat. Med.30, 2924–2935 (2024). [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 30.Valieris, R. et al. Weakly-supervised deep learning models enable HER2-low prediction from H&E stained slides. Breast Cancer Res.26, 124 (2024). [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 31.Huang, C. Y. et al. Deep-learning model to improve histological grading and predict upstaging of atypical ductal hyperplasia / ductal carcinoma in situ on breast biopsy. Histopathology84, 983–1002 (2024). [DOI] [PubMed] [Google Scholar]
  • 32.Visser, L. L. et al. Discordant marker expression between invasive breast carcinoma and corresponding synchronous and preceding DCIS. Am. J. Surg. Pathol.43, 1574 (2019). [DOI] [PubMed] [Google Scholar]
  • 33.Hutten, S. J. et al. A living biobank of patient-derived ductal carcinoma in situ mouse-intraductal xenografts identifies risk factors for invasive progression. Cancer Cell41, 986–1002.e9 (2023). [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 34.Latta, E. K., Tjan, S., Parkes, R. K. & O’Malley, F. P. The role of HER2/neu overexpression/amplification in the progression of ductal carcinoma in situ to invasive carcinoma of the breast. Mod. Pathol.15, 1318–1325 (2002). [DOI] [PubMed] [Google Scholar]
  • 35.Purdie, C. A. et al. Increased mortality in HER2 positive, oestrogen receptor positive invasive breast cancer: a population-based study. Br. J. Cancer103, 475–481 (2010). [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 36.Morita, M. et al. CD8+ tumor-infiltrating lymphocytes contribute to spontaneous “healing” in HER2-positive ductal carcinoma in situ. Cancer Med.5, 1607–1618 (2016). [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 37.Ej, G. et al. Prognostic value of histopathological DCIS features in a large-scale international interrater reliability study. Breast Cancer Res. Treat. Available from: https://pubmed.ncbi.nlm.nih.gov/32734520/. [DOI] [PMC free article] [PubMed]
  • 38.Clements, K. et al. Cohort profile of the Sloane Project: methodology for a prospective UK cohort study of >15 000 women with screen-detected non-invasive breast neoplasia. BMJ Open12, e061585 (2022). [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 39.Pedregosa, F. et al. Scikit-learn: machine learning in Python. J. Mach. Learn Res.12, 2825–2830 (2011). [Google Scholar]
  • 40.Ilse, M., Tomczak, J. M. & Welling, M. Attention-based deep multiple instance learning. Proc. 35th International Conference on Machine Learning. pp. 2127–2136 (PMLR, 2018).

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

Supplementary Information (56.9MB, docx)

Data Availability Statement

The data used in this study were shared among members of the PRECISION Consortium under a unified funding initiative. Requests for access to the data may be accommodated upon reasonable inquiry directed to the corresponding author, subject to appropriate agreements. The underlying code for this study is not publicly available but may be made available to qualified researchers on reasonable request from the corresponding author.

The underlying code for this study is publicly available at https://github.com/NKI-AI/dcis-biomarkers.


Articles from NPJ Breast Cancer are provided here courtesy of Nature Publishing Group

RESOURCES