Skip to main content
PeerJ logoLink to PeerJ
. 2026 Aug 6;14:e21553. doi: 10.7717/peerj.21553

ImmunoResponse Predictor: a GUI for accurate response prediction to immunotherapy

Rajat Butola 1, Shinsheng Yuan 1,2, Grace S Shieh 1,2,3,4,✉
Editor: Scott Edmunds
PMCID: PMC13453136  PMID: 42572661

Abstract

Immune checkpoint inhibitors (ICIs) have improved outcomes for subsets of patients with metastatic urothelial carcinoma (mUC) and metastatic renal cell carcinoma (mRCC), yet objective response rates remain low (∼15–25%), underscoring the need for tools that support patient stratification. We previously developed LogitDA, a logistic regression–based predictor incorporating feature selection and domain adaptation, which outperformed established immune-related signatures in predicting response to the PD-L1 inhibitor atezolizumab. Here, we present the ImmunoResponse Predictor, a web-based clinical decision-support framework that enables responsible application of LogitDA in real-world settings. The system integrates standardized transcriptomic preprocessing, interpretable individual-level predictions (including single-sample use), clinically motivated LogitDA score cutoffs that prioritize minimization of false negatives, and a cohort-level percentage of applicability with empirically derived thresholds designed to assess whether predictions can be reliably extrapolated to newly uploaded datasets. Importantly, applicability functions as a diagnostic safeguard against distributional shift rather than as a response predictor. We evaluated the framework across four independent cohorts, PCD4989g(mUC), PCD4989g(mRCC), the Moreno cohort, and the UNC-108 cohort. LogitDA achieved prediction accuracies of 0.69, 0.83, 0.86, and 0.53, with corresponding applicability estimates of 74%, 76%, 71%, and 48%, respectively, correctly identifying the UNC-108 cohort as one in which predictions warrant increased caution. Overall, the ImmunoResponse Predictor extends LogitDA into a practical, interpretable, and safeguarded tool for immunotherapy response prediction, supporting cautious clinical and translational use.

Keywords: Biomarker, Immunotherapy, Cancer, Machine learning, GUI, Regression, Prediction

Introduction

Urothelial carcinoma (UC) is the ninth most common cancer worldwide, while renal cell carcinoma (RCC) accounts for approximately 90% of all kidney cancers. In 2022, an estimated 552,000 and 413,000 new cases of UC and RCC were reported globally (World Cancer Research Fund, 2025). Metastatic urothelial carcinoma (mUC) and metastatic renal cell carcinoma (mRCC) are highly aggressive malignancies, accounting for ∼90% of deaths from UC and RCC. In recent years, immunotherapies, in particular immune checkpoint inhibitors (ICIs), have reshaped the treatment landscapes for mUC and mRCC (Gajate et al., 2020). These agents target immune checkpoints such as PD-1 and PD-L1, which play important roles in human immune system. Specifically, Atezolizumab, this humanized monoclonal antibody selectively blocks PD-L1 from interacting with PD-1 and the co-stimulatory molecule B7.1. By disrupting these immunosuppressive interactions, atezolizumab restores tumor-specific T-cell activity and enables a robust immune response.

In patients who respond to ICIs, e.g., atezolizumab, overall survival (OS) can be significantly prolonged. As a result, ICIs have become frontline treatments in selected cases and the standard of care for second-line therapy following progression on platinum-based chemotherapy (Powles et al., 2018). However, the objective response rate (ORR) remains low-approximately 15–25% in mUC (Powles et al., 2018) and mRCC (Motzer et al., 2015). This underscores the critical, yet challenging, need to identify potential responders prior to treatments (Havel, Chowell & Chan, 2019; Ma et al., 2021).

Using machine learning and innovative feature selection techniques (Wang et al., 2022), including unsupervised domain adaptation (Jeng et al., 2023), we previously developed predictors for cancer patient responses to chemo-, targeted-, and immunotherapies (Yuan et al., 2023; Langfelder et al., 2025a). Notably, a logistic regression-based predictor (LogitDA) demonstrated the ability to generalize response prediction to atezolizumab (a PD-L1 inhibitor) from training data to independent test datasets (Langfelder et al., 2025b). LogitDA identified a 49-gene signature for metastatic urothelial carcinoma (mUC) and a 27-gene signature for metastatic renal cell carcinoma (mRCC); see Table S1 for the signature genes. With these signatures, LogitDA achieved an area under the curve (AUC) of 75% for mUC and 72% for mRCC. Moreover, LogitDA outperformed six established signatures, including PD-L1 IHC (Banchereau et al., 2021), the IFN-γ signature, the CD8T signature, the T-cell dysfunction signature, the T-exhaust signature, and the T-inflamed signature (Ayers et al., 2017; Lakatos et al., 2020; Mariathasan et al., 2018; Jiang et al., 2018; Cristescu et al., 2018).

In this study, we developed ImmunoResponse Predictor, a web-based graphical user interface (GUI). This GUI is based on LogitDA and its associated gene signatures for mUC and mRCC, which can predict patient response (including single samples) to immunotherapy. We also trained LogitDA score cutoffs that prioritize minimizing false negatives of predictions, and derived an applicability metric with empirically derived thresholds to assess whether LogitDA predictions can be reliably extrapolated to new cohorts. This GUI is demonstrated using four independent cohorts in mUC and mRCC. Overall, this user-friendly platform is designed to support clinicians and researchers by delivering ICI response predictions together with explicit safeguards for their interpretation in advanced or metastatic UC and RCC.

Materials & Methods

Training datasets

We used the IMvigor210 and the IMmotion150 cohorts as the training datasets, which were collected as previously described in Langfelder et al. (2025b).

Independent test datasets

We used PCD4989g (NCT01375842; Herbst et al., 2014) as test datasets in mUC and mRCC, which were obtained as previously described in Langfelder et al. (2025b). Additionally, we collected whole-transcriptome profiles of 89 and 11 patients with mUC (Rose et al., 2021; GSE111636 (henceforth the Moreno cohort)), which served as unseen cohorts to demonstrate how this GUI can be used to guide treatment in clinics. Clinical responses in the IMvigor210, PCD4989g, and IMmotion 150 datasets were assessed according to RECIST 1.1 (Schwartz et al., 2016), and were grouped into responders (CR/PR) and non-responders (SD/PD), respectively, as described in Langfelder et al. (2025b). In total, the IMvigor210 (IMmotion150) cohort included 298 (77) patients, with 68 (15) responders and 230 (62) non-responders. The PCD4989g test dataset for mUC (mRCC) included 94 (58) patients, with 22 (eight) responders and 72 (50) non-responders. Similarly, the clinical response in the UNC-108 and Moreno cohorts were classified by RECIST 1.1, of which there are 16 (∼18%) and six (∼55%) responders out of 89 and 11 samples in total. IMvigor210 dataset is available in European Genome-Phenome Archive (EGA) under accession number EGAS00001002556. Data for the clinical trials IMmotion150 and PCD4989g are available under restricted access in European Genome-Phenome Archive with the reference number EGAS00001004343. Raw and clinical data of PCD4989g were accessed via Genentech’s internal Strand pipeline (South San Francisco, USA), and downloaded using pyEGA3 (https://github.com/EGA-archive/ega-download-client). Both the UNC-108 and Moreno cohorts were downloaded from GEO with accession number GSE176307 and GSE111636, respectively.

Standardization of training and test data

We implemented the same standardization procedures for training and test data as described in the Methods of Langfelder et al. (2025b).

Clinically motivated performance metrics and the trained cutoffs

Let Dtrain denote the training dataset, which was selected such that its sample size and event rate were close to the observed objective response rate. This was intended to ensure that Dtrain is representative of the target population with respect to response prevalence. Let si denote the LogitDA score for subject i, and let yi ∈ {0,1} denote the observed response status, where 1 and 0 correspond to responder and non-responder, respectively.

To reflect the clinical priority of minimizing false negatives (more important than false positives), we adopted an asymmetric decision thresholds rather than the default probability cutoff of 0.5. Specifically, we define an upper cutoff cUfor responder prediction and a lower cutoff cL for non-responder prediction, where cU∈0.6,0.9 and cL ∈ [0.1, 0.4], each evaluated in increments of 0.01.

For each candidate cutoff pair (cU, cL), predictions are defined as follows.

y ˆi=1,si>cU,0,si<cL,NA,otherwise.

Using the IMvigor210 cohort as the training set, we evaluated each candidate cutoff pair according to three criteria, ranked lexicographically: (1) minimum false negative rate, (2) maximum true positive rate, and (3) maximum precision.

The top five cutoff pairs were retained, and the top-ranked pair was selected. In our implementation, this resulted in an upper cutoff cU = 0.50, and a lower cutoff cL = 0.29. These LogitDA score thresholds were then fixed and applied to the four independent datasets, e.g., PCD (mUC), and future datasets. Accordingly, for any new subject, si > 0.50 is predicted as responder, si < 0.29 is predicted as non-responder, and intermediate scores are classified as not applicable (i.e., NA).

Because the fixed score cutoffs are sensitive to scale, this procedure assumes that future data are on the same scale as the training data. Therefore, we recommend applying the trained cutoffs only to properly normalized data. To support this requirement, we have incorporated a machine learning-based normalization procedure into the GUI implementation.

The cosine distance

The cosine distance was used to quantify similarity between an uploaded sample and responder/non-responder groups in the training cohort based on gene-expression profiles. The cosine distance between an uploaded sample xK and the Rs (NRs) of the test set y1j (y2j) is defined as follows.

Cosine distance=1−∑j=1Ji∑k=1Kxkyijk∑k=1Kxk2∑k=1Kyijk2,

where i = 1 and 2, and y1j (y2j) denote the jth responder R (non-responder NR) in the test data used for domain adaptation in training LogitDA, yijk and xk represent the kth gene of the signature in the training sample yij and a new uploaded data. For example, K = 49 for mUC, y1 contains 68 Rs and y2 contains 230 NRs in the IMvigor210 training set.

While cosine distance provides an intuitive measure of proximity, its direct use for classification requires ad hoc thresholds that are difficult to justify clinically. Furthermore, in a pilot study the cosine distance method yielded only 70% applicability in PCD4989g(mUC) and 60% in PCD4989g(mRCC), which did not reflect their prediction accuracy of 75% and 83% using the default cutoff 0.50 for LogitDA scores (Tables S2A and S2B), respectively.

ORR information-based cosine distance and the applicability metric

To address the limitations of cosine distance, we developed an ORR-informed cosine distance metric (iCosineDist) method and the associated percentage of applicability. Based on large clinical studies reporting ORRs of approximately 15–25% for patients with mUC and mRCC treated with ICIs (Powles et al., 2018; Motzer et al., 2015), we adopted a median ORR of 20% as the expected responder proportion. For a newly uploaded cohort, samples were ranked by their average cosine distance to the responder group, and the top 20% were labeled as responders, with the remainders labeled as NRs, thereby defining the iCosineDist labels.

We define the percentage of applicability, a metric that quantifies the applicability of LogitDA to unseen datasets, as follows.

Percentage of applicability=total matchestotal samples×100%,

where total matches denotes the number of samples whose LogitDA-predicted labels are consistent with those assigned by iCosineDist, and total samples denotes the total number of uploaded test samples.

Empirical thresholds for applicability of LogitDA to new cohorts

Using the IMvigor210 cohort as the training reference, we empirically examined the relationship between cohort-level applicability and prediction performance across three independent mUC and one mRCC cohorts. We observed that cohorts with applicability above approximately 70% consistently retained stable prediction performance (the PCD4989g(mUC and mRCC), Moreno and cohorts), whereas cohorts with the percentage of applicability below approximately 60% showed marked performance degradation (e.g., the UNC-108 cohort), indicating a distributional shift relative to the training data. Based on these observations, we adopted 70% and 60% as practical upper and lower bounds, respectively, to guide interpretation of model outputs. These thresholds are empirically observed heuristics rather than formal decision rules.

Results

The architecture of ImmunoResponse Predictor

This section outlines the structure of ImmunoResponse Predictor (the GUI), which comprises two main components: the Interface Unit and the Computing Unit. The overall workflow is depicted in Fig. S1, illustrating the integration between user interaction and backend computation.

  • (a)

    Interface unit: The Interface Unit serves as the front end of the system, where users can upload a gene-expression matrix (log2 (TPM+1)) and select the appropriate pre-trained LogitDA model (mUC or mRCC). The ImmunoResponse Predictor accepts a pre-treatment RNA-seq count or microarray matrix in .csv format, where rows represent samples and columns represent genes. The column names comprise either the 49-gene mUC signature and the 27-gene mRCC signature, or whole-transcriptome data for either cancer type, derived derived from biopsy or surgical samples collected prior to initiation of immunotherapy. The tool can accept four types of gene identifiers (gene symbol, Entrez gene IDs, Ensembl gene ID and Ensembl transcript ID). If some signature genes are absent, the system reports an error and prompts correction before prediction. Once a file is submitted, the interface passes the data to the Computing Unit, and the GUI predicts each sample as a responder (R), not applicable (NA), or a non-responder (NR), respectively. Finally, the GUI outputs a .csv file containing the sample IDs, LogitDA scores, predicted labels, and the percentage of applicability for a cohort.

  • (b)

    Computing unit: This backend module first extracts the expression values of the signature genes of LogitDA from the uploaded test data for mUC (mRCC), respectively. The GUI preprocesses the uploaded data by converting multiple gene IDs into Entrez IDs, conducting batch correction, and applying quantile normalization for mRCC cohort. Next, the system predicts each sample as either a R, not applicable (NA), or NR, and computes the percentage of applicability that quantifies how well LogitDA applies to new cohorts (see Methods).

The GUI usage

The GUI reports sample-level LogitDA scores with predicted labels and a cohort-level applicability score, provided multiple samples are uploaded.

Demonstration using real datasets

In this section, we first demonstrate the efficacy of the ImmunoResponse Predictor in predicting responses to immune checkpoint inhibitor (ICI) treatments using the PCD4989g cohorts (NCT01375842; Banchereau et al., 2021). These independent test datasets comprise whole-transcriptome RNA-seq profiles and corresponding clinical information from 94 and 58 patients with metastatic urothelial carcinoma (mUC) and metastatic renal cell carcinoma (mRCC), respectively. Hereafter, these cohorts are referred to as PCD(mUC) and PCD(mRCC).

With feature selection procedures that include unsupervised domain adaptation, LogitDA demonstrated strong predictive performance, as reflected by high AUC values across independent datasets (Langfelder et al., 2025a). In the PCD(mUC) cohort, LogitDA achieved a prediction AUC of 0.75 with an accuracy of 71%, while in mRCC it reached an AUC of 0.72 with an accuracy of 83%. Figure 1 illustrates the predictive performance of LogitDA, as measured by area under the ROC curve (AUC), applied to the PCD(mUC) cohort. The prediction results for LogitDA with all evaluated signatures are provided in Tables S2A and S2B, in which LogitDA with the identified mUC (49 genes) and mRCC (27 genes) signatures outperformed several existing immune-related signatures (Langfelder et al., 2025a). Collectively, these findings underscore the strong predictive capability of LogitDA with ours for immunotherapy response and its potential to improve patient stratification in mUC and mRCC.

Figure 1. The prediction AUC of the ROC curve of LogitDA with our signature (ours) and the six existing signatures (listed in Table S1).

Figure 1

Demonstration of LogitDA with the trained cutoffs using four independent cohorts

In this study, we additionally collected two mUC cohorts from the public domain (Rose et al., 2021; GSE111636; see Materials), hereafter referred to as UNC-108 and Moreno, to evaluate performance of LogitDA on newly uploaded datasets. From a clinical perspective, avoiding false negatives (FNs), patients who could benefit from immune checkpoint inhibitors (ICIs) but are incorrectly predicted as non-responders, is generally more critical than minimizing false positives (FPs), particularly in mUC and mRCC where durable responders exist. Accordingly, we used the IMvigor210 cohort to train LogitDA score cutoffs to reflect this clinical priority (see Methods).

Test samples from the PCD(mUC), PCD(mRCC), Moreno, and UNC-108 cohorts were classified as responder (R), NA, or non-responder (NR) according to the trained cutoffs (see Methods). LogitDA with our signature (ours) demonstrated stable performance in the PCD(mUC), PCD(mRCC), and Moreno cohorts, but only moderate performance in the UNC-108 cohort. The corresponding prediction accuracies of 69%, 83%, 86%, and 53%, respectively. The associated false negative rates (FNRs; corresponding precisions) were 0% (41%) for PCD (mUC), 33% (40%) for PCD (mRCC), 25% (100%) for Moreno, and 27% (24%) for UNC-108 (see Table 1 for details).

Table 1. Performance of LogitDA with four signatures in response prediction to ICIs across four cohorts.

A. The PCD4989g(mUC) cohort
Signatures CV
result
Prediction resulta
AUC
(SE) (%)
AUC
(%)
accuracy
(%)
FNR
(%)
Recall (%) Precision
(%)
TPs TNs FPs FNs
Oursb 77 75 69 0 100 40 12 25 17 0
PD-L1 57 55 40 17 83 26 15 15 42 3
tGE8 (8) 68 65 61 45 55 31 12 45 27 10
IFN-γ (18) 70 67 67 41 59 37 13 50 22 9

Notes.

a

The prediction results of LogitDA with ours were obtained using the trained cutoffs for LogitDA scores.

b

Ours denotes the identified gene signatures of LogitDA for mUC/mRCC (Langfelder et al., 2025a; Langfelder et al., 2025b), the genes of tGE8 and IFN-γ signatures are listed in Table S1.

Next, we compared LogtDA with ours to LogitDA using three well-established signatures, PD-L1 (Banchereau et al., 2021), tGE8 (an eight-gene T cell–related signature; Lakatos et al., 2020), and IFN-γ (Ayers et al., 2017). As shown in Table 1, LogitDA with our signature outperformed LogitDA with these signatures across the PCD(mUC), Moreno, and UNC-108 cohorts in terms of lower false negative rates and higher recall, ranking second only to PD-L1. However, our approach substantially outperformed PD-L1 in precision (40% vs. 15%), as PD-L1 identified only six true positives among 39 predicted positives.

Clinical use and interpretation of outputs

We further examined the relationship between cohort-level applicability (see Methods) and prediction performance of LogitDA across these independent datasets. As shown in Table 2, cohorts with applicability values above approximately 70%, including the PCD(mUC), PCD(mRCC), and Moreno cohorts, consistently retained stable prediction performance. In contrast, the UNC-108 cohort exhibited applicability below 60% and achieved a prediction accuracy of only 53%, indicating a substantial shift relative to the training data. Notably, applicability values computed using CosineDist for the PCD(mRCC) and UNC-108 cohorts (60% and 73%, respectively) were inconsistent with their corresponding prediction accuracies (83% and 53%). By comparison, applicability based on iCosineDist more closely reflected observed performance. Accordingly, we recommend using iCosineDist-based applicability for future uploaded samples (see Table 2 for details).

Table 2. Prediction performances of LogitDA versus cohort applicability values across four independent cohorts.

Dataset Sample
size
Responder Non-Responder Percentage of responders (%) Accuracy
(%) the
trained cutoffs a
% of Applicability (iCosineDist b ) % of
Applicability (CosineDist)
PCD(mUC) 94 22 72 23 69 74 70
PCD(mRCC) 58 8 50 14 83 76 60
Moreno 11 6 5 55 86 71 73
UNC-108 89 16 73 18 53 48 73

Notes.

a

Predictions were based on the trained cutoffs: LogitDA scores >0.50 were classified as responders, scores <0.29 as non-responders, and intermediate scores (0.29 <score ≤ 0.50) as not applicable (NA). NA samples were excluded from performance calculations.

b

The iCosineDist and CosineDist denote the iCosine distance and cosine distance, respectively.

Based on these observations, we interpreted applicability values above 70% as indicating reliable predictions, values below 60% as unreliable, and values between 60% and 70% as requiring cautious interpretation. Importantly, these thresholds are not intended to serve as rigid clinical decision rules, but rather as conservative safeguards to guide interpretation of model outputs.

Details of cutoff derivation and applicability computation are provided in the Methods.

Table 3 summarizes the outputs of the ImmunoResponse Predictor for the Moreno cohort, including LogitDA scores, predicted labels based on the trained cutoffs, iCosineDist-based labels, and the corresponding applicability values. Complete prediction results for the PCD(mUC), PCD(mRCC), Moreno, and UNC-108 cohorts are provided in Table S3.

Table 3. The output of ImmunoResponse prediction, including percentage of applicability, of the Moreno Cohart.

SampleID CosDist_2_Rs CosDist_2_NRs LogitDA_Score LogitDA_
score_label a
True_label a iCosinDist_
label
% of applicability
GSM3036125 0.81 1.07 0.55 R R R 71
GSM3036135 0.90 1.03 0.32 NA NR R
GSM3036129 0.91 1.03 0.92 R R NR
GSM3036133 0.93 1.03 0.30 NA NR NR
GSM3036127 0.96 1.03 0.54 R R NR
GSM3036134 0.96 1.02 0.26 NR NR NR
GSM3036132 1.06 0.98 0.27 NR NR NR
GSM3036130 1.09 0.98 0.24 NR R NR
GSM3036131 1.10 0.97 0.24 NR NR NR
GSM3036128 1.11 0.95 0.44 NA R NR
GSM3036126 1.14 0.94 0.33 NA R NR

Notes.

a

LogitDA_ score_label, True_labela and iCosinDist_label denote the labels (R, NA or NR) assigned based on LogitDA scores, the observed responses in the Moreno cohort, and the iCosineDist metric, respectively.

Cohort-level applicability is critical for interpretation. When the percentage of applicability is high (e.g., above 75%), outputs from the GUI may be used to support clinical judgement. Conversely, even when predicted labels are strong (i.e., associated with high LogitDA scores), results should be interpreted cautiously if applicability is low. In particular, applicability values below 60% indicate limited similarity between the uploaded data and the training cohorts, suggesting that the GUI may not be applicable to these data. The cohort-level percentage of applicability is not intended to replace individual predictions. For very small sample sizes, this metric is not required for generating predictions and should be interpreted cautiously; when applicable, it provides complementary information on model reliability rather than a prerequisite for individual-level clinical use. Moreover, although transcriptomic predictors capture key aspects of tumor-immune biology, they do not account for all host-, treatment-, or disease-related factors that influence clinical outcomes. Accordingly, the ImmunoResponse Predictor is intended to support, rather than replace, clinical judgment.

Single-sample prediction and output interpretation

Because a common clinical use case involves evaluating a single patient or a small number of patients, the ImmunoResponse Predictor provides individual-level predictions directly for single samples (Table S4). The percentage of applicability is not required to generate individual-level predictions and is therefore not reported for single-sample inputs. For very small sample sizes, this metric should be interpreted cautiously, as it primarily reflects cohort-level model reliability rather than individual-level prediction confidence.

The trained LogitDA score cutoffs (>0.50 for responders and <0.29 for non-responders) remain applicable for single-sample predictions. As a practical rule of thumb when interpreting GUI outputs for individual samples, LogitDA scores closer to 1.0 indicate a higher likelihood of response to immune checkpoint inhibitors (ICIs), whereas scores closer to 0 indicate a higher likelihood of non-response; scores near the decision cutoffs should be interpreted with caution.

Other clinical factors to be considered when interpreting the outputs

Predictions generated by the ImmunoResponse Predictor should be interpreted within the broader clinical context, including prior treatments (e.g., chemotherapy or targeted therapies that may alter the tumor immune microenvironment and gene expression profiles), line of therapy (as response rates and durability are generally higher in earlier treatment lines), patient characteristics such as age, sex, and performance status (e.g., ECOG), and tumor features including histology and molecular subtype.

Installation and dependencies

Users can access the ImmunoResponse Predictor at GitHub, and it can be downloaded for local use from https://github.com/gshieh/ImmunoResponsePredictor. The application is implemented in R (v4.3.2; R Core Team, 2023) using the Shiny framework for both preprocessing and prediction, leveraging R’s robust ecosystem. The system runs on a Windows platform powered by an Intel® Core™ i7-13700 processor with 16 GB of RAM.

Discussion

The ImmunoResponse Predictor was developed to facilitate practical use of transcriptomic response models while explicitly addressing challenges associated with external validation. Built on LogitDA and identified gene signatures for mUC and mRCC, the GUI enables non-technical users to generate response predictions to PD-L1 inhibitors such as atezolizumab with minimal technical burden. The tool is intentionally framed as a decision-support system: individual-level predictions are provided for single patients, while cohort-level applicability functions as a conservative safeguard when uploaded data deviate from the validated domain.

A key limitation of transcriptomic predictors is their sensitivity to distributional shift, which can compromise reliability when applied to unseen cohorts. To mitigate this risk, the GUI integrates clinically motivated LogitDA score cutoffs together with an explicit assessment of cohort-level applicability, allowing users to identify settings in which predictions should be interpreted cautiously. Cutoffs were derived by prioritizing clinically relevant error trade-offs, specifically minimizing false negatives before optimizing recall and precision, reflecting the higher clinical cost of failing to identify true responders to immune checkpoint inhibitors.

Importantly, the percentage of applicability is not intended to predict treatment response or to serve as a surrogate for predictive accuracy. Rather, it provides a conservative indicator of potential unreliability when uploaded data substantially deviate from the training cohorts. Individual-level predictions remain available for single patients, while applicability offers complementary guidance when cohort-level interpretation is appropriate. Together, these components support cautious and transparent use of transcriptomic predictors in clinical and translational research.

The empirical thresholds for the percentage of applicability were derived from four independent cohorts; additional cohorts will be required to further refine and validate these thresholds. Future work will also examine how the choice of distance metric for quantifying similarity between new samples and responder/non-responder groups influences applicability estimates. Finally, we plan to extend the GUI to include a response predictor for melanoma, which has relatively high objective response rates (∼40–45%) to immune checkpoint inhibitors and represents a clinically important population for such tools.

Conclusions

In summary, we present the ImmunoResponse Predictor, a user-friendly GUI built on LogitDA and identified gene signatures for mUC and mRCC. By combining clinically informed score cutoffs with an explicit assessment of cohort-level applicability, the tool enables cautious interpretation of immunotherapy response predictions under potential distributional shift. Designed to support rather than replace clinical judgment, the GUI provides individual-level predictions together with safeguards highlighting limitations when new data fall outside the validated domain. This framework represents a practical step toward responsible translation of transcriptomic predictors into clinical and translational research, and its public web-based deployment enables access from any location with an internet connection.

Supplemental Information

Supplemental Information 1. The output and annotations of LogitDA.
peerj-14-21553-s001.xlsx (11.8KB, xlsx)
DOI: 10.7717/peerj.21553/supp-1
Supplemental Information 2. Our signature for mUC/mRCC outperformed the other well-known ones.
DOI: 10.7717/peerj.21553/supp-2
Supplemental Information 3. Output of the ImmuneResponse predictor for ORR information-based cosine distance.
peerj-14-21553-s003.xlsx (53.8KB, xlsx)
DOI: 10.7717/peerj.21553/supp-3
Supplemental Information 4. Single sample output PCD(mUC).
DOI: 10.7717/peerj.21553/supp-4
Supplemental Information 5. Architecture diagram of ImmunoResponse Predictor.
peerj-14-21553-s005.docx (95.6KB, docx)
DOI: 10.7717/peerj.21553/supp-5
Supplemental Information 6. Sample test file for mUC.
peerj-14-21553-s006.csv (11.9MB, csv)
DOI: 10.7717/peerj.21553/supp-6
Supplemental Information 7. Sample test file for mRCC.
peerj-14-21553-s007.csv (16.1MB, csv)
DOI: 10.7717/peerj.21553/supp-7
Supplemental Information 8. Technical report of mUC/mRCC.
DOI: 10.7717/peerj.21553/supp-8

Acknowledgments

We thank Genentech for providing the raw RNA-seq and clinical data of PCD4989g. We are grateful to Peter Langfelder for assistance with LogitDA development; Sz-Tsun Hou and Shen-Han Chiu for computational support; Hong-Lian Jian and Ta-Chien Chan for code deployment to GitHub and Shinyapps.io during revision; and Spandana Vadloori for early-stage contributions. ChatGPT (OpenAI) was used solely for grammar checking and manuscript polishing; it was not used in GUI development, data analysis, or results interpretation.

Funding Statement

This research was supported by a group research grant, from Institute of Statistical Science, Academia Sinica, Taiwan, and NSTC (113-2118-M-001-002, and 114-2118-M-001-001) to GSS and NSTC 114-2118-M-001-011 to SY from National Science & Technology Council, Taiwan, Republic of China. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

Additional Information and Declarations

Competing Interests

The authors declare there are no competing interests.

Author Contributions

Rajat Butola performed the experiments, analyzed the data, prepared figures and/or tables, and approved the final draft.

Shinsheng Yuan analyzed the data, authored or reviewed drafts of the article, and approved the final draft.

Grace S. Shieh conceived and designed the experiments, performed the experiments, analyzed the data, prepared figures and/or tables, authored or reviewed drafts of the article, and approved the final draft.

Data Availability

The following information was supplied regarding data availability:

The data and test files for the mUC and mRCC models are available in the Supplemental Files.

The code is available at GitHub and Zenodo:

- https://github.com/gshieh/ImmunoResponsePredictor

- gshieh. (2026). gshieh/ImmunoResponsePredictor: ImmunoResponsePredictor (v1.0.1). Zenodo. https://doi.org/10.5281/zenodo.18616476

The data is available at: http://research-pub.gene.com/IMvigor210CoreBiologies/

The raw clinical data of PCD4989g are available at GitHub: https://github.com/EGA-archive/ega-download-client

Data for the clinical trial IMvigor210 is available in European Genome-Phenome Archive (EGA) under accession number EGAS00001002556.

The raw RNA-seq and clinical data for IMmotion150 and PCD4989g are third-party controlled-access clinical trial data and cannot be redistributed by the authors because access is governed by Genentech/EGA data-use agreements. Qualified researchers may request access through the original data providers/repositories, where applicable.

To enable reproducibility of the analyses reported in this article, the processed gene-expression matrices used by the ImmunoResponse Predictor, response labels used for model training/testing, gene signatures, analysis scripts, and example input/output files are available at the following links:

- https://zenodo.org/records/18616476

- https://github.com/gshieh/ImmunoResponsePredictor.

These processed data are sufficient to reproduce the reported LogitDA scores, classifications, validation metrics, and applicability analyses.

References

  • Ayers et al. (2017).Ayers M, Lunceford J, Nebozhyn M, Murphy E, Loboda A, Kaufman DR, Albright A, Cheng JD, Kang SP, Shankaran V, Piha-Paul SA, Yearley J, Seiwert TY, Ribas A, McClanahan TK. IFN-γ–related mRNA profile predicts clinical response to PD-1 blockade. Journal of Clinical Investigation. 2017;127:2930–2940. doi: 10.1172/JCI91190. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • Banchereau et al. (2021).Banchereau R, Leng N, Zill O, Sokol E, Liu G, Pavlick D, Maund S, Liu LF, Kadel E III, Baldwin N, Jhunjhunwala S, Nickles D, Assaf ZJ, Bower D, Patil N, McCleland M, Shames D, Molinero L, Huseni M, Sanjabi S, Cummings C, Mellman I, Mariathasan S, Hegde P, Powles T. Molecular determinants of response to PD-L1 blockade across tumor types. Nature Communications. 2021;12:3969. doi: 10.1038/s41467-021-24112-w. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • Cristescu et al. (2018).Cristescu R, Mogg R, Ayers M, Albright A, Murphy E, Yearley J, Sher X, Liu XQ, Lu H, Nebozhyn M, Zhang C, Lunceford JK, Joe A, Cheng J, Webber AL, Ibrahim N, Plimack ER, Ott PA, Seiwert TY, Ribas A, McClanahan TK, Tomassini JE, Loboda A, Kaufman D. Pan-tumor genomic biomarkers for PD-1 checkpoint blockade-based immunotherapy. Science. 2018;362:eaar3593. doi: 10.1126/science.aar3593. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • Gajate et al. (2020).Gajate P, Torres-Jiménez J, Bueno-Bravo C, Couñago F. Practice change in the management of metastatic urothelial carcinoma after ASCO 2020. World Journal of Clinical Oncology. 2020;11:976–982. doi: 10.5306/wjco.v11.i12.976. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • Havel, Chowell & Chan (2019).Havel JJ, Chowell D, Chan TA. The evolving landscape of biomarkers for checkpoint inhibitor immunotherapy. Nature Reviews Cancer. 2019;19:133–150. doi: 10.1038/s41568-019-0116-x. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • Herbst et al. (2014).Herbst RS, Soria JC, Kowanetz M, Fine GD, Hamid O, Gordon MS, Sosman JA, McDermott DF, Powderly JD, Gettinger SN, Kohrt HE, Horn L, Lawrence DP, Rost S, Leabman M, Xiao Y, Mokatrin A, Koeppen H, Hegde PS, Mellman I, Chen DS, Hodi FS. Predictive correlates of response to the anti-PD-L1 antibody MPDL3280A in cancer patients. Nature. 2014;515:563–567. doi: 10.1038/nature14011. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • Jeng et al. (2023).Jeng XJ, Hu Y, Venkat V, Lu TP, Tzeng JY. Transfer learning with false negative control improves polygenic risk prediction. PLOS Genetics. 2023;19:e1010597. doi: 10.1371/journal.pgen.1010597. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • Jiang et al. (2018).Jiang P, Gu S, Pan D, Fu J, Sahu A, Hu X, Li Z, Traugh N, Bu X, Li B, Liu J, Freeman GJ, Brown MA, Wucherpfennig KW, Liu XS. Signatures of T cell dysfunction and exclusion predict cancer immunotherapy response. Nature Medicine. 2018;24:1550–1558. doi: 10.1038/s41591-018-0136-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • Lakatos et al. (2020).Lakatos E, Williams MJ, Schenck RO, Cross WCH, Househam J, Zapata L, Werner B, Gatenbee C, Robertson-Tessi M, Barnes CP, Anderson ARA, Sottoriva A, Graham TA. Evolutionary dynamics of neoantigens in growing tumors. Nature Genetics. 2020;52:1057–1066. doi: 10.1038/s41588-020-0687-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • Langfelder et al. (2025a).Langfelder P, Lin ET, Tsai YT, Cha TL, Shieh GS. Gene signature for response prediction to immunotherapy in metastatic urothelial carcinoma and renal cell carcinoma. Institute of Statistical Science, Academia Sinica, Taipei, TaiwanTechnical Report 2025-02. 2025a
  • Langfelder et al. (2025b).Langfelder P, Lin ET, Tsai YT, Cha TL, Shieh GS. Gene signature for response prediction to immunotherapy and prognostic markers in metastatic urothelial carcinoma. Frontiers in Immunology. 2025b;16:1607222. doi: 10.3389/fimmu.2025.1607222. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • Ma et al. (2021).Ma J, Fong SH, Luo Y, Bakkenist CJ, Shen JP, Mourragui S, Wessels LFA, Hafner M, Sharan R, Peng J, Ideker T. Few-shot learning creates predictive models of drug response that translate from high-throughput screens to individual patients. Nature Cancer. 2021;2:233–244. doi: 10.1038/s43018-020-00169-2. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • Mariathasan et al. (2018).Mariathasan S, Turley SJ, Nickles D, Castiglioni A, Yuen K, Wang Y, Kadel EE III, Koeppen H, Astarita JL, Cubas R, Jhunjhunwala S, Banchereau R, Yang Y, Guan Y, Chalouni C, Ziai J, Şenbabaoğlu Y, Santoro S, Sheinson D, Hung J, Giltnane JM, Pierce AA, Mesh K, Lianoglou S, Riegler J, Carano RAD, Eriksson P, Höglund M, Somarriba L, van der Heijden MS, Loriot Y, Rosenberg JE, Fong L, Mellman I, Chen DS, Green M, Derleth C, Fine GD, Hegde PS, Bourgon R, Powles T. TGFβ attenuates tumour response to PD-L1 blockade by contributing to exclusion of T cells. Nature. 2018;554:544–548. doi: 10.1038/nature25501. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • Motzer et al. (2015).Motzer RJ, Escudier B, McDermott DF, George S, Hammers HJ, Srinivas S, Tykodi SS, Sosman JA, Procopio G, Plimack ER, Castellano D, Choueiri TK, Gurney H, Donskov F, Bono P, Wagstaff J, Gauler TC, Ueda T, Tomita Y, Schutz FA, Kollmannsberger C, Larkin J, Ravaud A, Simon JS, Xu LA, Waxman IM, Sharma P, for the CheckMate 025 Investigators Nivolumab versus everolimus in advanced renal-cell carcinoma. New England Journal of Medicine. 2015;373:1803–1813. doi: 10.1056/NEJMoa1510665. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • Powles et al. (2018).Powles T, Durán I, Van der Heijden MS, Loriot Y, Vogelzang NJ, De Giorgi U, Oudard S, Retz MM, Castellano D, Bamias A, Fléchon A, Gravis G, Hussain S, Takano T, Leng N, Kadel EE III, Banchereau R, Hegde PS, Mariathasan S, Cui N, Shen X, Derleth CL, Green MC, Ravaud A. Atezolizumab versus chemotherapy in patients with platinum-treated locally advanced or metastatic urothelial carcinoma (IMvigor211) Lancet. 2018;391:748–757. doi: 10.1016/S0140-6736(17)33297-X. [DOI] [PubMed] [Google Scholar]
  • R Core Team (2023).R Core Team . Version 4.3.2. Vienna: R Foundation for Statistical Computing; 2023. R: A language and environment for statistical computing. [Google Scholar]
  • Rose et al. (2021).Rose TL, Weir WH, Mayhew GM, Shibata Y, Eulitt P, Uronis JM, Zhou M, Nielsen M, Smith AB, Woods M, Hayward MC, Salazar AH, Milowsky MI, Wobker SE, McGinty K, Millburn MV, Eisner JR, Kim WY. Fibroblast growth factor receptor 3 alterations and response to immune checkpoint inhibition in metastatic urothelial cancer. British Journal of Cancer. 2021;125:1251–1260. doi: 10.1038/s41416-021-01488-6. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • Schwartz et al. (2016).Schwartz LH, Seymour L, Litière S, Ford R, Gwyther S, Mandrekar S, Shankar L, Bogaerts J, Chen A, Dancey J, Hayes W, Hodi FS, Hoekstra OS, Huang EP, Link N, Liu Y, Therasse P, Wolchok JD, de Vries E. RECIST 1.1—standardization and disease-specific adaptations: perspectives from the RECIST Working Group. European Journal of Cancer. 2016;62:138–145. doi: 10.1016/j.ejca.2016.03.082. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • Wang et al. (2022).Wang X, Wang Y, Wong K, Li X. A self-adaptive weighted differential evolution approach for large-scale feature selection. Knowledge-Based Systems. 2022;235:107633. doi: 10.1016/j.knosys.2021.107633. [DOI] [Google Scholar]
  • World Cancer Research Fund (2025).World Cancer Research Fund Cancer statistics. 2025. https://www.wcrf.org/preventing-cancer/cancer-statistics/ https://www.wcrf.org/preventing-cancer/cancer-statistics/
  • Yuan et al. (2023).Yuan S, Chen Y, Tsai C, Chen H, Shieh GS. Feature selection translates drug response predictors from cell lines to patients. Frontiers in Genetics. 2023;14:1217414. doi: 10.3389/fgene.2023.1217414. [DOI] [PMC free article] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

Supplemental Information 1. The output and annotations of LogitDA.
peerj-14-21553-s001.xlsx (11.8KB, xlsx)
DOI: 10.7717/peerj.21553/supp-1
Supplemental Information 2. Our signature for mUC/mRCC outperformed the other well-known ones.
DOI: 10.7717/peerj.21553/supp-2
Supplemental Information 3. Output of the ImmuneResponse predictor for ORR information-based cosine distance.
peerj-14-21553-s003.xlsx (53.8KB, xlsx)
DOI: 10.7717/peerj.21553/supp-3
Supplemental Information 4. Single sample output PCD(mUC).
DOI: 10.7717/peerj.21553/supp-4
Supplemental Information 5. Architecture diagram of ImmunoResponse Predictor.
peerj-14-21553-s005.docx (95.6KB, docx)
DOI: 10.7717/peerj.21553/supp-5
Supplemental Information 6. Sample test file for mUC.
peerj-14-21553-s006.csv (11.9MB, csv)
DOI: 10.7717/peerj.21553/supp-6
Supplemental Information 7. Sample test file for mRCC.
peerj-14-21553-s007.csv (16.1MB, csv)
DOI: 10.7717/peerj.21553/supp-7
Supplemental Information 8. Technical report of mUC/mRCC.
DOI: 10.7717/peerj.21553/supp-8

Data Availability Statement

The following information was supplied regarding data availability:

The data and test files for the mUC and mRCC models are available in the Supplemental Files.

The code is available at GitHub and Zenodo:

- https://github.com/gshieh/ImmunoResponsePredictor

- gshieh. (2026). gshieh/ImmunoResponsePredictor: ImmunoResponsePredictor (v1.0.1). Zenodo. https://doi.org/10.5281/zenodo.18616476

The data is available at: http://research-pub.gene.com/IMvigor210CoreBiologies/

The raw clinical data of PCD4989g are available at GitHub: https://github.com/EGA-archive/ega-download-client

Data for the clinical trial IMvigor210 is available in European Genome-Phenome Archive (EGA) under accession number EGAS00001002556.

The raw RNA-seq and clinical data for IMmotion150 and PCD4989g are third-party controlled-access clinical trial data and cannot be redistributed by the authors because access is governed by Genentech/EGA data-use agreements. Qualified researchers may request access through the original data providers/repositories, where applicable.

To enable reproducibility of the analyses reported in this article, the processed gene-expression matrices used by the ImmunoResponse Predictor, response labels used for model training/testing, gene signatures, analysis scripts, and example input/output files are available at the following links:

- https://zenodo.org/records/18616476

- https://github.com/gshieh/ImmunoResponsePredictor.

These processed data are sufficient to reproduce the reported LogitDA scores, classifications, validation metrics, and applicability analyses.


Articles from PeerJ are provided here courtesy of PeerJ, Inc

RESOURCES