Abstract
Background/Objectives: Survival outcomes with IL-2-free dinutuximab beta (DB) treatment strategies with and without 13-cis-retinoic acid (RA) have not been directly compared in a randomized study. We compared event-free survival (EFS) and overall survival (OS) between two study-defined cohorts with relapsed or refractory neuroblastoma receiving DB with or without RA. Methods: We retrospectively reanalyzed individual patient data from APN311-304 study (DB without RA, n = 36) and the experimental arm of APN311-202 V3 study (DB plus RA, n = 44). Eligibility and time zero were harmonized, and overlap-weighted Kaplan–Meier and Cox analyses were performed. An exploratory post-end-of-treatment landmark analysis was conducted among patients who remained alive and EFS-event-free through the landmark. Results: In the primary overlap-weighted analysis, no clear difference was detected between the cohorts for event-free survival (EFS; hazard ratio [HR], 0.92; 95% confidence interval [CI], 0.31–2.73) or overall survival (OS; HR, 1.95; 95% CI, 0.46–8.20). Cohort-specific effective sample sizes were 10.15 for no RA and 15.30 for RA versus nominal sizes of 36 and 44, respectively. Exploratory conditional landmark estimates were also imprecise for EFS (HR, 1.24; 95% CI, 0.37–4.12) and OS (HR, 0.44; 95% CI, 0.07–2.71). Conclusions: This exploratory comparison did not provide evidence of more favorable EFS or OS in the RA cohort than in the no-RA cohort. However, the estimates were highly imprecise and compatible with clinically important benefit or harm. The findings should not be interpreted as evidence of equivalence or as evidence that RA provides no benefit and should not alone guide continuation or omission of RA. Because RA use was perfectly aligned with the source study, the comparison cannot isolate a causal RA effect.
Keywords: neuroblastoma, dinutuximab beta, isotretinoin, 13-cis-retinoic acid, event-free survival, overall survival, propensity score, landmark analysis
1. Introduction
Dinutuximab beta (DB; Qarziba®) is a chimeric monoclonal antibody directed against disialoganglioside 2 (GD2), a cell surface antigen that is highly expressed on neuroblastoma cells but has limited expression in normal tissues. By binding to GD2, DB mediates tumor cell destruction primarily through immune effector mechanisms, including antibody-dependent cellular cytotoxicity and complement-dependent cytotoxicity, thereby enhancing the host antitumor immune response [1,2,3,4,5]. The rationale for targeting GD2 in neuroblastoma is well established, and anti-GD2 antibodies have become a cornerstone of immunotherapeutic strategies for this disease [1,5].
In Europe, DB is an established component of maintenance immunotherapy for patients with high-risk neuroblastoma and is also indicated for patients with a history of relapsed or refractory disease after stabilization of active disease [4]. In contemporary protocols, DB has been administered alone or with other agents, including interleukin-2 (IL-2) and 13-cis-retinoic acid (isotretinoin, RA). Randomized evidence showed that adding subcutaneous IL-2 to DB and RA increased toxicity without improving event-free survival, supporting IL-2-free DB regimens [6]. Whether EFS or OS differs between IL-2-free DB treatment strategies with and without RA remains unresolved.
RA is a differentiation agent rather than a conventional cytotoxic drug. In neuroblastoma models, 13-cis-RA and its active metabolites promote neurite outgrowth, inhibit proliferation, and can reduce MYCN expression through retinoid-receptor signaling [7]. These effects provide a biological rationale for using RA in a minimal-residual-disease setting, in which differentiation or growth arrest of residual tumor cells may complement immune-mediated tumor-cell killing by DB. The clinical precedent derives largely from post-consolidation treatment in newly diagnosed high-risk neuroblastoma, where earlier follow-up of CCG-3891 favored RA over no further therapy, although the difference was attenuated with longer follow-up [8,9]. These data do not isolate the contribution of RA when an anti-GD2 antibody is already present.
A more specific interaction with anti-GD2 therapy is biologically plausible but incompletely established. In preclinical experiments, all-trans retinoic acid maintained GD2 expression in most tested neuroblastoma cell lines and enhanced antibody-dependent cellular cytotoxicity mediated by the anti-GD2 antibody Hu14.18K322A [10]. However, those experiments used all-trans retinoic acid, a different anti-GD2 antibody, and short-term in vitro or ex vivo systems. They therefore support a testable hypothesis of complementarity, not clinical proof of synergy between isotretinoin and DB. No randomized component trial has directly compared DB plus RA with DB alone in a clinically comparable R/R (relapsed or refractory) population. More broadly, patient advocates have emphasized the need to critically reassess components of intensive multimodal neuroblastoma therapy that may increase treatment burden [11].
For R/R neuroblastoma, prospective phase II data have shown that single-agent DB administered as a long-term infusion is active and well tolerated, with clinically meaningful response rates and 3-year progression-free survival (PFS) and overall survival (OS) rates of 31% and 66%, respectively [2]. Broader reviews emphasize that the treatment of high-risk and relapsed neuroblastoma is multimodal and that further therapeutic advances remain necessary [3].
The specific contribution of RA to clinical outcomes when coadministered with DB in relapsed or refractory neuroblastoma remains unclear. No randomized study has directly compared DB plus RA with DB alone in a clinically comparable maintenance population, and the available evidence was not designed to isolate the independent effect of RA in this setting [3]. Addressing this question using conventional observational designs or indirect comparisons is methodologically challenging because treatment exposure accumulates over time, whereas early relapse, disease progression, or death may shorten treatment duration. Consequently, naïve analyses that do not account for the timing of treatment exposure or cumulative dose are susceptible to guarantee-time or immortal-time bias. Landmark analyses, time-dependent exposure definitions, and inverse probability weighting are among the recommended approaches when treatment assignment or classification depends on post-baseline events [12,13,14,15,16,17,18].
We therefore performed an exploratory, hypothesis-generating comparison of individual patient data from two prospective cohorts treated with IL-2-free DB strategies with or without RA. After harmonizing eligibility criteria and time zero, we used propensity-score overlap weighting to compare EFS and OS between the study-defined cohorts in the population represented by patients with overlapping measured baseline characteristics. Because RA use was perfectly aligned with the source study, any observed between-cohort differences could not be attributed independently to RA rather than to unmeasured patient-level or protocol-level differences. The post-EOT (post-end-of-treatment) landmark analysis was exploratory and conditional on remaining alive and EFS-event-free through the landmark.
2. Materials and Methods
2.1. Study Design
This was an exploratory unanchored indirect comparison of time-to-event outcomes using IPD (individual patient data) from prospective studies evaluating DB in patients with R/R neuroblastoma. Both unadjusted (naïve) and population-adjusted analyses were performed, with the latter using inverse probability weighting. Because treatment strategy was completely determined by the source study, the analysis could reduce measured patient-level imbalance but could not separate an RA effect from unmeasured patient-level or protocol-level differences. The validity of the comparison depended on the assumption that all prognostic factors and treatment-effect modifiers that differed between studies were measured and adequately controlled through eligibility restriction and weighting.
The following two cohorts were included in the comparison:
Non-RA cohort comprising patients with R/R neuroblastoma who received DB monotherapy, without concomitant RA or IL-2; and
RA cohort comprising patients with R/R neuroblastoma who received DB in combination with RA, without concomitant IL-2.
Harmonized inclusion criteria were applied across both study cohorts. To ensure analytical consistency, a common time zero for EFS and OS was defined. In the base-case analysis, time zero for both EFS and OS was the date of the first DB administration in each cohort. This alignment was intended to improve comparability by using a common index date; it does not account for differences in supportive care, eligibility, assessment schedules, or other study-level factors. We sought to address these limitations by applying harmonized eligibility criteria across the two study cohorts and using adjusted indirect comparison methods based on propensity-score (PS) weighting to balance the cohorts with respect to key baseline prognostic factors.
Recent findings indicate that greater DB exposure was associated with both EFS and OS [19]. The effects of RA and DB may be interdependent, and exposure to both treatments accumulates over time. Events such as disease progression, relapse, or death (which define EFS or OS) frequently terminate or shorten treatment, such that patients with early progression typically receive fewer treatment cycles and a lower cumulative DB dose. Consequently, simply adjusting for DB exposure when comparing the RA and no-RA cohorts may introduce substantial bias, including immortal-time bias (where patients must survive long enough to receive the full planned treatment) and reverse causation (where a lower cumulative DB dose is a consequence, rather than a cause, of shorter EFS or OS) [14,15]. Therefore, in a complementary analysis, post-treatment EFS and OS were evaluated only among patients who remained alive and EFS-event-free through a post-EOT landmark defined as 25 days after the last DB administration. Weighted landmark analyses were then performed conditional on reaching this landmark.
Conditioning on survival to the post-EOT landmark may itself introduce selection bias. Therefore, stabilized inverse probability of selection weights (IPSWs) for inclusion at the post-EOT landmark were estimated using baseline and pre-landmark covariate history [16,17]. The weights were then truncated at the 1st to 99th percentiles to reduce variance inflation [18]. Finally, weighted survival models were fitted from the post-EOT landmark to compare post-EOT EFS and OS between the RA and no-RA cohorts. The post-EOT landmark analysis was exploratory and conditional on patients remaining alive and EFS-event-free through the landmark. It therefore describes a selected post-treatment risk set and should not be interpreted as an intention-to-treat comparison or as confirmation of the base-case analysis.
2.2. Data Sources and Patient Selection
Among the prospective and protocol-defined DB cohorts considered for this assessment (Table 1), APN311-304 [2] was the only prospective source that provided individual patient data on DB monotherapy (i.e., without IL-2 or RA). APN311-202 V3 [20] provided the closest eligible source for DB plus RA without IL-2 that met the prespecified criteria. To compare long-term outcomes between patients receiving IL-2-free DB with and without RA, it was necessary to identify a data source that was as clinically comparable as possible to APN311-304 and that included DB in combination with RA.
Table 1.
Main prospective and protocol-defined DB cohorts considered for the assessment of treatment strategies with or without RA.
| Study, Cohort | Comment |
|---|---|
| Included studies | |
| APN311-304 [2] |
|
| APN311-202, V3 (stage II) [20] | |
| Excluded studies | |
| APN311-303 (compassionate use) [20] |
|
| APN311-202, V1 + V2 (stage I) [20] |
|
| APN311-302 R2/R4 [6] |
|
| Wieczorek et al. 2023 [21] |
|
| APN311-201 (Flaadt et al. 2023) [22] |
|
| Mueller et al. 2018 [23] |
|
| APN311-101 (Ladenstein et al. 2013) [20] |
|
DB—dinutuximab beta; IL-2—interleukin-2; IPD—individual patient data; SCT—stem cell transplantation.
The selection criteria were as follows: (i) patients with R/R neuroblastoma after stabilization of active disease, consistent with the disease setting in the DB indication [4]; (ii) an intended DB schedule matching the target regimen (up to five 35-day cycles, with DB administered over 5 or 10 days per cycle); (iii) no concomitant IL-2 with DB; (iv) an intended RA schedule consistent with clinical guidelines/practise (v) prospective study design; and (vi) availability of IPD.
The experimental arm of the APN311-202 V3 (stage II) study [20] met the predefined inclusion criteria.
Several differences were identified between the APN311-304 and APN311-202 V3 studies with respect to the inclusion and exclusion criteria, study design, and planned treatment regimens (Supplementary Table S2). APN311-202 V3 enrolled patients with HR-NBL following high-dose chemotherapy and stem cell rescue, whereas APN311-304 included patients with R/R disease that had been controlled with conventional therapy and also permitted enrollment of patients with early minimal bone marrow relapse (up to nine patients in APN311-304 had not received first-line high-dose therapy; information on subsequent stem cell transplantation in these patients was unavailable). The eligibility criteria were otherwise broadly comparable with respect to key indicators of clinical stability, including the absence of progressive disease at study entry, a performance status ≥ 70, a life expectancy of ≥12 weeks, a washout period of ≥2 weeks, and similar cardiopulmonary and laboratory eligibility requirements. However, APN311-202 V3 excluded all patients with prior exposure to DB, whereas APN311-304 excluded only patients who were anti-drug antibody–positive following previous anti-GD2 therapy (affected at least four patients in APN311-304).
Explicit alignment of time zero was required because the APN311-202 V3 study used randomization as the primary starting point for EFS, while the APN311-304 study was a single-arm study in which OS and PFS were secondary endpoints. Therefore, the indirect comparison used a harmonized time zero (e.g., the first administration of DB or an EOT landmark), consistent with the prespecified analytical approach. In addition, eligibility in the APN311-304 study was restricted to patients with evidence of disease at baseline, whereas the APN311-202 V3 study also allowed enrollment of patients without evidence of disease. This eligibility difference could have favored APN311-202 V3 because absence of detectable disease is prognostically favorable. To improve comparability with the APN311-304 study, patients in APN311-202 V3 without evidence of disease at baseline were excluded from the indirect comparison (i.e., patients without disease measurable by magnetic resonance imaging and/or computed tomography, and without disease evaluable by metaiodobenzylguanidine [MIBG] scintigraphy, technetium scintigraphy, or bone marrow histology). The harmonized inclusion and exclusion criteria for the indirect comparison are presented in Table 2. In simple terms, the RA cohort was drawn from APN311-202 V3, a randomized trial in which patients had undergone high-dose chemotherapy and stem-cell rescue, whereas the no-RA cohort was drawn from APN311-304, a single-arm relapsed/refractory study in which active disease had been stabilized with conventional treatment. The studies also differed in prior anti-GD2 exposure, eligibility regarding detectable disease, assessment schedules, calendar period, and subsequent therapy. Eligibility restriction, use of a common time zero, and weighting could address measured patient-level differences only; they could not eliminate differences inherent to the source studies.
Table 2.
Harmonized inclusion and exclusion criteria for the indirect comparison.
| Inclusion Criteria | Exclusion Criteria | |
|---|---|---|
| Base-case analysis |
|
|
| Additional exploratory restrictions evaluated in sensitivity analyses | - |
|
CNS, central nervous system; CT, computed tomography; DB, dinutuximab beta; FEV1, forced expiratory volume in 1 s; FVC, forced vital capacity; HIV, human immunodeficiency virus; IL-2, interleukin-2; INSS, International Neuroblastoma Staging System; MIBG, metaiodobenzylguanidine; MRI, magnetic resonance imaging; SpO2, peripheral oxygen saturation. Protocol eligibility required a performance status score of at least 70; however, the numerical baseline score was unavailable in the analytical dataset for 15/44 patients in the RA cohort.
Applying these criteria resulted in the inclusion of 80 patients: 36 from the APN311-304 study (DB without RA) and 44 from the APN311-202 V3 study (DB plus RA) (Figure 1).
Figure 1.

Patient selection. DB, dinutuximab beta; FAS, full analysis set; IL-2, interleukin-2; RA, 13-cis-retinoic acid.
2.3. Data Management
The present manuscript reports a secondary analysis and was not separately registered as a clinical trial. The original studies were registered as follows: APN311-304, ClinicalTrials.gov NCT02743429 and EudraCT 2014-000588-42; and APN311-202, ClinicalTrials.gov NCT01701479 and EudraCT 2009-018077-31.
This study was a retrospective reanalysis of IPD from these two prospective clinical trials. Eligible patients were selected from the full analysis set (FAS) of the APN311-304 study and from the experimental arm of the APN311-202 V3 study (DB plus RA, without IL-2) within its FAS (Figure 1). The following information was extracted for each patient:
2.3.1. Patient Characteristics, Determined According to Availability in Both Cohorts
date of birth, for patients from APN311-304, only the year of birth was available; therefore, a birth date of June 30 was assumed for each patient; this variable was used to calculate age at study entry and age at initial diagnosis;
sex, categorized as male or female;
date of initial diagnosis, used to calculate time from diagnosis in months and calendar year of diagnosis;
date of immunotherapy initiation, defined as the first administration of DB;
date of DB treatment completion, defined as the date of the last DB administration; this date was subsequently used to derive the post-EOT landmark by adding 25 days. For patients in APN311-202 V3 with a missing date of the last DB administration, the date was estimated from the number of treatment cycles, the 35-day cycle length, and the date of the first DB administration;
MYCN status (amplified, non-amplified, or missing);
International Neuroblastoma Staging System (INSS) stage at initial diagnosis (INSS stage or missing);
frontline high-dose therapy (busulfan and melphalan [BuMEL]; carboplatin, etoposide, melphalan [CEM], or MIBG therapy);
frontline treatment (local therapy, maintenance therapy, radiotherapy, surgery, and anti-GD2 maintenance therapy);
baseline performance status (Lansky or Karnofsky score);
baseline MIBG scan findings (soft tissue, distant lymph nodes, liver, and skeletal lesions);
number of DB treatment cycles, DB dose per cycle, and cumulative DB dose per m2;
number of RA treatment cycles and cumulative RA dose (mg).
2.3.2. Outcomes
date of censoring (date of the last follow-up assessment or last contact);
date of death;
date of the EFS event, defined as relapse, disease progression, other malignancy, or death;
OS event indicator (event, 1; no event—censored, 0);
EFS event indicator (event, 1; no event—censored, 0);
The following additional modifications were made to the database: (i) correction of a dosage entry error (decimal point error) for one patient in the APN311-202 V3 study; and (ii) recoding of a baseline performance status value of 0 as missing for one patient in the APN311-202 V3 study because it was considered a probable data entry error.
2.4. RA Treatment
In the APN311-202 V3 study, RA was administered at a dose of 160 mg/m2/day or, for patients weighing > 12 kg who were unable to swallow capsules, 200 mg/m2/day [24]. It was administered twice daily for 14 days of each treatment cycle, starting after completion of the DB infusion.
The study collected data on the number of RA cycles initiated and the cumulative RA dose administered across all cycles (expressed as milligrams per patient). The number of cycles initiated was designated the primary descriptive RA exposure metric; this choice parallels the use of initiated cycles for DB exposure [19].
2.5. Statistical Analysis
2.5.1. Endpoints
The study included two efficacy endpoints:
EFS: time to the first occurrence of disease progression, relapse, secondary neoplasm, or death from any cause;
OS: time to death from any cause.
The endpoints used in the present analysis were consistent with those of the original studies, except for APN311-304, in which PFS was the original endpoint (Supplementary Table S3).
For APN311-304, the harmonized time-to-event endpoint was derived from the available information on progression, relapse, and death. Information on secondary neoplasms was not available in the extracted dataset. Consequently, ascertainment of the secondary-neoplasm component of EFS could not be fully harmonized between the source studies.
The target contrast was between two trial-defined treatment strategies rather than between RA and no RA under otherwise identical conditions. Because treatment strategy was completely determined by the source study, the validity of the comparison required the strong assumption that all prognostic factors and treatment-effect modifiers differing between studies were measured, harmonized, and adequately controlled. Study-level effects could not be separated from RA use.
The original time zero for EFS and OS (baseline, study entry, or randomization) was harmonized across both cohorts. In the base-case analysis, time zero for EFS and OS was defined as the date of the first DB administration in both cohorts. In additional analyses evaluating post-treatment survival, time zero for EFS and OS was set at the post-EOT landmark. The post-EOT landmark was defined as the date of the last DB administration plus the standard 25-day interval between consecutive DB administrations used in the long-term infusion schedule. The 25-day interval was selected to avoid classifying patients as post-treatment while they were still within the expected interval before the next planned DB cycle. Patients who experienced an event before or on the post-EOT landmark were excluded from the analyses [19].
Safety endpoints were not analyzed because they were not comparable between the two studies. The methods used to collect and grade adverse events differed between study protocols and reflected differences in the periods during which the studies were conducted. Furthermore, RA-related adverse events (e.g., dyslipidemia, hepatic abnormalities, and mucocutaneous toxicities) are influenced by the intensity of safety monitoring, further limiting the validity of direct comparisons.
2.5.2. Covariates
The following covariates, considered potential predictors of clinical outcomes, were available and were considered in the descriptive and/or adjusted analyses: age at study entry (years); time from initial diagnosis to study entry (months); calendar year of diagnosis; country of residence; INSS stage at diagnosis (stage 4 vs. other); MYCN status at diagnosis (amplified vs. other); sex (male or female); frontline high-dose therapy (BuMEL, CEM, or MIBG therapy); frontline treatment (local therapy, maintenance therapy, radiotherapy, surgery, and anti-GD2 maintenance therapy); baseline performance status (Lansky or Karnofsky score); baseline MIBG scan findings (soft tissue, distant lymph nodes, liver, and skeletal lesions); and DB exposure, including the number of treatment cycles initiated, the number of cycles with a dose of at least 50 mg/m2, and the cumulative DB dose (mg/m2).
Baseline laboratory prognostic markers (e.g., ferritin and lactate dehydrogenase [LDH]) and baseline response status following re-induction/stabilization therapy were excluded from the analyses because the data were unavailable or incomplete. In the APN311-304 study, ferritin measurements and LDH measurements were missing for 37 and 35 patients, respectively, and no information on response status before study enrollment was available. Bone marrow assessment was also excluded because the data were unavailable in the APN311-202 V3 study.
2.5.3. Primary Handling of Missing Data
Patients with multiple missing characteristics or outcomes were planned to be excluded from the base-case analysis (there were only 2 exclusions from available full-analysis set (Figure 1). There was no missing data adjustment for continuous variables (no missing continuous data). The categorical variables (MYCN, performance scale) were extended with an explicit “Missing” category as an additional variable level. However, only one patient from no-RA cohort had missing MYCN data, hence the patient was included in the analysis under cumulative category level with non-amplified MYCN (‘Other MYCN’). Although protocol eligibility required a performance status score of at least 70, the numerical baseline score was unavailable in the analytical dataset for 15/44 patients (34.1%) in the RA cohort but was available for all 36 patients in the no-RA cohort. Because this missingness differed systematically by source study, baseline performance status was excluded from the propensity-score model and was not used to assess or claim post-weighting balance. No deterministic assignment, complete-case restriction, or model-based imputation of baseline performance status was performed. Because all missing performance-status values occurred in one source-study cohort and the available data did not support a credible reconstruction of their distribution, these approaches would have required strong and unverifiable assumptions and would not have resolved source-study confounding. Candidate covariates that caused collinearity, complete or quasi-complete separation, or nonconvergence of the propensity-score model were prespecified for exclusion. However, no candidate covariate otherwise eligible for the base-case model met these criteria; therefore, no additional covariates were excluded for collinearity, separation, or nonconvergence.
2.5.4. Comparison of Patient Characteristics
Baseline patient characteristics were compared between the cohorts using the χ2 test for categorical variables and the Wilcoxon rank-sum (Mann–Whitney U) test for continuous variables. For comparisons of weighted cohorts, continuous variables were compared using a test of the linear regression coefficient for the cohort indicator.
2.5.5. PS Weighting
A population-adjusted comparison of EFS and OS was performed using propensity-score overlap weighting. Propensity score weighting was used to balance the treatment cohorts with respect to key baseline prognostic factors. Patient characteristics were included in the PS model if they met the following criteria: (i) availability in both studies; and (ii) sufficient frequency in each study cohort. Variables represented by fewer than 3 patients in either study were excluded from the base-case analysis to avoid assigning excessive weights to individual patients. In the base-case analysis, the following baseline characteristics were included in the adjustment process: age at DB initiation, time from initial diagnosis (months), sex, presence of soft tissue lesions on baseline MIBG scan, presence of skeletal lesions on baseline MIBG scan, INSS stage at diagnosis, disease status (relapsed or refractory), MYCN status, and type of frontline treatment (maintenance therapy; radiotherapy; surgery; high-dose MIBG therapy; high-dose BuMEL therapy; and rapid cisplatin, vincristine, carboplatin, etoposide, cyclophosphamide chemotherapy; Supplementary Table S4).
The two-level cohort variable (DB without RA vs. DB plus RA) was modeled using logistic regression with covariates measured at the initiation of DB treatment. To mitigate limited covariate overlap and reduce sensitivity to extreme inverse probability weights, overlap weighting was applied, targeting the covariate distribution of patients within the region of common support (i.e., the average treatment effect in the overlap population) [18,19,25].
Model selection and assessment were based on the Box–Tidwell test for linearity of continuous covariates in the logit, the generalized Hosmer–Lemeshow test, and the log-likelihood. Interactions between covariates and quadratic terms for continuous covariates were considered to accommodate nonadditivity and nonlinearity, respectively. Candidate terms were evaluated using likelihood-ratio (LR) tests comparing nested models and were retained when they improved model fit (two-sided α = 0.05). Terms were added using a hierarchy-preserving forward-selection procedure. Among candidate terms with p < 0.05, the term yielding the largest increase in the LR χ2 statistic was entered first. The model was then refitted, and the remaining candidate terms were re-evaluated in descending order of LR χ2. A newly added term was retained only if it continued to improve model fit (LR test p < 0.05); otherwise, it was removed.
Post-weighting covariate distributions were summarized descriptively using the available validated weighted outputs. The cohort-specific effective sample size was reported as a diagnostic measure [18,19,26]. p values for weighted baseline comparisons were retained as descriptive outputs only and were not interpreted as evidence of covariate balance or absence of imbalance.
Patients without an event were censored at the date of their last available assessment or at the applicable source-study data cutoff.
The weighted IPD were analyzed using a weighted Cox proportional hazards model with robust variance estimation and the weighted Kaplan–Meier method. Hazard ratios were parameterized for RA versus no RA; therefore, HR < 1 indicates a lower event hazard in the RA cohort. Effect estimates and 95% confidence intervals were the primary basis for interpretation. p values are reported descriptively and were not used to infer equivalence or the absence of a between-cohort difference. All analyses were performed using StataNow 19.5SE (StataCorp., College Station, TX, USA).
2.5.6. Sensitivity Analyses
Several sensitivity analyses were prespecified, including a naïve comparison and post-landmark analyses with adjustment for DB exposure. The post-landmark analysis adjusted for DB exposure followed the methodology described previously [19]. Comparative survival analyses of the RA and no-RA groups were performed using a two-stage weighting approach to reduce bias arising from (i) selection into the post-landmark risk set and (ii) confounding in treatment assignment among patients who survived to the landmark.
First, the landmark analysis cohort was defined as patients who survived beyond the landmark without experiencing the EFS event, with follow-up commencing at the landmark. Stabilized IPSWs were estimated using a logistic regression model that included the cohort indicator and prespecified baseline and treatment covariates.
Among patients included in the landmark cohort, the PS for receiving RA was estimated using a logistic regression model that included the same covariates (excluding the treatment indicator) and DB exposure accumulated up to the landmark, defined as the number of DB cycles initiated [19]. Models were fitted with and without IPSWs. Propensity score overlap weights were then derived to target the population with clinical equipoise, with weights equal to 1 minus the PS for patients receiving RA and PS for patients not receiving RA.
Depending on the scenario, the final analysis weight was defined as (i) the product of the IPSWs and PS overlap weights, with both weights calculated independently; (ii) PS overlap weights estimated from a weighted PS model that incorporated IPSWs; (iii) the product of IPSWs and PS overlap weights, with the IPSWs estimated without including the cohort indicator; or (iv) PS overlap weights estimated from an unweighted PS model, targeting the population restricted to patients who were event-free at the EOT.
The sensitivity analysis scenarios are described in Supplementary Table S5.
No additional sensitivity analyses, missing-data reconstructions, subgroup analyses, or model variants were performed during the present revision.
3. Results
3.1. Patient Characteristics and Treatments
Before propensity-score weighting, notable differences were observed between the cohorts, particularly with respect to frontline treatment and baseline performance status (Supplementary Table S1). The cohorts also differed in subsequent treatment patterns; because these post-baseline treatments may reflect disease course, protocol differences, and clinical practice, they were not interpreted as measures of baseline comparability.
After weighting, the distributions of most covariates included in the propensity-score model became more similar between cohorts. Residual imbalance remained, particularly for five-cycle MSK m.N7 chemotherapy (p < 0.001). Baseline performance status was excluded from the propensity-score model because of study-dependent missingness and was found to vary between reweighted cohorts (p = 0.037). The statistically significant difference between cohorts in PS score was driven by missing data: p = 0.001 when the missing category was included in the unweighted comparison and p = 0.198 when the missing category was excluded The cohorts also differed in subsequent treatment patterns.
3.2. RA Exposure
In the APN311-202 V3 study, RA exposure data were available for all 44 patients with measurable or evaluable disease at baseline. Most patients (31/44, 70.5%) initiated five RA cycles, whereas fewer patients initiated two cycles (6/44, 13.6%), one cycle (3/44, 6.8%), four cycles (3/44, 6.8%), or three cycles (1/44, 2.3%). The mean number of cycles initiated was 4.20 (SD, 1.37; range, 1–5). The mean cumulative RA dose was 7237 mg (SD 3527), with a median of 7070 mg (interquartile range [IQR], 5600–8960) and a range of 700 to 21,000 mg. Among patients who initiated five cycles, the median cumulative dose was 8400 mg (IQR 7000–9240).
3.3. EFS and OS from the First DB Administration: PS-Weighted Analysis
In the overlap-weighted analysis from the first DB administration, no clear difference was detected between the two study-defined treatment cohorts for EFS (RA versus no RA: HR, 0.92; 95% CI, 0.31–2.73; p = 0.884) or OS (HR, 1.95; 95% CI, 0.46–8.20; p = 0.364; Figure 2). Both confidence intervals were wide and compatible with clinically important benefit or harm. The cohort-specific ESSs were 10.15 in the no-RA cohort and 15.30 in the RA cohort, compared with nominal sizes of 36 and 44, respectively. Because RA use was perfectly aligned with the source study, the estimates compared the two study-defined strategies rather than the independent causal effect of RA. In simple terms, patients whose baseline profiles were poorly represented in the other study received little weight, so the weighted survival contrasts were informed by a much smaller effective amount of data. This loss of information contributed to the wide confidence intervals and limited the ability to detect or rule out clinically relevant differences.
Figure 2.

EFS (upper panel) and OS (lower panel) from the first DB administration after PS weighting. Numbers at risk are sums of overlap weights and should not be interpreted as patient counts or effective sample sizes.
3.4. Sensitivity Analyses
3.4.1. Naïve Comparison
In the unadjusted (naïve) analysis, the estimated EFS event hazard was lower in the RA cohort, but the confidence interval included the null (HR, 0.57; 95% CI, 0.31–1.04; p = 0.067). The OS estimate was also statistically imprecise (HR, 0.96; 95% CI, 0.46–1.99; p = 0.903; Figure 3).
Figure 3.

EFS (upper panel) and OS (lower panel) in the unadjusted (naïve) comparison.
Due to substantial differences in patient characteristics (see the “Before PS weighting” section of Supplementary Table S1), study settings, prior treatments, and DB exposure, the results of the unadjusted (naïve) indirect comparison should be interpreted with extreme caution because of the high potential for confounding bias.
3.4.2. Exploratory Conditional Post-EOT Landmark Analysis with Adjustment for DB Exposure
A total of 80 patients initiated DB treatment across both studies. Of these, 19 experienced an EFS event on or before the landmark time point, defined as 25 days after the last DB administration. This included nine patients (25%) in the no-RA cohort and 10 patients (22.7%) in the RA cohort. The remaining 61 patients were included in the post-landmark survival analysis. This exploratory analysis included only patients who remained alive and EFS-event-free through the post-EOT landmark and therefore estimated survival within a selected conditional risk set. All patients, including those who experienced an event before the landmark, were included in the estimation of IPSWs.
After weighting, most measured characteristics appeared broadly similar; however, residual imbalance persisted, particularly for five-cycle MSK m.N7 chemotherapy (Table 3). This indicates that the post-landmark weighted comparison did not fully remove measured confounding.
Table 3.
Characteristics of the post-landmark study population by cohort.
| Characteristic | Weighted Post-Landmark Population A | ||||
|---|---|---|---|---|---|
| No RA (N = 27, Σw = 5.5) | RA (N = 34, Σw = 9.1) | p Value | |||
| Age at DB initiation | Median (IQR) | 7.6 (4.7 to 8.0) | 5.4 (5.0 to 7.0) | 0.763 | |
| Mean (SE) | 7.0 (0.8) | 6.6 (1.2) | |||
| Age at diagnosis | Median (IQR) | 5.1 (2.8 to 6.6) | 3.0 (3.0 to 4.5) | 0.400 | |
| Mean (SE) | 5.1 (0.7) | 4.2 (0.9) | |||
| Months since diagnosis | Median (IQR) | 17.0 (13.0 to 30.0) | 29.4 (20.3 to 29.4) | 0.965 | |
| Mean (SE) | 29.0 (6.2) | 29.3 (4.4) | |||
| Year of the diagnosis | Median (IQR) | 2015 (2014 to 2015) | 2013.0 (2013 to 2014) | By design (0.190) | |
| Mean (SE) | 2014.0 (0.6) | 2013.0 (0.4) | |||
| Sex | Male | n (%) | 3.7 (66.3%) | 4.4 (80.3%) | 0.431 |
| Female | 1.9 (33.8%) | 1.1 (19.7%) | |||
| Ethnicity | Asian | n (%) | 0.0 (0.0%) | 0.3 (3.8%) | 0.679 |
| Black | 0.0 (0.0%) | 0.0 (0.5%) | |||
| Italian/Philippines | 0.0 (0.0%) | 0.0 (0.1%) | |||
| not available | 0.0 (0.0%) | 0.4 (3.9%) | |||
| White or Caucasian | 5.5 (100.0%) | 8.1 (89.6%) | |||
| Cuban | 0.0 (0.0%) | 0.2 (2.0%) | |||
| Baseline performance score B | 70 | n (%) | 0.0 (0.0%) | 0.0 (0.0%) | 0.676 |
| 80 | 0.1 (1.4%) | 0.0 (0.0%) | |||
| 90 | 1.8 (32.5%) | 2.2 (24.1%) | |||
| 100 | 3.6 (66.1%) | 6.9 (75.9%) | |||
| Baseline MIBG scan | soft tissue lesions | n (%) | 2.2 (39.0%) | 3.5 (62.7%) | 0.320 |
| distant lymph nodes | n (%) | 0.0 (0.0%) | 0.2 (4.4%) | 0.433 | |
| liver lesions | n (%) | 0.4 (6.6%) | 0.3 (5.9%) | 0.925 | |
| skeletal lesions | n (%) | 3.6 (66.1%) | 4.2 (75.4%) | 0.639 | |
| INSS at diagnosis | INSS = 4 | n (%) | 4.2 (75.7%) | 4.5 (82.3%) | 0.706 |
| other | 1.3 (24.3%) | 1.0 (17.7%) | |||
| Disease status | Relapsed | n (%) | 2.9 (52.7%) | 3.7 (67.8%) | 0.495 |
| Refractory | 2.6 (47.3%) | 1.8 (32.3%) | |||
| MYCN | Other MYCN | n (%) | 5.1 (92.0%) | 5.1 (92.6%) | 0.944 |
| Amplified | 0.4 (8.0%) | 0.4 (7.4%) | |||
| Frontline treatment | Chemotherapy | n (%) | 4.8 (87.0%) | 5.3 (95.9%) | 0.315 |
| High-dose therapy | n (%) | 3.6 (66.0%) | 4.4 (79.1%) | 0.471 | |
| Local therapy | n (%) | 5.0 (91.3%) | 4.7 (84.3%) | 0.560 | |
| Maintenance therapy | n (%) | 1.5 (27.7%) | 2.9 (52.6%) | 0.307 | |
| Radiotherapy | n (%) | 2.7 (48.5%) | 3.6 (64.7%) | 0.487 | |
| Surgery | n (%) | 4.1 (74.7%) | 4.6 (84.1%) | 0.553 | |
| Anti-GD2 maintenance | n (%) | 0.1 (1.5%) | 0.0 (0.0%) | 0.214 | |
| High-dose therapy: MIBG | n (%) | 1.3 (23.0%) | 0.9 (16.2%) | 0.674 | |
| High-dose therapy: BuMEL | n (%) | 2.8 (50.9%) | 3.7 (67.6%) | 0.460 | |
| High-dose therapy: CEM | n (%) | 0.3 (5.2%) | 0.2 (3.8%) | 0.814 | |
| Chemotherapy: rapid COJEC | n (%) | 2.2 (39.7%) | 3.4 (62.0%) | 0.359 | |
| Chemotherapy: MSK m.N7 (5 cycles) | n (%) | 0.1 (1.5%) | 1.6 (28.6%) | 0.001 | |
| Cycles with DB dose of at least 50 mg/m2 | 1 | n (%) | 0.6 (11.3%) | 0.0 (0.0%) | 0.380 |
| 2 | 0.0 (0.0%) | 0.6 (6.5%) | |||
| 3 | 0.0 (0.0%) | 1.1 (11.6%) | |||
| 4 | 0.0 (0.0%) | 0.0 (0.4%) | |||
| 5 | 4.9 (88.7%) | 7.4 (81.5%) | |||
| Initiated DB treatment cycles [19] | 1 | n (%) | 0.6 (11.3%) | 0.0 (0.0%) | 0.417 |
| 2 | 0.0 (0.0%) | 0.5 (5.0%) | |||
| 3 | 0.0 (0.0%) | 0.7 (7.7%) | |||
| 4 | 0.0 (0.0%) | 0.4 (3.9%) | |||
| 5 | 4.9 (88.7%) | 7.5 (83.3%) | |||
| Cumulative DB dose (mg/m2) | Median (IQR) | 468.0 (461.5 to 481.0) | 493.0 (430.2 to 493.0) | 0.650 | |
| Mean (SE) | 428.3 (40.0) | 449.9 (25.6) | |||
| First subsequent anticancer therapy | Local therapy | n (%) | 1.7 (30.5%) | 1.6 (17.4%) | Inapplicable due to conditioning on subsequent treatment (0.091) |
| Retinoid/transplant consolidation | 3.8 (69.5%) | 1.3 (14.3%) | |||
| Targeted/biologic systemic therapy | 0.0 (0.0%) | 0.3 (2.8%) | |||
| Cytotoxic chemotherapy | 0.0 (0.0%) | 5.9 (65.5%) | |||
A Σw—Values are weighted estimates. The symbol w denotes the sum of weights and should not be interpreted as the effective sample size. BuMEL—busulfan and melphalan; CEM—carboplatin, etoposide, melphalan; COJEC—cisplatin, vincristine, carboplatin, etoposide, cyclophosphamide; DB—dinutuximab beta; INSS—International Neuroblastoma Staging System; IQR—interquartile range; MIBG—metaiodobenzylguanidine; MSK m.N7—Memorial Sloan Kettering modified N7 protocol; MYCN—MYCN oncogene; PS—propensity score; RA—isotretinoin (13-cis-retinoic acid); SD—standard deviation; SE—standard error. B Baseline performance status was not included in the base-case propensity-score model because missingness was study-dependent. The post-landmark values are presented descriptively among patients with observed performance status only and should not be interpreted as evidence of covariate balance. No imputation was performed.
In the exploratory conditional post-EOT analysis adjusted for DB exposure, the estimates remained imprecise for EFS (RA versus no RA: HR, 1.24; 95% CI, 0.37–4.12; p = 0.725) and OS (HR, 0.44; 95% CI, 0.07–2.71; p = 0.374; Figure 4). These estimates target patients who reached the landmark without an EFS event and should not be interpreted as an intention-to-treat comparison or as confirmation of the base-case analysis.
Figure 4.

EFS (upper panel) and OS (lower panel) in the post-landmark analysis with adjustment for DB exposure. Numbers at risk are sums of the final analysis weights and should not be interpreted as patient counts or effective sample sizes.
3.4.3. Other Sensitivity Analyses
The evaluated sensitivity analyses produced imprecise estimates (Supplementary Table S6). No sensitivity-analysis scenario showed a clear or precisely estimated difference in EFS or OS between the RA and no-RA cohorts; all estimates should be interpreted in light of the limited effective sample size and potential residual confounding.
4. Discussion
In this exploratory population-adjusted comparison, no clear difference in EFS or OS was detected between the two study-defined, IL-2-free DB treatment cohorts. The primary and conditional landmark estimates were imprecise, and their confidence intervals were compatible with clinically important benefit or harm. Accordingly, the analysis did not provide evidence of more favorable survival outcomes in the RA cohort than in the no-RA cohort, but neither did it establish equivalence or demonstrate the absence of benefit from RA.
The primary overlap-weighted analysis yielded HRs of 0.92 (95% CI, 0.31–2.73) for EFS and 1.95 (95% CI, 0.46–8.20) for OS. The exploratory conditional post-EOT analysis yielded HRs of 1.24 (95% CI, 0.37–4.12) for EFS and 0.44 (95% CI, 0.07–2.71) for OS. The point estimates differed in direction across outcomes and analyses, while all intervals were wide. Nonsignificant p values should therefore not be interpreted as demonstrating equivalence or the absence of a clinically relevant difference between the cohorts.
The question remains biologically credible. RA can promote neuroblastoma differentiation and growth arrest through retinoid-receptor pathways, whereas DB recruits immune effector mechanisms against GD2-expressing cells [7]. Preclinical work with all-trans retinoic acid and Hu14.18K322A further suggests that retinoid-induced differentiation can preserve GD2 expression in most tested models and enhance antibody-dependent cellular cytotoxicity [10]. Our clinical analysis did not measure tumor GD2 density, RA pharmacokinetics or metabolites, MYCN modulation, RAR-pathway activity, NK-cell phenotype, or antibody-dependent cytotoxicity. It therefore cannot test or refute this proposed mechanism. Moreover, the preclinical evidence does not directly establish synergy between isotretinoin and DB.
Our findings should be interpreted in the context of the historical role of retinoid therapy in neuroblastoma. In the randomized Children’s Cancer Group 3891 trial, conducted in children with high-risk neuroblastoma who had achieved at least a partial response after induction therapy and completed consolidation without disease progression, post-consolidation RA improved 3-year EFS compared with no further therapy (46% vs. 29%; p = 0.027) after a median follow-up of 36 months [8]. However, with longer follow-up (median 7.7 years), the magnitude of benefit decreased and was no longer statistically significant (5-year EFS: 42% vs. 31%; p = 0.122), while no statistically significant difference in OS was observed (5-year OS: 50% vs. 39%; p = 0.195) [8,9]. This study supported the incorporation of RA into earlier multimodal treatment paradigms for newly diagnosed high-risk neuroblastoma but predated the current era of anti-GD2 maintenance therapy. Consequently, it did not address whether RA provides additional benefit when administered alongside a GD2-directed antibody backbone such as dinutuximab beta. The present study sought to address this clinically relevant question.
The present findings are also consistent with the broader evolution of anti-GD2 immunotherapy. In the randomized HR-NBL1/SIOPEN trial, the addition of subcutaneous IL-2 to DB and RA increased toxicity without improving EFS [6]. This finding shifted clinical practice toward IL-2-free treatment regimens whenever feasible, making the present comparison particularly relevant to contemporary clinical practice.
The study-dependent missingness of baseline performance status represents an important limitation. Performance status was unavailable for 15/44 patients in the RA cohort but was available for all patients in the no-RA cohort. Because missingness was completely aligned with the source study, neither complete-case analysis with this variable nor conventional imputation would provide a reliable solution. Complete-case analysis would selectively remove a substantial proportion of the RA cohort, whereas deterministic assignment or model-based imputation would require strong and unverifiable assumptions about the unobserved distribution. We therefore did not adjust for or impute the missing performance-status values. Accordingly, residual confounding related to baseline functional status cannot be excluded.
An important strength of the present study is its methodological design. The question addressed is particularly susceptible to guarantee-time and immortal-time bias because exposure to both DB and RA accumulates over time, whereas early disease progression, relapse, or death shortens treatment duration [12,14,15]. The analysis incorporated weighting and landmark approaches intended to mitigate these biases, although these methods cannot eliminate residual confounding or selection bias. In the base-case analysis, all patients were included and PS weighting was applied without adjustment for DB exposure, because DB exposure accrued after treatment initiation and was not a baseline covariate. Given the previously demonstrated association between the extent of DB exposure and both EFS and OS [19], the robustness of the base-case analysis was further evaluated using exploratory post-EOT landmark analyses in which DB exposure was defined before the landmark. These analyses should be interpreted with caution because the PS-weighted and post-landmark approaches target partially overlapping, but not identical, patient populations. The former includes all eligible patients from treatment initiation and more closely approximates an intention-to-treat comparison, whereas the latter is restricted to patients who survived and remained event-free until the landmark time point. The absence of statistically distinguishable associations across approaches reflects broadly similar statistical uncertainty; it should not be interpreted as directional consistency because the point estimates differed and the analyses targeted different populations. Neither approach fully eliminates residual confounding, exposure-related bias, or selection bias.
Use of prospectively collected individual patient data allow alignment of eligibility definitions, index dates, and measured baseline covariates. Overlap weighting also made the target population explicit and reduced some measured imbalance.
Several limitations should be emphasized. First, this was an unanchored cross-trial comparison. RA use was perfectly aligned with the source study, so protocol, eligibility, assessment schedule, calendar-period, supportive-care, and subsequent-treatment differences are inseparable from the RA contrast. Overlap weighting reduced some measured patient-level imbalance but cannot control unmeasured factors or remove study-level confounding. The estimates therefore compare two trial-defined treatment strategies, and any between-cohort differences cannot be attributed independently to RA.
Second, the nominal sample was small and weighting further reduced the effective amount of information. The cohort-specific ESSs were 10.15 for no RA and 15.30 for RA, compared with 36 and 44 patients, respectively. Patients whose baseline profiles were poorly represented in the other study received little weight, so a smaller effective amount of data informed the estimates. The sum of the two cohort-specific ESSs (25.45) is descriptive only and is not a pooled sample size or a complete determinant of variance. Cohort-specific base-case EFS-event counts, death counts, and potential follow-up estimates were not available in the validated analytical output and are therefore not reported; this limits descriptive interpretation of the survival curves. The resulting wide confidence intervals cannot exclude clinically important benefit or harm, and lack of statistical significance is not evidence of equivalence or absence of a between-cohort difference.
Third, post-baseline anticancer therapy also differed between cohorts (Supplementary Table S1). Cytotoxic chemotherapy was recorded as the first subsequent therapy in 9/44 patients in the RA cohort and in 0/36 patients in the no-RA cohort, whereas retinoid/transplant-related consolidation was recorded in 1/44 and 4/36 patients, respectively. These differences may reflect protocol, disease course, and clinical decision-making and could materially influence OS after the initial DB strategy. Because subsequent therapy occurs after baseline and may be a mediator or consequence of progression, it was not included as a baseline confounder; nevertheless, the imbalance further limits attribution of OS differences to RA use. Outcome ascertainment was also not fully identical between the source studies. APN311-304 originally reported PFS, and information on secondary neoplasms was not available in the extracted dataset, whereas APN311-202 V3 used EFS. The harmonized endpoint therefore relied on the event components available in both studies. Although secondary neoplasms are expected to be uncommon in this clinical setting, this difference represents an additional limitation of cross-study endpoint harmonization.
The post-EOT landmark analysis was exploratory and conditional on patients remaining alive and EFS-event-free through the landmark. It therefore describes a selected post-treatment risk set and should not be interpreted as an intention-to-treat comparison or as confirmation of the base-case analysis.
Independent reviews emphasize that neuroblastoma treatment is risk-adapted and multimodal, with therapeutic strategies shaped by disease stage, tumor biology, prior therapy, consolidation, and maintenance [3,27]. This broader context reinforces that the contribution of a single maintenance component cannot be inferred reliably when that component is perfectly aligned with the source study and other elements of the treatment pathway differ between cohorts.
These limitations are consistent with methodological evidence showing that population-adjustment methods can reduce measured cross-study imbalance only under strong assumptions and that uncertainty may be understated when covariate overlap and effective sample size are limited [28]. The study-dependent missingness of performance status is particularly important because treating missingness as a category does not, by itself, recover the unobserved covariate distribution or remove bias [29]. Accordingly, interpretation should focus on the effect estimates and their confidence intervals rather than on whether individual p values cross a conventional threshold [30].
Safety was not compared between the treatment cohorts because adverse event collection, grading practices, and monitoring intensity differed between the study protocols. This limitation is particularly relevant for RA, for which the detection and reporting of mucocutaneous toxicities and laboratory abnormalities may be influenced by protocol-specific monitoring procedures.
Clinical decisions about RA should not be based on this indirect comparison alone. They should integrate evidence from other disease settings, the treatment protocol and its intended maintenance strategy, disease status and prior therapy, expected RA-related toxicity and treatment burden, and individual patient circumstances. Accordingly, the present findings neither support routine omission of RA nor establish that RA should be continued in every patient.
The present results should be used to refine, rather than settle, the clinical question. A prospective component-randomized design would provide the clearest estimate of the incremental contribution of RA. If randomization is not feasible, a prospectively specified multicenter registry analysis should use a common protocol era, harmonized assessments, detailed salvage-treatment data, and embedded biomarkers of retinoid exposure, GD2 expression, and immune-effector function. Safety and patient burden should be measured with identical schedules because any small survival effect must be interpreted alongside RA-associated toxicity and treatment burden.
5. Conclusions
In this exploratory unanchored comparison of two prospective cohorts comprising 80 patients with relapsed or refractory neuroblastoma, no clear difference in EFS or OS was detected between the overlap-weighted, study-defined IL-2-free DB treatment strategies with and without RA. The analysis did not provide clear evidence of more favorable survival outcomes in the RA cohort than in the no-RA cohort. However, the estimates were highly imprecise and compatible with clinically important benefit or harm. Because RA use was inseparable from the source study, covariate overlap and cohort-specific effective sample sizes were limited, performance-status missingness differed between studies, and residual patient-level and protocol-level confounding could not be excluded. The findings should therefore not be interpreted as evidence of equivalence or as evidence that RA provides no benefit. They are hypothesis-generating and should not alone guide continuation or omission of RA.
Acknowledgments
The authors acknowledge Centrum HTA Sp. z o.o. for providing contracted medical writing support, including drafting of the manuscript based on a previously prepared study report. All authors reviewed and approved the final manuscript and take responsibility for its content.
Abbreviations
The following abbreviations are used in this manuscript:
| 13-cis-RA | 13-cis-retinoic acid |
| ADA | anti-drug antibody |
| BM | bone marrow |
| BuMEL | busulfan and melphalan |
| CEM | carboplatin, etoposide, and melphalan |
| CI | confidence interval |
| COJEC | cisplatin, vincristine, carboplatin, etoposide, and cyclophosphamide |
| CT | computed tomography |
| DB | dinutuximab beta |
| EFS | event-free survival |
| EOT | end of treatment |
| FAS | full analysis set |
| HR | hazard ratio |
| IL-2 | interleukin-2 |
| INSS | International Neuroblastoma Staging System |
| IPD | individual patient data |
| IPSW | inverse probability of selection weights |
| IQR | interquartile range |
| LDH | lactate dehydrogenase |
| MIBG | metaiodobenzylguanidine |
| MRI | magnetic resonance imaging |
| OS | overall survival |
| PS | propensity score |
| RA | 13-cis-retinoic acid (isotretinoin) |
| R/R | relapsed or refractory |
| SA | sensitivity analysis/analyses |
| SD | standard deviation |
Supplementary Materials
The following supporting information can be downloaded at https://www.mdpi.com/article/10.3390/biomedicines14102200/s1.
Author Contributions
Conceptualization, oversight, data interpretation, provision of clinical data, and writing—review and editing, H.N.L.; conceptualization, oversight, software, indirect-comparison methodology, formal analysis, data interpretation, writing—original draft, P.H.; writing—review and editing, N.S. and S.T.-M.; provision of clinical data and writing—review and editing, D.V.-C., A.G., A.C., J.A., I.Y., S.A., J.G., L.M., G.L., R.L., R.L.L., C.O., C.M. and A.W.; data interpretation and writing—original draft, K.Ś.; project administration, methodology and data-analysis oversight, data interpretation, supervision, and writing—review and editing, P.K. All authors have read and agreed to the published version of the manuscript.
Institutional Review Board Statement
Not applicable. This study was a secondary retrospective reanalysis of pre-existing individual patient data from previously conducted prospective clinical studies. No new patients were enrolled, no new intervention was assigned, and no additional patient data or biological samples were collected for the present analysis. Ethics approval was obtained for the original clinical studies according to their respective protocols.
Informed Consent Statement
Written informed consent for participation and secondary use of study data was obtained in the original studies in accordance with their protocols.
Data Availability Statement
The data presented in this study are available on request from the corresponding author, subject to the original trial agreements and applicable privacy requirements. The data are not publicly available because they contain de-identified individual patient data governed by those agreements and requirements.
Conflicts of Interest
Author Paweł Kawalec was employed by the company Centrum HTA Sp. z o.o. H.N.L., A.W., K.Ś., P.K. and P.H. have acted as consultants and participated in advisory boards organized by EUSA Pharma/Recordati Rare Diseases. J.G. has been a member of a DMC for a trial sponsored by YmAbs Therapeutics and has had previous consulting/advisory board roles for EUSA Pharma, YmAbs Therapeutics, Celgene, Norgine, and AbbVie. R.L. (Roberto Luksch) received travel reimbursement from Recordati Rare Diseases. L.M. is a past member of data monitoring committees for clinical trials sponsored by Novartis, Shionogi, and Incyte; has had consulting roles for Novartis, Norgine, Boehringer, YmAbs, Merck, Roche, Bayer, and Shionogi; has participated in educational activities organized by Bayer and EUSA Pharma and received travel expenses from EUSA Pharma; and is President of SIOPEN (European neuroblastoma research cooperative group), an organization that receives royalties from sales of dinutuximab beta. Recordati UK Ltd. provided funding for data extraction and editorial assistance, and Recordati Rare Diseases funded the open-access publication fee. These funders had no role in the study design, selection of data sources, data access, statistical analysis, interpretation of the results, decision to submit the manuscript for publication, or choice of journal. Although editorial assistance was funded by Recordati UK Ltd., the funder had no control over the scientific content, interpretation, conclusions, or final wording of the manuscript. The authors retained full responsibility for the conduct of the analysis, the integrity and interpretation of the results, the content of the manuscript, and the decision to publish. The other funders listed in the Funding section had no role in the design, conduct, analysis, interpretation, or preparation of the study.
Funding Statement
Funding for data extraction and editorial assistance was provided by Recordati UK Ltd. Open Access was funded by Recordati Rare Diseases. Recordati Netherlands B.V. has marketing authorization for dinutuximab beta in Europe. This work was partially supported by the Italian Ministry of Health 5 × 1000 project 2019 (5M-2019-23680433) and by “Ricerca Corrente” for the collection of Italian data. Further financial support came from Hector Stiftungen, under Grant M2116, Deutsche Forschungsgemeinschaft, under Grant Sl 2147/4-1, as well as Kinderkrebsstiftung under Grant DKS 2024.23.
Footnotes
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.
References
- 1.Balaguer J., García Hidalgo L., Hladun R., Márquez Vega C., Pérez Alonso V. Recent Evidence-Based Clinical Guide for the Use of Dinutuximab Beta in Pediatric Patients with Neuroblastoma. Target. Oncol. 2023;18:77–93. doi: 10.1007/s11523-022-00930-w. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Lode H.N., Ehlert K., Huber S., Troschke-Meurer S., Siebert N., Zumpe M., Loibner H., Ladenstein R. Long-term, continuous infusion of single-agent dinutuximab beta for relapsed/refractory neuroblastoma: An open-label, single-arm, Phase 2 study. Br. J. Cancer. 2023;129:1780–1786. doi: 10.1038/s41416-023-02457-x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.Whittle S.B., Smith V., Doherty E., Zhao S., McCarty S., Zage P.E. Overview and recent advances in the treatment of neuroblastoma. Expert Rev. Anticancer Ther. 2017;17:369–386. doi: 10.1080/14737140.2017.1285230. [DOI] [PubMed] [Google Scholar]
- 4.European Medicines Agency Qarziba (Dinutuximab Beta): EPAR—Product Information. Nov Updated 26, 2025. [(accessed on 3 August 2026)]. Available online: https://www.ema.europa.eu/en/documents/product-information/qarziba-epar-product-information_en.pdf.
- 5.Yu A.L., Gilman A.L., Ozkaynak M.F., London W.B., Kreissman S.G., Chen H.X., Smith M., Anderson B., Villablanca J.G., Matthay K.K., et al. Anti-GD2 antibody with GM-CSF, interleukin-2, and isotretinoin for neuroblastoma. N. Engl. J. Med. 2010;363:1324–1334. doi: 10.1056/NEJMoa0911123. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Ladenstein R., Pötschger U., Valteau-Couanet D., Luksch R., Castel V., Yaniv I., Laureys G., Brock P., Michon J.M., Owens C., et al. Interleukin 2 with anti-GD2 antibody ch14.18/CHO (dinutuximab beta) in patients with high-risk neuroblastoma (HR-NBL1/SIOPEN): A multicentre, randomised, phase 3 trial. Lancet Oncol. 2018;19:1617–1629. doi: 10.1016/S1470-2045(18)30578-3. [DOI] [PubMed] [Google Scholar]
- 7.Sonawane P., Cho H.E., Tagde A., Verlekar D., Yu A.L., Reynolds C.P., Kang M.H. Metabolic characteristics of 13-cis-retinoic acid (isotretinoin) and anti-tumour activity of the 13-cis-retinoic acid metabolite 4-oxo-13-cis-retinoic acid in neuroblastoma. Br. J. Pharmacol. 2014;171:5330–5344. doi: 10.1111/bph.12846. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Matthay K.K., Villablanca J.G., Seeger R.C., Stram D.O., Harris R.E., Ramsay N.K., Swift P., Shimada H., Black C.T., Brodeur G.M., et al. Treatment of High-Risk Neuroblastoma with Intensive Chemotherapy, Radiotherapy, Autologous Bone Marrow Transplantation, and 13-cis-Retinoic Acid. N. Engl. J. Med. 1999;341:1165–1173. doi: 10.1056/NEJM199910143411601. [DOI] [PubMed] [Google Scholar]
- 9.Matthay K.K., Reynolds C.P., Seeger R.C., Shimada H., Adkins E.S., Haas-Kogan D., Gerbing R.B., London W.B., Villablanca J.G. Long-Term Results for Children With High-Risk Neuroblastoma Treated on a Randomized Trial of Myeloablative Therapy Followed by 13-cis-Retinoic Acid: A Children’s Oncology Group Study. J. Clin. Oncol. 2009;27:1007–1013. doi: 10.1200/JCO.2007.13.8925. Erratum in J. Clin. Oncol. 2014, 32, 1862–1863. https://doi.org/10.1200/JCO.2014.57.0382. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Nguyen R., Houston J., Chan W.K., Finkelstein D., Dyer M.A. The role of interleukin-2, all-trans retinoic acid, and natural killer cells: Surveillance mechanisms in anti-GD2 antibody therapy in neuroblastoma. Cancer Immunol. Immunother. 2018;67:615–626. doi: 10.1007/s00262-017-2108-6. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Bird N., Scobie N., Palmer A., Ludwinski D. To transplant, or not to transplant? That is the question. A patient advocate evaluation of autologous stem cell transplant in neuroblastoma. Pediatr. Blood Cancer. 2022;69:e29663. doi: 10.1002/pbc.29663. [DOI] [PubMed] [Google Scholar]
- 12.Giobbie-Hurder A., Gelber R.D., Regan M.M. Challenges of Guarantee-Time Bias. J. Clin. Oncol. 2013;31:2963–2969. doi: 10.1200/JCO.2013.49.5283. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Duchesneau E.D., Jackson B.E., Webster-Clark M., Lund J.L., Reeder-Hayes K.E., Nápoles A.M., Strassle P.D. The Timing, the Treatment, the Question: Comparison of Epidemiologic Approaches to Minimize Immortal Time Bias in Real-World Data Using a Surgical Oncology Example. Cancer Epidemiol. Biomark. Prev. 2022;31:2079–2086. doi: 10.1158/1055-9965.EPI-22-0495. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Suissa S. Immortal time bias in pharmaco-epidemiology. Am. J. Epidemiol. 2008;167:492–499. doi: 10.1093/aje/kwm324. [DOI] [PubMed] [Google Scholar]
- 15.Suissa S. Immortal time bias in observational studies of drug effects. Pharmacoepidemiol. Drug Saf. 2007;16:241–249. doi: 10.1002/pds.1357. [DOI] [PubMed] [Google Scholar]
- 16.Dafni U. Landmark analysis at the 25-year landmark point. Circ. Cardiovasc. Qual. Outcomes. 2011;4:363–371. doi: 10.1161/CIRCOUTCOMES.110.957951. [DOI] [PubMed] [Google Scholar]
- 17.Robins J.M., Hernán M.A., Brumback B. Marginal structural models and causal inference in epidemiology. Epidemiology. 2000;11:550–560. doi: 10.1097/00001648-200009000-00011. [DOI] [PubMed] [Google Scholar]
- 18.Cole S.R., Hernán M.A. Constructing inverse probability weights for marginal structural models. Am. J. Epidemiol. 2008;168:656–664. doi: 10.1093/aje/kwn164. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Holko P., Lode H.N., Garaventa A., Manzitti C., Luksch R., Valteau-Couanet D., Gambart M., Anderson J., Gray J., Cañete A., et al. Association Between Dinutuximab Beta Exposure and Post-End-of-Treatment Survival in Neuroblastoma: A Weighted Patient-Level Analysis of Three Clinical Studies. Pediatr. Blood Cancer. 2026;73:e70502. doi: 10.1002/1545-5017.70502. [DOI] [PubMed] [Google Scholar]
- 20.European Medicines Agency Dinutuximab Beta Apeiron: EPAR—Public Assessment Report. 2017. [(accessed on 3 August 2026)]. Available online: https://www.ema.europa.eu/en/documents/assessment-report/dinutuximab-beta-apeiron-epar-public-assessment-report_en.pdf.
- 21.Wieczorek A., Żebrowska U., Ussowicz M., Sokół A., Stypińska M., Dembowska-Bagińska B., Pawińska-Wąsikowska K., Balwierz W. Dinutuximab Beta Maintenance Therapy in Patients with High-Risk Neuroblastoma in First-Line and Refractory/Relapsed Settings—Real-World Data. J. Clin. Med. 2023;12:5252. doi: 10.3390/jcm12165252. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Flaadt T., Ladenstein R.L., Ebinger M., Lode H.N., Arnardóttir H.B., Poetschger U., Schwinger W., Meisel R., Schuster F.R., Döring M., et al. Anti-GD2 Antibody Dinutuximab Beta and Low-Dose Interleukin 2 After Haploidentical Stem-Cell Transplantation in Patients With Relapsed Neuroblastoma: A Multicenter, Phase I/II Trial. J. Clin. Oncol. 2023;41:3135–3148. doi: 10.1200/JCO.22.01630. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Mueller I., Ehlert K., Endres S., Pill L., Siebert N., Kietz S., Brock P., Garaventa A., Valteau-Couanet D., Janzek E., et al. Tolerability, response and outcome of high-risk neuroblastoma patients treated with long-term infusion of anti-GD2 antibody ch14.18/CHO. mAbs. 2018;10:55–61. doi: 10.1080/19420862.2017.1402997. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.Veal G.J., Errington J., Rowbotham S.E., Illingworth N.A., Malik G., Cole M., Daly A.K., Pearson A.D.J., Boddy A.V. Adaptive Dosing Approaches to the Individualization of 13-Cis-Retinoic Acid (Isotretinoin) Treatment for Children with High-Risk Neuroblastoma. Clin. Cancer Res. 2013;19:469–479. doi: 10.1158/1078-0432.CCR-12-2225. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.Li F., Morgan K.L., Zaslavsky A.M. Balancing Covariates via Propensity Score Weighting. J. Am. Stat. Assoc. 2018;113:390–400. doi: 10.1080/01621459.2016.1260466. [DOI] [Google Scholar]
- 26.Austin P.C., Stuart E.A. Moving towards best practice when using inverse probability of treatment weighting (IPTW) using the propensity score to estimate causal treatment effects in observational studies. Stat. Med. 2015;34:3661–3679. doi: 10.1002/sim.6607. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27.Tolbert V.P., Matthay K.K. Neuroblastoma: Clinical and biological approach to risk stratification and treatment. Cell Tissue Res. 2018;372:195–209. doi: 10.1007/s00441-018-2821-2. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.Remiro-Azócar A., Heath A., Baio G. Methods for population adjustment with limited access to individual patient data: A review and simulation study. Res. Synth. Methods. 2021;12:750–775. doi: 10.1002/jrsm.1511. [DOI] [PubMed] [Google Scholar]
- 29.Groenwold R.H.H., White I.R., Donders A.R.T., Carpenter J.R., Altman D.G., Moons K.G.M. Missing covariate data in clinical research: When and when not to use the missing-indicator method for analysis. CMAJ. 2012;184:1265–1269. doi: 10.1503/cmaj.110977. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30.Amrhein V., Greenland S., McShane B. Scientists rise up against statistical significance. Nature. 2019;567:305–307. doi: 10.1038/d41586-019-00857-9. [DOI] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
Data Availability Statement
The data presented in this study are available on request from the corresponding author, subject to the original trial agreements and applicable privacy requirements. The data are not publicly available because they contain de-identified individual patient data governed by those agreements and requirements.
