Abstract
Background
Accurate staging of Hodgkin lymphoma in children is important for selecting appropriate therapies. However, evaluation of Ann Arbor staging criteria on whole-body 18F-FDG PET scans is time-consuming and subject to reader-dependent variability.
Objective
To determine if a novel computer-aided staging tool can improve the time-efficiency and accuracy of Ann Arbor staging.
Methods
18F-FDG PET/MRI scans of fifty-six pediatric patients were divided into two groups with matched Ann-Arbor stages. Group 1 was staged via traditional inspection and Group 2 was staged with a newly developed web-based staging tool by one radiology resident, four radiologists and two nuclear medicine physicians. An additional radiologist and nuclear medicine physician jointly established the reference standard. The time to generate the Ann Arbor score was compared between group 1 and 2 with the Wilcoxon Rank-Sum test, and agreement with the reference standard was assessed with Cohen's kappa analysis. In addition, staging time was correlated with reader experience level, measured as the number of PET cases interpreted per year, using linear regression analysis.
Result
Use of the tool significantly reduced Ann Arbor staging time (10.8 ± 6.33 min) compared to traditional staging without the tool (13.87 ± 8.16 min; p = 0.001). The greatest reduction in staging time was observed for the radiology resident (17.63 ± 2.3 min with the tool and 21.5 ± 3.3 without the tool), followed by radiologists (13.63 ± 2.5 min with the tool and 18.03 ± 2.6 without the tool), while no significant change was observed for nuclear medicine physicians (1.45 ± 0.82 min with the tool and 1.39 ± 1.12 without the tool). Agreement with the reference standard improved with tool assistance (κ = 0.616) compared to traditional staging without the tool (κ = 0.945 with the tool). Linear regression demonstrated a significant inverse association between reader experience and time saved using the tool (β = −0.812, p < 0.001; R² = 0.66), indicating greater benefit for less experienced readers.
Conclusion
The computer-aided staging tool significantly improved time-efficiency and accuracy of Ann Arbor staging, especially for less experienced readers. We provide the tool as a freely accessible web resource.
Keywords: 18F-FDG PET/MRI, Ann Arbor staging, computer-aided tool, pediatric hodgkin lymphoma, time efficiency
Introduction
Hodgkin lymphoma (HL) is among the most commonly diagnosed malignancies in children and adolescents aged 0 to 19 years (1). Timely, accurate diagnosis and staging are essential to guide treatment decisions and achieve optimal outcomes (2). 18F-FDG positron emission tomography (PET) is the standard imaging modality for initial staging, treatment response assessment, and surveillance in lymphoma care (3). The Ann Arbor classification, first introduced in 1971, remains the National Comprehensive Cancer Network (NCCN) recommended staging system for HL (4).
However, growing imaging volumes are straining radiology workflows, making thorough and efficient interpretation of complex whole-body 18F-FDG PET examinations challenging. Martella et al. reported an increase in 18F-FDG PET utilization at major U.S. cancer centers from 5.9 to 6.7 studies per 1,000 persons between 2011 and 2020 (5). Khurana et al. reported that the number of radiologists per 100,000 population remained largely stable, 79.7 in 2012 and 79.9 in 2019 (6), and Morales-Tisnés et al. reported a decline in the number of pediatric radiologists between 2016 and 2023, despite increasing demand for imaging services (7). The widening gap between imaging volume and radiologist capacity is concerning. Klein et al. reported a 20.2 % misdiagnosis rate in on-call pediatric radiology reporting, highlighting a risk to timely and accurate diagnoses (8).
Computer-aided diagnostic (CAD) systems have emerged as a promising response to this bottleneck. Frood et al. demonstrated that AI-assisted lymphoma lesion detection and segmentation integrated into 18F-FDG PET/CT staging software reduced reporting time (median 15.0 vs. 13.3 min) without affecting report quality (9). Hasanabadi et al. applied radiomics and machine learning to automatically classify lymphoma on 18F-FDG PET scans into early (I–II) vs. advanced (III–IV) stages (10). Thus, current AI approaches assist readers to provide simplified stage grouping. To our knowledge, no existing system fully automates clinical Ann Arbor staging. In addition, previously reported tools were designed as “black box” systems that do not include the reader in the decision-making process (11). In contrast, we designed an interactive tool that guides the reader through the complex staging task, improving efficiency and accuracy without compromising clinician control. The purpose of our study was to determine if this novel computer-aided staging tool can improve the time-efficiency and accuracy of Ann Arbor staging.
Materials and methods
This single-center retrospective study was approved by the institutional review board (IRB # 44706) at Stanford University, with a waiver of informed consent due to the retrospective study design. Pediatric and adolescent patients with histologically confirmed Hodgkin lymphoma who underwent baseline 18F-fluorodeoxyglucose (FDG) whole-body PET/MRI at Lucile Packard Children's Hospital between February 2023 and December 2025 were identified from an institutional 18F-FDG PET/MR image registry. Inclusion criteria were age younger than 25 years, a diagnosis of Hodgkin lymphoma, and availability of baseline 18F-FDG PET/MRI performed at initial diagnosis prior to treatment initiation. 62 patients met the eligibility criteria. Six patients were excluded due to incomplete imaging studies (n = 3) or severe imaging artifacts (n = 3) (Figure 1). The final study cohort comprised 56 patients, including 30 males (53.6%) and 26 females (46.4%), with a mean age of 15.6 ± 3.5 years (range, 7–24 years).
Figure 1.
Flow chart depicting the application of inclusion and exclusion criteria, showing the final study population and the allocation of patients to group 1 (standard assessment) and group 2 (staging with AI tool).
Image acquisition
All patients underwent whole-body 18F-FDG PET/MRI as part of the institutional imaging protocol at Stanford at the time of HL diagnosis, before initiation of cancer therapy. Whole-body 18F-FDG PET/MRI is routinely used for pediatric oncology patients to reduce radiation exposure while maintaining high diagnostic accuracy for whole-body staging.
Imaging was performed on a 3-T integrated PET/MRI system (Signa PET/MRI, GE Healthcare, software version MP26) using surface coils tailored to patient size.
Patients fasted for at least 4 h, and blood glucose levels were confirmed to be below 140 mg/dL before tracer administration. 18F-FDG was injected intravenously at a dose of 3–5 MBq/kg of body weight. 18F-FDG PET/MRI acquisition started approximately 60 min post-injection (mean ± SD, e.g., 58 ± 4 min). The head-to-toe whole-body 18F-FDG PET/MRI protocol included the following MRI sequences: Axial T1-weighted fat-saturated LAVA (Liver Acquisition with Volume Acceleration, repetition time TR: 4.2 ms; echo time TE: 1.7 ms; slice thickness SL: 3 mm, no gap). Axial Dixon sequence (water/fat separation) for PET attenuation correction (MRAC, TR: 4.2 ms; TE: 2.2 ms; SL: 5 mm, no gap). Axial Diffusion-Weighted Imaging (DWI, b-values: 50 and 800 s/mm², TR: 5,000–8,000 ms; TE: 70–90 ms; SL: 5 mm, interleaved slices). Coronal T2-weighted fast spin echo (thorax and abdomen): TR, 4,500–5,000 ms; TE, 90–100 ms; slice thickness, 4 mm; matrix, 256 × 256; voxel size, 2.8 × 2.8 × 2.8 mm; no gap.
18F-FDG PET data were acquired simultaneously with MRI using 3-minute bed positions and an axial field of view of 25 cm. PET images were reconstructed using ordered subsets expectation maximization with time-of-flight and point-spread function modeling (2 iterations, 28 subsets). Attenuation correction of PET data was performed using MR-based attenuation maps derived from a two-point Dixon sequence, which segments tissue into four classes (air, lung, fat, and soft tissue) and assigns corresponding attenuation coefficients for PET reconstruction. Attenuation-corrected PET images were intrinsically coregistered with MRI using GE scanner-integrated software.
Reference standard
The reference standard for Ann Arbor staging was established by expert consensus. All baseline 18F-FDG PET/MRI examinations were independently reviewed by a nuclear medicine physician (L.B.) and a pediatric radiologist (I.V.), both with expertise in oncologic imaging. Readers applied Ann Arbor criteria to the imaging findings to determine the stage, with clinical reports reviewed in parallel to ensure consistency. There were no discrepant interpretations between the expert readers and the clinical reports. This consensus-derived staging assignment served as the reference standard for all subsequent reader evaluations and performance analyses.
The computer-aided staging tool
A computer-aided staging tool was developed by an experienced computer scientist (M.B.) to support standardized Ann Arbor staging of HL based on PET/MRI findings. The tool combines a rule-based decision tree reflecting Ann Arbor staging criteria with an interactive user interface designed for clinical use (Figure 2). The computer-aided staging tool was implemented primarily in JavaScript with a web-based graphical user interface. Following lesion identification on 18F-FDG PET/MRI scans, tumor sites were categorized as nodal or extranodal involvement and assigned to their respective anatomical distribution. A decision tree algorithm then sequentially evaluated staging criteria in descending order, beginning with assessment for stage IV disease, followed by stage III, stage II, and stage I. At each step, a binary decision was made based on imaging-defined tumor extent, such as the distribution of nodal and extranodal tumors relative to the diaphragm. This structured approach enabled deterministic and reproducible staging.
Figure 2.
Decision tree for the computer-aided Ann Arbor staging tool. Lesions are first localized and categorized by anatomical distribution, followed by hierarchical evaluation of staging criteria from stage IV to stage I. Representative 18F-FDG PET maximum intensity projections (MIP) of four patients with different stages of Hodgin's lymphoma (HL) are shown: (A) 11-year-old male with stage IV HL: multiple enlarged lymph nodes above and below the diaphragm, including neck and anterior mediastinum (arrows), with additional hypermetabolic lesions in the spleen (arrow) and left iliac wing (arrow), consistent with splenic and bone marrow involvement. (B) 19-year-old female with stage III HL: multiple enlarged lymph nodes above and below the diaphragm (arrows). (C) 18-year-old female with stage II HL: multiple enlarged and hypermetabolic lymph nodes above the diaphragm, in the neck and anterior mediastinum (arrows). (D) 16-year-old male with stage I HL: single enlarged hypermetabolic lymph node below the diaphragm in the right inguinal region (arrow). (E) 10-year-old male with no PET-avid lesions.
The decision tree was implemented within a web-based graphical user interface designed to reflect routine clinical staging workflows (Figure 3). Users recorded case-specific imaging findings by answering six structured questions corresponding to key anatomical regions: lymph node involvement above and/or below the diaphragm, splenic involvement, and presence of extranodal disease. For each category, disease extent was recorded as none, single nodal station, or multiple nodal stations, with optional designation of bulky disease where applicable.
Figure 3.
Web-based interface of the Ann Arbor staging tool: the layout for lesion input, anatomical localization, and automated hierarchical staging assessment.
Human reader assessments
Fifty-six 18F-FDG PET/MRI scans were divided into two groups with matched Ann Arbor stages: Images in Group 1 were staged conventionally, while images in Group 2 were staged with assistance by the web-based computer-aided staging tool. For each case, readers recorded the time to assign an Ann Arbor stage, measured from initial case opening on a PACS workstation to final stage submission.
Seven readers participated, representing a range of training levels and subspecialty backgrounds. These included one second-year radiology resident with no prior PET experience, four board-certified pediatric radiologists with 2, 7, 11 and 15 years of experience, respectively, interpreting 90–1,500 PET examinations per year and two board certified nuclear medicine physicians with 7–9 years of experience, interpreting 2,000–4,500 PET examinations per year.
Statistical analysis
Staging times without and with the tool were compared using the Wilcoxon rank-sum test. Relative time savings were calculated as the percentage reduction in staging time using the formula: (reading time without tool—reading time with tool)/reading time without tool × 100. For each Ann Arbor stage, staging times were compared using the Wilcoxon signed-rank test. Staging time was correlated with reader experience, measured as the number of PET cases interpreted per year, using linear regression analysis. Agreement between reader-assigned Ann Arbor stage and the reference standard was evaluated using Cohen's kappa coefficient, with interpretation based on the criteria proposed by Landis and Koch (<0, no agreement; 0.01–0.20, slight; 0.21–0.40, fair; 0.41–0.60, moderate; 0.61–0.80, substantial; and 0.81–1.00, almost perfect agreement). Corresponding 95% confidence intervals were calculated for each kappa estimate. All statistical analyses were conducted using SPSS software (version 29.0.2.0; IBM Corp.).
Results
Patient demographics
Among the final cohort of 56 patients, the reference standard classified five patients (8.9%) as stage I, 20 patients (35.7%) as stage II, 12 patients (21.4%) as stage III, and 19 patients (33.9%) as stage IV. Bulky disease was present in 12 patients (21.4%), and extranodal involvement was identified in 18 patients (32.1%). Patient characteristics and stage distribution are summarized in Table 1. PET/MRI evaluations for the reference standard identified tumor lesions above the diaphragm in 53 patients (94.6%) and lesions below the diaphragm in 30 (53.6%) patients. Splenic involvement was present in 16 (28.6%) patients, and stage IV with extranodal CNS, lung, liver, bone marrow involvement, or their combination, was noted in 19 patients (33.9%).
Table 1.
Patient demographics.
| Characteristic | Group 1 Patients staged without AI tool | Group 2 Patients staged with AI tool | All patients (n = 56) |
|---|---|---|---|
| Age (years) | |||
| Mean ± SD | 15.96 ± 3.6 | 16.21 ± 3.54 | 15.83 ± 3.53 |
| Range | 10–23 | 7–24 | 7–24 |
| Sex (number of patients) | |||
| Male | 13 (46.4%) | 17 (60.7%) | 30 (53.57%) |
| Female | 15 (53.6%) | 11 (39.3%) | 26 (46.43%) |
| Race (number of patients) | |||
| White | 11 (39.3%) | 15 (53.6%) | 26 (46.4%) |
| Asian | 3 (10.7%) | 3 (10.7%) | 6 (10.7%) |
| Black or African American | 3 (10.7%) | 0 | 3 (5.4%) |
| Other | 11 (39.3%) | 10 (35.7%) | 21 (37.5%) |
| Ethnicity (number of patients) | |||
| Hispanic/Latino | 8 (28.6%) | 11 (39.3%) | 19 (33.9%) |
| Non-Hispanic/Non-Latino | 20 (71.4%) | 17 (60.7%) | 37 (66.1%) |
Patient demographics for Group 1 (scans evaluated without tool assistance) and Group 2 (scans evaluated with the tool assistance). Data are presented as mean ± standard deviation or number (percentage) where appropriate.
Staging time
The mean staging time without the tool (Group 1) was 13.87 ± 8.16 min and the mean staging time with the tool (Group 2) was 10.8 ± 6.33 min. The staging times for Group 1 and Group 2 were significantly different (p = 0.001). For the second-year resident, the mean staging time decreased significantly from 21.5 ± 3.3 min without the tool to 17.63 ± 2.3 min with the tool (p = 0.001). The mean time saved with the tool was 3.88 ± 3.43 min. For the group of four radiologists, the staging time decreased significantly from 18.03 ± 2.6 min without the tool to 13.63 ± 2.5 min with the tool (p = 0.001). The mean time saved by using the tool was 4.41 ± 2.32 min. For the two nuclear medicine physicians, the staging time did not change significantly without the tool (1.39 ± 1.12 min) and with the tool (1.45 ± 0.82 min; p = 0.554; Figure 4, Table 2).
Figure 4.
Staging time (minutes) for human readers with and without the computer-aided staging tool: Bar plots show mean staging times for readers with different training backgrounds: one radiology resident, four pediatric radiologists, and two nuclear medicine physicians. Each bar represents the mean staging time across 28 PET/MR examinations per reader. Blue bars represent staging performed without the computer-aided tool, and red bars represent staging with the tool. Error bars indicate standard deviations (SD). Asterisks (*) denote statistically significant differences between staging with and without the tool (p < 0.05, paired comparison).
Table 2.
Time required for staging patients without tool assistance (group 1) and with tool assistance (group 2).
| Reader | Time without the tool (minutes) | Time with the tool (minutes) | P value |
|---|---|---|---|
| Resident | 21.31 (3.32) | 17.27 (2.28) | <0.001 |
| Radiologists | |||
| Reader 1 | 17.15 (2.15) | 13.15 (1.98) | <0.001 |
| Reader 2 | 17.73 (2.21) | 14.57 (0.86) | <0.001 |
| Reader 3 | 16.50 (2.11) | 14.00 (2.49) | <0.001 |
| Reader 4 | 18.76 (3.51) | 12.39 (3.31) | <0.001 |
| Nuc Med | |||
| Reader 1 | 1.16 (0.58) | 1.45 (0.63) | 0.554 |
| Reader 2 | 2.13 (1.22) | 1.45 (0.99) | 0.154 |
Data are presented as mean ± standard deviation or as number (percentage). Comparison of mean values between groups was performed using a Wilcoxon Rank-Sum test.
Linear regression analysis demonstrated a significant inverse relationship between reader experience, measured as annual PET interpretation volume, and the time saved by using the tool, measured as the difference in staging time with and without the tool (β = −0.812, p < 0.001, R² = 0.66; Figure 5).
Figure 5.
Correlation between staging time using the computer-aided tool and reader experience. Reader experience was measured as the number of PET examinations interpreted per year. The scatter plot shows individual staging times recorded during the evaluation of 28 18F-FDG PET/MR studies by seven readers (blue dots). Higher annual scan volume was significantly associated with shorter staging time using the tool (β = −0.812, p < 0.001, R² = 0.66). The solid line represents the linear regression with 95% confidence intervals.
Relative time savings across Ann Arbor stages
Comparison of mean staging times across Ann Arbor stages demonstrated stage-dependent time savings with the tool. The largest relative reductions in staging time were observed for stage I and stage IV disease, with reductions of 36.13% and 36.30%, respectively. For stage I disease, the mean staging time decreased significantly from 16.9 ± 9.14 min without the tool (Group 1) to 12.42 ± 4.52 min with the tool (Group 2; p = 0.021). For stage II disease, staging time decreased by 22.04%, from 16.0 ± 6.12 min without the tool to 13.1 ± 4.77 min with the tool (p = 0.024). For stage III disease staging time decreased by 23.42%, from 17.68 ± 9.58 min without the tool to 14.33 ± 7.01 with the tool (p = 0.028). For stage IV disease, the mean staging time decreased from 20.67 ± 7.35 min without the tool (Group 1) to 15.17 ± 5.29 min with the tool (Group 2, p = 0.033).
Agreement with the reference standard
Agreement between reader-assigned Ann Arbor stage and the reference standard for each reader is summarized in Table 3. Without tool assistance, agreement varied by reader expertise, with lower agreement among less experienced readers and consistently high agreement among expert readers.
Table 3.
Interobserver agreement with the reference standard for readers performing staging with and without the computer-aided tool.
| Reader | Kappa without the Tool | S.E | Confidence interval | Kappa with the Tool | S.E | Confidence interval |
|---|---|---|---|---|---|---|
| Resident | 0.433 | 0.12 | 0.184–0.681 | 0.789 | 0.10 | 0.586–0.933 |
| Radiologist 1 | 0.476 | 0.12 | 0.230–0.721 | 0.946 | 0.05 | 0.836–1.000 |
| Radiologist 2 | 0.524 | 0.12 | 0.279–0.769 | 0.789 | 0.10 | 0.586–0.933 |
| Radiologist 3 | 0.525 | 0.11 | 0.297–0.752 | 0.620 | 0.13 | 0.363–0.878 |
| Radiologist 4 | 0.588 | 0.12 | 0.343–0.833 | 0.643 | 0.11 | 0.412–0.873 |
| Nuclear med physician 1 | 0.836 | 0.09 | 0.655–1.000 | 0.946 | 0.05 | 0.836–1.000 |
| Nuclear med physician 2 | 0.834 | 0.09 | 0.654–1.000 | 0.947 | 0.05 | 0.838–1.000 |
Agreement is expressed as Cohen's kappa, with standard error (S.E.) and 95% confidence intervals (CIs).
The radiology resident demonstrated the lowest baseline agreement and the highest number of staging discrepancies, with 11 errors without the tool (κ = 0.433) and 4 errors with tool assistance (κ = 0.789). Among radiologists, Radiologist 1 demonstrated the largest improvement among radiologists, with discrepancies decreasing from 10 errors (κ = 0.476) to 1 error (κ = 0.946). Radiologist 2 improved from 9 errors (κ = 0.524) to 4 errors (κ = 0.789), and Radiologist 3 showed a reduction in discrepancies from 9 errors without the tool (κ = 0.525) to 7 errors with the tool (κ = 0.620). Radiologist 4 showed a smaller change, with 8 errors without the tool (κ = 0.588) and 7 errors with the tool (κ = 0.643). Nuclear medicine physicians demonstrated high baseline agreement with the reference standard, with 3 errors each without the tool (κ = 0.836 and 0.834), which decreased to 1 error each with tool assistance (κ = 0.946 and 0.947). Overall, the staging tool reduced the number of discrepancies with the reference standard for the resident and less experienced radiologists, but not expert readers. These findings indicate that the staging tool primarily benefits less experienced readers, while providing limited added value for expert readers who already perform at a high level.
Discussion
Our results showed that a novel computer-aided staging tool can improve the time-efficiency and accuracy of Ann Arbor staging, particularly for readers operating outside highly optimized expert workflows. Ann Arbor staging plays a key role in risk stratification and treatment planning in pediatric Hodgkin lymphoma. However, inconsistencies in staging results have been noted between different readers. Singh et al. reported discordance rates of 11.3% in disease staging and 7.8% in risk stratification between a multidisciplinary clinic and an independent expert team. In all discordant cases, there was up-staging of patients by the multidisciplinary clinic which led to overtreatment of the patient (16). Zijlstra et al. reported only 56%–61% agreement between Ann Arbor staging of baseline PET examinations by eleven nuclear medicine physicians with varying experience and expert readers (17). These findings highlight the dependence of staging accuracy on reader experience, underscoring the need for computer-aided decision-support tools to standardize Ann Arbor staging and reduce interobserver variability.
Supporting this concept, a recent multicenter study by Jemma et al. demonstrated that a fully automated deep learning algorithm for Lugano response assessment in FDG-avid lymphomas achieved agreement rates of 93%, 87%, and 85% with adjudicated expert radiologic responses across three independent clinical trial cohorts (18), suggesting that automated approaches may help reduce reader-dependent variability in lymphoma imaging assessment (18). Similarly, Sadik et al. developed an AI-based tool for automated detection of bone marrow 18F-FDG uptake in HL patients, achieving 81% agreement with expert readers (19). These findings demonstrate that automated and computer-aided approaches can achieve expert-level performance in complex lymphoma imaging tasks.
A systematic literature review of explainable artificial intelligence in medical image analysis by Muhammad and Bendechache comprehensively evaluated existing Explainable Artificial Intelligence approaches and highlighted that the “black-box” nature of deep learning models remains a major barrier to clinical adoption, particularly because model decisions lack transparency and interpretability in high-stakes medical settings (12). Importantly, this lack of transparency is not merely a theoretical limitation but may have direct clinical consequences. Prior studies have demonstrated that deep learning models can rely on non-causal or confounding features, thereby limiting generalizability and potentially affecting clinical reliability. For example, Zech et al. showed that a deep learning model for pneumonia detection achieved significantly reduced performance when applied to external datasets, as it had inadvertently learned to depend on imaging device characteristics rather than disease-specific features (13). Similarly, DeGrave et al. demonstrated that AI models for COVID-19 detection may rely on spurious correlations unrelated to pathology, further highlighting the risk of shortcut learning (14).
Supporting this, research by Singla et al. introduced a counterfactual explanation framework for medical image classification and demonstrated that conventional explanation methods, such as saliency maps, are insufficient because they only indicate where the model focuses but do not explain what imaging features drive the prediction or how changes in these features affect the decision (15). Importantly, in a human-grounded evaluation with radiology trainees, counterfactual explanations significantly improved users' understanding of model decisions compared with standard approaches (15).
In contrast, the proposed computer-aided staging tool follows a transparent, rule-based (“white-box”) approach, in which each decision step is explicitly defined and guided by established clinical criteria. This allows direct verification of the decision-making process and ensures that staging outcomes are derived from clinically relevant inputs. By integrating domain knowledge into the decision pathway, the proposed system improves interpretability, reproducibility, and ultimately the clinical reliability of imaging-based staging.
Peters et al. performed a comparative analysis of two CAD systems and demonstrated substantial variability in volumetric measurements, with relative volume differences of 1.3 ± 18.6% for solid nodules and −15.2 ± 23.5% for ground-glass nodules, resulting in discordant lesion classification in 14.9% of cases and significant differences in correct classification rates (88.5% vs. 79.8%, p = 0.004) (20). These findings highlight that variability in CAD-derived measurements can directly affect reproducibility and, consequently, the clinical reliability of imaging-based decision-making. In this context, our tool not only improves efficiency but also supports a structured and standardized staging workflow, which may reduce variability in interpretation and improve consistency across readers.
Wu et al. evaluated the impact of CAD on inter-observer agreement in nodule management and demonstrated a significant improvement in reproducibility, with Fleiss κ increasing from 0.437 to 0.623 (21). The use of CAD reduced overall management discrepancies from 39.0% to 26.2%, including a reduction in major discrepancies from 27.5% to 15.8% and substantial discrepancies from 4.8% to 1.5% (21). In addition, CAD improved detection sensitivity in part-solid nodules from 82.6% to 92.2% (p < 0.05), supporting its role in enhancing both clinical reliability and diagnostic performance.
Several computer-aided diagnosis approaches have been proposed to address specific components of lymphoma imaging interpretation. Yang et al. developed deep learning–based 18F-FDG PET/CT models to differentiate lymphomatous involvement from metastatic disease in enlarged cervical lymph nodes, achieving diagnostic accuracies of up to 86.9%, thereby supporting more reliable nodal classification during staging (22). Gao et al. introduced a longitudinal image navigation and analysis system for automated lesion SUV measurements on serial PET/CT scans of lymphoma patients and demonstrated close agreement with radiologist-derived measurements, with an average relative squared difference in SUVmax of 0.02 (23). Yu et al. proposed a semi-automated PET/CT workflow in which CT-based multi-atlas segmentation is first used to remove organs with physiologic tracer uptake, followed by conditional random field-based detection and segmentation of candidate lymphoma volumes on PET images, with final user selection of true-positive lesions. In their cohort of 11 patients, the approach demonstrated 100% detection of all reference lymphoma regions and achieved a mean Dice coefficient of 84.4% compared with manual segmentations, supporting automated tumor volume delineation for assessment of disease burden (24). Complementing lesion detection and quantification approaches, Sollini et al. proposed a radiomics framework demonstrating that analysis incorporating all lesions, rather than a single target lesion, improved classification of relapsing/refractory vs. non-relapsing disease, achieving an accuracy of 82%, highlighting the importance of whole-disease characterization for outcome stratification beyond conventional staging (25). Together, these studies illustrate how computer-assisted tools can support nodal classification, quantitative disease assessment, lesion segmentation, and whole-disease characterization, thereby addressing multiple steps of lymphoma staging and response evaluation.
Beyond diagnostic performance, the integration of AI tools into clinical workflows has been explored with respect to efficiency and reader experience. Müller et al. reported that a PACS-integrated AI tool for chest CT interpretation did not significantly increase reading time for either residents or consultants (resident: 370 s without AI vs. 437 s with AI; consultant: 366 s vs. 380 s), while providing additional actionable findings in 12.5% of studies (26). Brown et al. used a commercial chest CT CAD system to automate lesion measurements and reporting in clinical practice, reducing reporting time by 7%–44% compared with manual methods (27). Frood et al. demonstrated that AI-assisted PET/CT reporting achieved diagnostic performance comparable to standard interpretation while modestly reducing reporting time from a median of 15.0 to 13.3 min (9). Similarly, Xia et al. reported that a CT-based clinico-radiomics human-machine hybrid system improved diagnostic performance in distinguishing mediastinal lymphoma from thymic epithelial tumors by 14%–40%, with the greatest gains observed among junior radiologists (28).
Our study focused on lymphoma staging, while most prior CAD systems focused on lesion detection, segmentation, or quantitative assessment. For example, Lartizien et al. developed a computer-aided diagnosis system for automated lesion detection on 18F-FDG PET/CT of adult patients with lymphoma (29). Using a combination of PET and CT first order and textural features, their machine-learning classifiers achieved high diagnostic performance, with AUC values up to 0.97 for distinguishing malignant from physiologic and inflammatory regions. While demonstrating the feasibility of CAD-based lesion characterization in lymphoma, this approach did not address Ann Arbor staging (29). Wang et al. developed one of the first AI-based approaches for lymphoma detection in pediatric patients on combined 18F-FDG PET and T1-weighted MRI scans. Lesions suspicious for tumor were initially identified on PET based on areas of increased FDG uptake. False-positive regions were subsequently excluded using a CNN-based classifier that evaluated both metabolic PET signal and anatomical MRI appearance to distinguish true tumor lesions from physiologic uptake and normal structures (30). Hasanabadi et al. developed a radiomics-based machine-learning framework for automated Lugano staging in adults using PET/CT, achieving an AUC of 0.87 and a sensitivity of 0.88 in external validation (10). Our staging tool was tested on a cohort of pediatric patients. In the future, it could also be applied to adult patients. The tool provides a structured interface that allows clinicians to enter imaging findings and it automatically assigns an Ann Arbor stage in a standardized manner. This approach supports consistent staging by guiding clinicians through structured input of nodal and extranodal involvement, ensuring systematic consideration of nodal regions, organ involvement, and bulky disease, thereby reducing variability in staging decisions and facilitating consistent reporting across readers with different levels of experience. Importantly, our proposed CAD system differs from previously reported approaches by directly addressing the clinical staging workflow rather than isolated tasks such as lesion detection or segmentation. While prior tools primarily assist in identifying or quantifying disease, our system is designed to guide the clinician through the full Ann Arbor staging process using a structured and interactive framework. This allows standardized integration of imaging findings into a clinically meaningful staging output, representing a shift from automated prediction toward clinician-guided decision support. From a clinical perspective, improved standardization of Ann Arbor staging may have direct implications for patient management. Accurate staging determines treatment intensity, including the choice between limited-field therapy and more aggressive combined-modality regimens. Reducing interobserver variability may therefore decrease the risk of both over- and undertreatment, which has been previously reported in discordant staging scenarios. In addition, a structured and guided staging workflow may be particularly valuable in settings with limited subspecialty expertise, supporting more consistent decision-making across institutions. By integrating imaging findings into a standardized staging output, the proposed tool has the potential to improve the reliability of risk stratification and facilitate more uniform treatment planning in pediatric Hodgkin lymphoma.
Conclusion
The novel computer-aided staging tool presented here can improve the time-efficiency and accuracy of Ann Arbor staging, particularly for readers with limited experience. By reducing variability and accelerating report generation, it improves patient care and decreases workload for radiologists. To promote broad accessibility and widespread use, we are offering this tool as a freely accessible web resource to clinicians and researchers worldwide: https://mike-barrow.github.io/wbtdemo/.
Acknowledgments
The author retains the right to make the Author Accepted Manuscript publicly available in PubMed Central upon publication in accordance with the NIH Public Access Policy.
Funding Statement
The author(s) declared that financial support was received for this work and/or its publication. This research was funded by a grant from the National Cancer Institute (NCI), National Institutes of Health, grant number R01 CA269231.
Footnotes
Edited by: Laura Travascio, Azienda USL di Pescara, Italy
Reviewed by: Goran Milosevic, University Children's Hospital, Serbia
Pankaj Dwivedi, National Cancer Institute, India
Data availability statement
The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.
Ethics statement
The studies involving humans were approved by IRB # 44706 at Stanford University. The studies were conducted in accordance with the local legislation and institutional requirements. The ethics committee/institutional review board waived the requirement of written informed consent for participation from the participants or the participants' legal guardians/next of kin because Written informed consent was waived because this retrospective study analyzed previously collected, de-identified data, posing minimal risk to participants and not affecting their rights, privacy, or clinical care.
Author contributions
IV: Methodology, Project administration, Resources, Visualization, Writing – original draft. MB: Software, Writing – review & editing. LB: Investigation, Methodology, Writing – review & editing. HK: Writing – review & editing. VK: Writing – review & editing. YL: Writing – review & editing. AS: Writing – review & editing. MM: Writing – review & editing. KG: Writing – review & editing. KH: Writing – review & editing. HD-L: Data curation, Funding acquisition, Methodology, Project administration, Supervision, Validation, Writing – review & editing.
Conflict of interest
The author(s) declared that this work was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Generative AI statement
The author(s) declared that generative AI was not used in the creation of this manuscript.
Any alternative text (alt text) provided alongside figures in this article has been generated by Frontiers with the support of artificial intelligence and reasonable efforts have been made to ensure accuracy, including review by the authors wherever possible. If you identify any issues, please contact us.
Publisher's note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
References
- 1.Siegel RL, Giaquinto AN, Jemal A. Cancer statistics, 2024. CA Cancer J Clin. (2024) 74(1):12–49. 10.3322/caac.21820 [DOI] [PubMed] [Google Scholar]
- 2.Naumann R, Beuthien-Baumann B, Reiß A, Schulze J, Hänel A, Bredow J, et al. Substantial impact of FDG PET imaging on the therapy decision in patients with early-stage Hodgkin’s lymphoma. Br J Cancer. (2004) 90(3):620–5. 10.1038/sj.bjc.6601561 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.Munker R, Glass J, Griffeth LK, Sattar T, Zamani R, Heldmann M, et al. Contribution of PET imaging to the initial staging and prognosis of patients with Hodgkin's Disease. Ann Oncol. (2004) 15(11):1699–704. 10.1093/annonc/mdh426 [DOI] [PubMed] [Google Scholar]
- 4.Flerlage JE, Hiniker SM, Armenian S, Benya EC, Bobbey AJ, Chang V, et al. Pediatric hodgkin lymphoma, version 3.2021. J Natl Compr Canc Netw. (2021) 19(6):733–54. 10.6004/jnccn.2021.0027 [DOI] [PubMed] [Google Scholar]
- 5.Martella M, Lenzi J, Gianino MM. Diagnostic technology: trends of use and availability in a 10-year period (2011–2020) among sixteen OECD countries. Healthcare. (2023) 11(14):2078. 10.3390/healthcare11142078 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Khurana A, Patel B, Sharpe R. Geographic variations in growth of radiologists and medicare enrollees from 2012 to 2019. J Am Coll Radiol. (2022) 19(9):1006–14. 10.1016/j.jacr.2022.06.009 [DOI] [PubMed] [Google Scholar]
- 7.Morales-Tisnés T, Pelzl CE, Christensen EW, Rula EY, Otero HJ. Defining the pediatric radiology workforce in the United States using insurance claims data. J Am Coll Radiol. (2025) 22(11):1429–35. 10.1016/j.jacr.2025.07.029 [DOI] [PubMed] [Google Scholar]
- 8.Klein WM, Offiah AC, Kvist O, Rosendahl K. On-call or not on-call, what difference does it make in paediatric radiology? Insights Imaging. (2025) 16(1):73. 10.1186/s13244-025-01948-0 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Frood R, Willaime JMY, Miles B, Chambers G, Al-Chalabi H, Ali T, et al. Comparative effectiveness of standard vs. AI-assisted PET/CT Reading workflow for pre-treatment lymphoma staging: a multi-institutional reader study evaluation. Front Nucl Med. (2024) 3:1327186. 10.3389/fnume.2023.1327186 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Hasanabadi S, Aghamiri SMR, Abin AA, Cheraghi M, Bakhshayesh Karam M, Vosoughi H, et al. Automatic lugano staging for risk stratification in lymphoma: a multicenter PET radiomics and machine learning study with survival analysis. Nucl Med Commun. (2025) 46(12):1200–11. 10.1097/MNM.0000000000002046 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Fang Z, Johnston A, Cheuy LY, Na HS, Paschali M, Gonzalez C, et al. Automated real-time assessment of intracranial hemorrhage detection AI using an ensembled monitoring model (EMM). Npj Digit Med. (2025) 8(1):608. 10.1038/s41746-025-02007-0 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Muhammad D, Bendechache M. Unveiling the black box: a systematic review of explainable artificial intelligence in medical image analysis. Comput Struct Biotechnol J. (2024) 24:542–60. 10.1016/j.csbj.2024.08.005 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Zech JR, Badgeley MA, Liu M, Costa AB, Titano JJ, Oermann EK. Variable generalization performance of a deep learning model to detect pneumonia in chest radiographs: a cross-sectional study. PLOS Med. (2018) 15(11):e1002683. 10.1371/journal.pmed.1002683 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.DeGrave AJ, Janizek JD, Lee SI. AI For radiographic COVID-19 detection selects shortcuts over signal. Nat Mach Intell. (2021) 3(7):610–9. 10.1038/s42256-021-00338-7 [DOI] [Google Scholar]
- 15.Singla S, Eslami M, Pollack B, Wallace S, Batmanghelich K. Explaining the black-box smoothly—a counterfactual approach. Med Image Anal. (2023) 84:102721. 10.1016/j.media.2022.102721 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Singh AK, Eipe T, Sengar M, Porathur S, Gawale Y, Agrawal A, et al. A retrospective observational study to evaluate the reliability of staging and risk stratification of adolescent and adult patients with Hodgkin's Lymphoma registered at the lymphoma clinic of a tertiary cancer center in western India. Cancer Res Stat Treat. (2023) 6(1):19–25. 10.4103/crst.crst_285_22 [DOI] [Google Scholar]
- 17.Zijlstra JM, Comans EF, Van Lingen A, Hoekstra OS, Gundy CM, Willem Coebergh J, et al. FDG PET in lymphoma: the need for standardization of interpretation. An observer variation study. Nucl Med Commun. (2007) 28(10):798–803. 10.1097/MNM.0b013e3282eff2d5 [DOI] [PubMed] [Google Scholar]
- 18.Jemaa S, Ounadjela S, Wang X, El-Galaly TC, Kostakoglu L, Knapp A, et al. Automated lugano metabolic response assessment in18 F-fluorodeoxyglucose–avid non-hodgkin lymphoma with deep learning on18 F-fluorodeoxyglucose–positron emission tomography. J Clin Oncol. (2024) 42(25):2966–77. 10.1200/JCO.23.01978 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Sadik M, López-Urdaneta J, Ulén J, Enqvist O, Krupic A, Kumar R, et al. Artificial intelligence could alert for focal skeleton/bone marrow uptake in Hodgkin's Lymphoma patients staged with FDG-PET/CT. Sci Rep. (2021) 11(1):10382. 10.1038/s41598-021-89656-9 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Peters AA, Christe A, Von Stackelberg O, Pohl M, Kauczor HU, Heußel CP, et al. Will I change nodule management recommendations if I change my CAD system?”—impact of volumetric deviation between different CAD systems on lesion management. Eur Radiol. (2023) 33(8):5568–77. 10.1007/s00330-023-09525-z [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Quanyang W, Lina Z, Yao H, Jiawei W, Wei T, Linlin Q, et al. Application of computer-aided detection for NCCN -based follow-up recommendation in subsolid nodules: effect on inter-observer agreement. Cancer Med. (2024) 13(2):e6967. 10.1002/cam4.6967 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Yang Y, Zheng B, Li Y, Li Y, Ma X. Computer-aided diagnostic models to classify lymph node metastasis and lymphoma involvement in enlarged cervical lymph nodes using PET/CT. Med Phys. (2023) 50(1):152–62. 10.1002/mp.15901 [DOI] [PubMed] [Google Scholar]
- 23.Gao X, Xue Z, Xing J, Lee DY, Gottschalk SM, Heslop HE, et al. Computer-assisted quantitative evaluation of therapeutic responses for lymphoma using serial PET/CT imaging. Acad Radiol. (2010) 17(4):479–88. 10.1016/j.acra.2009.10.026 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.Yu Y, Decazes P, Lapuyade-Lahorgue J, Gardin I, Vera P, Ruan S. Semi-automatic lymphoma detection and segmentation using fully conditional random fields. Comput Med Imaging Graph. (2018) 70:1–7. 10.1016/j.compmedimag.2018.09.001 [DOI] [PubMed] [Google Scholar]
- 25.Sollini M, Kirienko M, Cavinato L, Ricci F, Biroli M, Ieva F, et al. Methodological framework for radiomics applications in Hodgkin's Lymphoma. Eur J Hybrid Imaging. (2020) 4(1):9. 10.1186/s41824-020-00078-8 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Müller FC, Raaschou H, Akhtar N, Brejnebøl M, Collatz L, Andersen MB. Impact of concurrent use of artificial intelligence tools on radiologists Reading time: a prospective feasibility study. Acad Radiol. (2022) 29(7):1085–90. 10.1016/j.acra.2021.10.008 [DOI] [PubMed] [Google Scholar]
- 27.Brown M, Browning P, Wahi-Anwar MW, Murphy M, Delgado J, Greenspan H, et al. Integration of chest CT CAD into the clinical workflow and impact on radiologist efficiency. Acad Radiol. (2019) 26(5):626–31. 10.1016/j.acra.2018.07.006 [DOI] [PubMed] [Google Scholar]
- 28.Xia H, Yu J, Nie K, Yang J, Zhu L, Zhang S. CT Radiomics and human-machine hybrid system for differentiating mediastinal lymphomas from thymic epithelial tumors. Cancer Imaging. (2024) 24(1):163. 10.1186/s40644-024-00808-2 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.Lartizien C, Rogez M, Susset A, Giammarile F, Niaf E, Ricard F. Computer aided staging of lymphoma patients with FDG PET/CT imaging based on textural information. In: Travascio L, editor. 2012 9th IEEE International Symposium on Biomedical Imaging (ISBI). Barcelona, Spain: IEEE; 2012. p. 118–21. Available online at: http://ieeexplore.ieee.org/document/6235498/ (Accessed March 31, 2025) 10.1109/ISBI.2012.6235498 [DOI] [Google Scholar]
- 30.Wang H, Sarrami A, Wu JTY, Baratto L, Sharma A, Wong KCL, et al. Multimodal pediatric lymphoma detection using PET and MRI. AMIA Annu Symp Proc AMIA Symp. (2023) 2023:736–43. [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Data Availability Statement
The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.





