Abstract
Purpose
To develop a tradeoff hyperplane model to facilitate tradeoff decision-making before inverse planning.
Methods and materials
We propose a model-based approach to determine the tradeoff hyperplanes that allow physicians to navigate the clinically viable space of plans with best achievable dose-volume parameters before planning. For a given case, a case reference set (CRS) is selected using a novel anatomical similarity metric from a large reference plan pool. Then, a regression model is built on the CRS to estimate the expected dose-volume histograms (DVHs) for the current case. This model also predicts the DVHs for all CRS cases and captures the variation from the corresponding DVHs in the clinical plans. Finally, these DVH variations are analyzed using the principal component analysis to determine the tradeoff hyperplane for the current case.
To evaluate the effectiveness of the proposed approach, 244 head-and-neck cases were randomly partitioned into reference (214) and validation (30) sets. A tradeoff hyperplane was built for each validation case and evenly sampled for 12 tradeoff predictions. Each prediction yielded a tradeoff plan. The root-mean-squared-errors (RMSEs) of the predicted and the realized plan DVHs were computed for prediction achievability evaluation.
Results
The tradeoff hyperplane with three principal directions accounts for 57.8%±3.6% of variations in the validation cases, suggesting the hyperplanes capture a significant portion of the clinical tradeoff space. The average RMSE in three tradeoff directions are 5.23±2.46, 5.20±2.52, and 5.19±2.49, as compared to 4.96±2.48 of the KBP predictions, indicating that the tradeoff predictions are comparably achievable.
Conclusions
Clinically relevant tradeoffs can be effectively extracted from existing plans and characterized by a tradeoff hyperplane model. The hyperplane allows physicians and planners to explore the best clinically achievable plans with different OAR sparing goals before inverse planning and is a natural extension of the current KBP framework.
Keywords: Knowledge-based planning, treatment planning, tradeoff modeling, DVH prediction, intensity modulated radiation therapy
1. Introduction
Knowledge-based planning (KBP) uses a model to predict optimal achievable plan DVHs [1–5] and provides planning guidance that leads to clinically optimal plans. Clinical implementations of KBP models have gained widespread acceptance [6–10]. However, in treatment sites such as head-and-neck (HN), one set of DVH predictions may not be sufficient for clinical planning due to the complexity of tradeoff relations. Physicians usually prescribe OAR dose constraints based on estimates of the best achievable DVHs with desired tradeoffs, and planners often have to interact with the treatment planning system (TPS) and the physicians iteratively to achieve patient-specific optimal OAR-sparing. This iterative tradeoff process forgoes some of the time-saving advantages accomplished by the KBP.
There are two possible approaches to providing decision support for tradeoff considerations: pre-planning and post-planning. In the post-planning approach, the tradeoff decisions are based on alternative plans that are on the Pareto front of a multi-criteria optimization (MCO) search space [11–15]. In a pre-planning approach, tradeoff decisions are based on models that predict such tradeoff scenarios before any inverse planning is performed. This approach has not been previously reported.
This study presents a novel pre-planning approach that aims to support tradeoff decision-making and accelerate HN treatment planning by modeling the clinically viable tradeoff experiences embedded in prior clinical plans. We hypothesize that historical plans are at or close to Pareto-optimal and that for a given case, the clinically feasible Pareto-surface has been sufficiently explored previously in the planning of similar cases. Using a morphological metric, we can identify a set of similar cases, or a case reference set (CRS). If we build a model using this CRS, then the variations observed between the model predictions and clinical DVHs within the CRS should reflect prior tradeoff decisions, and such tradeoff information can be extracted and projected to the current case of interest as a subspace consisting of clinically viable tradeoff plans (i.e. tradeoff hyperplanes).
2. Methods and materials
2.1. KBP model
The workflow of the proposed method starts with building a localized KBP model. First, for a given current case, a case reference set (CRS) consisted of N reference cases is selected from a reference database. The cases in CRS are morphologically similar to the current case and used as the training set for KBP modeling. Thus, we refer this as the localized KBP model, as this modeling only uses a subset of the reference pool (214 cases in this study). The localized KBP model implemented in this study is based on a previously reported localized modeling technique [16, 17] that works effectively for cases with multiple PTVs as are typical in HN cancer treatment. We implemented the same generalized distance-to-target (gDTH) feature with slight modifications. The model previously presented [16] references similar plans in terms of individual OARs. In contrast, this study selects similar plans in terms of all OARs by employing a case similarity metric that is a weighted sum of gDTH Euclidean distances between two cases across all OARs. To take into account the prescription variation in the dataset, we adopt a similarity metric S that takes both prescription ratio and spatial information into account17:
where denotes Frobenius norm, d denotes prescription dose, and α is a balancing factor set to match the mean values of the first term and the second term in the training dataset.
The CRS size is determined to be 35 based on training-set cross-validation results. The number is consistent with the number of cases previously used for HN knowledge-based planning, which ranges from 12 to 44, as reported in a recent review article [18]. The CRS size is fixed in the current study. However, it may be possible and more advantageous to dynamically vary the CRS size based on similarity metrics to ensure more cases can be selected to the CRS when a case is determined to be very similar to more than a set number of cases in the database.
For all the cases in CRS, dosimetric parameters and anatomical features are extracted to train a regression model using the following formula:
where denotes P anatomical feature values from N training cases (i.e., N is the size of CRS), denotes OAR DVH principal component scores (PCS) of the N training cases, and denotes the optimal regression coefficients corresponding to P anatomical features. Here, the PCS is a dimension-reduced representation of the entire DVH curve [19]. Following previous implementations, we retain the first three PCS for the modeling process and use the equation to model the three PCS values separately.[20] The last term, known as the penalty term, helps to prevent overfitting. The penalty hyperparameter λ for adjusting the model bias-variance balance was decided by in-training-set five-fold cross validation results. The results were evaluated using RMSE of predicted DVHs compared to clinical DVHs, and the λ value corresponding to the smallest RMSE value was selected. This localized KBP model is used to predict the OAR DVH for the current case.
2.2. Tradeoff hyperplanes
After the KBP model is built, it is applied to all the cases in the CRS to extract tradeoff related variations. The difference between the model predicted and the actual DVH PCS (from clinical plans) for all OARs is formulated as , which is essentially the fitting residuals of N training cases in the CRS (N=35 in this study), each with M OARs and P DVH PCS scores per OAR. By retrospectively examining the DVH predictions and comparing them with clinical DVHs, we observed that significant portions of the fitting errors are due to the tradeoff relations. As a result, there is valuable information in the fitting residuals. The purpose of subtracting the predicted PCS is to remove the variations linked to anatomical differences and extract only the discrepancy between the KBP model and the clinical plans that are likely caused by tradeoff decisions. The matrix E of OAR DVH fitting residuals is subsequently processed by principal component analysis (PCA) to further reduce the dimensionality with the first L PCS (L=3 in this study) taken as the principal tradeoff directions. The tradeoff directions effectively reveal the most prominent DVH variation patterns in the CRS after adjusting for anatomy variations. These patterns are representative of the commonly-occurring tradeoffs in the historical reference database. Since the CRS used as training cases in the model building process is selected based on morphological similarity to the current case, the extracted tradeoff directions are thus specific to the current-case. These directions form a tradeoff hyperplane that provides effective guidance for a well-confined and clinically representative tradeoff subspace.
2.3. Data selection
A total of 244 anonymized HN cases were retrieved with IRB approval. These cases were all regularly-fractionated but were of various prescription doses, including 44 Gy/ 70 Gy and 50 Gy/ 60 Gy to the primary and boost PTVs. All cases were planned with IMRT technique using from 7 to 11 beams. Recently, volumetric modulated arc therapy (VMAT) has been increasingly utilized to treat HN cases. However, in this study, the proposed method are evaluated with IMRT cases due to data availability in our historical database. It is expected that the method can be applied to VMAT without major modifications. The cases were treated by three physicians from our institution. OAR constraints were prescribed to limit parotid Dmedian, oral cavity Dmedian, larynx Dmedian, pharynx Dmedian, mandible D1cc/Dmax, brainstem Dmax, and cord+5mm Dmax. The prescribed planning constraints were given by physicians based on their estimations of best achievable dose-volume values from past experience. Typical constraints used in our institution are presented in the supplementary materials. Note that in our clinical practice and in this HN dataset, PTV-OAR is not a tradeoff direction. For these patients, the PTV coverage is always normalized to have 100% prescription dose cover at least 95% PTV volume.
2.4. Validation
The validation experiment covers two aspects: (1) to validate the assumption that the clinically desirable tradeoffs can be well-represented by the proposed hyperplanes; and (2) DVHs generated by the hyperplane model can be realized in the actual IMRT plans. From the 244 anonymized cases, we randomly partitioned 214 cases to the reference pool and the remaining 30 cases to the validation pool. For each validation case, we created a total of 14 auto-generated plans. First, a KBP plan was generated from DVH predictions given by the KBP model. This plan represents the baseline scenario before any tradeoff considerations are attempted. Second, the clinical plans’ DVHs in the CRS were analyzed against the KBP model predictions to extract the embedded tradeoff knowledge and construct the tradeoff hyperplane. The tradeoff hyperplane was sampled in all three principal tradeoff directions with the amplitude of and to generate 12 sets of OAR DVH predictions that represent 12 different tradeoff options. Here , n ∈ [1, 30], i ∈ [1, 3] denotes the standard deviation of the tradeoff vector in the CRS for case n in the ith direction. These 12 sets of DVH predictions were then used to generate 12 tradeoff plans. Finally, the 14th plan, called the clinical-DVH-fitted plan, was generated as a fitting of the clinical DVHs on the predicted DVH hyperplanes. Formally, DVHfitted can be found by solving a linear least-squares problem: , where denotes the three principal tradeoff directions, and denotes the fitting parameters corresponding to the three principal tradeoff directions. The clinical-DVH-fitted plan can then be generated by using , followed by auto-generation of the plan. This plan is essentially a projection of the clinical plan, it provides a sanity check on the validity of the other 13 auto-generated plans in this experiment. In this closed loop, the difference between the original clinical plan and its clinical-DVH-fitted plan serves another baseline of the achievability of the hyperplane model.
All 14 plans were generated automatically in the Eclipse™ treatment planning system (TPS; Varian Medical Systems, Palo Alto, CA) using the predicted DVHs as optimization objectives. To interface with the TPS and streamline the planning process, we have developed an Eclipse scripting API[21] program to automatically predict DVHs, place optimization objectives, and run optimizations. These auto-generated plans share the same isocenters and beam angles of the clinical plans. The endpoint of the workflow is an ensemble of best achievable plans with various tradeoffs (referred to as “tradeoff plans” in the rest of the paper).
To test the achievability of hyperplane based tradeoff guidance, the realized DVHs of the 14 plans for each validation case were evaluated against their corresponding DVH predictions. Root-mean-squared error (RMSE) values were calculated to quantify the discrepancies between the realized and predicted DVH curves. Furthermore, the distribution of OARs that were involved in tradeoffs along the three principal directions was analyzed. Two OARs with the largest PCS amplitudes in each tradeoff vector were selected and denoted as tradeoff organs. We expect that those more involved OARs along tradeoff directions should correspond to OARs that have more clinical importance in sparing decision making.
3. Results
3.1. Distribution of tradeoff directions
Figure 1 shows the percentages of DVH PCS variations (8 OARs) in the CRS that can be represented by the hyperplane. The variations were quantified by the Euclidean distances between the clinical DVH PCS and the clinical-plan-fitted DVH PCS in a tradeoff subspace with a given number of tradeoff directions n, normalized to the Euclidean distance between clinical DVH PCS and KBP DVH PCS. Using this measurement, the first three directions (n=3) account for 57.8 % ± 3.6 % of the total variations. It confirms the hypothesis that the clinical tradeoffs are of low dimensions and can be effectively represented by hyperplanes. This also means that the validation cases are close to the hyperplanes, with less than half of the variations due to other factors. The OARs involved in tradeoff directions in the validation cases are summarized in Fig. 2. Parotids often appear in the primary tradeoff direction. Oral cavity, larynx, and pharynx are often involved in secondary and tertiary tradeoff directions. This indicates that physicians have made consistent selections of OARs to tradeoff with similar anatomies, albeit tradeoff directions and dose amount were different case-to-case. On the contrary, cord, brainstem, and mandible have not been identified as tradeoff OARs, suggesting that the DVHs of these OARs do not form direct tradeoff relations with any other OARs.
3.2. Achievability of tradeoff predictions
Figure 3 shows the RMSE between the DVHs predicted by the tradeoff hyperplane and the corresponding DVHs realized by the auto-generated tradeoff plans. These RMSE values represent the fidelity of the realized plans compared with predictions. Among these 14 plans, 12 are actual tradeoff plans and two plans are references (the KBP plan and the clinical-DVH-fitted plan). As shown, RMSEs of the max-dose constrained OARs (cord, brainstem, mandible) have higher values compared to dose-volume constrained OARs (e.g. parotid). In clinical planning, when OARs are max-dose constrained, planners tend to place very low priorities on sparing these OARs at dose-volume points other than the Dmax. This results in large DVH variations not attributed to anatomy differences. Therefore, these DVH curves are not predicted as accurately as DVHs of other OARs. Due to such variations, RMSE values, even for the KBP plans, are not expected to be zero. However, as it has been shown in the literature that KBP model predicted DVHs are indeed achievable [22], the non-zero RMSE of the KBP model predictions can establish the baseline for the hyperplane model.
Table 1 shows the dosimetric results of hyperplane-guided tradeoff plans, the KBP plans, and the clinical-DVH-fitted plans, averaged over the validation set. The averaged dose-volume results confirm that the tradeoff plans, as a group, were achievable and of comparable plan quality to KBP plans. It is important to note that tradeoff directions are case-specific and the tradeoff directions of one case can be opposite to that of another case. After taking the average, much of the tradeoff variations are averaged out. Thus the average values listed in this table may not reflect the full range of dosimetric variations. Nevertheless, the primary tradeoff directions are still clearly reflected in the right parotid Dmedian, oral cavity Dmedian, and larynx Dmedian.
Table 1.
KBP | Primary direction | Secondary direction | Tertiary direction | Clinical-DVH-Fitted | ||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
+σ | −σ | + 2σ | −2σ | +σ | −σ | +2σ | −2σ | +σ | −σ | +2σ | −σ | |||
Right parotid Dmedian (Gy) | 22.2 | 20.1 | 24.3 | 18.8 | 26.2 | 21.8 | 22.7 | 21.5 | 23.2 | 22.2 | 22.2 | 22.3 | 22.3 | 21.8 |
Left parotid Dmedian (Gy) | 20.4 | 19.8 | 20.7 | 19.3 | 21.1 | 19.1 | 21.5 | 18.4 | 22.5 | 20.2 | 20.4 | 20.0 | 20.6 | 20.1 |
Oral cavity Dmedian (Gy) | 29.6 | 29.1 | 29.9 | 28.8 | 30.2 | 29.2 | 29.8 | 28.9 | 30.1 | 29.3 | 29.8 | 29.1 | 29.8 | 29.3 |
Larynx Dmedian (Gy) | 24.0 | 23.0 | 25.1 | 22.1 | 26.1 | 24.0 | 24.1 | 24.0 | 24.2 | 24.3 | 23.8 | 24.4 | 23.6 | 23.7 |
Pharynx Dmedian (Gy) | 39.3 | 39.0 | 39.5 | 38.5 | 39.6 | 38.9 | 39.6 | 38.2 | 39.8 | 38.9 | 39.7 | 38.1 | 40.1 | 39.1 |
Cord+5mm Dmax (Gy) | 43.2 | 43.2 | 43.0 | 43.5 | 43.0 | 42.5 | 43.4 | 40.7 | 43.8 | 42.9 | 43.2 | 42.1 | 43.0 | 42.8 |
Brainstem Dmax (Gy) | 25.7 | 25.9 | 25.8 | 25.9 | 25.8 | 25.0 | 25.6 | 25.0 | 26.1 | 25.8 | 25.6 | 25.7 | 25.6 | 25.9 |
Mandible D1cc (Gy) | 65.3 | 65.3 | 65.3 | 65.4 | 65.4 | 65.2 | 65.5 | 65.2 | 65.5 | 65.4 | 65.4 | 65.5 | 65.3 | 65.4 |
3.2. An example case illustrating the primary tradeoff direction
Figure 4 shows an example case with the original clinical plan, the KBP plan, and two tradeoff plans (sampled in the primary tradeoff direction). DVHs of the clinical plan (blue), KBP model predictions (magenta), and tradeoff predictions (grey) are shown for all contoured OARs, including right parotid, left parotid, oral cavity, larynx, pharynx, cord+5mm, brainstem, and mandible, respectively. The primary tradeoff direction for this case involves right parotid, left parotid, larynx, and pharynx, and the tradeoff DVHs cover a significant dose-volume range. On the contrary, cord, oral cavity, mandible, and brainstem show little involvement in the tradeoff decisions.
In this case, we notice that the clinical planner traded extra sparing on the right parotid with sparing of the ipsilateral parotid (left parotid). As the figure shows, the right parotid DVH (blue) is lower than KBP prediction (magenta) and is closest to the +σ marked by “o” signs, while the left parotid is higher than KBP prediction and also is closest to the +σ marked by “o” signs. This indicates a significant tradeoff decision favoring the right parotid. The series of tradeoff DVHs in the figure also reveals the fact that if significant improvement of left parotid sparing (as suggested by the DVHs marked with squares) is warranted, then the compromise of the right parotid sparing is necessary. Therefore, providing a series of such hyperplane-guided tradeoff predictions to physicians would help them make informed decisions on the best tradeoff choices. This series of tradeoff plans are shown in the bottom row of Fig. 4, as the gradually enhanced sparing of ipsilateral parotid clearly resulted in the compromise of the contralateral parotid.
4. Discussion
To summarize, the hyperplane presents tradeoff plans that are clinically-relevant and narrows down the search space. The physician could use the hyperplane to effectively navigate the tradeoffs and make tradeoff decisions with other clinical considerations. The proposed method is an extension of previously reported knowledge models [16], which further explores the nature of variation in plans with highly similar anatomies. The RMSE data, shown in Fig. 3, illustrate that parotids and oral cavity have least variations among similar anatomies, while brainstem and mandible vary the most. The result is as expected from the clinical planning point of view. In HN planning, sparing of parotids often carries the highest priority. In order to lower the probability of severe xerostomia correlated with parotid mean dose, physicians and planners carefully examine and paint the dose based on the location of the PTVs with respect to both parotids. On the contrary, brainstems and mandibles are often evaluated for the maximum dose, so different planners have different habits in controlling the overall dose in these organs.
One important insight provided by the proposed modeling approach is the case-specific tradeoff directions. For the planning of HN IMRT, these tradeoff directions provide physicians and planners guidance on the tradeoff candidate OARs and the range of the potential tradeoffs. As shown in Fig. 2, cord and brainstem are the organs rarely involved in tradeoffs as all their tradeoff choices are collapsed onto the expected DVHs. The parotids, on the other hand, are the primary tradeoff candidates, showing the highest frequency in Fig. 2. For a specific case like the one shown in Fig. 4, the prior clinical experience indicating the Dmedian tradeoff range (one standard deviation) for left parotid is about 7 Gy. And, the gains in left parotid sparing, is mostly coming from the compromise in right parotid sparing, with the corresponding range of 2 Gy. Such information is valuable to physicians and planners as they can examine the feasibility of their sparing goals prior to planning, with the guidance on tradeoff directions and ranges. Further, the predicted hyperplane can be sampled and interpolated, and resulted DVHs are then used to generate the corresponding tradeoff KBP plans, with full potential of automation. This process produces an ensemble of treatment plans that represent past tradeoff experience in the clinical practice.
As mentioned earlier, multi-criteria optimization (MCO) [11–15], which has been successfully implemented in some commercial treatment planning systems [23, 24], provides a post-planning solution to the tradeoff decision problem. Given an initial plan, these systems generate a set of alternative plans based on pre-selected tradeoff criteria and allow users to navigate Pareto surfaces in the vicinity of the initial plan before final dose calculations. Each of the alternative plans represents a tradeoff location on the Pareto surface. In this work, we also provide physicians tradeoff options for each patient. Compared with MCO approaches, the proposed model is different in two aspects. First, the model is directly built with existing clinical plans. Prior knowledge about optimal tradeoffs for different patients embedded in the reference database allows the model to predict the clinically relevant tradeoff hyperplane without inverse planning. Since a unique KBP model and a set of tradeoff directions are built for each patient case, the proposed model allows flexible tradeoff modeling based on patient-specific anatomy. Patients with different sub-type and different PTV sizes may require different tradeoff considerations and such considerations are implicitly modeled during the anatomy-based CRS selection phase. Second, the exploration range of this method is guided by historical plans. From the computational performance perspective, selecting a proper exploration range is important in finding the final tradeoff plan because larger than necessary range will result in decreased efficiency and overly small range will not allow the user to navigate to the desired tradeoff location. In MCO planning, the tradeoff range is usually a fixed template set by the TPS. In comparison, the exploration ranges in the proposed model are proportional to prior plan variations in corresponding tradeoff directions. The proposed model intuitively explores the tradeoff hyperplane based on previous clinicians’ tradeoff decisions and focuses on searching in clinically meaningful tradeoff directions.
We note that successful implementation of this technique requires two conditions. First, the KBP model accurately models the anatomical variations. Improvements in high-order features and advanced modeling techniques ensure patient-specific anatomical features can be well-modeled [16]. To further reduce the effects of anatomical variations, we select only a highly similar subset of cases (CRS) for KBP modeling. Second, all the plans in the reference dataset are planned consistently. Prior evaluations of the plan quality have shown consistent quality among academic institutions. For instance, in a study by Lian et al [25], an HN IMRT KBP model from one institution was compared with a Tomotherapy KBP model from another institution and the authors found the two models were in high agreement, indicating that both institutions’ dosimetry quality are highly consistent, despite the differences in treatment modalities, delivery techniques, and treatment planning procedures. Thus, compared with the conventional knowledge-based models, the proposed model needs more training cases to establish a subset of sufficiently similar cases for plan referencing. A potential limitation of the study is the validation of the proposed model in its predictability of trade-off locations. In this study, we used a surrogate test for validation purposes. As an ensemble, clinical plans from a pool of patients are at different tradeoff locations of their own patient-specific tradeoff surfaces. We have projected each clinical plan to its corresponding tradeoff hyperplane predicted by our model and examined the clinical-DVH-fitted plans, the clinical plans, and the KBP plans and found the discrepancies between the clinical-DVH-fitted plans and the clinical plans are on average 57.8% smaller than the discrepancy between KBP plans and the clinical plans. This shows that the hyperplane model explains most of the variation between clinical plans and the KBP plans.
In addition, the variations of the CRS can be due to both tradeoff considerations and inter-planner or intra-planner plan quality variations. While the former type of variations can be extracted using the proposed method, the latter can potentially present itself as noise and cannot be effectively summarized with PCA. Therefore, the results shown in section 3.1 may vary based on the quality of the available reference database. It is also worth noting that the dataset used in this paper is representative of a single-center experience. Physicians from the same treatment facility tend to take similar and consistent tradeoffs. Therefore, we expect that the tradeoff hyperplane model will capture more variations and potentially become of higher dimensions if applied to a heterogeneous dataset with treatment plans across different cancer centers. Accordingly, the number of cases for CRS and the entire reference pool will likely need to be increased.
5. Conclusions
By taking advantage of a high-dimensional morphological feature and the KBP modeling framework, we have developed a patient-specific pre-planning technique for tradeoff hyperplane estimation to aid clinical decision-making and facilitate an efficient clinical workflow for head-and-neck treatment planning. Experiments show that the proposed hyperplane model predicts an effective subspace of tradeoff DVHs that are both achievable and clinically meaningful.
Supplementary Material
Funding Statement
This work is partially supported by an NIH grant (#R01CA201212) and a master research grant by Varian Medical Systems.
Footnotes
Publisher's Disclaimer: This is a PDF file of an unedited manuscript that has been accepted for publication. As a service to our customers we are providing this early version of the manuscript. The manuscript will undergo copyediting, typesetting, and review of the resulting proof before it is published in its final form. Please note that during the production process errors may be discovered which could affect the content, and all legal disclaimers that apply to the journal pertain.
Conflict of Interest Statement
The authors have no conflicts of interests to report.
References
- 1.Zhu X, et al. , A planning quality evaluation tool for prostate adaptive IMRT based on machine learning. Medical Physics, 2011. 38(2): p. 719–726. [DOI] [PubMed] [Google Scholar]
- 2.Wu B, et al. , Data-Driven Approach to Generating Achievable Dose–Volume Histogram Objectives in Intensity-Modulated Radiotherapy Planning. International Journal of Radiation Oncology*Biology*Physics, 2011. 79(4): p. 1241–1247. [DOI] [PubMed] [Google Scholar]
- 3.Yuan L, et al. , Quantitative analysis of the factors which affect the interpatient organ-at-risk dose sparing variation in IMRT plans. Medical Physics, 2012. 39(11): p. 6868–6878. [DOI] [PubMed] [Google Scholar]
- 4.Appenzoller LM, et al. , Predicting dose-volume histograms for organs-at-risk in IMRT planning. Medical Physics, 2012. 39(12): p. 7446–7461. [DOI] [PubMed] [Google Scholar]
- 5.Zhang J, et al. , An Ensemble Approach to Knowledge-Based Intensity-Modulated Radiation Therapy Planning. Frontiers in Oncology, 2018. 8(57). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Tol JP, et al. , Evaluation of a knowledge-based planning solution for head and neck cancer. Int J Radiat Oncol Biol Phys, 2015. 91(3): p. 612–20. [DOI] [PubMed] [Google Scholar]
- 7.Tol JP, et al. , Can knowledge-based DVH predictions be used for automated, individualized quality assurance of radiotherapy treatment plans? Radiat Oncol, 2015. 10: p. 234. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Berry SL, et al. , Evaluating inter-campus plan consistency using a knowledge based planning model. Radiother Oncol, 2016. 120(2): p. 349–55. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Fogliata A, et al. , On the pre-clinical validation of a commercial model-based optimisation engine: application to volumetric modulated arc therapy for patients with lung or prostate cancer. Radiother Oncol, 2014. 113(3): p. 385–91. [DOI] [PubMed] [Google Scholar]
- 10.Chang ATY, et al. , Comparison of Planning Quality and Efficiency Between Conventional and Knowledge-based Algorithms in Nasopharyngeal Cancer Patients Using Intensity Modulated Radiation Therapy. Int J Radiat Oncol Biol Phys, 2016. 95(3): p. 981–990. [DOI] [PubMed] [Google Scholar]
- 11.Craft D, et al. , An approach for practical multiobjective IMRT treatment planning. Int J Radiat Oncol Biol Phys, 2007. 69(5): p. 1600–7. [DOI] [PubMed] [Google Scholar]
- 12.Craft DL, et al. , Improved planning time and plan quality through multicriteria optimization for intensity-modulated radiotherapy. Int J Radiat Oncol Biol Phys, 2012. 82(1): p. e83–90. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Craft D, Halabi T, and Bortfeld T, Exploration of tradeoffs in intensity-modulated radiotherapy. Phys Med Biol, 2005. 50(24): p. 5857–68. [DOI] [PubMed] [Google Scholar]
- 14.Halabi T, Craft D, and Bortfeld T, Dose–volume objectives in multi-criteria optimization. Physics in Medicine and Biology, 2006. 51(15): p. 3809–3818. [DOI] [PubMed] [Google Scholar]
- 15.Craft DL, et al. , Approximating convex pareto surfaces in multiobjective radiotherapy planning. Med Phys, 2006. 33(9): p. 3399–407. [DOI] [PubMed] [Google Scholar]
- 16.Zhang J, et al. , Modeling of multiple planning target volumes for head and neck treatments in knowledge-based treatment planning. Medical Physics, 2019. 46(9): p. 3812–3822. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Zhang J, et al. , Knowledge-Based Statistical Inference Method for Plan Quality Quantification. Technology in cancer research & treatment, 2019. 18. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Ge Y and Wu QJ, Knowledge-based planning for intensity-modulated radiation therapy: A review of data-driven approaches. Medical Physics, 2019. 46(6): p. 2760–2775. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Jolliffe I, Principal Component Analysis, in Wiley StatsRef: Statistics Reference Online. 2014.
- 20.Yuan L, et al. , Quantitative analysis of the factors which affect the interpatient organ-at-risk dose sparing variation in IMRT plans. Med Phys, 2012. 39(11): p. 6868–78. [DOI] [PubMed] [Google Scholar]
- 21.Eclipse Scripting API Reference Guide. 2015: Varian Medical Systems.
- 22.Wall PDH, Carver RL, and Fontenot JD, Impact of database quality in knowledge-based treatment planning for prostate cancer. Pract Radiat Oncol, 2018. 8(6): p. 437–444. [DOI] [PubMed] [Google Scholar]
- 23.Eclipse Photon and Electron Algorithm Reference Guide. 15.5 ed. 2017: Varian Medical Systems, Inc. [Google Scholar]
- 24.Multi-criteria optimization in RayStation. 2015: RaySearch Laboratories.
- 25.Lian J, et al. , Modeling the dosimetry of organ-at-risk in head and neck IMRT planning: an intertechnique and interinstitutional study. Med Phys, 2013. 40(12): p. 121704. [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.