Abstract
Purpose
We present a particle swarm optimization (PSO)‐based technique to create deliverable four‐dimensional (4D = 3D + time) intensity‐modulated radiation therapy (IMRT) plans for lung stereotactic body radiotherapy (SBRT). The 4D planning concept uses respiratory motion as an additional degree of freedom to achieve further sparing of organs at risk (OARs). The 4D‐IMRT plan involves the delivery of an order of magnitude more IMRT apertures (~15,000–20,000), with potentially large interaperture variations in the delivered fluence, compared to conventional (i.e., 3D) IMRT. In order to deliver the 4D plan in an efficient manner, we present an optimization‐based aperture sequencing technique.
Method
A graphic processing unit (GPU)‐enabled PSO‐based inverse planning engine, developed and integrated with a research version of the Eclipse (Varian, Palo Alto, CA) treatment planning system (TPS), was employed to create 4D‐IMRT plans as follows. Four‐dimensional computed tomography scans (4DCTs) and beam configurations from clinical treatment plans of seven lung cancer patients were retrospectively collected, and in each case, the PSO engine iteratively adjusted aperture monitor unit (MU) weights for all beam apertures across all respiratory phases to optimize OAR dose sparing while maintaining planning target volume (PTV) coverage. We calculated the transition times from each aperture to all other apertures for each beam, taking into account the maximum leaf velocity of the multileaf collimator (MLC), and developed a mixed integer optimization technique for aperture sequencing. The goal of sequencing was to maximize delivery efficiency (i.e., minimize the time required to deliver the dose map) by accounting for leaf velocity, aperture MUs, and duration of each respiratory phase. The efficiency of the proposed delivery method was compared with that of a greedy algorithm which chose only from neighboring apertures for the subsequent steps in the sequence.
Results
4D‐IMRT‐optimized plans achieved PTV coverage comparable to clinical plans while improving OAR sparing by an average of 39.7% for heart, 20.5% for esophagus, 25.6% for spinal cord, and 2.1% for lung (with standing for maximum dose and standing for volume receiving 13 Gy). Our mixed integer optimization‐based aperture sequencing enabled the delivery to be performed in fewer cycles compared to the greedy method. This reduction was 89 ± 79 cycles corresponding to an improvement of 15.94 ± 8.01%, when considering respiratory cycle duration of 4 s, and 55 ± 33 cycles corresponding to an improvement of 15.14 ± 4.45%, when considering respiratory cycle duration of 6 s.
Conclusion
PSO‐based 4D‐IMRT represents an attractive technique to further improve OAR sparing in lung SBRT. Efficient delivery of a large number of sparse apertures (control points) introduces a challenge in 4D‐IMRT treatment planning and delivery. Through judicious optimization of the aperture sequence across all phases, such delivery can be performed on a clinically feasible time scale.
Keywords: 4D‐IMRT , aperture sequencing, lung SBRT , mixed integer programming, particle swarm optimization
1. Introduction
Accounting for respiratory motion is one of the major challenges in delivering radiation therapy (RT) to patients with thoracic and abdominal cancer.1, 2 Concerns about respiration‐induced motion generally lead clinicians to treat a larger treatment volume, that is, internal target volume (ITV), which consequently increases the probability of toxicity in organs at risk (OARs). In lung stereotactic body RT (SBRT), where biologically potent radiation doses are administered to the tumor target in relatively few fractions,3 the potential for overdose to normal structures and, therefore, radiation‐induced toxicity is significantly higher than in conventionally fractionated RT. Thus, while SBRT achieves significantly superior outcomes compared to conventionally fractionated RT,4 increased risk of OAR toxicity limits the use of SBRT in patients with large and/or centrally located lung tumors.
One of the strategies proposed to improve OAR dose sparing is to use respiration‐induced motion and deformation of thoracic organs and tumor, as observed from four‐dimensional computed tomography (4DCT) simulation images, as an additional degree of freedom in treatment planning.5, 6, 7, 8, 9 We term this approach as 4D planning and delivery. The term “4D” has been used for treatment planning and delivery strategies that use temporal information concurrently with 3D spatial information. For instance, conventional (i.e., 3D) ITV‐based intensity‐modulated RT (IMRT) plans are often referred to in the literature as “4D plans”. However, in this study, the term “4D” means that one explicitly accounts for the complex respiration‐induced anatomical changes in the entire irradiated volume (tumor and OARs). In a conventional ITV‐based IMRT delivery, for each beam, the total irradiation time in monitor units (MUs) is divided by the number of apertures corresponding to that beam. Thus, during delivery, the aperture shape is changed as a function of irradiation time. However, in our 4D‐IMRT delivery, the aperture shape changes as a function of both irradiation time and the respiratory phase.10 In its current form, our technique accounts for anticipated motion (as seen during CT sim) and is distinct from respiratory gating where treatment plans are created for and delivered over fixed portions of respiratory cycle.11 Our technique is also distinct from real‐time multileaf collimator (MLC) tracking, where patient respiration is monitored during delivery to synchronize the treatment aperture with breathing in real time, thereby accounting for unanticipated motion.12
In previous studies, we introduced our 4D optimization strategy for conformal radiation therapy (CRT) planning5, 9 and for inverse‐planned respiratory phase gating.13 More recently, we reported on the implementation of particle swarm optimization (PSO) on a graphic processing unit (GPU)‐based platform for 4D‐IMRT employing a research version of a commercial treatment planning platform, Eclipse (Varian Medical Systems, Palo Alto, CA, USA).14 In our 4D planning approach, one 3D‐IMRT treatment plan is created for each individual respiratory phase in Eclipse and MUs are optimized for all apertures in all respiratory phases simultaneously using the in‐house GPU‐enabled PSO engine.
Compared to 4D‐CRT, 4D‐IMRT utilizes more apertures to better conform to motion and deformation of the tumor. However, this advantage comes at the price of orders of magnitude higher complexity of optimization. In 4D‐CRT, each beam usually has only one aperture (control point) per respiratory phase, whereas in 4D‐IMRT, each beam usually has hundreds of apertures per respiratory phase. Delivering these many apertures purely sequentially would greatly increase the treatment time. It is important to reduce treatment time because patients may have difficulty lying on the treatment couch for long periods of time during radiation delivery resulting in increased risk of involuntary movements. Furthermore, longer fraction delivery times (≥15 min) are likely to significantly decrease cell killing.15 Finally, fast delivery also increases the number of patients treated using the same linear accelerator (Linac).16 Therefore, in addition to the dosimetric optimization, we also developed a technique to minimize the delivery time, thereby maximizing the delivery efficiency. For this purpose, we chose a mixed integer optimization‐based aperture sequencing approach, where we minimize the time required to deliver the dose of a given set of apertures. While several groups have reported on IMRT leaf sequencing based on fluence map optimization,17, 18, 19 MIOBAS is developed to optimize the sequence of apertures for which the shapes were preconfigured (in Eclipse), and MUs optimized in our in‐house PSO engine. Note that while the PSO engine was implemented on GPUs, the MIOBAS module was implemented on the central processing unit (CPU) platform.
In the following sections, we describe our method, including patient cohort, data preparation, 4D‐IMRT treatment plan optimization, and the aperture sequencing optimization (MIOBAS). Subsequently, we present results for both 4D‐IMRT planning and aperture sequencing.
2. Method
Figure 1 describes the overall workflow of this study consisting of the steps performed in Eclipse treatment planning system (Section 2.B.1), our in‐house GPU‐based PSO inverse planning system (Section 2.B.2), and our in‐house aperture‐sequencing system, MIOBAS (Section 2.C). Appendix A (in Tables AI and AII) gives a glossary table for variables used in MIOBAS. The patient cohort and processing platform details are described in Sections 2.A and 2.D, respectively.
Figure 1.

Overall workflow of our proposed 4D‐IMRT planning: We use three modules: Eclipse treatment planning system (TPS), PSO inverse planning, and aperture sequencing for deliverability (MIOBAS). [Color figure can be viewed at wileyonlinelibrary.com]
2.A. Patient cohort
Seven consecutive lung cancer patients were retrospectively selected for this study. Of these, six underwent lung SBRT (5 fractions, 30–60 Gy). One patient was initially prescribed SBRT, but upon further consideration by our clinical team, ended up receiving 45 Gy in 15 fractions. Figure 2 summarizes patient and prescription details.
Figure 2.

Coronal views with planning target volumes (PTVs) outlined in red (note yellow arrows) are shown for the seven patients of this study. Patient‐specific maximum respiration‐induced target motions and number of clinically assigned radiotherapy beams and fractions as well as prescribed PTV doses are also reported. [Color figure can be viewed at wileyonlinelibrary.com]
2.B. PSO inverse planning
2.B.1. Data preparation
For each patient, we collected the clinical treatment plan, which was created on average CT scans using ITVs. In addition, for each patient, tumor and OARs were manually contoured on the CT volumes corresponding to end‐exhalation (end‐exhalation; i.e., 50%). The contours were then propagated from the 50% phase to other phases using Velocity (Varian, Palo Alto, CA. USA) image registration tool. Ten respiratory phases were considered, and the corresponding ten 3D‐IMRT plans were generated in the Eclipse TPS V13.6 using the same beam configurations (gantry and couch angles) assigned by clinicians to the clinical ITV‐based plans. In the individual‐phase 3D‐IMRT planning process, individual‐phase target volumes were used in contrast to motion‐inclusive target volumes used in a conventional ITV‐based planning process. For each individual‐phase 3D‐IMRT plan, leaf sequencing was performed in Eclipse using Smart LMC (Leaf Motion Calculator); that is, apertures were sequenced for each beam at each phase independent of other phases. We then exported dose deposition matrices (one for each aperture) in order to optimize the dose contribution of each beam aperture to the irradiated anatomical volume (through optimizing its MU weight) as explained in the next subsection.
2.B.2. Optimizing aperture MU weights
Using our in‐house optimization engine, the aperture MU weights for all beams across all respiratory phases (i.e., the ten 3D‐IMRT plans) were optimized simultaneously such that dose deposited to OARs was minimized while the prescribed dose to the PTV remained at the required level. To use the respiratory motion as an additional degree of freedom rather than a hindrance, the algorithm could increase the MUs for a beam in one phase, in which due to respiration motion the tumor moved away from critical organs, and, reduce the dose in another phase in which tumor moved close to those organs. Therefore, the individual‐phase 3D‐IMRT plans were not necessarily delivering identical MUs.
The two following major calculation steps were involved in our aperture MU weight optimization5, 14:
Deformable image registration
We used an open‐source deformable image registration (DIR) software, Elastix,20 to sum up the dose across respiratory phases. As a one‐time process, before starting optimization, deformable vector fields (DVFs) were calculated from CT images for all respiratory phases to be mapped on the reference phase (end‐exhalation). During each iteration cycle of the MU weight optimization algorithm, the precalculated DVFs were applied to the dose matrices in a GPU‐based parallelized implementation.14 Before optimizing the 3D‐IMRT plans exported from Eclipse, we created an equal‐weight summation of the doses from the ten 3D‐IMRT plans on the reference phase using DIR. This plan is called 4D equal‐weight plan.
Particle swarm optimization
The optimization algorithm optimizes aperture MUs across all respiratory phases simultaneously. PSO search methodology penalizes any violation of the dose–volume constraints, regardless of what form of penalty term is applied. To that end, it scans through phase–adjacent apertures and preferentially chooses to increase the weight for the apertures in respiratory phases where there are fewer OARs in the beam line, so as to reduce OAR dose. Such an approach eliminates or reduces the impacts of unwanted apertures, that is, those with more OARs in the beam line, by assigning a zero or lowered MU weights to them. As by‐product, this approach results in sparsity or large MU variations between phase–adjacent apertures. While large variations in MUs of phase–adjacent apertures were avoided by some other groups (e.g., Nohadani et al.21) in order to guarantee deliverability, we rectified the impact of allowing such large variations by dividing large MUs into multiple pieces, similar to Gui et. al's work,22 to be delivered over several breathing cycles in the sequencing step (Section 2.C). Similar to our previous works,5, 14 we chose dose–volume limits that were stricter than institutional lung SBRT dose–volume constraints (protocols) to formulate our objective function (Appendices B and C). For each OAR within a patient, we considered multiple upper dose–volume limits corresponding to different partial volumes in order to obtain a better sparing than that in the clinical plan.
2.C. Aperture sequencing for deliverability
To formulate our aperture sequencing technique, we consider that the total delivery time for each beam is composed of time needed to deliver all apertures plus time needed to transition between apertures. We calculate these times separately in the following subsections.
2.C.1. Data preparation
Let and represent the set of apertures and the set of phases, respectively. For convention, we write that denoted aperture of phase throughout this paper. Two crucial pieces of information are needed to ensure deliverability of an aperture sequence: time to deliver the prescribed dose in an aperture and time to change MLC shape between two consecutive apertures. In what follows, we explain how to compute these times.
Let denote the time needed to deliver aperture of phase in beam , which is calculated as follows:
| (1) |
where MU of beam () and was read from the individual‐phase treatment plans and aperture weights were the output of PSO. is the probability of respiratory phase , which was calculated through a 2‐min recording by bellows pneumatic belt (Philips Medical Systems, Andover, MA) acquired during 4DCT acquisition.
We calculated the transition time between every possible aperture pair for each beam. In each MLC leaf bank (Bank A and Bank B), there were (normally, =60) leaves. and denote the positions of leaf of aperture in Bank A and Bank B, respectively. Thus, , the transition time to go from aperture to aperture in beam was calculated as:
| (2) |
where is the leaf velocity for which we used the mechanical properties of the MLC. A maximum MLC leaf velocity of 3.5 cm/s (for the Varian MLC23,23) was considered. In Eq. (2), we calculated the maximum distance the leaves must move to convert from aperture to aperture , and then by considering leaf velocity, we calculated the time needed for this transition.
We considered two respiratory cycle durations () in this study: 4 s and 6 s. To calculate the duration of each phase (e.g., for phase ), we multiplied the probability of that respiratory phase , denoted by , by . These probabilities were patient‐specific.
2.C.2. Miobas
Figure 3 shows our overall sequencing workflow for both greedy and MIOBAS approaches. We started with reading intensity weights, beam MUs, respiratory phase durations, and transition times (between all possible pairs of apertures) for a given patient and plan. For each respiratory cycle, the optimized sequence of apertures was found, and the remaining aperture timings were updated; that is, if an aperture was completely delivered during that cycle, it was removed from further processing; Otherwise, the remaining required irradiation time (i.e., MUs) for that aperture's complete delivery was used in the next cycles of optimization. The difference between MIOBAS and greedy approaches was the strategy each method used to create the sequence of the apertures in each respiratory cycle. MIOBAS found the optimal sequence using an optimization model (Section 2.C.3) while the greedy method moved from each aperture to its closest aperture in shape in neighboring aperture set. We considered the uniform dose rate delivery and allowed the apertures to be delivered in multiple respiratory cycles.22 Once the optimal sequence for one respiratory cycle was found, the MIOBAS algorithm moved on to the next respiratory cycle. This process was terminated when there were no apertures with undelivered MUs left. Since multiple respiratory cycles were required to complete the delivery of each beam, the respiratory phase loop was recursive.
Figure 3.

Workflow of the aperture sequencing system (MIOBAS). In finding the optimized aperture sequence in respiratory cycle k, the greedy method chooses only from neighboring apertures whereas our proposed method uses an optimization‐based model which searches beyond neighboring apertures.
Figure 4 illustrates a typical optimal sequence of apertures in one respiratory cycle highlighted in red, where one phase (Phase ) is skipped.
Figure 4.

The schematic display of apertures of a beam along with a sequence for three phases highlighted in red. [Color figure can be viewed at wileyonlinelibrary.com]
We compared the output of our proposed MIOBAS method with that of a greedy method. Typical solutions of both methods are presented in Fig. 5. In the greedy method, the next aperture to serve is chosen based on the shortest transition time in neighboring apertures. That is why a predictable pattern can be observed in the solutions of this method. On the contrary, MIOBAS could produce sequences of apertures that maximize the utilization time fraction, defined as the fraction of the respiratory cycle utilized for dose delivery.
Figure 5.

A typical solution proposed by greedy (red) and MIOBAS (green) methods. [Color figure can be viewed at wileyonlinelibrary.com]
2.C.3. MIOBAS mathematical details
Here, we explain how we obtain the delivery‐time‐optimized sequence of apertures in a single respiratory cycle, where the best sequence is one that has the maximum delivery efficiency (maximum utilization time fraction). We first define the variables to formulate this optimization problem. Then, we explain the objective function and the constraints to solve this problem.
For beam , to define a feasible sequence, we introduce four sets of binary variables:
= 1 if aperture is the first aperture of phase in the sequence, and 0 otherwise;
= 1 if aperture is the last aperture of phase in the sequence, and 0 otherwise;
= 1 if in phase , aperture is the successor of aperture in the sequence, and 0 otherwise; and
= 1 if phase is to be skipped, and 0 otherwise.
We also introduced three continuous variables:
, the start time of aperture in phase ;
, the finish time of aperture in phase ; and
, the time that MLC spends in aperture in phase .
In this formulation, the objective function aims at maximizing time spent on dose delivery rather than transitioning between apertures.
| (3) |
In (3), also by multiplying by in the objective function, the apertures are prioritized by their intensity weights, so that those with larger weights are likely delivered earlier in the sequence. In our PSO 4D planning, we minimize violations of dose–volume constraints. A large aperture weight (and consequently, a large ) means that the respective aperture had less violation of dose–volume constraints. In other words, a large means there were less OAR voxels in‐line with radiation dose deposited by aperture of phase in beam compared to other apertures. That is why the sequencing algorithm prioritizes aperture with larger weights.
A feasible sequence of apertures in a respiratory cycle should satisfy three major sets of constraints. First, in the dynamic MLC setting, apertures should be sequenced consecutively without any discontinuity in delivery. Second, the start and finish time of delivering an aperture should fall into its corresponding respiratory phase period. Third, the time difference between the finish time and start time of two consecutive apertures in a sequence should be no shorter than their calculated transition time. We formulate these constraints as follows
| (4) |
| (5) |
| (6) |
| (7) |
Constraints (4)–(7) define a feasible path of apertures. Constraint (4) implies that if the MLC begins delivering an aperture, that aperture should be followed by either moving to another aperture in the same phase or moving to the following phase. Constraint (5) imposes that a phase j is either chosen to be processed, in which case the first aperture to be visited is selected, or be skipped, in which case y j should equal 1. Constrain (6) implies that a phase j is either chosen to be processed or be skipped. By constraint (7), we ensure that an aperture is not visited more than once in one respiratory cycle.
In addition to having a feasible path of apertures, we need to define timing of delivering the chosen apertures.
| (8) |
| (9) |
| (10) |
Equation (8) makes the finish time be equal to the start time plus the processing time. By constraint (9), we put a limit on the start time of an aperture, if it is chosen to be in the sequence in current respiratory cycle. Constraint (10) does the same thing for the finish time.
We also want to ensure that in each sequence, the transition time between apertures is considered properly:
| (11) |
| (12) |
| (13) |
The third set of constraints, (11)–(13), limits the transition time between selected apertures. In Eq. (11), and denote the index and finish time of the last aperture processed in previous respiratory cycle, respectively. By introducing this constraint, we ensure that dose delivery does not occur during aperture‐to‐aperture transition. Equations (12) and (13) ensure that when the algorithm requires to choose an aperture from a different phase, it does so with minimal time expended by considering the leaf travel times for the aperture transition as well as the time difference between the current and the target phase.
Our formulation should account for cases where the calculated time for an aperture, τ, is longer than the corresponding respiratory phase length. To manage this condition, we apply two constraints:
| (14) |
| (15) |
And visit those apertures multiple times so as to ensure the assigned MU is delivered. Constraint (14) introduces a slack variable r ji and allows delivery of a fraction of τ jib . Suppose that the aperture is chosen to be delivered, that is, . In this case, constraint (14) could be rewritten as p ji + r ji ≥ τ jib which allows p ji to take values less than τ jib . Since p ji has a positive weight in the objective function, the model tends to find the largest possible value for p ji . However, p ji cannot exceed the needed time τ jib which is enforced in constraint (15). If MLC is not chosen to deliver in a cycle, the model should have . Therefore, constraint (14) would be simplified as p ji + r ji ≥ 0, which does not enforce anything because both p ji and r ji are positive by definition.
The signs and types of our variables are
| (16) |
| (17) |
If the intensity weight of an aperture is zero, p ji will be zero for that aperture making all the related continuous and binary variables related to that aperture zero. Also, delivering phases consecutively is not always necessarily possible. For example, in some cases, the transition time between one aperture i in a respiratory phase j − 1 and all remained apertures of the following respiratory phase, j, is so long that none of the apertures of phase j are eligible to be delivered after aperture . Or, in some cases while some apertures in phases j − 1 and are left to be delivered, all apertures of phase j have already been sequenced. In the two above cases, phase j must be skipped. Assuming N apertures = 166 (Eclipse default number of apertures used in our study), Fig. 4 illustrates this condition and a feasible sequence which traverses a dummy aperture designated in phase j to skip this phase. For this example, the sequence of apertures of phases j − 1, j, and is as follows:
To skip phase j and obtain this sequence, the model will set
Therefore, to skip phase j, the model would have y j = 1.
2.D. Processing platform
2.D.1. PSO inverse planning
The optimization engine was implemented in C++ CUDA on a hardware consisting of dual 8‐core Xeon processors, 256 GB RAM, and four NVIDIA Tesla K80 general purpose GPUs (eight NVIDIA Kepler GK210 GPUs). We used Eclipse scripting interface (ESAPI) to generate dose matrices corresponding to apertures in Eclipse. The multi‐GPU computing platform had a maximum processing capability of 8.5 Tflops per K80 card. Each GK210 had 12 GB of memory, totaling 96 GB of GPU memory for our whole system. This system had a nonuniform memory access (NUMA) architecture, where each CPU had direct access to their own system memory and PCI slots.
2.D.2. Aperture sequencing for deliverability
The MIOBAS proof‐of‐concept module was also implemented in C++ on the computing platform explained in the previous section (2.D.1), and the optimization was solved using Gurobi 7.02.24
3. Results
3.A. PSO inverse planning
Due to possibility of having zero weights, the number of apertures to be sequenced was smaller than the nominal number of apertures (N variables). These numbers are displayed in Table 1 for our seven patients. No more than approximately 10% of apertures took nonzero weights.
Table 1.
Number of apertures for each patient's treatment plan, both nominal and PSO‐created plans
| Patient 1 | Patient 2 | Patient 3 | Patient 4 | Patient 5 | Patient 6 | Patient 7 | |
|---|---|---|---|---|---|---|---|
| Nominal | 14940 | 18260 | 13280 | 16600 | 16600 | 18260 | 11620 |
| In PSO‐created plan | 1490 | 1790 | 1577 | 2202 | 2660 | 859 | 1339 |
Figure 6 shows dose–volume histogram (DVH) curves corresponding to the recreated clinical ITV‐based plans, 4D PSO‐optimized plans, and 4D equal‐weight plans. Following our clinical practice, the ITV‐based plans were created on average CT scans using our clinical protocol (see Appendix C). The 4D‐optimized plans were created using our in‐house optimization engine using dose constraints which were tighter than those applied in the clinic.
Figure 6.

DVHs of the three following plans are compared: (1) Blue curves: 4D PSO‐Optimized plans, which are created by employing the in‐house PSO engine to optimize MU weights of the 3D IMRT plans created by the commercial TPS for the ten respiratory phases individually, (2) Red curves: 4D equal‐weight plans, which are created through an equally‐weighted summation of the individual‐phase 3D IMRT plans, and, (3) Black curves: the clinical ITV‐based IMRT plans, which are created by the commercial TPS. [Color figure can be viewed at wileyonlinelibrary.com]
Following our clinic's practice, the plans were normalized to ensure 95% of PTV is covered by 100% of the prescribed dose. Although the 4D‐IMRT plans did not necessarily have high dose sparing improvement for all OARs, Patients 1, 3, 4, and 6 experienced substantial improvements in dose sparing. Figure 7 gives a statistical demonstration of the improvements shown in Fig. 6. We calculated the percent improvement of OAR sparing in the 4D‐IMRT PSO‐optimized plans relative to the ITV‐based plans for maximum dose (Dmax) deposited in esophagus, heart, and spinal cord in all patients. For lung, the improvement was calculated for mean dose, V13 and V20. We used the following relation to calculate the percent improvement for each OAR:
| (18) |
Figure 7.

Box plots for percent improvement of doses deposited on OARs with 4D‐IMRT PSO‐optimized plans relative to ITV‐based plans. [Color figure can be viewed at wileyonlinelibrary.com]
It can be observed that although, for some patients, lung received more doses, and in one patient, this was the case for spinal cord, the other OARs had consistent positive improvement.
The process time consists of two main parts: the optimization time with the PSO engine and the registration time with the DIR. The registration time is a one‐time step which essentially extracts and stores the sparse dose matrices for each patient. Therefore, we only summarized the optimization time of the PSO engine in Table 2.
Table 2.
PSO engine time to optimize MU weights
| Patient 1 | Patient 2 | Patient 3 | Patient 4 | Patient 5 | Patient 6 | Patient 7 | |
|---|---|---|---|---|---|---|---|
| Time (minutes) | 77.5 | 69.7 | 69.8 | 82.3 | 79.1 | 79.3 | 73.5 |
3.A.1. Aperture sequencing for deliverability
Figure 8 compares the MIOBAS with the greedy method in terms of the total number of cycles required to deliver each plan over a (8a) 4‐s respiratory cycle and (8b) 6‐s respiratory cycle. Also, the relative improvement in efficiency using the proposed method is shown in the Fig. 8(c). The average and standard deviation of percent improvement yielded by our proposed method with were 15.94% and 8.01%, respectively. The average and standard deviation of percent improvement with T = 6 s were 15.14% and 4.45%, respectively. In Table 3, we summarize the total delivery time in seconds for each patient considering greedy and MIOBAS methods, and in Appendix D, we report on utilization times per method in Table A3.
Figure 8.

Total number of cycles for both the greedy and the MIOBAS approaches, and percent improvement of using the MIOBAS relative to the greedy for each patient with 4 and 6 s respiratory cycle time. [Color figure can be viewed at wileyonlinelibrary.com]
Table 3.
Total delivery time (in seconds) for each patient for greedy and MIOBAS methods using 4‐s and 6‐s respiratory cycle times
| Respiratory cycle | Sequencing method | Patients | ||||||
|---|---|---|---|---|---|---|---|---|
| 1 | 2 | 3 | 4 | 5 | 6 | 7 | ||
| 4 s | Greedy | 3188 | 2324 | 1164 | 1960 | 2556 | 672 | 924 |
| MIOBAS | 2224 | 1936 | 1040 | 1512 | 2108 | 612 | 848 | |
| 6 s | Greedy | 3294 | 2454 | 1254 | 2040 | 2718 | 804 | 1140 |
| MIOBAS | 2568 | 2070 | 1056 | 1662 | 2298 | 678 | 1038 | |
4. Discussion
While lung SBRT has been demonstrated to be highly successful in achieving local control, the use of more potent (and, arguably more effective) SBRT fractionation schema and the administration of SBRT to more centrally located lesions are limited in practice because of potential toxicity to surrounding tissues.25, 26 The applications of SBRT can be potentially further expanded by creating treatment plans with improved OAR sparing and, hence, lowered toxicity. The 4D planning concept can be independently applied to most commonly deployed treatment delivery techniques, that is, CRT,5 IMRT,27 and volumetric arc therapy (VMAT).6, 28
Applying our group's previously developed 4D‐IMRT inverse planning system to seven patients retrospectively, we observed the two following key specifications in the achieved results:
Compared to the clinical ITV‐based IMRT plans, OAR dose sparing was improved while PTV coverage was maintained (Fig. 6). Although not all of our patients benefited from 4D planning, Patients 1, 3, 4, and 6 showed remarkable sparing improvements comparing to their clinical plans (Fig. 7).
While the PSO optimization process started with a large number of apertures, the number of apertures picked by the optimization algorithm to be delivered was less by one, sometimes two orders of magnitude; that is, comparable to the number of apertures in ITV‐based IMRT (Table 1). This reduction makes the delivery problem much more tractable than if we had to deliver all possible 4D‐IMRT apertures.
To enable and demonstrate the deliverability of 4D‐IMRT plans, we developed a mixed integer optimization‐based aperture sequencing method MIOBAS, which finds the best sequence of apertures for the MLC over each respiratory cycle, with minimal time spent in aperture–aperture transition. Several challenges were addressed. First, delivery of apertures should only take place in their associated respiratory phase duration. Second, large aperture MUs could be delivered in multiple respiratory cycles. Finally, zero‐MU apertures were removed from the sequence without interrupting the delivery process.
In our study, for both 4D planning and aperture sequencing for delivery, we were limited by assuming that respiratory motion is fixed and reproducible — an assumption that is used in current clinical practice. Therefore, any intrafractional deviation from the assumed motion pattern due to irregularities such as amplitude or frequency changes, baseline shifts, and/or changes in the relative proportion of abdominal vs thoracic breathing, as well as phase discrimination errors could lead to geometric and dosimetric errors that adversely impact OAR sparing. A possible approach to address this limitation is to add a motion‐related margin to each phase such that relatively minor deviations are covered, and a “beam‐hold” signal which pauses dose delivery in case of larger deviations. Delivery time is relatively longer in 4D‐IMRT because of the large number of apertures. Nevertheless, the improvements achieved in dose sparing of OARs make the proposed technique an attractive alternative to conventional IMRT. While short delivery times have been achieved by several radiotherapy techniques, such as RapidArc and VMAT, margin expansion is used for managing respiration‐induced motion and deformation (i.e., ITV) limiting OAR sparing.
Our current MIOBAS model does not explicitly account for residual Mus; that is, while constraints (11)–(13) account for the transition time between aperture pairs, they do not consider MUs delivered during transition times between aperture pairs (residual MUs). For the seven patients of our study, we calculated these residual MUs in Appendix E and showed that they were a small fraction (<8.05%) of the prescribed MUs in the clinical plans in Appendix F. As a side note, we observed that the residual MUs were distributed almost uniformly across beams. One possible approach to overcome this limitation is to modify the current MIOBAS formulation so as to calculate the residual MUs corresponding to transition between every possible aperture pair for each beam and include the calculated value in the MIOBAS objective function. Alternatively, a more simplistic postsequencing approach is to assert beam‐holds during the delivery whenever the apertures undergo transition.12 Beam‐holds could be applied for all transitions, or preferably, for transition times exceeding a predetermined MU threshold.
5. Conclusion
In this study, we proposed and developed a deliverable 4D‐IMRT framework for lung SBRT to account for complex motion and deformation of the tumor target and OARs due to respiration. A research version of a commercial TPS was used to calculate dose deposition matrices, and a swarm intelligence‐based algorithm was adopted to optimize the aperture fluence weights. Subsequently, a proposed mixed integer optimization‐based sequencing method was developed to find the best sequence of apertures for every cycle of breathing while accounting for sparse fluence weights. Long delivery time required for some apertures was handled by delivering those apertures in multiple respiratory cycles. The results for seven lung cancer patients indicated that (a) OAR sparing was significantly improved, (b) the plans were deliverable, and (c) the sequences were significantly more efficient than the naïve greedy method. We have thus demonstrated the feasibility of 4D‐IMRT as an attractive planning and delivery strategy to effectively manage respiratory motion during lung SBRT.
Conflicts of interest
This work was partially supported through an in‐kind equipment loan from Varian Medical Systems.
Acknowledgments
The authors thank Wayne Keranen, Michelle Svatos, and Camille Noel from Varian Medical Systems, Palo Alto, CA, USA, for helping us with development features in Eclipse TPS. Our study was partially supported by the National Institutes of Health (R01CA169102).
Appendix A.
A.1. Glossary tables
Tables AI and AII define the variables used in MIOBAS.
Table AI. Variables used as the input of the MIOBAS
| Name | Description | How obtained | |
|---|---|---|---|
| τ jib | The time needed to deliver the prescribed dose of aperture i of phase j in beam b | Calculated in data preparation | |
|
|
The transition time to convert MLC from aperture (j, i) of beam b to aperture (j’, i’) of the same beam | Calculated in data preparation | |
|
|
The position of leaf k of aperture i of phase j in Bank A leaves of MLC | Read from the output files of Eclipse TPS | |
|
|
The position of leaf k of aperture i of phase j in Bank B leaves of MLC | Read from the output files of Eclipse TPS | |
| T | Length of respiratory cycle | Assumed to be either 4 or 6 s | |
| t j | Length of respiratory phase j | Calculated based on length of respiratory cycle and the probability of each phase in data preparation |
Table AII. Variables used as the output of the MIOBAS
| Name | Type | Description | |
|---|---|---|---|
| w ji | binary | 1 if aperture i is the first aperture of phase j in the sequence | |
| z ji | binary | 1 if aperture i is the last aperture of phase j in the sequence | |
| y j | binary | 1 if phase j of respiration is skipped | |
|
|
binary | 1 if in phase j aperture i is succeeded by i’ in the sequence | |
| S ji | continuous | the start time of aperture i in phase j | |
| v ji | continuous | the finish time of aperture i in phase j | |
| p ji | continuous | the time that MLC spends in aperture i in phase j |
Appendix B. Dose–volume Constraints
B.1.
Let N structures be the number of structures considered in the planning. For each structure, multiple upper and lower bounds (indexed by f) and one maximum voxel‐dose bound are introduced; and denote the number of upper and lower bounds for structure i, respectively. In this formulation, , , and are used as the f th upper limit, lower limit, and maximum dose value, respectively, of structure i. For this structure, N voxelsi is introduced as the number of voxels.
The PSO algorithm was employed to find the optimum aperture weights (ϑ) values which minimize the objective/cost function (F) modeled as
| (19) |
where:
| (20) |
| (21) |
| (22) |
In the above equations, we used the indicator function
where , , and represent the patient‐specific prioritizing factors for upper bound, lower bound, and maximum dose‐related terms, respectively, in the objective function.
In Equations (2), (3), (4), the dose values D j for each phase are calculated using DIR in the following equation:
| (23) |
where d k represents the dose matrices of aperture k.
Appendix C. Clinical Protocol for SBRT Dose Constraints
C.1.
| Five fractions | Volume | Volume max (Gy) | Max point dose (Gy) | Endpoint (≥Grade 3) |
|---|---|---|---|---|
| Serial tissue | ||||
| Spinal cord and medulla |
<0.35 cc <1.2 cc |
23 Gy (4.6 Gy/fx) 14.5 Gy (2.9 Gy/fx) |
30 Gy (6 Gy/fx) | Myelitis |
| Spinal cord subvolume (5–6 mm above and below level treated per Ryu) | <10% of subvolume | 23 Gy (4.6 Gy/fx) | 30 Gy (6 Gy/fx) | Myelitis |
| Esophagus | <5 cc | 19.5 Gy (3.9 Gy/fx) | 35 Gy (7 Gy/fx) | Stenosis/fistula |
| Heart/pericardium | <15 cc | 32 Gy (6.4 Gy/fx) | 38 Gy (7.6 Gy/fx) | Pericarditis |
| Critical volume (cc) | Critical volume dose max (Gy) | Endpoint (≥Grade 3) | |
|---|---|---|---|
| Parallel tissue | |||
| Lung (Right & Left) | 1500 cc | 12.5 Gy (2.5 Gy/fx) | Basic lung function |
| Lung (Right & Left) | 1000 cc | 13.5 Gy (2.7 Gy/fx) | Pneumonitis |
Appendix D. Utilization
D.1.
Table AIII. Utilization timetable
| Patient | Respiratory cycle time (s) | Method | Utilization(%) | Improvement (%) |
|---|---|---|---|---|
| 1 | 4 | Naive | 3.56 | 43.36 |
| Optimized | 5.10 | |||
| 6 | Naive | 3.45 | 28.12 | |
| Optimized | 4.42 | |||
| 2 | 4 | Naive | 4.97 | 20.04 |
| Optimized | 5.96 | |||
| 6 | Naive | 4.70 | 18.55 | |
| Optimized | 5.58 | |||
| 3 | 4 | Naive | 4.71 | 11.92 |
| Optimized | 5.28 | |||
| 6 | Naive | 4.38 | 18.75 | |
| Optimized | 5.20 | |||
| 4 | 4 | Naive | 4.71 | 29.63 |
| Optimized | 6.11 | |||
| 6 | Naive | 4.53 | 22.74 | |
| Optimized | 5.56 | |||
| 5 | 4 | Naive | 3.20 | 21.25 |
| Optimized | 3.88 | |||
| 6 | Naive | 3.02 | 18.28 | |
| Optimized | 3.57 | |||
| 6 | 4 | Naive | 0.52 | 7.39 |
| Optimized | 0.56 | |||
| 6 | Naive | 0.41 | 12.88 | |
| Optimized | 0.46 | |||
| 7 | 4 | Naive | 0.15 | 26.01 |
| Optimized | 0.18 | |||
| 6 | Naive | 0.11 | 7.62 | |
| Optimized | 0.12 |
The utilization time fraction, defined as the fraction of the respiratory cycle utilized for delivering apertures, is calculated as follows:
where the index b represents the beams. The utilization is calculated for each method (naïve or optimized). Let U naive and U optimized denote the utilization of naïve approach and optimized approach, respectively. The rightmost column shows the percent improvement of the utilization of the optimized method with respect to the utilization of the naïve method which is obtained with the following calculation:
Appendix E. Calculating residual MU
E.1.
Two hypothetical apertures in a 4D‐IMRT are shown in Fig. A1. Suppose we want to calculate the residual MU to transition from aperture 1 to aperture 2.
Let N leaf denote the number of leaf pairs in each aperture. In the example of Fig. A1, for the sake of brevity, we only considered N leaf = 12, but in our experiments with Eclipse, we set N leaf = 60. Suppose for a leaf pair k, the distance between left and right leaf is denoted as and for apertures (j, i) and (j′, i′), respectively, as shown in Fig. A2. In this figure, a kl and a kr is written for the distance that left leaf and right leaf should move from Aperture 1 to Aperture 2.
For linear accelerators, Task Group 71 of the Therapy Physics Committee of the AAPM29 defines 1 MU as machine calibration dose rate when 1 cGy is delivered at the depth of maximum dose on the central axis (d max) for a 10 × 1 field with 100 source surface distance (SSD). Therefore, given a field with size s, one could calculate the MU delivered in t minutes with the following formulation:
| (24) |
where V MU is the machine dose rate per minute.
As displayed in Fig. A2, we break calculation of the residual transition MU into three parts: (1) the residual MU of moving left leaf a kl mm, (2) the residual MU of moving right leaf for a kr mm, and (3) the residual MU deposited in a long field during the total transition time from aperture to (j′, i′). Therefore,
where
and
V leaf and V MU denote the leaf velocity (which we considered 3.5 cm/s in our experiments) and machine dose rate (which we assumed 600 MU/min) and w k denotes the width of the kth leaf pair. Also, (defined in Section 2.C.1) is the transition time from aperture (j, i) to (j′, i′) in beam b. In , the first term in the integral, , calculates time required for leaves to displace a a long field. The term w k · dx basically gives the field size which should be scaled by . The total residual MU can be then calculated by .
Figure A1.

Two apertures in an 4D‐IMRT. [Color figure can be viewed at wileyonlinelibrary.com]
Figure A2.

Distance of kth leaf pairs in Aperture 1 and Aperture 2. [Color figure can be viewed at wileyonlinelibrary.com]
Appendix F. Residual MU Results
F.1.
For the seven patients of study, we calculated total residual MU presented in Table AIV.
Table AIV. MU calculated by clinical plan, residual MU deposited in transition times, and the ratio of residual to clinical in both 4‐s and 6‐s respiratory cycle
| Clinical plan | 4‐s respiratory cycle | 6‐s respiratory cycle | |||
|---|---|---|---|---|---|
| Residual transition | Ratio (%) | Residual transition | Ratio (%) | ||
| Patient 1 | 2228.9 | 100.5 | 4.51 | 89.1 | 4.00 |
| Patient 2 | 2101.5 | 57.5 | 2.74 | 53.5 | 2.55 |
| Patient 3 | 1217.5 | 9.4 | 0.77 | 9.2 | 0.76 |
| Patient 4 | 6719.2 | 5.6 | 0.08 | 5.3 | 0.08 |
| Patient 5 | 2570.2 | 40.0 | 1.56 | 40.2 | 1.56 |
| Patient 6 | 2116.7 | 13.1 | 0.62 | 13.6 | 0.64 |
| Patient 7 | 1151.4 | 92.5 | 8.04 | 89.3 | 7.75 |
For Patient 1 and Patient 7 who had the most residual MUs, we display the bar charts of residual MU per beam in Fig. A3. The plots show that the residual MUs are almost uniformly distributed among all the beams in these cases.
Figure A3.

Residual MU per beam for Patient 1 and Patient 7. [Color figure can be viewed at wileyonlinelibrary.com]
References
- 1. Rietzel E, Chen GT, Choi NC, Willet CG. Four‐dimensional image‐based treatment planning: target volume segmentation and dose calculation in the presence of respiratory motion. Int J Radiat Oncol Biol Phys. 2005;61:1535–1550. [DOI] [PubMed] [Google Scholar]
- 2. Coolens C, Evans PM, Seco J, et al. The susceptibility of IMRT dose distributions to intrafraction organ motion: an investigation into smoothing filters derived from four dimensional computed tomography data. Med Phys. 2006;33:2809–2818. [DOI] [PubMed] [Google Scholar]
- 3. Benedict SH, Yenice KM, Followill D, et al. Stereotactic body radiation therapy: the report of AAPM Task Group 101. Med Phys. 2010;37:4078–4101. [DOI] [PubMed] [Google Scholar]
- 4. Timmerman RD, Hu C, Michalski J, et al. Long‐term results of RTOG 0236: a Phase II trial of stereotactic body radiation therapy (SBRT) in the treatment of patients with medically inoperable stage I non‐small cell lung cancer. Int J Radiat Oncol Biol Phys. 2014;90:S30. [Google Scholar]
- 5. Modiri A, Gu X, Hagan A, et al. Inverse 4D conformal planning for lung SBRT using particle swarm optimization. Phys Med Biol. 2016;61:6181–6202. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6. Ma Y, Chang D, Keall P, et al. Inverse planning for four‐dimensional (4D) volumetric modulated arc therapy. Med Phys. 2010;37:5627–5633. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7. Trofimov A, Rietzel E, Lu H‐M, et al. Temporo‐spatial IMRT optimization: concepts, implementation and initial results. Phys Med Biol. 2005;50:2779. [DOI] [PubMed] [Google Scholar]
- 8. Li G, Cohen P, Xie H, Low D, Li D, Rimner A. A novel four‐dimensional radiotherapy planning strategy from a tumor‐tracking beam's eye view. Phys Med Biol. 2012;57:7579–7598. [DOI] [PubMed] [Google Scholar]
- 9. Tachibana H, Sawant A. Four‐dimensional planning for motion synchronized dose delivery in lung stereotactic body radiation therapy. Radiother Oncol. 2016;119:467–472. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10. Keall PJ, Siebers JV, Joshi S, Mohan R. Monte Carlo as a four‐dimensional radiotherapy treatment‐planning tool to account for respiratory motion. Phys Med Biol. 2004;49:3639–3648. [DOI] [PubMed] [Google Scholar]
- 11. Giraud P, Garcia R. Respiratory gating for radiotherapy: main technical aspects and clinical benefits. Bull Cancer. 2010;97:847–856. [DOI] [PubMed] [Google Scholar]
- 12. Sawant A, Venkat R, Srivastava V, et al. Management of three‐dimensional intrafraction motion through real‐time DMLC tracking. Med Phys. 2008;35:2050–2061. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13. Modiri A, Sabouri P, Gu X, Timmerman R, Sawant A. Inversed‐planned respiratory phase gating in lung conformal radiation therapy. Int J Radiat Oncol Biol Phys. 2017;99:317–324. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14. Hagan A, Sawant A, Folkerts M, Modiri A. Multi‐GPU configuration of 4D intensity modulated radiation therapy inverse planning using global optimization. Phys Med Biol. 2018;63:025028. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15. Wang JZ, Li XA, D'Souza WD, Stewart RD. Impact of prolonged fraction delivery times on tumor control: a note of caution for intensity‐modulated radiation therapy (IMRT). Int J Radiat Oncol Biol Physics. 2003;57:543–552. [DOI] [PubMed] [Google Scholar]
- 16. Bratengeier K, Gainey MB, Flentje M. Fast IMRT by increasing the beam number and reducing the number of segments. Radiat Oncol. 2011;6:170. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17. Langer M, Thai V, Papiez L. Improved leaf sequencing reduces segments or monitor units needed to deliver IMRT using multileaf collimators. Med Phys. 2001;28:2450–2458. [DOI] [PubMed] [Google Scholar]
- 18. Kamath S, Sahni S, Li J, Palta J, Ranka S. Leaf sequencing algorithms for segmented multileaf collimation. Phys Med Biol. 2003;48:307–324. [DOI] [PubMed] [Google Scholar]
- 19. Taşkın ZC, Smith JC, Romeijn HE, Dempsey JF. Optimal multileaf collimator leaf sequencing in IMRT treatment planning. Oper Res. 2010;58:674–690. [Google Scholar]
- 20. Klein S, Staring M, Murphy K, Viergever MA, Pluim JP. Elastix: a toolbox for intensity‐based medical image registration. IEEE Trans Med Imaging. 2010;29:196–205. [DOI] [PubMed] [Google Scholar]
- 21. Nohadani O, Seco J, Bortfeld T. Motion management with phase‐adapted 4D‐optimization. Phys Med Biol. 2010;55:5189–5202. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22. Gui M, Feng Y, Yi B, Dhople AA, Yu C. Four‐dimensional intensity‐modulated radiation therapy planning for dynamic tracking using a direct aperture deformation (DAD) method. Med Phys. 2010;37:1966–1975. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23. Wijesooriya K, Bartee C, Siebers JV, Vedam SS, Keall PJ. Determination of maximum leaf velocity and acceleration of a dynamic multileaf collimator: implications for 4D radiotherapy. Med Phys. 2005;32:932–941. [DOI] [PubMed] [Google Scholar]
- 24. Gurobi Optimizer Reference Manual , http://www.gurobi.com [computer program]. Version 7.02 2016.
- 25. Woerner A, Roeske JC, Harkenrider MM, et al. A multi‐institutional study to assess adherence to lung stereotactic body radiotherapy planning goals. Med Phys. 2015;42:4629–4635. [DOI] [PubMed] [Google Scholar]
- 26. Timmerman R, McGarry R, Yiannoutsos C, et al. Excessive toxicity when treating central tumors in a phase II study of stereotactic body radiation therapy for medically inoperable early‐stage lung cancer. J Clin Oncol. 2006;24:4833–4839. [DOI] [PubMed] [Google Scholar]
- 27. Suh Y, Sawant A, Venkat R, Keall PJ. Four‐dimensional IMRT treatment planning using a DMLC motion‐tracking algorithm. Phys Med Biol. 2009;54:3821. [DOI] [PubMed] [Google Scholar]
- 28. Chin E, Loewen SK, Nichol A, Otto K. 4D VMAT, gated VMAT, and 3D VMAT for stereotactic body radiation therapy in lung. Phys Med Biol. 2013;58:749–770. [DOI] [PubMed] [Google Scholar]
- 29. Gibbons JP, Antolak JA, Followill DS, et al. Monitor unit calculations for external photon and electron beams: report of the AAPM therapy physics committee task group No. 71. Med Phys. 2014;41:031501. [DOI] [PMC free article] [PubMed] [Google Scholar]
