Abstract
Over the past several decades, a medical physics service group covering 35 clinical sites has provided routine monthly output and energy quality assurance for over 75 linear accelerators. Based on the geographical spread of these clinics and the large number of physicists involved in data acquisition, a systematic calibration procedure was established to ensure uniformity. A consistent measurement geometry and data collection technique is used across all machines for every calendar month, using a standardized set of acrylic slabs. Charge readings in acrylic phantoms are linked to AAPM's TG‐51 formalism via a parameter denoted k acrylic, used to convert raw charge readings to machine output values. Statistical analyses of energy ratios and k acrylic values are presented. Employing the k acrylic concept with a uniform measurement geometry of similar acrylic blocks was found to be a reproducible and simple way of referencing a calibration completed in water under reference conditions and comparing to other machines, with the ability to alert physicists of outliers.
Keywords: analysis, electron, energy, output, photon, trends
1. INTRODUCTION
The American Association of Physicists in Medicine (AAPM) Task Group 51 formalism (TG‐51) 1 , 2 specifically requires measurements in water. Updated AAPM guidance on TG‐51 implementation 3 reiterates the requirement for a water phantom; however, TG‐51 notes that the protocol does not preclude the use of solid phantoms for routine measurement of output so long as an appropriate transfer factor has been established via a calibration performed in water at least annually. Seuntjens et al. 4 describe the framework of using an absorbed‐dose‐to‐water calibration coefficient to convert charge measured in a solid phantom to that in water for routine quality assurance of linear accelerators (linacs). The use of solid phantoms for external audits has previously been discussed in the literature 5 as a valuable component in peer review. 6
As this physics group expanded, it became necessary to create a uniform linac beam output and energy measurement system that could be employed at all clinics to ensure consistency. Because the group's physicists regularly provide cross‐coverage between sites, standardizing the monthly output and energy procedure allowed for consistency without shipping a phantom to many clinics. By sharing results in a centralized cloud‐based database for all linacs, automated anomaly checks flag data that deviates significantly from the average.
TG‐51 may be employed to measure the output of medical linear accelerators using an air‐filled chamber. Equation (3) of TG‐51 defines as the absorbed dose to water at the reference depth (in water) when the ion chamber is absent:
| (1) |
Here, M is corrected for incomplete ion collection efficiency, polarity effects, ambient temperature and pressure differences from standard conditions, and the electrometer's calibration factor. The standardized quality assurance system described in this paper is based on the above AAPM TG‐51 protocol. This system uses stacks of polymethylmethacrylate (PMMA, also known as acrylic) blocks, commercially known as Perspex and Lucite, with a mass density of approximately 1.18 g/cm3, an electron density relative to water of approximately 1.147. 7 The following equation is used with the acrylic phantom‐based setup:
| (2) |
k acrylic is a factor that embeds both the water‐to‐acrylic conversion and the change from reference conditions included in TG‐51 measurement geometry (including percentage depth dose (PDD) information), and is defined as described above. Here, M is corrected for temperature and pressure at the time of measurement in the acrylic phantom. Note that for simplicity and consistency with group practice, this factor is referenced as k acrylic, but is dependent on beam quality Q, so could be named kQ acrylic. It is expected that the conversion factor k acrylic is proportional to the average restricted collision stopping power ratios:
| (3) |
The average restricted stopping power acrylic‐to‐air is acquired at the depth of interest in the acrylic phantom geometry, while the average restricted stopping power water‐to‐air is acquired at the depth of reference conditions. For photon spectra ranging with nominal accelerating potential ranging from 4 to 20 MV (energies of interest for this work) with an energy cutoff value of 10 keV, the values for range from 1.10 to 1.07, and corresponding values for range from 1.13 to 1.10. 8 Ratios with the same energy cutoff at 1.2 cm depth in acrylic (the depth of measurement in acrylic) range from 1.03 to 0.93, and at approximately d ref in water, range from 1.07 to 1.02. 9 It is noted that this method does not provide absolute dose at the depth of measurement. This system is a surrogate for the absorbed dose at the calibration geometry.
2. METHODS
The solid phantom is composed of acrylic block slabs, each approximately (20 × 20 × 2.4) cm3. Slabs are purchased at nominal 1 in thickness, for which the manufacturer states an actual machined thickness of approximately 2.4 cm, with manufacturing tolerances resulting in slight variation in slab thicknesses. Because of this variation, clinics number their slabs and consistently stack the slabs in the same order for each month. One block has a hole drilled to accommodate a PTW 30013 farmer chamber with acrylic buildup cap. Four more acrylic blocks are used to provide uniform backscatter (Figure 1). For electron measurements, the approximately 1.2 cm depth of the chamber block is sufficient to avoid most of the slope of the buildup region for all energies. For photon output measurements, an additional acrylic block is used to approach the d max depth of the photon beam. Monthly electron measurements are acquired at 100 cm source to surface distance (SSD), and photon measurements are acquired at 100 cm Source to Axis Distance (SAD).
FIGURE 1.

Photographs of the acrylic block phantom, with a single acrylic block drilled to accommodate a PTW 30013 farmer chamber with buildup cap. The geometry shown in (a) is arranged for electron output measurements at 100 cm SSD, with four acrylic slabs as backscatter, nominally 2.4 cm thick each, and one drilled acrylic slab. The geometry shown in (b) is arranged for photon output measurements at 100 cm SAD, with four acrylic slabs as backscatter, one drilled acrylic slab, and a sixth acrylic slab placed on top of the chamber block.
To evaluate the constancy of each measured beam's energy, additional acrylic blocks are added so that a ratio charge measured at two standardized depths can be calculated and compared to an established baseline. For photons, three additional acrylic blocks are added to simulate a depth of approximately 10 cm. For electrons, the blocks added vary with energy such that the ratio measured is between 30% and 70% of the maximum dose, and clinics included in this analysis do not use a single, standardized phantom geometry for electron energy measurements. Therefore, electron energy results are not presented in this paper. For photon and electron output and photon beam energy verifications, the same geometry and setup is followed by all physicists at all clinics.
The k acrylic value for each beam for each linac is established using the above materials and geometry immediately following a TG‐51 calibration in water. The ion chamber used for water measurements and the ion chamber used for acrylic measurements are not necessarily the same detector; however, they are often the same if the clinic maintains a single calibrated ion chamber. Each chamber has its own values, determined by ADCL calibration. The k acrylic value is re‐established yearly at the time of the annual TG‐51 calibration or coinciding with TG‐51 calibration performed after any major linac repair. Upon initial verification of the linac's beam energy, the ratio of the reading at approximately d max to the reading at the depth of approximately 10 cm is measured in the acrylic phantom. This ratio does not change for the life of the linac unless significant beam energy changes are intentionally made. Subsequently, the k acrylic values and energy ratios are used to perform the monthly output and beam energy constancy checks. The k acrylic values, energy ratios, and raw monthly readings are reported to a common database. The database is then audited as a secondary check for constancy and conformance to AAPM standards.
3. RESULTS
3.1. Linacs
The database includes 75 linacs: 57 manufactured by Varian Medical Systems, 16 produced by Elekta, and 2 by Siemens Medical Systems. These linacs reside or resided at more than 35 clinics in the United States. Beams include both conventional flattened photon beams and flattening‐filter‐free (FFF) beams. Although the uniform measurement system was adopted more than a decade ago and is still in use, the data presented here were acquired from May 2013 to May 2021. The mean duration of contiguous measurements was 1674 days (4.6 years) for all the linacs in the database. The linac with the longest continuous measurement duration spanned 3249 days (8.9 years) up until the chosen end date for the analysis.
TG‐51 describes reference conditions for photon calibration as either SSD or SAD geometry. Of the 75 linacs included in the database for the relevant period, three were SSD‐calibrated and the remainder were SAD‐calibrated. Data for the minority subset of SSD‐calibrated linacs include k acrylic values that vary significantly from the average based on the inclusion of a factor of approximately 1/r 2. Based on the small sample size of the photon SSD‐calibrated machines, such data were removed for this analysis.
3.2. k acrylic analysis
A series of 2D surface plots of all the data were generated to help identify data anomalies. This exercise served as a simple approach to data cleaning 10 to detect and investigate potential data errors and duplicates. Photon and electron k acrylic values for all linac types are illustrated in Figure 2.
FIGURE 2.

Values for normalized mean k acrylic across all linacs. Shown in (a) are values for flattened photon beams. Shown in (b) are values for electron beams. Uncertainty bars indicate one standard deviation.
For all photon beams included in the current analysis, the depth of maximum dose measured in water is less than the measurement depth of approximately 3.6 cm in acrylic. Therefore, a conceptual correlation is expected to exist between these k acrylic values and the d max values. An empirical relationship was derived, comparing mean normalized k acrylic values, in units of Gy/C, and (d max)0.08, in units of cm0.08, for each nominal photon beam energy. This relationship is summarized in Figure 3. The product of mean normalized k acrylic values and (d max)0.08 is approximately unity for all beams. The observed trend underlines the correlation between the depth at which charged particle equilibrium occurs and the k acrylic values.
FIGURE 3.

k acrylic and d max versus photon beam energy.
3.3. Histograms
The frequency distribution of k acrylic values was reviewed for each nominal beam energy for both Varian and Elekta linacs. Histograms of the k acrylic values for photons beams of Varian and Elekta linacs are shown in Figure 4. Similar histograms of the k acrylic values for electron beams are included in Figure 5.
FIGURE 4.

Frequency distributions of photon k acrylic values for (a) Varian linacs and (b) Elekta linacs.
FIGURE 5.

Frequency distributions of electron k acrylic values for (a) Varian linacs and (b) Elekta linacs.
Comparisons of the distributions of Varian and Elekta k acrylic values were completed for nominal beam energies for which both manufacturers were represented in the dataset. For both manufacturers, k acrylic distributions for a given nominal energy were normalized to the maximum number of counts, and then the full width at half maximum (FWHM) was acquired. As an example of this analysis, the FWHM of the normalized distribution of Varian flattened 6 MV photon beams was compared to the FWHM of Elekta flattened 6 MV, and the Varian distribution was found to be approximately 63% larger than the Elekta distribution (0.017 and 0.009, for Varian and Elekta, respectively).
3.4. Coefficient of variation and statistical prudence
The mean value of each beam's k acrylic for each linac draws from a smaller sample size than the mean value of all k acrylic values for a given energy from a given manufacturer. These smaller sets differ in size, to wit: a linac that has been in operation for a decade has many more data points than a newly commissioned machine. Sampling bias is therefore a concern. However, based on the large size of the complete dataset, the difference between the mean of k acrylic values of a single beam from a given linac manufacturer did not differ by more than 0.3% from the mean k acrylic value of that same nominal energy over the entire dataset of that manufacturer's linacs. Hence, the data presented here are averages of the data of the same type.
In addition to using histograms to review k acrylic distribution data, the coefficient of variation (COV) was quantified for k acrylic values for each nominal beam energy. COV is the ratio of the sample standard deviation to the mean, and values were calculated with Bessel's (N–1) correction included, where N is the number of data points. COV values for photon k acrylic and energy ratio data are included in Figure 6. COV values for electron k acrylic data are included in Figure 7.
FIGURE 6.

Photon coefficient of variation data for all beams of all linac types for (a) k acrylic data, and (b) energy ratio data.
FIGURE 7.

COV values calculated for k acrylic data for electron beams for Varian, Elekta, and Siemens linacs. COV indicates coefficient of variation.
Varian and Elekta linacs showed similar coefficients of variation (COV) for k acrylic for all beams across different linacs at various clinics. For Varian machines, the COV of k acrylic ranged from 0.5% to 1.5% for 16 photon and electron beams. For Elekta machines, the COV of k acrylic ranged from 0.3% to 0.9% for 14 beams. Both Figures 6 and 7 indicate a wider variability in k acrylic values for Varian linacs compared to those for Elekta. It is noted that the scales for Figures 6a and 7 differ by approximately a factor of 2, suggesting that the electron beams have a wider variance.
4. DISCUSSION
This database was designed to allow for straightforward reporting of monthly linac output and energy data, and to verify annual reference data against many other machines. The reproducibility of the set‐up geometry was planned to allow for physicists to provide cross‐coverage of different clinical sites safely and consistently, and the database provides an immediate confidence check by referencing data from many machines over several years. AAPM's TG‐100 framework 11 discusses quality management tools, with automation and computerization (including computerized verification) listed only behind forcing functions in effectiveness. Furthermore, standardized protocols and independent double check systems (including independent review and comparison with standards) are also included in the TG‐100 framework as important tools in a quality management system. The automated flagging system for routine annual and monthly linac data may be used by other medical physics practices to support increased safety and quality.
In its current form, the database does not record direct measures of beam quality such as electron R50 or photon %dd(10)X, so beam quality information cannot be mined from the database in its current form. Future work could include revising the database submission interface so that beam quality information could later be reviewed, keeping in mind the need for simplicity and speed in uploading linac data.
Previously, the standardized procedure for linac commissioning for this group included completing a full TG‐51 calibration at the initiation of commissioning measurements to “rough in” beam output prior to running the large amount of beam required for commissioning, and then completing a final TG‐51 calibration at the conclusion of commissioning. The current analysis has demonstrated the ability to employ the k acrylic concept (using average k acrylic values of the appropriate linac manufacturer, machine type, and energy) instead of completing the initial TG‐51 calibration. Additionally, all database users have a powerful tool to verify that their machine and set up are within expected tolerances every time they perform a TG‐51 calibration, by comparing across linacs over time. A physicist performing TG‐51 on a machine currently in the database can use k acrylic as an additional layer of safety—unexpected fluctuations in k acrylic for a given beam on a given linac can act as a warning to re‐examine the machine and the TG‐51 measurement process.
Note that a full, expanded uncertainty analysis (for example, as described by NIST Technical Note 1297 12 ) for k acrylic and COV values was not performed and is considered outside the scope of this technical note. Variation in parameters outside of machine performance (such as acrylic slab thickness differences based on manufacturing tolerances) is expected to contribute to some of the variation in values across clinics. The purpose of the standardized measurement procedure and reporting process is to add a level of risk reduction, and the above analysis indicates that this framework is a useful tool.
5. CONCLUSION
This analysis has shown that a large medical physics service group, distributed over an extended geographical region and over 10 years, can employ a consistent methodology for routine monthly linear accelerator output and energy quality assurance. The described approach uses a standardized acrylic phantom geometry that is traceable to TG‐51 measurements under reference conditions, such that each clinical site may maintain its own relatively inexpensive monthly QA phantom. Results are maintained in a centralized data repository. Such tables include each individual linac beam's values for the transfer coefficient used to convert charge measured in the standardized phantom to dose under TG‐51 reference conditions. Results also include photon charge ratios using two different depths of acrylic buildup as a quantification of beam energy.
AUTHOR CONTRIBUTION
Mehran Miron Zaini: Data Measurements, Database Generation, Mathematical Analysis, Text Preparation, Graph Creation.
Jessica M. Fagerstrom: Data Measurements, Data Analysis, Text Preparation, Review and Editing.
Edward I. Marshall: Data Measurements, System‐wide Data Collection, Database Generation, Data Organization, Text Preparation.
Kathryn M. Hedrick: Data Measurements, Logistics, Review.
Daniel Zaks: Data Measurements, Database Organization.
Hung Tran: Data Measurements, Database Manipulations.
Trevor M. Fitzgerald: Data Measurements, Program Design.
CONFLICT OF INTEREST STATEMENT
The authors declare that there is no conflict of interest that could be perceived as prejudicing the impartiality of the research reported.
ACKNOWLEDGMENTS
This work is a culmination of the efforts of over 60 physicists over a decade in more than 35 clinics on 75 medical linear accelerators. We are truly grateful for their dedication and attention to detail in all such measurements and beam calibrations. It is not feasible to name all those individuals in this paper. They are almost all either current or past members of Northwest Medical Physics Center. Over the years, there have been other medical physicists outside of our group, who have carried on these data collection endeavors and collaborated with us in the different clinics that we serve.
Zaini MM, Fagerstrom JM, Marshall EI, et al. Therapeutic radiation beam output and energy variation across clinics, technologies, and time. J Appl Clin Med Phys. 2023;24:e13945. 10.1002/acm2.13945
REFERENCES
- 1. Almond PR, Biggs PJ, Coursey BM, et al. AAPM's TG‐51 protocol for clinical reference dosimetry of high‐energy photon and electron beams. Med Phys. 1999;26(9):1847‐1870. doi: 10.1118/1.598691 [DOI] [PubMed] [Google Scholar]
- 2. McEwen M, DeWerd L, Ibbott G, et al. Addendum to the AAPM's TG‐51 protocol for clinical reference dosimetry of high‐energy photon beams. Med Phys. 2014; 41(4):041501. doi: 10.1118/1.4866223 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3. Muir B, Culberson W, Davis S, et al. AAPM WGTG51 Report 374: guidance for TG‐51 reference dosimetry. Med Phys. 2022; 49(11): 6739‐6764. doi: 10.1002/mp.15949 [DOI] [PubMed] [Google Scholar]
- 4. Seuntjens J, Olivares M, Evans M, Podgorsak E. Absorbed dose to water reference dosimetry using solid phantoms in the context of absorbed‐dose protocols. Med Phys. 2005;32(9):2945‐2953. doi: 10.1118/1.2012807 [DOI] [PubMed] [Google Scholar]
- 5. Choi CH, Kim J‐I, Park JM, et al. External auditing on absorbed dose using a solid water phantom for domestic radiotherapy facilities. J Korean Soc Therap Radiol Oncol. 2010;28(1):50. doi: 10.3857/jkstro.2010.28.1.50 [DOI] [Google Scholar]
- 6. Halvorsen PH, Das IJ, Fraser M, et al. AAPM Task Group 103 report on Peer Review in clinical radiation oncology physics. J Appl Clin Med Phys. 2005;6(4):50‐64. doi: 10.1120/jacmp.v6i4.2142 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7. Pruitt JS, Loevinger R. The photon‐fluence scaling theorem for Compton‐scattered radiation. Med Phys. 1982;9(2):176‐179. doi: 10.1118/1.595080 [DOI] [PubMed] [Google Scholar]
- 8. Shulz RJ, Almond PR, Cunningham JR, et al. A protocol for the determination of absorbed dose from high‐energy photon and electron beams. Med Phys. 1983;10(6):741‐771. doi: 10.1118/1.595446 [DOI] [PubMed] [Google Scholar]
- 9. Gerbi BJ, Antolak JA, Deibel FC, et al. Recommendations for clinical electron beam dosimetry: supplement to the recommendations of Task Group 25. Med Phys. 2009;36(7):3239‐3279. doi: 10.1118/1.3125820 [DOI] [PubMed] [Google Scholar]
- 10. Abedjan Z, Chu X, Deng D, et al. Detecting data errors. Proc VLDB Endow. 2016;9(12):993‐1004. doi: 10.14778/2994509.2994518 [DOI] [Google Scholar]
- 11. Huq MS, Fraass BA, Dunscombe PB, et al. The report of Task Group 100 of the AAPM: application of risk analysis methods to radiation therapy quality management. Med Phys. 2016;43(7):4209‐4262. doi: 10.1118/1.4947547 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12. Taylor BN, Kuyatt CE. Guidelines for Evaluating and Expressing the Uncertainty of NIST Measurements Results. National Institute of Standards and Technology; 1994. [Google Scholar]
