Skip to main content
Pharmaceutics logoLink to Pharmaceutics
. 2020 May 7;12(5):430. doi: 10.3390/pharmaceutics12050430

4D Micro-Computed X-ray Tomography as a Tool to Determine Critical Process and Product Information of Spin Freeze-Dried Unit Doses

Brecht Vanbillemont 1,, Joris Lammens 2,, Wannes Goethals 3,4, Chris Vervaet 2, Matthieu N Boone 3,4, Thomas De Beer 1,*
PMCID: PMC7284464  PMID: 32392705

Abstract

Maintaining chemical and physical stability of the product during freeze-drying is important but challenging. In addition, freeze-drying is typically associated with long process times. Therefore, mechanistic models have been developed to maximize drying efficiency without altering the chemical or physical stability of the product. Dried product mass transfer resistance (Rp) is a critical input for these mechanistic models. Currently available techniques to determine Rp only provide an estimation of the mean Rp and do not allow measuring and determining essential local (i.e., intra-vial) Rp differences. In this study, we present an analytical method, based on four-dimensional micro-computed tomography (4D-μCT), which enables the possibility to determine intra-vial Rp differences. Subsequently, these obtained Rp values are used in a mechanistic model to predict the drying time distribution of a spin-frozen vial. Finally, this predicted primary drying time distribution is experimentally verified via thermal imaging during drying. It was further found during this study that 4D-μCT uniquely allows measuring and determining other essential freeze-drying process parameters such as the moving direction(s) of the sublimation front and frozen product layer thickness, which allows gaining accurate process knowledge. To conclude, the study reveals that the variation in the end of primary drying time of a single vial could be predicted accurately using 4D-μCT as similar results were found during the verification using thermal imaging.

Keywords: freeze-drying, 4D-μCT imaging, process design, endpoint analysis, mechanistic modelling, process simulation, continuous processing

1. Introduction

Freeze-drying or lyophilisation of pharmaceutical unit doses is a low temperature drying technique where water, or other solvents, are removed from temperature-sensitive products via sublimation [1]. Freeze-drying or lyophilisation consists of three consecutive steps: freezing, primary drying (i.e., sublimation) and secondary drying (i.e., desorption) [2]. Despite its popularity, freeze-drying is still an inefficient process associated with high production costs and long process times [3]. A reduction in production cost and process time can be achieved by shifting from batch freeze-drying to continuous freeze-drying. An innovative continuous freeze-drying process was recently developed [4,5,6,7,8]. The freezing step used in this continuous freeze-drying process is modified compared to traditional batch freeze-drying, as glass vials filled with a liquid formulation are rotated around their longitudinal axis while cooled and frozen with a cold, sterile and inert gas (i.e., spin freezing) [4,5,6,7,8]. This approach reduces the product layer thickness and increases the surface area, resulting in much higher sublimation rates and thus much shorter production times. A complementary method to decrease the production time involves using mechanistic models describing the drying step. A lot of research has been conducted last decades to develop mechanistic models for primary and secondary drying in order to maximise the drying rate, while maintaining the critical quality attributes (CQA) of the product [9,10,11,12,13]. The appearance of the cake (i.e., the layer of dried material) is an important CQA and is highly dependent on the collapse temperature of the product (Tc). Once the product temperature (Tp) exceeds Tc, molecular motion induces structural loss of the cake. Therefore, the Tp should be kept below Tc during primary drying [2,14].

The sublimation velocity depends on the local structure of the dried product. During sublimation, an ice-free layer is formed above the frozen product layer. Water molecules escaping from the sublimation front have to travel across this porous dried product matrix. The flow of these water molecules through this porous matrix is restricted by the size and tortuosity of the pores of this matrix, i.e., the dried product mass transfer resistance (Rp) [15,16]. A local rise in the partial water vapour pressure (Pi) occurs if the maximum mass flow through the pores is reached, leading to an increase in sublimation front temperature (Ti). Therefore, Rp is one of the most important inputs for mechanistic primary drying models [13]. Furthermore, Rp is highly dependent on the size of the ice crystals formed during freezing, and highly impacts the process cycle design [17,18]. Vial-to-vial and intra-vial variability in ice crystal size were recently reported, indicating that Rp is not uniform over the batch and even over the entire vial [19,20]. However, currently available techniques for Rp determination only provide an average Rp at vial or batch level [21,22,23,24]. An analytical method to determine the Rp distribution over the entire vial would be very useful in elucidating intra-vial variability of the drying characteristics.

Micro-CT is a powerful non-destructive microscopy technique that has become widely available in the last decade. Micro-CT allows non-destructive visualisation and analysis of a sample in three dimensions with a spatial resolution in the order of a few micrometers [25]. However, 3D characterization of the pore structure of a fully freeze-dried cake does not necessarily provide detailed information about the drying kinetics [26]. Usually, the 3D characterization of the pore structure is used to give an estimation of the Rp via mass transfer modelling, which can be mathematically challenging [16]. Furthermore, 3D characterization usually requires static conditions to avoid image blurring and other motion artefacts. 4D-μCT or time-resolved μCT enables the possibility to image dynamic processes by capturing 3D-volumes in function of time, adding a temporal dimension. Recently, enormous improvements in the domain of 4D-μCT have been made. 4D-μCT enables the possibility of fast image acquisition, even on a sub-second time-scale [27,28,29]. By mapping differences between the 3D-volumes, dynamic parameters describing the process under investigation can be regressed. This allows the visualization of dynamic processes via μCT without the need to interrupt the process.

These Rp distributions will provide detailed information about the cake structure which can be used during formulation and process development. Furthermore, the effect of local differences in pore structure will be better understood, allowing better controlled process conditions.For instance, the Rp distribution and differences in the frozen layer thickness at start of primary drying are essential parameters in primary drying process simulations, such as the prediction of the primary drying endpoint distribution. An endpoint distribution could assist in the decision to proceed to secondary drying. Advancing to secondary drying when certain parts of the vials are not completely free of crystal water could lead to local meltback or collapse, impairing chemical and physical stability and other critical quality attributes of the freeze-dried cake [2,12].

It is the aim of this paper to evaluate the use of 4D-μCT in lyophilisation and in particular its ability to determine the Rp vs. dried layer thickness (Ldr) profile per azimuth-height coordinate (i.e., a cylindrical angular-height segmentation) for a spin freeze-dried vial. This would lead to the establishment of a Rp distribution over the entire cake. Furthermore, it will be investigated if 4D-μCT could reveal the drying kinetics such as sublimation rate by directly analysing the 3D-volumes without the need of mass transfer modelling. In addition, the possibility of 4D-μCT to display the impact of cake artefacts, such as cracks and shrinkage, on the lyophilisation process will be researched.

2. Materials and Methods

2.1. Materials

Two model formulations were used in this study, a 3% (w/V) mannitol solution and a 4% (w/V) bovine serum albumin (BSA) solution in deionised water. Both were selected because of their differences in solid state, i.e., mainly crystalline for the dried mannitol formulation and amorphous for the BSA formulation. Furthermore, both formulations have a high Tc (−2 C for mannitol and −9 C for BSA), minimizing the risk of (micro-)collapse during the time-resolved μCT experiments. All materials were purchased from Sigma Aldrich (Zwijnaarde, Belgium).

2.2. Determination of Collapse Temperature

The collapse temperature (Tc) of the model formulations was determined via freeze-dry microscopy. A FDCS 196 freeze-drying stage (Linkam, Surrey, UK) was mounted underneath an optical microscope (BX51, Olympus, Hamburg, Germany). A sample of 3 μL was placed on top of a quartz sample window. Next, a thin metal U-shaped spacer was placed around the sample. Subsequently, the sample and spacer were covered with a glass coverslip. Finally, the freeze-drying chamber was closed with a hermetical lid.

The sample was frozen by lowering the temperature of the freeze-drying stage to −45 C via the Linksys32 software (Linksys 32, Linkam, Surrey, UK). The pressure of the sample chamber was decreased via a rotary vane vacuum pump to 1 Pa (E2M1.5, Edwards, Nazareth, Belgium) once the freezing-stage reached a temperature of −45 C. Next, the temperature of the stage was increased with a heating rate of 1.0 C/min. Meanwhile, the structure of the dried product was monitored via a digital camera which was mounted on top of the microscope. Tc was defined as the temperature at which fissures were visible in the freshly formed dried product layer. The experiment was executed three times for each formulation.

2.3. Spin-Freezing

A 10R glass vial (Fiolax clear, Schott, Lukácsháza, Hungary) was filled with 3.5 mL formulation prior to spin-freezing. This filled glass vial was positioned vertically in the spin-freezer (Rheavita, Zwijnaarde, Belgium) depicted in Figure 1a [5]. Next, the vial was rotated at 2900 rpm around its longitudinal axis while jetting it with cold compressed air (130 L/min, −60 C) for 6 min as displayed in Figure 1b. Meanwhile, the temperature of the vial was monitored with a thermal infrared (IR) camera (FLIR A655sc, Thermal focus, Ravels, Belgium). This thermal IR camera was located in front of the spin-freezer, measuring the temperature of the glass vial through a germanium window. The temperature of the vial was monitored to assure that the temperature at the end of spin-freezing was well below −45 C. Finally, the vials were stored on dry ice (i.e., −78.5 C) for transport to the μCT scanner.

Figure 1.

Figure 1

(a) Picture of a Rheavita spin-freezer with the thermal camera in front of a germanium window and (b) the graphical representation of the spin-freezing concept. Adapted with permission from Corver J., Eur. Pharm. Rev.; published by Russell Publishing Ltd., [30].

2.4. In-Situ Micro-CT Set-Up

2.4.1. EMCT Scanner

The μCT scanner used in this set-up is an in-house built high-resolution scanner developed for in-situ monitoring (EMCT scanner, UGCT, Belgium). This gantry based μCT scanner rotates horizontally around the sample and allows fast and continuous scanning of objects, particularly when peripheral equipment is used. The EMCT is equipped with a closed 130 kV X-ray source and a CMOS flat panel detector with 1316 by 1312 pixels [31]. The 10R vial was positioned in between the source and detector to have the full image of the frozen product inside the vial, resulting in a resolution of 30 μm (Figure 2).

Figure 2.

Figure 2

(A) μCT set-up with spin-frozen vial wrapped with insulating fabric surrounded by X-ray source and detector. (B) Spin-frozen vial without insulation (merely to illustrate the positioning of the vial). (C) 1: Vacuum pump; 2: Condenser; 3: Frozen product thermocouple read-out; 4: Proportional pressure valve; 5: Pirani gauge; 6: Vial manifold 7: X-ray source; 8: Detector; 9: Spin-frozen vial; 10: Heating pad wrapped with insulating fabric.; 11: thermocouple located inside vial at vial neck.

2.4.2. Freeze-Drying Set-Up

A custom-built single-vial manifold freeze-dryer was installed in the middle of the μCT scanner. (cfr. Figure 2). This custom-built freeze-dryer consisted of a condenser which was located underneath the μCT scanner. A rotational vacuum pump (DS102, Agilent technologies, Leini, Italy) was connected to the condenser to evacuate the system. The pressure of the system was monitored via a VD84 Pirani gauge (Thyracont vacuum instruments, Passau, Germany) and controlled via a EVR116 proportional pressure valve (Pfeiffer Vacuum, Asslar, Germany), both connected to the vial manifold.

A 10R vial filled with 3.5 mL of the formulation was spin-frozen as described in Section 2.3. The spin-frozen vial was pulled vacuum (and thus dried) by mounting it on the custom-built single-vial freeze-dryer, installed in the middle of the μCT scanner. Transfer from dry ice to the set-up was achieved in 10 s to limit heating of the vial. An electric heating pad was tightly wrapped around the spin-frozen vial to provide the heat required for sublimation. An in-house scripted LabVIEW 2017 (National Instruments, Austin, TX, USA) application was used to keep the electric heating pad around the spin frozen vial at a fixed temperature of 40 C and the pressure level at 5 Pa using proportional–integral–derivative (PID) controllers [4]. In addition, a low attenuating insulating fabric was put over the spin-frozen vial to shield it from uncontrolled energy from the environment.

Furthermore, the temperature of the ice layer was monitored via a thin gauge type-K thermocouple (Labfacility, Leeds, United Kingdom) located at the ice surface near the vial neck. In addition, two extra thermocouples were installed, one at the bottom of the spin-frozen vial and one at the top of the heating pad to monitor the temperature of the spin-frozen vial and heating pad, respectively. The thickness of the frozen product layer was monitored during primary drying via a μCT scanner. Therefore, the scanner rotated constantly around the spin-frozen vial while recording. A full vial scan was made each 176.11 s during primary drying, recording 1600 projections per rotation. The process was imaged during 40 (BSA) or 35 (mannitol) sequential rotations in total (i.e., 117 and 103 min of primary drying, respectively). From this data, 40 (BSA) and 69 (mannitol) 3D volumes were reconstructed at a time interval of 2.93 min (BSA) and 1.47 min (mannitol).

2.4.3. Data Structure

Tomographic reconstruction of all scans was performed using the in-house CTrex software (UGCT, Ghent, Belgium). For all 3D volumes, i.e., each time point (ti), the data-structure was converted from a cartesian coordinate system (x, y, z), with 1300 segmentations in each direction at a voxel size of (30 μm)3, to a cylindrical coordinate system (r, Φ, h) with 650 radial (r), 1600 azimuthal (Φ) and 1300 height (h) segmentations which resulted in a 4D matrix (ti, r, Φ, h) as represented in Figure 3. The amount of x-rays absorbed by an object is defined by Beer’s law as a function of the attenuation coefficient and thickness of a material. The dried product layer formed during freeze-drying has a negligibly low attenuation coefficient in comparison with the dense frozen product and glass layer. Therefore, only the frozen product layer could be segmented from the vial-assembly by thresholding the greyscale value per voxel. At last, for all (ti, Φ, h) coordinates the inner radius of the frozen product layer (rp) and inner vial wall (rvial) was calculated.

Figure 3.

Figure 3

Conversion of the data structure from a cartesian coordinate system (x,y,z) (middle section) to a cylindrical coordinate system (r, Φ, h) (right section) for each time point ti, (i.e., each scan).

2.5. Direction of Sublimation

Two algorithms were developed to evaluate if, for all (ti, Φ, h) coordinates, the direction of sublimation was primarily radial (r) (i.e., from centre of the vial to vial wall) and if sublimation front irregularities were present. At first, the thickness of the frozen product layer (Lice) was calculated by the difference between the radial coordinates of the inner vial wall (rvial) and of the frozen product (rp) closest to the centre of the vial (Lice,i=rvialrp,i). Secondly, an integrated frozen layer length (Lice) was computed by summation of the length of all voxels in the radial direction that were categorised as ice. Cavities in the frozen layer would not be covered by the Lice parameter as these are not be classified as ice. Conversely, they are included in the Lice parameter as they are located within rvial and rp,i. Significant difference between Lice and Lice would indicate the existence of these cavities which can only originate from multiple sublimation interfaces in the radial direction and would be a sign of considerable non-radial sublimation. Lastly, for every time point (ti) a surface plot was constructed to display both the Lice and the relative difference ((LiceLice)/Lice) for all azimuthal and height coordinates.

2.6. Determination of Dried Product Mass Transfer Resistance

Rp (m/s) describes the relationship between the driving pressure difference (PiPc) and the surface area normalized sublimation rate (Equation (1)) [1]. The dry layer thickness (Ldr) versus Rp profiles were determined for every (ti, Φ, h) coordinate in the data matrix using the following equations.

Rp=Ap(PiPc)m˙sub (1)

where Ap is the projected product area (m2), Pi the vapour pressure of ice at the sublimation front (Pa), Pc the partial pressure in the drying chamber (Pa) and m˙sub the sublimation rate (kg/s). Pi was determined via Equation (2) which is an empirical equation based on the Clausius-Clapeyron relation between the sublimation front temperature (Ti) (K) and vapour pressure of ice with αPi till δPi empirical coefficients [32].

Pi=eαPiβPiTi+γPilnTiδPiTi (2)

The thickness of the frozen product layer (Lice,i) was extracted from the data structure at each time point (i.e., 3D volume) for all (Φ, h) coordinates. A Savitzky-Golay smoothing (third degree polynomial and window of 15) of Lice over the time was applied to increase the precision of the data without distorting the signal tendency. Subsequently, considering the cylindrical geometry of the cake (Figure 3), the volume Vi of frozen product within each azimuthal-height segmentation was calculated in function of time (ti) according Equation (3).

Vi=πhvialn·m(rvial2rp,i2) (3)

where, hvial is the height of the vial (m), n the number of azimuthal segmentations of the vial (-) and m the number of height segmentations of the vial (-).

Subsequently, the sublimation rate m˙sub could be calculated according to Equation (4) from the change in frozen product volume per time point (dVidt) (m3/s) by taking the dried layer porosity (θdr) (-) and ice density (ρice) (kg/m3) into account.

m˙sub,i=dVidtρiceθdr (4)

As a one-dimensional freeze-drying model was assumed, the frozen product area (Ap,i) available for sublimation (m2) was calculated according to Equation (5) by considering the projected surface area of the part of the voxel oriented to the centre of the vial. Hence, the main sublimation direction was considered to be radial. Any minor freeze-drying phenomena leading to a diversion from the main radial direction was still included in the model as it was regressed into the formulation and (micro-)structure parameter Rp.

Ap,i=2πn·mhvial(rp,i) (5)

Rp can be expressed in function of time or in function of dry layer thickness (Ldr). The dry layer thickness was calculated per azimuthal and height coordinate according to Equation (6). Note that not necessarily every (Φ, h) coordinate reaches the same dry layer thickness at an identical point in time.

Ldr,i=Lice,0Lice,i (6)

where Ldr,i is the dried layer thickness (m) for a specific time point, Lice,0 is the initial (t0) ice layer thickness (m) and Lice,i the ice layer thickness at a certain scan (ti) (m).

The Rp was calculated using Equations (1) till (6) with the frozen product temperature measured by thermocouple near the vial necks as the sublimation temperature (Ti). Next, surface plots with the (Φ, h) coordinate values of Ldr, m˙sub and Rp were constructed for every time point related to a 3D-volume. Finally, the Rp data was also plotted as a function of Ldr by binning the latter into 38 bins ranging from 0 to 2.5 mm to facilitate the graphical representation of the Rp at similar Ldr instead of time.

2.7. Simulation of the Primary Drying Time Distribution

The Rp profiles of BSA determined in the previous sections were used to simulate the primary drying time for every azimuthal and height coordinate of the vial (Φ, h). A similar continuous process for BSA was modelled but with a chamber pressure (Pc) of 10 Pa and a total power of 1.2 W (Ptot) towards the vial. However, to decrease the computational time of this simulation, spatial binning over the azimuthal (10×) and height (10×) dimensions were necessary, resulting in 100 height and 160 azimuthal coordinates per time point.

To estimate the heat balance of the whole vial system, the median Ldr,vial vs. Rp,vial profile was determined from the BSA dataset calculated in the previous section. At each time iteration of the prediction (Δt: 60 s), the sublimation interface temperature (Ti) of the whole vial system was estimated by simultaneously solving Equations (2), (7) and (8) with Ap,vial the sublimating surface of the whole system (m2), M the molecular weight of water (kg/mol), ΔHsub the latent heat of sublimation (J/mol) and αHsub till ϵHsub the empirical coefficients describing the ΔHsub in function of the temperature [12].

Ptot=Ap,vial(PiPc)Rp,vial·ΔHsubM (7)
ΔHsub=αHsub+βHsubTiγHsubTi2+δHsube(TiϵHsub)2 (8)

Subsequently, the following actions were performed per (Φ, h) coordinate. At first, the dried layer resistance was estimated using a spline interpolation of the Ldr vs Rp profile of that coordinate calculated in Section 2.6. This was followed by a product surface (Ap,i) calculation according Equation (5). Next, m˙sub,i could be computed by applying Equations (1) and (2). Furthermore, the sublimated volume (Vi) was calculated.

Vi=t0tim˙sub,iΔtθρice (9)

With these parameters, the Ldr,i of all (ti, Φ, h) coordinates was approximated according to Equation (10) and compared to the initial frozen product thickness (Lice,0) of every coordinate to check if sublimation was finished (tend) for that specific (Φ, h) coordinate.

Ldr,i=rvialLice,0(rvialLice,0)2Viπhvial (10)

At the end of every time iteration, a new heat balance of the vial was made using Equations (2), (7) and (8) to yield a new global Ti. With the Ap,vial being estimated by summation of all radial facing sublimating voxel surfaces. Ldr,vial was calculated as the mean of Ldr,i from all coordinates still sublimating and used in the Ldr,vial vs Rp,vial spline interpolation to yield Rp,vial. Finally, a primary drying time (tend) surface plot for all (Φ, h) coordinates was constructed. All parameter values used in the regression and simulation are listed in Table 1.

Table 1.

Parameters and variables list. A dash as value represents a variable.

Description Symbol Value Unit
Field of view angle α 45.1
Latent heat of sublimation ΔHsub - J/mol
Time resolution prediction Δt 60 s
Dried layer porosity θ 0.97 (-)
Mass density ice ρice 918 kg/m3
Azimuth (cylindrical coordinate) Φ - Rad
Pi coefficient αPi 9.550426 Pa
Pi coefficient βPi 5723.2658 K
Pi coefficient γPi 3.53068 1/K
Pi coefficient δPi 0.00728332 Pa
ΔHsub coefficient αHsub 4.68 × 104 J/mol
ΔHsub coefficient βHsub 35.9 J/molK
ΔHsub coefficient γHsub 0.0741 J/molK2
ΔHsub coefficient δHsub 542 J/mol
ΔHsub coefficient ϵHsub 124 K2
Product surface Ap - m2
Product surface entire vial Ap,vial - m2
Distance camera - vial dw 15×102 m
Height (cylindrical coordinate) h - m
Height of vial hvial 32×103 m
Horizontal field of view HFOV 12×102 m
Dried product thickness Ldr - m
Frozen product thickness Lice - m
Initial frozen product thickness Lice,0 - m
Integrated frozen product length Lice - m
Sublimation rate m˙sub - kg/s
Molecular weight water M 18.01528×103 kg/mol
Height segmentations (Section 2.6/Section 2.7) m 1000/100 (-)
Azimuthal segmentations (Section 2.6/Section 2.7) n 1600/160 (-)
Chamber Pressure (Section 2.6/Section 2.7 and Section 2.8) Pc 5/10 Pa
Partial water vapour Pressure Pi - Pa
Total power towards vial Ptot 1.2 W
Radius (cylindrical coordinate) r - m
Radius frozen product rp - m
Radius inner vial wall rvial 10.9×103 m
Dried layer resistance Rp - m/s
Time point ti - min
Primary drying time tend - h
Collapse temperature (BSA/mannitol) Tc −9/−2 C
Sublimation interface temperature Ti - K
Product temperature Tp - K
Volume cylindrical segment V - m3
Length (cartesian coordinate) x - m
Width (cartesian coordinate) y - m
Depth (cartesian coordinate) z - m

2.8. Verification Experiment

The primary drying time distribution predicted as described in Section 2.7 was verified via thermal imaging of an actual primary drying phase. A 10R vial filled with 3.5 mL BSA formulation was spin-frozen according to Section 2.3. Subsequently, the vial was placed into a single-vial drying-chamber (Rheavita, Zwijnaarde, Belgium), where the spin-frozen vial rotated at 5 rpm in front of an infrared heater (Weiss Technik, Zellik, Belgium). Next, a rotary vacuum pump was switched on to lower the chamber pressure and thus inducing primary drying. As soon as the chamber pressure reached a pressure level of 10 Pa, the infrared heater was switched on (total power towards vial = 1.2 W, calculated according to the method described in [5]). Meanwhile, the temperature of the rotating vial was recorded with a thermal camera (FLIR A655sc, Thermal focus, Ravels, Belgium). The frame rate of the thermal camera was synchronised with the rotation velocity of the drying vial. In addition, the horizontal field of view of the thermal camera was calculated according to Equation (11), allowing the construction of a temperature distribution over the entire vial through time.

HFOV=2dwtanα2 (11)

where HFOV is the horizontal field of view of the thermal camera (m), dw is the distance between the thermal camera and the rotating vial (m) and α is the field of view angle (). A sharp increase in the mean temperature of the vial indicated that primary drying has come to an end [5]. The total primary drying time for each pixel was determined by verifying when this temperature raise occurred for each pixel of the vial wall. Finally, an additional primary drying time distribution was hence obtained via these thermal measurements. The primary drying time distribution achieved via μCT was compared to the time distribution obtained via thermal imaging.

3. Results and Discussion

3.1. Direction of Sublimation

Surface plots similar to Figure 4 were constructed for all the 3D volumes of BSA and mannitol. A surface colour in between black and cyan (i.e., left side of the colour scale) is indicative for a Lice that is as large as Lice. In case Lice is smaller than Lice, the coordinate will appear orange to yellow and indicates the existence of cavities inside the frozen product layer. Furthermore, the brighter the coordinate appears, the higher its Lice and Lice are. As can be perceived on Figure 4, no to very minimal orange is measured, which was also the case for all other time points in the BSA and mannitol samples. Situations where Lice < Lice can only originate if non-radial sublimation occurs, creating cavities in the ice layer. Such cavities result in multiple sublimation fronts in the radial direction of one (Φ, h) coordinate. This was only observed to a significant extent during preliminary tests of the setup with sublimation of deionised water without excipients. Since sublimation was mainly noticeable in the radial direction in the case of mannitol or BSA formulations, it is very likely that the dried product layer of spin freeze-dried samples prevents this complex non-radial behaviour. However, local differences in the progress of primary drying were still noticeable between the (Φ, h) coordinates as different grades of cyan and black are simultaneously visible in Figure 4. It stresses the importance of intra-vial m˙sub and Rp calculations. A one-dimensional freeze-drying model describing a sublimation front moving from the centre of the vial towards the vial wall was assumed since the moving direction of the sublimation front was mainly radial. Therefore, only the surface of the voxels facing the centre of the vial were presumed to sublimate in the Rp estimation. Consequently, all other freeze-drying behaviour, i.e., crack formation and slight non-radial sublimation resulting in irregular topology is covered by the formulation and structure parameter Rp.

Figure 4.

Figure 4

Graphical representation of the relative difference of the frozen product thickness (Lice) and integrated frozen product length (Lice) for every (Φ, h) coordinate by means of a 2D-colour scale (right) for 4% BSA (top left) and 3% mannitol (bottom left) at 41 min.

3.2. Frozen Product Thickness and Sublimation Rate

The decrease in frozen product layer thickness over time is visualised in Figure 5a,b for mannitol and BSA formulations, respectively. During spin-freezing the liquid formulation is spread over the entire vial wall. If the rotation velocity of the vial during spin-freezing is not high enough, a difference in frozen product layer thickness between top and bottom of the vial is expected [6]. The first measurement point (3 min for mannitol and 1 minute for BSA) revealed that this was the case for both formulations. A difference of up to respectively 15% and 23% in initial average frozen product layer thickness (Lice,1) between top and bottom of the vial was observed. These differences in initial layer thickness were expected (i.e., 20%) and earlier described by Lammens et al. [6]. Rotational velocities of more than 5700 rpm would be necessary to limit layer thickness differences in height to less then 5%. In addition, the first measurement point revealed azimuthal differences up to 1 mm in frozen product layer thickness over the vial at one height level. Minor vial geometry defects or a slight misalignment of the vial in the spin-interface introduced azimuthal differences in frozen product layer thickness, since the vial was spinned outside its true centre. Differences in layer thickness can induce intra-vial differences in drying time. However, these differences in drying time can be completely controlled during production, since the entire surface of all vials are monitored via thermal imaging (cfr. Section 3.5). The vial slowly rotates in front of the thermal camera having the whole vial in scope. Moreover, the primary drying end point of the complete vial can be determined very accurately as demonstrated by Van Bockstal et al. [5].

Figure 5.

Figure 5

(a) Frozen product layer thickness Lice,i for every (Φ, h) coordinate in function of time of a 3% mannitol formulation during spin freeze-drying (b) Frozen product layer thickness Lice,i for every (Φ, h) coordinate in function of time of a 4% BSA formulation during spin freeze-drying.

Furthermore, global differences in frozen product layer structure could be observed between both formulations. As visible in Figure 5b, some cracks in the frozen product layer of the BSA formulation were present during sublimation. These cracks were not clearly visible in the first measurement point, possibly because their size was still below the measurement resolution. The cracks are interruptions in the frozen product layer which can induce differences in drying kinetics as explained in following sections. However, these cracks were not present in the frozen product layer of mannitol. These differences might be a consequence of the differences in solid state since mannitol is mainly crystalline, while BSA is mainly amorphous. Moreover, it should be noted that cracks can be avoided by optimizing the bulk formulation composition [14]. Shrinkage and cracking are a result from relaxing the drying tension built up by water removal. There is an inverse correlation between shrinkage and cracking. If shrinkage is restrained due to the mechanical strength of the cake then more cracking occurs to relax the drying tension. The mechanical strength of the cake is related to the solid state of the product and influences therefore the occurrence of cracks [33].

On the other hand, the frozen product layer of mannitol exhibits some remarkable circular spots at the bottom of the vial (cfr. Figure 5a). These very local differences in frozen product layer thickness correspond with the position of the grippers used to hold the vial in vertical position during spin-freezing. These grippers covered a part of the vial during spin-freezing and prevented direct contact between the cold gas and the vial, therefore a local difference in frozen product layer thickness might be induced. Similar ice expansion phenomena are regularly seen at the centre top of a batch freeze-dried cake. As these are the last locations where liquid is present during freezing, all the ice expansion is directed toward these spots. It is clear that an optimisation of the gripper design is advisable to mitigate the azimuthal differences by misalignment and to counter the freezing artefacts at the location of the grippers. By minimizing the gripper adaptors and changing the material into a high conductive fabric would most probably lead to less interference. Moreover, redirecting more cooling power to the bottom of the vial which was also associated with higher frozen layer thicknesses could be another suggested optimisation.

The sublimation rate was derived from the decrease in ice layer thickness for every (Φ, h) coordinate as described in Equation (4). The sublimation rate distributions at multiple time points of the mannitol and BSA formulation are represented in Figure 6a,b, respectively. As visualised in these figures, local differences in sublimation rate across the entire vial were present, revealing a possible distribution in Rp. These local differences were observed for both formulations, indicating that sublimation rate distributions over the vial might be present regardless of the solid state of the dried product.

Figure 6.

Figure 6

(a) Sublimation rate (m˙sub) for every (Φ, h) coordinate in function of time of a 3% mannitol formulation during spin freeze-drying. (b) Sublimation rate (m˙sub) per (Φ, h) coordinate in function of time of a 4% BSA formulation during spin freeze-drying.

Evaluating the sublimation rate over time revealed that at some locations, the sublimation rate increases, as visible in Figure 6. An increase in sublimation rate is usually not expected, since as drying proceeds a longer Ldr is formed which should be accompanied with a longer and more restricting Knudsen flow [23]. The m˙sub increase can only be attributed to a unusual decrease in Rp. Micro-structural changes during processing could possibly explain such behaviour.

3.3. Dry Product Resistance Distribution

Rp in function of Ldr for every (Φ, h) coordinate was calculated as described in Section 2.6. The Rp distribution of the BSA formulation at a Ldr of 1.06 mm is represented in Figure 7. As can be deduced from Figure 7a, differences in Rp are present across the vial. Some noteworthy regions were highlighted in Figure 7b. For instance, the Rp profiles of regions in the immediate vicinity of a crack strongly differs from a theoretical textbook Rp profile (Region highlighted in cyan in Figure 7), as it decreased over time. This is correlated with an increase in sublimation rate over time (cfr. Figure 7b), most likely caused by the formation of the crack, since this interrupts the dried layer, thus facilitating the transport of water molecules through the dried layer.

Figure 7.

Figure 7

(a) Rp at a Ldr of 1.06 mm for every (Φ, h) coordinate for the 4% BSA formulation. Four noteworthy different regions (circles) were selected in the surface plot. (b) Following data were plotted for each of the selected point: Lice in function of time (left) with dashed lines the raw data and full lines the smoothed data; m˙sub in function of time (middle); Rp in function of Ldr (right).

Although the shape of the Rp profiles of the other selected points in Figure 7a are very similar, some Rp profiles are considerably higher than others. A slightly higher sublimation front temperature might be expected in regions with a higher Rp, therefore increasing the risk of (micro-) collapse. In addition, differences in Rp across the vial will induce differences in primary drying time across the vial as explained in Section 3.4. These locally different Rp profiles are most likely caused by differences in pore morphology. For instance, regions with a higher Rp might correlate with a locally higher tortuosity or a smaller pore size. These possible intra-vial structural differences will be investigated in future work. Local differences in pore morphology are inherent to freeze-drying as they partly originates from local heat flux differences at ice nucleation and consolidation during the freezing phase [34]. These heat flux differences are generally much higher in batch freeze-drying, so we would also expect a broader Rp distribution. However, they can be minimized by a more uniform heat transfer (i.e., continuous processing) or by controlled nucleation techniques in the case of batch processing [18,19].

3.4. Primary Drying Time Distribution

From the Rp and Lice,0 distribution of the BSA formulation, a prediction of the primary drying time (tend) for every (Φ, h) coordinate was made and is depicted in Figure 8a. Clear differences in tend are noticeable across the vial, which varies between 1 and 2.7 h. The tend results are regionally grouped with generally higher tend towards the bottom of the vial. However, there is also significant azimuthal asymmetry. This coincided with the results of the initial frozen product thickness of BSA (cfr. Figure 5b), evidenced by a correlation coefficient of 0.5292 between tend and Lice,1 with a 95% confidence interval (CI) from 0.5169 and 0.5419. It is evident that the product thickness inhomogeneity has a major influence on the process design, especially on the primary drying endpoint.

Figure 8.

Figure 8

(a) Distribution of primary drying endpoint (tend) for a simulation of a spin-freeze dried 10R vial with 3.5 ml 4% BSA formulation at a chamber pressure of 10 Pa and total power towards the vial of 1.2 W and (b) End of primary drying (tend) histograms (f(x)—left axis) and cumulative distribution (F(x)—right axis) for both the simulation (Section 3.4) and the verification (Section 3.5).

Another significant contributor to tend is Rp. Upon comparing the sublimation rate of BSA (Figure 6b) with the primary drying time (Figure 8a), considerable regional similarities can be recognized, particularly when comparing the areas with cracks. The higher sublimation rate was caused by a lower product resistance (Rp) and reduced primary drying times. This is evidenced by a correlation coefficient between the initial product resistance Rp,0 (at Lice,0) and tend of 0.3255, with a 95% CI from 0.3095 till 0.3413. Macro-structural phenomena, such as cracking, or micro-structural morphology differences are inducing significant local Rp differences, impacting the primary drying time.

3.5. Verification Experiment

As explained in Section 3.4, differences in Rp and initial frozen product layer thickness across the vial induce noteworthy intra-vial variability in primary drying time. This highlights the importance of an accurate in-process analytical tool to determine tend. Thermal imaging has proven to be a very valuable tool to determine tend accurately [5].

Thermal imaging was used as a tool to verify the tend distributions obtained via μCT methodology. The distribution in primary drying time across the vial acquired via thermal imaging is represented in Figure 8b. A quite similar distribution was obtained using thermal imaging compared to the μCT based primary drying simulation. The total predicted drying time is quite comparable with the total drying time of the verification experiment. In addition, the global trend in both distributions is very similar. Therefore, it was concluded that thermal imaging was successfully used as a process analytical tool to determine intra-vial differences in tend. This enables the possibility to use real-time feedback control to proceed to secondary drying and avoiding the risks of (micro-)collapse. Nonetheless, the described 4D μ-CT technique enables the possibility to determine intra-vial differences with a higher resolution than via thermal imaging. In addition, thermal imaging can only be used to detect intra-vial differences in drying time, the physical origin of the variation would be difficult to elucidate using thermal imaging. In contrast, 4D μ-CT generates 3D-volumes in function of time which can aid in the discovering the origin of the phenomena (i.e., cracking, freezing artefacts ..) leading to drying time variation. Moreover, freeze-drying is a drying technique based on the principles of heat and mass balance. Thermal imaging is a process analytical technology based on the heat balance while 4D μ-CT is a mass balance technique, which makes them both very complementary.

4. Conclusions and Future Perspectives

The in-situ μCT methodology was capable of recording a freeze-drying process and directly distilling essential process parameters such as the frozen product layer or sublimation rate. Furthermore, a framework is proposed to measure the local frozen product differences and to calculate their respective local Rp profiles. Moreover, the impact of the distribution of the initial frozen product layer thickness and product mass transfer resistance on the primary drying time was identified to be significant. It can be concluded that specific attention should be given to intra-vial inhomogeneity during freeze-cycle design, especially the decision to switch to secondary drying. Prematurely starting secondary drying could have a major impact on the product appearance and product stability. However, it was also established that in-process thermal imaging of the vial during primary drying is a justifiable alternative, as the primary drying endpoint distribution was comparable to the μCT methodology. In future work, the origin of the discovered differences in Rp will be further explored via high resolution μCT scans of the dried layer. Furthermore, a similar investigation should be executed on traditional batch freeze-drying. A broader Rp distribution would be expected in batch processing as generally a longer and more tortuous restrictive Knudsen flow will be present.

Author Contributions

B.V.: Conceptualization, Methodology, Software, Formal analysis, Investigation, Data Curation, Writing—Original Draft, Writing—Review & Editing, Visualization, Funding acquisition; J.L.: Methodology, Validation, Formal analysis, Investigation, Data Curation, Writing—Original Draft, Writing—Review & Editing; W.G.: Methodology, Software, Formal analysis, Data Curation, Writing—Review & Editing, Visualization; C.V.: Resources, Writing—Review & Editing, Supervision; M.N.B.: Conceptualization, Resources, Writing—Review & Editing, Supervision, Project administration, Funding acquisition; T.D.B.: Resources, Writing—Review & Editing, Supervision, Project administration. All authors have read and agreed to the published version of the manuscript.

Funding

The Research Foundation - Flanders (FWO) is gratefully acknowledged for the financial support for this research from the PhD fellowship strategic basic research program (FWO SB fellowship 1S23417N: Brecht Vanbillemont) and the Research Project program (FWO project 3G036518). The Ghent University Special Research Fund (BOF-UGent) is recognized for the financial support of the Centre of Expertise UGCT (BOF.EXP.2017.000007).

Conflicts of Interest

The authors declare no competing financial interest.

References

  • 1.Nail S.L., Jiang S., Chongprasert S., Knopp S.A. Development and Manufacture of Protein Pharmaceuticals. Springer; New York, NY, USA: 2002. Fundamentals of freeze-drying; pp. 281–360. [DOI] [PubMed] [Google Scholar]
  • 2.Tang X., Pikal M. Design of freeze-drying processes for pharmaceuticals: Practical advice. Pharm. Res. 2004;21:191–200. doi: 10.1023/B:PHAM.0000016234.73023.75. [DOI] [PubMed] [Google Scholar]
  • 3.Renteria Gamiz A.G., Van Bockstal P.J., De Meester S., De Beer T., Corver J., Dewulf, J. Analysis of a pharmaceutical batch freeze dryer: Resource consumption, hotspots, and factors for potential improvement. Dry. Technol. 2019;37:1563–1582. doi: 10.1080/07373937.2018.1518916. [DOI] [Google Scholar]
  • 4.De Meyer L., Lammens J., Mortier S.T.F.C., Vanbillemont B., Van Bockstal P.J., Corver J., Nopens I., Vervaet C., De Beer T. Modelling the primary drying step for the determination of the optimal dynamic heating pad temperature in a continuous pharmaceutical freeze-drying process for unit doses. Int. J. Pharm. 2018;90:13591–13599. doi: 10.1016/j.ijpharm.2017.09.004. [DOI] [PubMed] [Google Scholar]
  • 5.Van Bockstal P.J., Corver J., De Meyer L., Vervaet C., De Beer T. Thermal Imaging as a Noncontact Inline Process Analytical Tool for Product Temperature Monitoring during Continuous Freeze-Drying of Unit Doses. Anal. Chem. 2019;37:1563–1582. doi: 10.1021/acs.analchem.8b03788. [DOI] [PubMed] [Google Scholar]
  • 6.Lammens J., Mortier S.T.F.C., De Meyer L., Vanbillemont B., Van Bockstal P.J., Van Herck S., Corver J., Nopens I., Vanhoorne V., De Geest B.G., et al. The relevance of shear, sedimentation and diffusion during spin freezing, as potential first step of a continuous freeze-drying process for unit doses. Int. J. Pharm. 2018;539:1–10. doi: 10.1016/j.ijpharm.2018.01.009. [DOI] [PubMed] [Google Scholar]
  • 7.De Meyer L., Lammens J., Vanbillemont B., Van Bockstal P.J., Corver J., Vervaet C., Friess W., De Beer T. Dual chamber cartridges in a continuous pharmaceutical freeze-drying concept: Determination of the optimal dynamic infrared heater temperature during primary drying. Int. J. Pharm. 2019;570:118631. doi: 10.1016/j.ijpharm.2019.118631. [DOI] [PubMed] [Google Scholar]
  • 8.Brouckaert D., De Meyer L., Vanbillemont B., Van Bockstal P.J., Lammens J., Mortier S.T.F.C., Corver J., Vervaet C., Nopens I., De Beer T. Potential of near-infrared chemical imaging as process analytical technology tool for continuous freeze-drying. Anal. Chem. 2018;90:4354–4362. doi: 10.1021/acs.analchem.7b03647. [DOI] [PubMed] [Google Scholar]
  • 9.Velardi S.A., Barresi A.A. Development of simplified models for the freeze-drying process and investigation of the optimal operating conditions. Chem. Eng. Res. Des. 2008;86:9–22. doi: 10.1016/j.cherd.2007.10.007. [DOI] [Google Scholar]
  • 10.Kuu W.Y., McShane J., Wong J. Determination of mass transfer coefficients during freeze drying using modeling and parameter estimation techniques. Int. J. Pharm. 1995;124:241–252. doi: 10.1016/0378-5173(95)00094-Y. [DOI] [Google Scholar]
  • 11.Pikal M.J. Use of laboratory data in freeze drying process design: Heat and mass transfer coefficients and the computer simulation of freeze drying. PDA J. Pharm. Sci. Technol. 1985;39:115–139. [PubMed] [Google Scholar]
  • 12.Mortier S.T.F.C., Van Bockstal P.J., Corver J., Nopens I., Gernaey K.V., De Beer T. Uncertainty analysis as essential step in the establishment of the dynamic Design Space of primary drying during freeze-drying. Eur. J. Pharm. Biopharm. 2016;103:71–83. doi: 10.1016/j.ejpb.2016.03.015. [DOI] [PubMed] [Google Scholar]
  • 13.Vanbillemont B., Nicolaï N., Leys L., De Beer T. Model-Based Optimisation and Control Strategy for the Primary Drying Phase of a Lyophilisation Process. Pharmaceutics. 2020;12:181. doi: 10.3390/pharmaceutics12020181. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.Patel S.M., Nail S.L., Pikal M.J., Geidobler R., Winter G., Hawe A., Davagnino J., Gupta S.R. Lyophilized drug product cake appearance: What is acceptable? J. Pharm. Sci. 2017;106:1706–1721. doi: 10.1016/j.xphs.2017.03.014. [DOI] [PubMed] [Google Scholar]
  • 15.Goshima H., Do G., Nakagawa K. Impact of ice morphology on design space of pharmaceutical freeze-drying. J. Pharm. Sci. 2016;105:1920–1933. doi: 10.1016/j.xphs.2016.04.001. [DOI] [PubMed] [Google Scholar]
  • 16.Pisano R., Barresi A.A., Capozzi L.C., Novajra G., Oddone I., Vitale-Brovarone C. Characterization of the mass transfer of lyophilized products based on X-ray micro-computed tomography images. Dry. Technol. 2017;35:933–938. doi: 10.1080/07373937.2016.1222540. [DOI] [Google Scholar]
  • 17.Pisano R., Fissore D., Barresi A.A., Brayard P., Chouvenc P., Woinet B. Quality by design: Optimization of a freeze-drying cycle via design space in case of heterogeneous drying behavior and influence of the freezing protocol. Pharm. Dev. Technol. 2013;18:280–295. doi: 10.3109/10837450.2012.734512. [DOI] [PubMed] [Google Scholar]
  • 18.Kasper J.C., Friess W. The freezing step in lyophilization: Physico-chemical fundamentals, freezing methods and consequences on process performance and quality attributes of biopharmaceuticals. Eur. J. Pharm. Biopharm. 2011;78:248–263. doi: 10.1016/j.ejpb.2011.03.010. [DOI] [PubMed] [Google Scholar]
  • 19.Capozzi L.C., Trout B.L., Pisano R. From Batch to Continuous: Freeze-Drying of Suspended Vials for Pharmaceuticals in Unit-Doses. Ind. Eng. Chem. 2019;58:1635–1649. doi: 10.1021/acs.iecr.8b02886. [DOI] [Google Scholar]
  • 20.Oddone I., Van Bockstal P.J., De Beer T., Pisano R. Impact of vacuum-induced surface freezing on inter- and intra-vial heterogeneity. Eur. J. Pharm. Biopharm. 2016;103:167–178. doi: 10.1016/j.ejpb.2016.04.002. [DOI] [PubMed] [Google Scholar]
  • 21.Kuu W.Y., O’Bryan K.R., Hardwick L.M., Paul T.W. Product mass transfer resistance directly determined during freeze-drying cycle runs using tunable diode laser absorption spectroscopy (TDLAS) and pore diffusion model. Pharm. Dev. Technol. 2011;16:343–357. doi: 10.3109/10837451003739263. [DOI] [PubMed] [Google Scholar]
  • 22.Fissore D., Pisano R., Velardi S., Barresi A.A., Galan M. PAT tools for the optimization of the freeze-drying process. Pharm. Eng. 2009;29:58–70. [Google Scholar]
  • 23.Hottot A., Vessot S., Andrieu J. Determination of mass and heat transfer parameters during freeze-drying cycles of pharmaceutical products. PDA J. Pharm. Sci. Technol. 2005;59:138–153. [PubMed] [Google Scholar]
  • 24.Kuu W.Y., Hardwick L.M., Akers M.J. Rapid determination of dry layer mass transfer resistance for various pharmaceutical formulations during primary drying using product temperature profiles. Int. J. Pharm. 2006;313:99–113. doi: 10.1016/j.ijpharm.2006.01.036. [DOI] [PubMed] [Google Scholar]
  • 25.Maire E., Withers P.J. Quantitative X-ray tomography. Int. Mater. Rev. 2014;313:1–43. doi: 10.1179/1743280413Y.0000000023. [DOI] [Google Scholar]
  • 26.Haeuser C., Goldbach P., Huwyler J., Friess W., Allmendinger A. Imaging techniques to characterize cake appearance of freeze-dried products. J. Pharm. Sci. 2018;107:2810–2822. doi: 10.1016/j.xphs.2018.06.025. [DOI] [PubMed] [Google Scholar]
  • 27.Bultreys T., Boone M.A., Boone M.N., De Schryver T., Masschaele B., Van Hoorebeke L., Cnudde V. Fast laboratory-based micro-computed tomography for pore-scale research: Illustrative experiments and perspectives on the future. Adv. Water Resour. 2016;95:341–351. doi: 10.1016/j.advwatres.2015.05.012. [DOI] [Google Scholar]
  • 28.Mokso R., Marone F., Haberthür D., Schittny J.C., Mikuljan G., Isenegger A., Stampanoni M. Following dynamic processes by X-ray tomographic microscopy with sub-second temporal resolution. AIP Conf. Proc. 2010;1365:38–41. [Google Scholar]
  • 29.García-Moreno F., Kamm P.H., Neu T.R., Bülk F., Mokso R., Schlepütz C.M., Stampanoni M., Banhart J. Using X-ray tomoscopy to explore the dynamics of foaming metal. Nat. Commun. 2019;10:1–9. doi: 10.1038/s41467-019-11521-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 30.Corver J., Van Bockstal P.J., De Beer T. A continuous and controlled pharmaceutical freeze-drying technology for unit doses. Eur. Pharm. Rev. 2017;22:51–53. [Google Scholar]
  • 31.Dierick M., Van Loo D., Masschaele B., Van den Bulcke J., Van Acker J., Cnudde V., Van Hoorebeke L. Recent micro-CT scanner developments at UGCT. Nucl. Instrum. Meth. B. 2014;324:35–40. doi: 10.1016/j.nimb.2013.10.051. [DOI] [Google Scholar]
  • 32.Murphy D.M., Koop T. Review of the vapour pressures of ice and supercooled water for atmospheric applications. Q. J. R. Meteorol. Soc. 2005;131:1539–1565. doi: 10.1256/qj.04.94. [DOI] [Google Scholar]
  • 33.Ullrich S., Seyferth S., Lee G. Measurement of shrinkage and cracking in lyophilized amorphous cakes. Part II: Kinetics. Pharm. Res. 2015;32:2503–2515. doi: 10.1007/s11095-015-1639-9. [DOI] [PubMed] [Google Scholar]
  • 34.Nakagawa K., Hottot A., Vessot S., Andrieu J. Modeling of freezing step during freeze-drying of drugs in vials. AIChE J. 2007;53:1362–1372. doi: 10.1002/aic.11147. [DOI] [Google Scholar]

Articles from Pharmaceutics are provided here courtesy of Multidisciplinary Digital Publishing Institute (MDPI)

RESOURCES