Abstract
Background
Many medical imaging techniques utilize fitting approaches for quantitative parameter estimation and analysis. Common examples are pharmacokinetic modeling in dynamic contrast-enhanced (DCE) magnetic resonance imaging (MRI)/computed tomography (CT), apparent diffusion coefficient calculations and intravoxel incoherent motion modeling in diffusion-weighted MRI and Z-spectra analysis in chemical exchange saturation transfer MRI. Most available software tools are limited to a special purpose and do not allow for own developments and extensions. Furthermore, they are mostly designed as stand-alone solutions using external frameworks and thus cannot be easily incorporated natively in the analysis workflow.
Results
We present a framework for medical image fitting tasks that is included in the Medical Imaging Interaction Toolkit MITK, following a rigorous open-source, well-integrated and operating system independent policy. Software engineering-wise, the local models, the fitting infrastructure and the results representation are abstracted and thus can be easily adapted to any model fitting task on image data, independent of image modality or model. Several ready-to-use libraries for model fitting and use-cases, including fit evaluation and visualization, were implemented. Their embedding into MITK allows for easy data loading, pre- and post-processing and thus a natural inclusion of model fitting into an overarching workflow. As an example, we present a comprehensive set of plug-ins for the analysis of DCE MRI data, which we validated on existing and novel digital phantoms, yielding competitive deviations between fit and ground truth.
Conclusions
Providing a very flexible environment, our software mainly addresses developers of medical imaging software that includes model fitting algorithms and tools. Additionally, the framework is of high interest to users in the domain of perfusion MRI, as it offers feature-rich, freely available, validated tools to perform pharmacokinetic analysis on DCE MRI data, with both interactive and automatized batch processing workflows.
Keywords: Pharmacokinetic modeling, Tracer-kinetics, Dynamic PET, Multi-purpose, Software development, Model fitting
Background
Model fitting plays a vital role for many analysis approaches in medical imaging. In order to determine spatially resolved T1 relaxation times in magnetic resonance imaging (MRI), multiple images with different T1 weightings are acquired and the signal intensities are fitted with the relaxation equation [1]. Quantifying T1 relaxation times can add additional morphological information for a variety of pathological conditions. In diffusion-weighted MRI (DWI), the apparent diffusion coefficient (ADC) is derived by acquiring images at increasing diffusion gradients (b-values) and fitting the signal loss with an exponential [2]. In more advanced signal theory, effects such as intravoxel incoherent motion (IVIM) are included, which also rely on signal fitting with a theoretical model. For chemical exchange saturation transfer (CEST) imaging, Z-spectra, acquired through sweeping radiofrequency saturation around the bulk water resonance, are analyzed using multi-pool Lorentzian fitting [3].
A paradigm for fitting of medical images is pharmacokinetic modeling, as applied in dynamic contrast-enhanced (DCE) MRI and computed tomography (CT), or in dynamic positron emission tomography (PET). In PET, pharmacokinetic analysis can be used to measure transport rates of certain pharmaceuticals or metabolic substances [4, 5]. Dynamic scans are acquired over the injection of a radioactive tracer, which accumulates in tissue according to the metabolic properties of its pharmacologic compound. Tissue-specific kinetic parameters are then extracted by fitting the measured time-activity curves with compartment models that describe tracer transport. The most commonly used models are the one tissue compartment model (1TCM) and two tissue compartment model (2TCM) [4].
In DCE MRI the aim is to derive parameters on tissue perfusion and capillary permeability from analysis of the time course of contrast agent (CA) concentration in tissue by acquisition of a time series of T1 weighted MR images over CA administration [6, 7]. Tissue concentration-time curves are then analysed through fitting with a pharmacokinetic (compartment) model [8, 9]. The most commonly used compartment models for gadolinium-based, extracellular contrast agents are the classical Tofts model, the extended Tofts model and the two compartment exchange model (2CXM) [6].
DCE MRI has become a popular method to assess tissue physiology in various diseases, including cancer, multiple sclerosis [10], rheumatic arthritis [11] and stroke [12]. For research purposes, authors usually write their own analysis code in general purpose frameworks like MATLAB [13], Python, R [14] or MPFit [15]. However, this approach comes with a number of disadvantages: in-house developed analysis software tools often lack standardization and broad validation, which can result in errors on the estimated parameter and make comparison of results from different centers rather difficult [16]. Also, code is often written without software design concepts and reusability in mind. Thus, novel applications or variations in the analysis workflow often have to be implemented from scratch. Furthermore, in-house developed tools usually lack the integration into medical image processing ecosystems, leading to excessive data conversion and transfer. This limits their application in clinical routine, as the fitting analysis cannot be performed directly together with other necessary data evaluation steps like segmentation and registration. Many times these in-house solutions are not graphical user interface (GUI)-based, and therefore require a basic knowledge of the respective programming language.
Due to these drawbacks, and especially with respect to standardization, clinically oriented studies tend to be carried out using standard scanner software tools included by the vendors (e.g [17, 18]) or stand-alone tools [19, 20]. Apart from their commercial nature, these tools constitute black-box systems that do not offer any flexibility in extension and configuration, which makes them less suitable for research purposes. Many of these tools offer only basic analysis steps and are installed on special workstations of scanner related computers. Hence data evaluation cannot be performed offline by any researcher. On top of this, studies have shown that results from different vendor’s software yield differences in parameter estimates [21–23]. These aspects have given rise to the need of standardized, open access solutions.
Challenges
Ideally, such software tools would be included into larger medical image analysis platforms, enabling fitting analysis to be carried out side by side with other image processing steps without data conversion or import to other frameworks. In addition to that, linkage to a picture archiving and communication system (PACS) and support of DICOM data facilitates application of data evaluation in clinical settings. For research purposes, software should enable easy development and implementation of extensions to the tools in terms of models, fitting algorithms, etc. In order to be usable for both research and clinical evaluation purposes, the software needs to provide a user-friendly interface for analysis to be carried out, but yet allow for algorithm automatization in order to perform large scale data evaluations. Furthermore, direct means of fit visualization and exploration can improve quality of data evaluation and give room to model validation.
State of the art – software
Several open-source packages for analysis of DCE MRI data have been presented in the last years [24–31]. They can be divided into two categories: stand-alone tools, designed explicitly and only for DCE MRI analysis, and plug-ins or packages, that provide the analysis functionality within a larger analysis framework. Stand-alone tools are designed to be ready-to-use applications, with ports for data transfer (data input and results export) and can be modified and extended on basis of the source code by the user. Well-known examples of stand-alone tools are ROCKETSHIP [24], DCE@urLAB [26] or DCEMRI.jl [27]. However, these tools are not linked to a common image processing platform, and thus require conversion and transfer of data. Hence, substantial effort is required to perform data analysis with these tools, making them feasible only for research purposes. Additionally, even though these tools are made publicly available as open-source code, many of them depend on some underlying closed source dependency, e.g. MATLAB including its toolboxes. Contrary to that, plug-ins or packages can be used within larger analysis frameworks. More general examples include published packages for R or Python, like DATforDCEMRI [25], dcemriS4 [32] or pydcemri [30].
More dedicated solutions were introduced to be used complementary to standard image processing software, like OsiriX [33], PMI [28] or 3DSlicer [34]. With regards to the aspect of clinical oriented analysis workflows, these plug-in solutions provide the advantage of incorporation of the DCE MRI analysis into general image pre- and post-processing. Thus, OsiriX plug-ins for DCE MRI analysis, e.g. UMMPerfusion [31] and the DCETool [29], are popular tools that can be used for an entire radiological workflow. However, OsiriX is only available on Mac OS, which presents another drawback. The 3DSlicer-based option “PKModeling” [35] on the other hand provides only basic features of pharmacokinetic analysis for DCE MRI data. Additionally, many of these plug-in solutions are designed for application with direct user interaction, thus not allowing for automated batch-processing analysis pipelines. Another aspect is that all the above named solutions are designed for a single application purpose, i.e. DCE MRI. In order to include other image processing tasks based on image fitting (especially on other fitting domains e.g frequency), would require entirely new implementations from scratch. However, general concepts of the underlying algorithm are not limited to DCE MRI. An ideal tool would offer means for fitting of medical image data with any model and on any domain (time, frequency, etc.)
To the best of our knowledge, there exists no solution, that can be considered truly free in terms of an open-source, operating system (OS)-independent software tool for fitting tasks on medical images, regardless of image modality, dimensionality and domain that does not depend in any way on external, commercial software frameworks. In this work, we present the framework ModelFit for the Medical Imaging Interaction Toolkit (MITK) [36], which is designed to perform any fitting task with a given model on multi-dimensional image data in such a free way. Several dedicated use-cases in form of MITK workbench applications were derived from this tool. Special attention was given to pharmacokinetic analysis in DCE MRI, for which several applications were implemented and validated.
Implementation
We designed and implemented a framework within the Medical Imaging Interaction Toolkit (MITK) that enables fitting of medical imaging data with any given model. This framework was implemented with regards to both end-user applications as well as developer features. The following sub-sections present the design of the framework, explain how decoupling was achieved and which extension points are offered by the framework to tailor own setups and workflows.
Definition of general terms and concepts:
Before we introduce the structure of the here presented framework, let us briefly review the conceptional workflow of data fitting. Data fitting is an optimization problem with the aim of approximating the measured data points by a theoretical mathematical model of the underlying (physical) processes.
The theoretical representation of the data is referred to as the model function fϕ, θ(x) and maps from the signal grid domain X to the signal codomain Y. X and Y are problem dependent. X is e.g. often the time domain or frequency domain. Y represents the intensities of the images (e.g. concentration of the CA). X and Y are subsets of ℝ.
The model function is parameterized by the parameter vectors ϕ and θ. The parameter vector ϕ is the variable of the model fitting process and is named model parameter (MP) in the following. Parameter vector θ is not in the scope of the optimization and called static model parameter (SMP).
For the optimization the model in dependency of the signal grid and the SMP θ is used. The values S′ are named signal (in analogy to the measured sample S). The input sample S is the vector of measured data points on . The optimization is performed by iteratively adjusting the set of MP in order to minimize a similarity measure between data and model, i.e. the deviation between sample and signal. This similarity measure is referred to as cost function . C may be a single scalar or vectorial. In many applications the sum of quadratic difference between the sample and theoretical signal, referred to as sum of squared residuals, is used as similarity measure.
Decoupling strategies
An important design aspect for developers is the possibility to extend the framework in multiple ways and to reuse it for different fitting workflows and domains. Such a flexibility and reusability is achieved through the separation of concerns and decoupling (e.g. via abstraction). We regard these abstractions as equally important for a versatile fitting framework, though they are not sufficiently exploited in other publications (except for the model-view-controller pattern; see below).
Abstraction of the model function
Proper abstraction of the model function fϕ, θ(x) seems trivial, but is nevertheless important for the versatility of the whole concept. The abstraction is done object-oriented via model classes that represent , encapsulate the model function itself and generate signals for a defined signal grid upon request. Furthermore, a model class provides an abstract interface to interact with the encapsulated model function and to query its properties. The following properties are considered the most important regarding the fitting framework (e.g. for proper result serialization into DICOM and provenance tracking):
Name/ID of the model
Name and unit of the signal values
Name and unit of the model parameters ϕ (MP) (i.e. parameters in the model function that are iteratively adjusted during fitting).
Name and unit of the static model parameters θ (SMP) (i.e. parameters in the model function that are not affected by the fitting process)
Abstraction of the fitting process
The fitting process is abstracted into three components (see Fig. 1): model class (see above), cost function (e.g. sum of squared residuals; including the possibilities to define implicit regularization by boundary functions) and optimizer (e.g. LevenbergMarquart [37, 38] or LFGS-B [39–41]).
The optimizer drives and terminates the iterative fitting process based on the cost function and the optimizer’s stopping criteria. The combination of optimizer, cost function and model can be arbitrary chosen by the developer for the desired fitting workflow. Amongst others aspects, this allows for experimental settings e.g. benchmarking the performance of different model implementations using the same optimizer and cost function [42]. To facilitate reuse, meaningful combinations of optimizers and cost functions are composed as ModelFitFunctor classes. ModelFitFunctors depend only on MPs, the parameterized model itself and the sample. This design allows a great versatility and reusability in different workflows; e.g. the ModelFitFunctor itself does not change, if either a region of interest (ROI)-based (averaged curve over all voxels in a region of interest) or voxel-based fit (each voxel individually) is performed. To achieve this versatility, the fitting process (Fig. 1) is completely abstracted from type or purpose of input and output data. The concrete realization and further benefits are explained in more details in the next section.
Abstraction of data
To conduct fitting, several types of information are needed:
Sample signal
SMPs
Initial MP values
Constraints for the fitting
With regard towards fitting workflows and the above mentioned information types the following design consideration was made: Fitting is always done for an indexed discrete element (e.g. an image voxel). Therefore any data can be defined on a global scope (e.g. the sample signal in a ROI-based fitting) or a local scope (e.g. the sample signal in a voxel-based fitting; initial MP values of a model). The type of scope is not fixed. It might change depending on the chosen model, the workflow and the experimental setting. Furthermore the source of data and its representation (values stored in an image object, a value vector, etc.) might differ, depending on the workflow and state of the application.
In the here presented framework, this consideration is dealt with by introducing two groups of classes: ModelParameterizer classes and ModelFactory classes. The interplay of these classes with the fitting process is depicted in Fig. 2. The ModelParameterizer abstracts the way how default constraints, initial MP values and SMPs are accessed and therefore, the handling of different data representations and scopes. The ModelFitFunctor uses the ModelParameterizer for any index to request a parameterized and ready-to-use model instance with initial MP values for fitting.
ModelFactory classes are used by the application to get a valid ModelParameterizer based on the application state and available data types. Hence a ModelFactory encapsulates the decision, which ModelParameterizer should be used and how it should be initialized. A ModelFactory always represent a model class in the context of a certain problem statement. Thus, one model class might be managed by several ModelFactories, but with different ModelParameterizers and constraints regarding the specific problem statement, for which the factory was implemented.
Model-View-Controller pattern
The model-view-controller (MVC) pattern [43] and its variations are well-known strategies to decouple parts of an application and to allow thorough separation of concerns. It has been applied in other solutions [44]. In our implementations based on MITK, a MVC pattern with multiple views and controllers was applied. To avoid the ambiguity of the term “model” in the context of this paper, the term “application model” will be used for the model of the MVC pattern. In all other cases “model” refers to model classes that represent (see above).
In the herein presented framework, the application model not only consists of the data (e.g. input images, ROIs, resulting parameter images) but also of the fitting business logic. The fitting business logic encompasses all classes and structures introduced in the above abstraction levels (e.g. model class, ModelFitFunctor classes, etc.). The decision to make the fitting business logic part of the application model instead of the controller allows its decoupling from controllers. This decoupling enables the reuse of fitting business logic components in multiple controllers and facilitates the necessary unit testing. Within the MITK workbench implementation, a view consists of multiple graphical user elements (widgets) that display the images, model functions, model constraints etc. The controllers are provided by MITK workbench plug-ins (MFI, generator plug-ins for DCE MRI, etc.).
The application model is decoupled from the views and the controllers in two ways: data is decoupled via the MITK data storage and the MITK data / properties classes, which grant access to data and its meta data. Hence controllers and views do not interact directly, but via the information in the MITK data storage and application events. To decouple the model business logic from the controllers micro services are used to inject ModelFactory classes into the application and allow arbitrary controllers to access them. The MVC pattern of our application and its interplay is depicted in Fig. 3.
Extension points of the framework
As an open-source project there is a vast variety of options to extend and customize the described framework. Five extension points are regarded as most important and will therefore be explained briefly.
New models: The introduction of new models is the most obvious one. A completely new model function requires also the implementation of a respective ModelParameterizer and ModelFactory class. For both types, template base classes are provided to facilitate implementation. If a developer wants to add support of different data representations for an existing model class, only a suitable ModelParameterizer and ModelFactory must be implemented. For the registration of a factory as a micro service in order to make it available in the application, a helper class is provided.
New cost functions and fitting strategies: Custom cost functions can be integrated based on two base classes: SVModelFitCostFunction is used for single-value cost functions (e.g. sum of squared residuals) and MVModelfitCostFunction for multi-value cost functions (e.g. array of squared residuals). Both classes are based on cost function classes of the Insight Toolkit (ITK)[45], itk::SingleValuedCostFunction and itk::MultipleValuedCostFunction respectively. Therefore, every thread-safe optimizer offered by ITK can be used to drive the fitting process. In addition, own implementations or wrapping of existent optimizer implementations are possible. In order to regard different types of fitting constraints and boundary conditions, an abstract interface is provided along with a ready-to-use implementation of simple boundary conditions. The interface can either be used to inject constraints implicitly or explicitly into the fitting process. The latter option must be supported by the optimizer itself (e.g. LBFGS-B). The implicit injection is realized by a penalty term added to the cost function. This is easily done by using SVConstrainedCostFunctionDecorator or MVConstrainedCostFunctionDecorator. Both take the constraints and the original cost function and can then be used as cost functions with penalty term.
New domains: The main area of usage is currently time-resolved data, e.g. in pharmacokinetic analysis or for simple trend fitting (e.g. linear or exponential fits). Nevertheless, the framework itself is not limited to a special domain, neither data specific (e.g. time domain or frequency domain) nor regarding the use-case (e.g. image modalities, types of models). This covers e.g. the fitting of diffusion data over different b-values for ADC extraction, the determination of T1 over different inversion times and flip angles or T2* fitting for variant echo times. Due to the above introduced abstraction levels the only restriction imposed by the framework is the possibility to implement the model function. Everything else is covered by ready-to-use classes or can be extended.
New controller/generation plug-ins: At the latest when adding a new domain to MITK GUI applications, one has to add a new generation plug-in to serve as a controller. To ease the implementation of custom generation plug-ins, many typical generation aspects are encapsulated into ready-to-use widgets (e.g. definition of initial values or definition of constraints). Due to the above introduced abstractions those widgets can work with any model. Therefore developers can concentrate on implementing the logic that initializes the needed ModelFitFunctor.
Results
Due to the presented used decoupling strategies, the fitting framework is very flexible in terms of which use-case can be addressed and how the use-case is implemented. The first aspect (what/which) is possible due to abstraction between model, data and fit representation (see abstraction strategy 1 and 3). Thus, the framework can be applied to any kind of fitting task regardless of the image modality (CT, MRI, PET, etc.), fitting dimension (time, frequency, etc.) and applied model (linear, pharmacokinetic, etc.).
The second aspect (how) is achieved by separation and standardization of the fitting routine components in terms of model, cost function (respective fitting criteria) and fitting engine (optimizer) as well as by the used MVC pattern (see abstraction strategy 1, 2 and 4). This leads to modularity and high flexibility for implementations of concrete fitting workflows and applications. The versatility is demonstrated by the implementation of several ready-to-use tools, which will be shortly presented in the following
There are several different solutions, including our own work, available for the fitting of medical data (especially for DCE MRI). To ease the comparison and assessment for developers and users, Table 1 compiles software characteristics for a selection of solutions. The selection of solutions represents well-known or relatively similar solutions compared to our work, in order to show differences between potential alternatives. The selection is not exhaustive.
Table 1.
MITK- ModelFit | UMM Perfusion | Rocketship | DCEMRI.jl | PMI | DATforDCEMRI | 3DSlicer PkModeling | |
---|---|---|---|---|---|---|---|
Operating system | Linux, Mac OS, Windows | Mac OS | Linux, Mac OS, Windows | Linux, Mac OS, Windows | Windows | Linux, Mac OS, Windows | Linux, Mac OS, Windows |
Language | C++ | C | Matlab | Julia | IDL | R | C++ |
License | BSD | BSD | GNUGPL | MIT | GNU GPL | Creative Commons | Slicer (BSD like) |
Advanced extensibility | Yes | Yes | No | No | No | No | Yes |
Fitting domain | Time, Frequency, anya | Time | Time | Time | Time | Time | Time |
Eco-system | Yes (MITK) | Yes (OsiriX) | No | No | Yes (PMI) | No | Yes (3DSlicer) |
Image modalities | DCE-MRI, DCE-CT, PET, dynamic MRI, dynamic CT, CESL/CEST,a | DCE-MRI | DCE-MRI | DCE-MRI | DCE-MRI, DSC-MRI, DCE-CT | DCE-MRI | DCE-MRI |
Models | Tofts, Extended Tofts, 2CXM, 1TCM, 2TCM, Brix, Three-step linear (3SL), Semi-quantitative metrics (BAT, TTP, AUC, Cmax, Wash-in/Wash-out Slope, final uptake, mean residence time) | Extended Tofts, 1CP, 2CXM, 2C uptake model, two compartment filtration model (2FM) | Tofts, Extended Tofts, Fast Exchange Regime, 2CXM, Tissue uptake, Nested-model selection, Patlak, Semi-quantitative metrics (AUC) | Tofts, Extended Tofts, Plasma Only | Uptake models, Steady-state, Patlak, Model-free deconvolution, Tofts, Extended Tofts, 2CXM, 2C filtration model for kidney, Dual-inlet models for Liver, Semi-quantitative metrics (Slope/Signal enhancement) | Tofts, Semi-quantitative metrics (AUC, MRT - mean residence time) | Tofts, Semi-quantitative metrics (AUC, slope) |
Input / Output | DICOM, Analyze, NIFTI, NRRD, VTK, Raw data | DICOM | DICOM, Analyze, NIFTI, Raw data, Matlab data | Matlab data | DICOM, Raw data | R readable data formats | DICOM, Analyze, NIFTI, NRRD, VTK, Raw data |
GUI | Yes | Yes | Yes | No | Yes | No | Yes |
Fit exploration | Yes | Yes | Yes | No | Yes | No | Yesb |
PACS Support | Yes | Yes | No | No | No | No | Yes |
Automatization | Yes | Partiallyc | Yes | Yes | Yes | Yes | Yes |
Source | http://mitk.org/wiki/MITK | http://ikrsrv1.medma.uni-heidelberg.de/redmine/projects/ummperfusion | https://github.com/petmri/ROCKETSHIP | https://github.com/davidssmith/DCEMRI.jl | https://sites.google.com/site/plaresmedima/ | https://github.com/cran/DATforDCEMRI | https://www.slicer.org/wiki/Documentation/4.8/Modules/PkModeling |
aPossibility to extend framework to support other fitting domains
bPossibility to generate a 3D+t image that encode the voxel-wise model signal and to explore the image with the MultiVolumeExplorer
cPossibility to loop over all models and selected tissue ROIs for the loaded Data in the UMMPerfusion user interface
The selection of solutions represents well-known or relative similar solutions compared to our work in order to clarify the differences. The selection does not claim to be exhaustive. Commercial solutions are not included. Further R or Matlab are only included in context of concrete tools (DATforDCEMRI and Rocketship) and not as generic fitting environments on their own. The later would be a categorical error. R as well as Matlab can handle generic fitting problems or allow GUIs but by implementing an application from scratch and not by just using it of the shelf or extending an existing one. The following characteristics are assessed in the table: Operating system; Language (Programming language of the software); License (needed to regard if software is used/extended); Advanced extensibility (Indicates if software was designed to easily be extended with new models without the need to change the basis application or its programming logic; implies a advanced level of abstraction and decoupling); Fitting domain (Indicates which domains are supported for the fitting); Eco-system (indicates if software is embedded into image processing eco-system); Image modalities (medical image modalities that are supported be model and fitting techniques); Models (included pharmacokinetic models); Input / Output (most relevant data formats supported by the software); GUI (indicates if software offers a graphical user interface); Fit exploration (indicates if the software allows to interactively investigate the fit and signal curve per voxel/ROI); PACS Support (indicates if the software allows to use DICOM Q/R or receive data via DICOM Send); Automatization (indicates if the software can be used to automatize the analysis with no user interaction); Source (Link to the source codes or developer’s site)
For exploration of dynamic data and respective fits, the Model Fit Inspector (MFI) allows voxel-wise display of multi-dimensional data and associated fits. If no model is fitted to the data, it displays the raw image intensity values over time in the selected voxel. The plug-in can be used to scout the data (see Fig. 4), visually assessing data quality (temporal sampling, noise, etc.) and qualitatively evaluate the course of signal-time curves. After fitting, the resulting fit curve can be displayed together with the measured intensity time curve it was fitted to. Data properties like noise or different curve shapes can be assessed visually by navigating through the image. For ROI-based fits, both averaged curve and curve at the specific image position are shown. If an additional curve was defined (e.g. as input for the model, such as an arterial input function (AIF)), it is displayed as well in a different color. Display settings (axis range, curve display color) can be adjusted manually. An info box shows all resulting parameter estimates, evaluation and derived parameters for that specific fit. Data curves can be exported as [Time, Signal] arrays for external analysis.
For fitting tasks outside of pharmacokinetic analysis we provide a simple tool. Currently this multi-purpose fitting tool offers conduction of simple fits e.g. with linear or exponential models as well as a generic model. The generic model uses a formula parser to fit any explicit analytical model formula to data. The user needs to specify the functional representation of the model and the number of model parameters that are adjusted during fitting.
When data quality is not sufficient to enable proper fitting analysis or no suitable model is known, simple, semi-quantitative parameters describing the curve shape can be calculated to evaluate the data [46–48].
For these cases a plug-in for non-compartmental analysis of signal-time curves using semi-quantitative parameters (depicted in Fig. 5) is provided. Common examples are the integral area-under-the-curve (AUC), the maximum signal intensity or time-to-peak (TTP). In pharmacokinetic theory, this approach is often referred to as non-compartmental or descriptive analysis. The set of parameters is extendable and currently includes AUC, maximum intensity, TTP, area-under-the-first-moment curve and mean residence time [49]. The resulting parameter images can be further analyzed or used to identify regions of interest for detailed pharmacokinetic analysis.
DCE MRI data can be quantitatively analyzed with pharmacokinetic models using the DCE MRI fitting plug-in. It includes a descriptive model [50], the classical Tofts model, the extended Tofts model and the two compartment exchange model (2CXM). The 2CXM is provided in both the convolution and differential equation form [42]. Figure 6 shows an example for pharmacokinetic analysis, in this case DCE MRI data from a glioblastoma patient that was analyzed using the 2CXM. Furthermore, a simple three-step linear model was implemented, that assumes linear functions for each three segments of the curve in order to derive semi-quantitative measures, like the wash-in or wash-out slope.
The plug-in comprises several options shown in Fig. 7. The AIF, required as input for these models, can be defined in different ways. Image-based AIFs can be defined through segmentation of a feeding artery and are then extracted from dynamic images, equivalent to the tissue concentration-time curves. The segmentation can be defined on the same dynamic image as the tissue of interest or on any other dynamic image. This feature is especially useful in preclinical studies, where usually a slice through the heart is acquired separately and used for derivation of the CA concentration in the blood pool. Another option to provide an AIF is via an external file in .csv format, which can be used e.g. for population-derived input curves [51]. Initial parameter values can be defined for each individual model parameter, either as a constant global value for all voxels or locally in form of a parameter image. Default values for the respective model are natively set. Constraints can be imposed on the model parameters, in order to exclude unrealistic values and to limit the search space. Upper and lower constraint values can be defined individually for each model parameter. Combinations, such as sums of parameters, are also possible. The tool allows limitation of the fitting region by definition of a segmentation for the region/volume of interest. Within this ROI, fitting can be performed in each individual voxel (voxel-wise) or on the averaged curve (ROI-based). Parameter estimates of the respective model, together with the used fitting criterion (e.g. the sum of squared residuals), are displayed in parameter images. Individual fit curves can be assessed using the MFI. There is also an option to extract certain debug parameters describing technical statistics of the fitting process, such as the required optimization time, the number of fit iterations, or the convergence criterion. These are useful for evaluation of fit quality beyond standard criterion parameters and visual fit assessment, especially in cases of failed or non-terminated fits.
Before fitting can be performed, 4D DCE MRI image intensities usually need to be converted into the corresponding CA concentration. If pre-contrast T1 maps are available (e.g. from multiple flip-angle measurements), analytic conversion of the signal to concentration units is provided in the DCE MRI fitting tool (as described in [27]). Otherwise, conversion by means of relative and absolute signal enhancement can be performed. The conversion can be performed in a dedicated plug-in or as convenient alternative directly in the fitting plug-in.
The versatility of our framework enabled also the implementation of a tool for simulating concentration-time curves by forward calculation of the signal from parameter images in combination with an AIF. With this simulation tool, curves can be generated according to the standard Tofts Model, the extended Tofts model and the 2CXM. Noise in form of Gaussian random numbers can be added with user-defined contrast-to-noise ratios (defined as ratio between the maximum of the AIF and the standard deviation of the noise). The generation of synthetic concentration-time curves allows for validation of models and benchmarking of different configurations of fitting algorithms [42].
For tracer-kinetic analysis of dynamic PET images, a dedicated tool was implemented in analogy to the DCE MRI tool. It includes the one tissue compartment model (1TCM) and the two tissue compartment model (2TCM). The first is provided in the general three-parameter form and a simplified 2 parameter version, while the latter is provided in a general form and in an adapted form for FDG PET, the most commonly used tracer [52, 53]. The general 2TCM function is provided in both the convolution and differential equation form. The fit options (e.g. types of AIF, initial parameters, constraints) are similar to the presented options for DCE MRI fitting (see Fig. 7). Conversion of signal intensities from raw data time-activity curves (TAC) to standard uptake value (SUV) curves can be performed using a separate plug-in. Figure 8 shows an example case for the 18F-labeled fluoroethyl-tyrosine (FET) tracer, which is commonly used for detection and staging of brain tumors [54, 55]. Time-activity curves were fitted with the standard 1TCM. Parameter maps of the exchange rates are shown together with fitted curves in a representative voxel.
A number of additional analysis tools for other workflows and fitting domains (e.g. for fitting of Z-spectra in chemical exchange saturation transfer (CEST) MRI, general T1/T2 mapping) were further derived from the fitting framework.
The above presented ready-to-use analysis tools are integrated as plug-ins into the MITK workbench and can be run directly via the user interface. In addition, they can be used as command-line tools (CLI tool) for (semi-) automatic analysis, which makes efficient evaluation of large data cohorts feasible. The CLI tools are implemented using the CommonTK/Slicer execution model [56] and therefore offer an easy integration path into other applications without any compile or linkage dependencies.
The integration into MITK allows establishing a complete analysis pipeline. Pre- and post-processing of raw data and resulting parameter maps can be done using all available MITK functionalities. Dynamic images can be co-registered with other, static images of higher signal-to-noise ratio (SNR) or spatial resolution, which enables more precise lesion detection and subsequent segmentation. Manual and semi-automated image segmentation techniques facilitate definition of fitting ROIs and other inputs (e.g. AIF). Segmentations can then be directly used for voxel-based as well as ROI-based fitting without further data conversion. Generated model parameter maps from fitting or non-compartmental analysis can be handled independently as MITK images, and thus analyzed. Besides visual inspection of the individual fit values and curves using the MFI plug-in, statistics and histogram evaluations can be performed. Further segmentations of sub-regions can be derived for in-depth analysis. Parameter maps can be saved in various image formats or exported to .csv files for further analysis with other programs.
Validation
Validation was performed for the standard and the extended Tofts model as well as the 2CXM. The quantitative imaging biomarker alliance (QIBA) offers virtual phantom data, so-called digital reference objects (DRO), for pharmacokinetic analysis in DCE MRI. For validation of the standard 2-parameter Tofts model, the QIBA_v6_Tofts DRO was used (available from https://sites.duke.edu/dblab/qibacontent/). It contains 30 blocks of each 10 × 10 squares of combinations of Ktrans ∈ {0, 1, 2, 5, 10, 20, 35} ml/ min /100 ml and ve ∈ {0.01, 0.05, 0.1, 0.2, 0.5}. Concentration curves are sampled at a temporal resolution of 0.5 s over a total of 1361 time points. For validation of the extended 3-parameter Tofts model, the noise free 4D DRO (https://sites.duke.edu/dblab/dce-mri-test-images/) was chosen. It includes DICOM images of a 2D+t DCE MRI series, with each 10 x 10 voxel blocks of 108 different, spatially encoded concentration-time curves, using all combinations of Ktrans ∈ {0, 1, 2, 5, 10, 20} ml/ min /100 ml , vp ∈ {0.001, 0.005, 0.01, 0.02, 0.05, 0.1} and ve ∈ {0.1, 0.2, 0.5}. Concentration curves are sampled at a temporal resolution of 0.5 s over a total of 661 time points. The dataset was fitted with the DCE MRI tool and resulting parameter estimates were compared to the ground truth. Unfortunately, no DRO is available for the 2CXM to our knowledge. Thus, we created a third DRO for the 2CXM, similar to those for the standard and extended Tofts model. Concentration-time curves for different combinations of Fp, PS, vp and ve were generated from the 2CompFlowExch model in JSim [57]. Values used for generation of concentration-time curves were Fp ∈ {5, 10, 25, 40} ml/ min /100 ml, PS ∈ {0, 5, 15} ml/ min /100 ml, vp ∈ {0.02, 0.05, 0.1, 0.2} and ve ∈ {0.1, 0.2, 0.5}. Curves were simulated on 0.5 s temporal sampling using the arterial input curve extracted from the extended Tofts DRO data. Signal curves were arranged in a 3D+t image of spatial dimensions <10 ∙ Fp, 10 ∙ ve ∙ vp, PS > = < 40, 120, 3>, where each <10 × 10 × 1> voxels contained one curve type. The AIF was added as <40, 20, 3> block on the bottom of the image, leading to a final DCE MRI data set of dimension <40, 140, 3, 661>. The data is available in DICOM format under: http://mitk.org/wiki/MITK-ModelFit.
All three DROs of synthetic DCE MRI data were fitted with our model implementation, using the AIF within the images, and resulting parameter estimates were compared to the true values. Mean relative errors on parameter estimates are listed in Table 2. For the 2CXM, errors are subdivided into different cases of PS.
Table 2.
Mean Error [%] | |||
---|---|---|---|
Standard Tofts | K trans | 3.24 | |
v e | 0.38 | ||
extended Tofts | K trans | 7.01 | |
v p | 22.06 | ||
v e | 5.95 | ||
2CXM | F p | 푃푆 = 0 푚푙/푚푖푛/100 푚푙 | 2.54 |
푃푆 = 5 푚푙/푚푖푛/100 푚푙 | 1.99 | ||
푃푆 = 15 푚푙/푚푖푛/100 푚푙 | 1.86 | ||
v p | 푃푆 = 0 푚푙/푚푖푛/100 푚푙 | 10.55 | |
푃푆 = 5 푚푙/푚푖푛/100 푚푙 | 1.83 | ||
푃푆 = 15 푚푙/푚푖푛/100 푚푙 | 2.87 | ||
PS | 푃푆 = 5 푚푙/푚푖푛/100 푚푙 | 3.05 | |
푃푆 = 15 푚푙/푚푖푛/100 푚푙 | 2.69 | ||
v e | 푃푆 = 5 푚푙/푚푖푛/100 푚푙 | 3.22 | |
푃푆 = 15 푚푙/푚푖푛/100 푚푙 | 2.48 |
The standard Tofts model yielded mean errors of 3.24 % ± 0.97% for Ktrans and 0.38 % ± 1.99% for ve, ranging between −7.44% and +2.22% (error maps not shown). Figure 9 shows relative errors on parameter estimates Ktrans, vp and ve for the extended Tofts model. Largest errors on Ktrans and ve were observed for lowest Ktrans values of 1 ml/ min /100 ml. vp exhibited largest errors for vp = 0.001. These findings are reasonable, since perfusion is difficult to measure in cases with low overall perfusion (low Ktrans) and low vascularization (low vp). Apart from these cases, errors on parameter estimates were low, between 0% and 10% in most cases.
Figure 10 shows relative errors on Fp and vp, for each of the three different original values of PS = 0, 5, 15 ml/ min /100 ml. Original values of vp, ve and Fp are indicated on the axes. These 2D error maps were generated by averaging each 10 slices with respective PS values. Estimates on Fp presented with very low errors of approximately 2% on average. Largest errors of about 4% are found for PS = 0 ml/ min /100 ml, vp = 0.1 and Fp = 40 ml/ min /100 ml. For estimates on vp, largest errors were found for PS = 0 ml/ min /100 ml, at vp = 0.1 and Fp = 25 ml/ min /100 ml. Overall errors on vp for the other two cases of PS = 5, 15 ml/ min /100 ml were around 2 % − 3%. For analysis of estimates on PS and ve, cases with PS = 0 ml/ min /100 ml were excluded, as large errors are to be expected for these two parameters in cases with vanishing vascular permeability. For PS = 5 ml/ min /100 ml and PS = 15 ml/ min /100 ml, resulting errors on parameter estimates for PS and ve are presented in Fig. 11. Errors on both PS and ve were about 3% on average, except for PS = 5 ml/ min /100 ml, Fp = 5 ml/ min /100 ml with vp = 0.2 and 0.02 and ve = 0.1 and 0.5, respectively. All these findings are reasonable, since limit tissues (low Fpin combination with high vp, low PS in combination with high ve) are expected to yield larger errors, as correct determination of concentration-time curves is difficult and assumptions of the 2CXM are not entirely valid in these cases.
Discussion
We presented an open-source software framework for fitting of medical images within the Medical Imaging Interaction Toolkit MITK. Its implementation offers high flexibility and reusability, making it easily adaptable and extendable for own developments. This versatility enables development of analysis tools for various fitting tasks and image modalities, as for example fitting of Z-spectra in CEST MRI or tracer-kinetic analysis in dynamic PET using compartment models. Furthermore, means of qualitative and quantitative fit quality evaluation and result visualization are provided.
Ready-to-use applications in form of plug-ins for the MITK workbench were implemented for several dedicated use-cases, which allows for direct GUI-based analysis. An extensive toolbox for pharmacokinetic analysis of DCE MRI data was designed with several commonly used pharmacokinetic models. It offers a wide range of configuration options, such as definition of parameter starting values, constraints for model parameters and different methods to convert the acquired MR signal to contrast agent concentration. Several strategies for AIF definition are supported, in order to enable most common approaches, e.g. image-based or population-based AIFs. Fitting can be performed either on an individual voxel basis or in a ROI-based average approach. The most commonly used models “standard Tofts”, “extended Tofts” and “2CXM” were validated on digital reference data sets. Results of estimated parameters for the standard and extended Tofts model were comparable to other published data [16, 27]. For the 2CXM we created a synthetic data set using JSim [57]. In order to spread validation methods and thus standardize pharmacokinetic modeling in DCE MRI, we provide free access to our validation DRO for the 2CXM.
Many approaches in medical image analysis utilize fitting, from pre-processing over extraction of parameters as in pharmacokinetic analysis to simple modeling of time-dependent treatment effects. Commonly, image fitting is performed using in-house developed code in large data analysis platforms such as MATLAB, IDL/MPFIT or R [13–15]. For analysis of DCE MRI data using pharmacokinetic modeling, several groups have presented open-source software solutions. Even though these tools are made publicly available as open-source code, several (e.g. PMI based on IDL or ROCKETSHIP based on MATLAB) depend on commercial software. Smith et al. presented DCEMRI.jl [27], a toolkit for NLLS fitting analysis of DCE MRI written purely in the programming language julia, hence it does not depend on any commercial licenses. It is open-source and compatible with MacOS, Linux and Windows systems. However, no graphical user interface or fit visualization is provided. Furthermore, it is not incorporated into any image processing platform, and input and output of data is possible only in MAT-v5 files. Hence a clinical oriented workflow, depending on the support of DICOM formats, is very difficult to realize. Published packages for R or Python, for example DATforDCEMRI [25], depend on no commercial licenses, as these frameworks are freely available and applicable to all operating systems. However, they are not dedicated to medical image analysis, thus data import and integration into a DICOM workstation are not provided. Additionally, other image processing tasks, like segmentation or registration, have to be performed externally. The OsiriX [33] open-source DICOM workstation can be used for an entire radiological workflow. Thus, OsiriX plug-ins for DCE MRI analysis, e.g. UMMPerfusion [31], are popular tools in the context of clinical research. However, OsiriX is only available on Mac OS, which presents another drawback. Furthermore, these plug-ins are specifically designed and implemented for OsiriX, hence they cannot be used as stand-alone tools, or with in automated, batch-processing analysis pipelines. 3DSlicer offers a rich, open-source and OS-independent platform for medical image analysis and visualization. The PKModeling module [35] can be used in automated workflows or via the 3DSlicer GUI. The major drawbacks compared to other options are the limited number of available models.
Our framework overcomes these limitations, by offering a standardized software concept for data handling, fitting algorithmic and analysis pipelines that can be applied modularly and extended easily. The level of abstraction, compared to other solutions, does not stop with the introduction of normal MVC patterns to separate GUI and algorithms. The fitting infrastructure itself is carefully abstracted and standardized. This ensures a large degree of freedom with respect to both the use-case in question (image modality, fitting domain) as well as the specific algorithm configuration in a use-case (optimizer and cost function, model). Due to the toolkit nature of MITK and the framework, the implemented tools for specific use-cases (DCE MRI, dynamic PET, general purpose fitting) can be used for automated batch processing, for integration into other applications (e.g. as CLI tool), as well as for direct user-interaction with GUI-based applications (plug-ins for the MITK workbench) for end-users without need for advanced software development. Furthermore, the embedding in MITK allows for fitting to be performed within an eco-system of medical image processing combining all other relevant processing steps and without the burden of data conversion or inter-application transfer. This embedding, together with the capability of MITK to handle all different kinds of imaging modalities, is especially useful in the light of current efforts regarding modern hybrid PET-MRI scanners or other kinds of multi-parametric imaging data. Different dynamic data types can be evaluated side-by-side in the same software framework and thus allow direct comparison of the derived multi-parametric maps. MITK also enables the analysis of longitudinal data generated by treatment response studies like in neoadjuvant chemotherapy, radiation therapy or anti-angiogenic treatment. The data analysis tools of ModelFit can be utilized to evaluate the physiologic, metabolic and vascular status of the tumor tissue and thus assess treatment efficacy, as changes in parametric maps reflect responses to therapy. Additionally, the presented software framework can be considered as truly free and open-source as it requires neither further proprietary licenses nor is it limited to specific operating systems. These features also facilitate the wide spread use of the implemented tools and thus can aid in standardization and multi-center analyses.
The quantitative imaging biomarker alliance (QIBA) [58] aims to reduce variability of quantitative imaging biomarkers across devices, sites, patients and time, and thus improve their value and practicality. In recent years, substantial efforts have been made to include, amongst others, pharmacokinetic approaches in MRI and PET into the alliance through standardized validation datasets, software approaches and acquisition protocols. Within this context, our framework for fitting of medical image data could provide a huge step forward in standardizing software not only for DCE MRI, as it can provide a common basis for all application of fitting approaches, whilst being freely available, maintained and transparent (i.e. source code can be directly accessed).
To our knowledge there is no software package for DCE MRI pharmacokinetic analysis that (1) has more functionalities regarding pharmacokinetics (2) can be considered truly free as in open-source and operating system independent, (3) with both GUI and batch processing applicability, (4) integration into a global image processing platform for pre- and post-processing and (5) no dependencies on commercial software packages or licenses.
Conclusion
In summary we have designed and implement a highly flexible and easily extendable software environment for fitting analysis in medical imaging, that allows for the analysis to be performed directly integrated into a larger image pre- and post-processing workflow. This includes, amongst others, highly automatized evaluation workflows regarding longitudinal data, where modeling of responses (e.g. follow-up under therapy) comes into play and which has become increasingly important in the era of big data. The framework can be used by developers for custom developments, but also offers ready-to-use GUI based applications for end-users. It is open-source and OS-independent, which together with its high modularity, versatility and rich feature set makes it superior to other existing solutions, especially in the context of pharmacokinetic analysis of dynamic imaging data.
Availability and requirements
Project name: MITK ModelFit
Project home page: http://mitk.org/wiki/MITK-ModelFit
Operating system(s): Platform independent
Programming language: C++14
Other requirements: Qt 5.9 or higher, Cmake 3.10 or higher; Git from http://git-scm.com
License: BSD-like
Any restrictions to use by non-academics: none
Acknowledgements
The authors would like to thank Alina Bendinger, Christin Glowa, Maria Saager, Christian Karger, Patrick Schünke, Jennifer Mosebach, David Bonekamp, Patrick Badura and Dorde Komljenovic, for fruitful discussions on perfusion imaging and pharmacokinetic analysis, and testing of developed plug-ins. Furthermore we acknowledge Caspar Goch, Stefan Dinkelacker and the division of medical image computing for continuous software support and Ali Afshar and Uwe Haberkorn for insight knowledge on dynamic PET data evaluation.
Funding
This work was supported by the National Center for Tumor diseases (NCT 3.0-2015.22 BioDose, to AA) the German Research Foundation (DFG-KFO-214, to AA; and SFB/TRR 125 “Cognition-Guided Surgery”, to KMH and MN), the Federal Ministry of Education and Research Germany (BMBF 01IB13001B, to RF) and the Deutsche Krebshilfe (Max-Eder 108876, to AA). The funders had no role in study design, data collection and analysis, decision to publish or preparation of the manuscript.
Availability of data and materials
The software and the validation dataset generated during the current study are available under http://mitk.org/wiki/MITK-ModelFit
Abbreviations
- AIF
Arterial input function
- AUC
Area-under-the-curve
- CEST
Chemical exchange saturation transfer
- CLI
Command line interface
- CNR
Contrast-to-noise ratio
- DRO
Digital reference object
- GUI
Graphical user-interface
- MITK
Medical Imaging Interaction Toolkit
- MP
Model parameters
- MFI
Model-fit inspector
- MVC
Model-View-Controller
- QIBA
Quantitative imaging biomarker alliance
- ROI
Region of interest
- SMP
Static model parameters
- SNR
Signal-to-noise ratio
- SUV
Standard uptake value
- TAC
Time-activity curve
- TTP
Time-to-peak
- 1TCM
One tissue compartment model
- 2CXM
Two compartment exchange model
- 2TCM
Two tissue compartment model
Authors’ contributions
CD, RF, MN, KMH and AA participated in design and supervision of the project. CD and RF implemented the software. CD analyzed the data. MI and IK provided background knowledge on DCE MRI. CD and MI collected patient data. MN and KMH supplied the necessary software support for MITK. CD and RF wrote the manuscript. All authors read and approved the final version of the manuscript.
Ethics approval and consent to participate
Not applicable.
Consent for publication
Not applicable.
Competing interests
The authors declare that they have no competing interests.
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Footnotes
Charlotte Debus and Ralf Floca Shared first-authors
Charlotte Debus and Ralf Floca contributed equally to this work.
Contributor Information
Charlotte Debus, Phone: +49 6221 6538281, Email: c.debus@dkfz-heidelberg.de.
Ralf Floca, Phone: + 49 6221 42 2560, Email: r.floca@dkfz-heidelberg.de.
Michael Ingrisch, Email: michael.ingrisch@med.uni-muenchen.de.
Ina Kompan, Email: i.kompan@dkfz-heidelberg.de.
Klaus Maier-Hein, Email: k.maier-hein@dkfz-heidelberg.de.
Amir Abdollahi, Email: a.amir@dkfz-heidelberg.de.
Marco Nolden, Email: m.nolden@dkfz-heidelberg.de.
References
- 1.Taylor AJ, Salerno M, Dharmakumar R, Jerosch-Herold M. T1 Mapping: Basic Techniques and Clinical Applications. JACC Cardiovasc Imaging. 2016;9:67–81. doi: 10.1016/j.jcmg.2015.11.005. [DOI] [PubMed] [Google Scholar]
- 2.Le Bihan D. Looking into the functional architecture of the brain with diffusion MRI. Nat Rev Neurosci. 2003;4:469–480. doi: 10.1038/nrn1119. [DOI] [PubMed] [Google Scholar]
- 3.Jones KM, Pollard AC, Pagel MD. Clinical applications of chemical exchange saturation transfer (CEST) MRI. J Magn Reson Imaging JMRI. 2018;47:11–27. doi: 10.1002/jmri.25838. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Phelps ME. PET: Molecular Imaging and Its Biological Applications. New York: Springer New York; 2004. [Google Scholar]
- 5.Morris ED, Endres CJ, Schmidt KC, Christian BT, Muzic RF, Fisher RE. Emiss Tomogr Fundam PET SPECT Acad San Diego. 2004. Kinetic modeling in positron emission tomography. [Google Scholar]
- 6.Sourbron SP, Buckley DL. Tracer kinetic modelling in MRI: estimating perfusion and capillary permeability. Phys Med Biol. 2012;57:269–276. doi: 10.1088/0031-9155/57/2/R1. [DOI] [PubMed] [Google Scholar]
- 7.Ingrisch M, Sourbron S. Tracer-kinetic modeling of dynamic contrast-enhanced MRI and CT: a primer. J Pharmacokinet Pharmacodyn. 2013;40:281–300. doi: 10.1007/s10928-013-9315-3. [DOI] [PubMed] [Google Scholar]
- 8.Khalifa F, Soliman A, El-Baz A, Abou El-Ghar M, El-Diasty T, Gimel’farb G, et al. Models and methods for analyzing DCE-MRI: a review. Med Phys. 2014;41:124301. doi: 10.1118/1.4898202. [DOI] [PubMed] [Google Scholar]
- 9.Sourbron S. Technical aspects of MR perfusion. Eur J Radiol. 2010;76:304–313. doi: 10.1016/j.ejrad.2010.02.017. [DOI] [PubMed] [Google Scholar]
- 10.Ingrisch M, Sourbron S, Morhard D, Ertl-Wagner B, Kümpfel T, Hohlfeld R, et al. Quantification of perfusion and permeability in multiple sclerosis: dynamic contrast-enhanced MRI in 3D at 3T. Invest Radiol. 2012;47:252–258. doi: 10.1097/RLI.0b013e31823bfc97. [DOI] [PubMed] [Google Scholar]
- 11.Ledsam JR, Hodgson R, Moots RJ, Sourbron SP. Modeling DCE-MRI at low temporal resolution: A case study on rheumatoid arthritis. J Magn Reson Imaging. 2013;38:1554–1563. doi: 10.1002/jmri.24061. [DOI] [PubMed] [Google Scholar]
- 12.Kassner A, Roberts T, Taylor K, Silver F, Mikulis D. Prediction of Hemorrhage in Acute Ischemic Stroke Using Permeability MR Imaging. Am J Neuroradiol. 2005;26:2213–2217. [PMC free article] [PubMed] [Google Scholar]
- 13.The MathWorks, Inc. MATLAB - MathWorks. https://de.mathworks.com/. Accessed 10 July 2018.
- 14.The R Foundation. R: The R Project for Statistical Computing. https://www.r-project.org/. Accessed 10 July 2018.
- 15.Markwardt CB. Non-linear Least Squares Fitting in IDL with MPFIT. ArXiv09022850 Astro-Ph. 2009. http://arxiv.org/abs/0902.2850. Accessed 6 Feb 2017.
- 16.Huang W, Li X, Chen Y, Li X, Chang M-C, Oborski MJ, et al. Variations of Dynamic Contrast-Enhanced Magnetic Resonance Imaging in Evaluation of Breast Cancer Therapy Response: A Multicenter Data Analysis Challenge. Transl Oncol. 2014;7:153–166. doi: 10.1593/tlo.13838. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Siemens. Tissue 4D. https://www.healthcare.siemens.de/magnetic-resonance-imaging/options-and-upgrades/clinical-applications/tissue-4d. Accessed 6 Feb 2017.
- 18.Philips Healthcare. IntelliSpace Portal 8.0. https://www.philips.de/healthcare/resources/landing/intellispace-portal-enterprise. Accessed 26 June 2017.
- 19.NordicNeuroLab AS. nordicICE. http://www.nordicneurolab.com/products/nordicICE.html. Accessed 20 Feb 2018.
- 20.Olea Medical. Olea Sphere 3.0. Olea medical. http://www.olea-medical.com/en/olea-sphere-3-0/. Accessed 20 Feb 2018.
- 21.Beuzit L, Eliat P-A, Brun V, Ferré J-C, Gandon Y, Bannier E, et al. Dynamic contrast-enhanced MRI: Study of inter-software accuracy and reproducibility using simulated and clinical data. J Magn Reson Imaging. 2016;43:1288–1300. doi: 10.1002/jmri.25101. [DOI] [PubMed] [Google Scholar]
- 22.Cron GO, Sourbron S, Barnoriak DP, Abdeen R, Hogan M, Nguyen TB. Milan: Proceedings in Internaltional Conference for Magnetic Resonance in Medicine. 2014. Bias and precision of three different DCE-MRI analysis software packages: a comparison using simulated data. [Google Scholar]
- 23.Goh V, Schaeffter T, Leach M. Reproducibility of Dynamic Contrast-enhanced MR Imaging: Why We Should Care. Radiology. 2013;266:698–700. doi: 10.1148/radiol.12122447. [DOI] [PubMed] [Google Scholar]
- 24.Barnes SR, Ng TSC, Santa-Maria N, Montagne A, Zlokovic BV, Jacobs RE. ROCKETSHIP: a flexible and modular software tool for the planning, processing and analysis of dynamic MRI studies. BMC Med Imaging. 2015;15:19. doi: 10.1186/s12880-015-0062-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.Ferl GZ. DATforDCEMRI: An R Package for Deconvolution Analysis and Visualization of DCE-MRI Data. J Stat Softw. 2011;44. 10.18637/jss.v044.i03.
- 26.Ortuño JE, Ledesma-Carbayo MJ, Simões RV, Candiota AP, Arús C, Santos A. DCE@urLAB: a dynamic contrast-enhanced MRI pharmacokinetic analysis tool for preclinical data. BMC Bioinformatics. 2013;14:316. doi: 10.1186/1471-2105-14-316. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27.Smith DS, Li X, Arlinghaus LR, Yankeelov TE, Welch EB. DCEMRI.jl: a fast, validated, open source toolkit for dynamic contrast enhanced MRI analysis. PeerJ. 2015;3:e909. doi: 10.7717/peerj.909. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.Sourbron, Biffar, Ingrisch. PMI:platform for research in medical imaging. In: Magnetic Resonance Materials in Physics, Biology and Medicine. 2009.
- 29.Sung K. DCE_Tool. http://kyungs.bol.ucla.edu/software/DCE_tool/DCE_tool.html. Accessed 6 Feb 2017.
- 30.Welch EB. pydcemri: Python module for processing dynamic contrast enhanced magnetic resonance imaging (DCE-MRI) data. Python. 2017. https://github.com/welcheb/pydcemri. Accessed 30 Apr 2018.
- 31.Zöllner FG, Weisser G, Reich M, Kaiser S, Schoenberg SO, Sourbron SP, Schad LR. UMMPerfusion: an open source software tool towards quantitative MRI perfusion analysis in clinical routine. J Digit Imaging. 2013;26(2):344-52. [DOI] [PMC free article] [PubMed]
- 32.Whitcher B, Schmid VJ. others. Quantitative analysis of dynamic contrast-enhanced and diffusion-weighted magnetic resonance imaging for oncology in R. J Stat Softw. 2011;44:1–29. [Google Scholar]
- 33.Rosset A, Spadola L, Ratib O. OsiriX: an open-source software for navigating in multidimensional DICOM images. J Digit Imaging. 2004;17:205–216. doi: 10.1007/s10278-004-1014-6. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34.Kikinis R, Pieper SD, Vosburgh KG. 3D Slicer: A Platform for Subject-Specific Image Analysis, Visualization, and Clinical Support. In: Intraoperative Imaging and Image-Guided Therapy. New York: Springer; 2014. p. 277–89. 10.1007/978-1-4614-7657-3_19.
- 35.Miller J. PkModeling: Slicer Extension providing pharmacokinetic modeling. C++. 2018. https://github.com/millerjv/PkModeling. Accessed 7 May 2018.
- 36.Nolden M, Zelzer S, Seitel A, Wald D, Müller M, Franz AM, et al. The Medical Imaging Interaction Toolkit: challenges and advances. Int J Comput Assist Radiol Surg. 2013;8:607–620. doi: 10.1007/s11548-013-0840-8. [DOI] [PubMed] [Google Scholar]
- 37.Ahearn TS, Staff RT, Redpath TW, Semple SIK. The use of the Levenberg–Marquardt curve-fitting algorithm in pharmacokinetic modelling of DCE-MRI data. Phys Med Biol. 2005;50:N85. doi: 10.1088/0031-9155/50/9/N02. [DOI] [PubMed] [Google Scholar]
- 38.Moré, Jorge. The Levenberg-Marquardt algorithm: implementation and theory. 1978.
- 39.Broyden CG. The Convergence of a Class of Double-rank Minimization Algorithms 1. General Considerations. IMA J Appl Math. 1970;6:76–90. doi: 10.1093/imamat/6.1.76. [DOI] [Google Scholar]
- 40.Fletcher R. A new approach to variable metric algorithms. Comput J. 1970;13:317–322. doi: 10.1093/comjnl/13.3.317. [DOI] [Google Scholar]
- 41.Goldfarb D. A family of variable-metric methods derived by variational means. Math Comput. 1970;24:23–26. doi: 10.1090/S0025-5718-1970-0258249-6. [DOI] [Google Scholar]
- 42.Debus C, Floca R, Nörenberg D, Abdollahi A, Ingrisch M. Impact of fitting algorithms on errors of parameter estimates in dynamic contrast enhanced MRI. Phys Med Biol. 2017. 10.1088/1361-6560/aa8989. [DOI] [PubMed]
- 43.Krasner GE, Pope STA. Cookbook for Using the Model-view Controller User Interface Paradigm in Smalltalk-80. J Object Oriented Program. 1988;1:26–49. [Google Scholar]
- 44.Zöllner FG, Daab M, Sourbron SP, Schad LR, Schoenberg SO, Weisser G. An open source software for analysis of dynamic contrast enhanced magnetic resonance images: UMMPerfusion revisited. BMC Med Imaging. 2016;16:7. doi: 10.1186/s12880-016-0109-0. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 45.Ibanez L, Schroeder W, Ng L, Cates J. The ITK Software Guide. 2003. http://insight-journal.org/midas/item/view/948. Accessed 19 Feb 2018.
- 46.O’Connor JPB, Jackson A, Parker GJM, Jayson GC. DCE-MRI biomarkers in the clinical evaluation of antiangiogenic and vascular disrupting agents. Br J Cancer. 2007;96:189–195. doi: 10.1038/sj.bjc.6603515. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 47.O’Connor JPB, Tofts PS, Miles KA, Parkes LM, Thompson G, Jackson A. Dynamic contrast-enhanced imaging techniques: CT and MRI. Br J Radiol. 2011;84(special_issue_2):S112–S120. doi: 10.1259/bjr/55166688. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 48.DiStefano JJ. Noncompartmental vs. compartmental analysis: some bases for choice. Am J Physiol - Regul Integr Comp Physiol. 1982;243:R1–R6. doi: 10.1152/ajpregu.1982.243.1.R1. [DOI] [PubMed] [Google Scholar]
- 49.Riviere JE. Comparative Pharmacokinetics: Principles, Techniques and Applications: Wiley; 2011. 10.1002/9780470959916.
- 50.Brix G, Semmler W, Port R, Schad LR, Layer G, Lorenz WJ. Pharmacokinetic parameters in CNS Gd-DTPA enhanced MR imaging. J Comput Assist Tomogr. 1991;15:621–628. doi: 10.1097/00004728-199107000-00018. [DOI] [PubMed] [Google Scholar]
- 51.Parker GJM, Roberts C, Macdonald A, Buonaccorsi GA, Cheung S, Buckley DL, et al. Experimentally-derived functional form for a population-averaged high-temporal-resolution arterial input function for dynamic contrast-enhanced MRI. Magn Reson Med. 2006;56:993–1000. doi: 10.1002/mrm.21066. [DOI] [PubMed] [Google Scholar]
- 52.Sokoloff L, Reivich M, Kennedy C, Des Rosiers MH, Patlak CS, Pettigrew KD, et al. The [14C] deoxyglucose method for the measurement of local cerebral glucose utilization: theory, procedure, and normal values in the conscious and anesthetized albino rat. J Neurochem. 1977;28:897–916. doi: 10.1111/j.1471-4159.1977.tb10649.x. [DOI] [PubMed] [Google Scholar]
- 53.Phelps ME, Huang SC, Hoffman EJ, Selin C, Sokoloff L, Kuhl DE. Tomographic measurement of local cerebral glucose metabolic rate in humans with (F-18)2-fluoro-2-deoxy-D-glucose: validation of method. Ann Neurol. 1979;6:371–388. doi: 10.1002/ana.410060502. [DOI] [PubMed] [Google Scholar]
- 54.Langen K-J, Hamacher K, Weckesser M, Floeth F, Stoffels G, Bauer D, et al. O-(2-[18F]fluoroethyl)-l-tyrosine: uptake mechanisms and clinical applications. Nucl Med Biol. 2006;33:287–294. doi: 10.1016/j.nucmedbio.2006.01.002. [DOI] [PubMed] [Google Scholar]
- 55.Wester HJ, Herz M, Weber W, Heiss P, Senekowitsch-Schmidtke R, Schwaiger M, et al. Synthesis and Radiopharmacology of O-(2-[18F]fluoroethyl)-L-Tyrosine for Tumor Imaging. J Nucl Med. 1999;40:205–212. [PubMed] [Google Scholar]
- 56.CommonTK Command Line Interface. http://www.commontk.org/index.php/Documentation/Command_Line_Interface. Accessed 16 Nov 2018.
- 57.Butterworth E, Jardine BE, Raymond GM, Neal ML, Bassingthwaighte JB. JSim, an open-source modeling system for data analysis. F1000Research. 2014. 10.12688/f1000research.2-288.v3. [DOI] [PMC free article] [PubMed]
- 58.Radiological Society of North America. Quantitative Imaging Biomarkers Alliance (QIBA). https://www.rsna.org/QIBA/. Accessed 23 May 2018.
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Data Availability Statement
The software and the validation dataset generated during the current study are available under http://mitk.org/wiki/MITK-ModelFit