Abstract
Population pharmacokinetic and pharmacokinetic−pharmacodynamic (PKPD) modelling has been widely used in clinical research. Yet, its application in the evaluation of cardiovascular safety remains limited, particularly in the evaluation of pro-arrhythmic effects. Here we discuss the advantages of disadvantages of population PKPD modelling and simulation, a paradigm built around the knowledge of the concentration−effect relationship as the basis for decision making in drug development and its utility as a guide to drug safety. A wide-ranging review of the literature was performed on the experimental protocols currently used to characterize the potential for QT interval prolongation, both pre-clinically and clinically. Focus was given to the role of modelling and simulation for design optimization and subsequent analysis and interpretation of the data, discriminating drug from system specific properties. Cardiovascular safety remains one of the major sources of attrition in drug development with stringent regulatory requirements. However, despite the myriad of tests, data are not integrated systematically to ensure accurate translation of the observed drug effects in clinically relevant conditions. The thorough QT study addresses a critical regulatory question but does not necessarily reflect knowledge of the underlying pharmacology and has limitations in its ability to address fundamental clinical questions. It is also prone to issues of multiplicity. Population approaches offer a paradigm for the evaluation of drug safety built around the knowledge of the concentration−effect relationship. It enables quantitative assessment of the probability of QTc interval prolongation in patients, providing better guidance to regulatory labelling and understanding of benefit/risk in specific populations.
Keywords: cardiovascular safety, clinical trial simulations, drug development, ICH E14, PKPD modelling, QTc interval prolongation
Introduction
Predicting the cardiac safety risk of drugs in the general population in a strictly quantitative manner is technically challenging. Drug trials conducted in the pre-marketing period are often designed sub-optimally to detect adverse drug reactions (ADRs) such as cardiac arrhythmias [1], which may show low incidence or display a signal which may go undetected during treatment. Two key regulatory guidelines exist which delineate the strategy by which cardiac safety is assessed during drug development. The first focuses on the preclinical evaluation of cardiac pro-arrhythmic risk [2], whereas the second on the requirements for the evaluation of pro-arrhythmic risk in humans [3]. Despite the concern about the pro-arrhythmic properties of drugs and its impact on cardiovascular safety, little has been done to promote the assessment of causality, i.e. drug-relatedness during the evaluation of QTc interval prolongation. According to the ICH-E14, drug-induced effects are defined statistically rather than pharmacologically in that the effect size is determined relative to placebo after correction for differences in baseline. The approach assesses drug effects as a discrete variable, preventing direct inferences from underlying pharmacokinetic−pharmacodynamic (PKPD) relationships [4].
Improved decision-making during drug development relies on the availability of appropriate evidence of efficacy and safety prior to the approval process. Here we do not delve into further discussions about whether QTc prolongation or baseline QT values are the best predictors of arrhythmic events and cardiovascular risk [5,6]. It has been demonstrated that not all drugs that prolong the QT interval to the same amount carry the same risk of inducing torsade de pointes (TdP) and TdP itself does not occur in all subjects with the same prolongation of the QT interval [7,8]. Nevertheless, it should be clear to readers that the current practice is based on the assumption that increase ≥10 ms relative to baseline QT interval is potentially predictive of specific ADRs, such as TdP and has labelling implications for drugs. Irrespective of the prognostic value of the aforementioned measures, achieving a better understanding of the concentration−effect relationship on specific safety parameters, including the QT interval, is particularly beneficial since this can support further evaluation of causality. In this context, it has been shown that PKPD relationships can provide clinically valuable information for drug developers, regulators and clinicians [9,10]. In this review, we explore the advantages and disadvantages of population approaches to determining the QTc prolongation potential of novel compounds in clinical development and provide an overview of the requirements for systematic use of clinical trial simulations for the evaluation of drug effects on QTc interval. For the sake of clarity, methodological, pharmacological and clinical aspects are discussed separately.
The physiological and pharmacological basis of pro-arrhythmic effects
The QT interval represents the duration of the ventricular action potential in normal sinus rhythm and normal values are dependent on the resting heart rate (described by the RR interval). Higher heart rates are associated with a shorter QT interval and as such a correction factor has to be applied to numerically describe the QT interval accurately, referred to as the corrected QT interval (QTc) [11,12]. The evaluation of a drug's potential to prolong the QTc is relevant because TdP requires prolongation of the QT interval as an antecedent event (Figure 1). QTc therefore remains the only clinical surrogate for torsadogenicity, even though QT interval prolongation itself is not necessarily harmful [13]. In addition, TdP undergoes morphological evolution, degrading into ventricular fibrillation in about 20% of cases. As a result cardiac arrest or sudden death become potential outcomes with mortality estimates in the region of 10% [14]. The potential clinical problem is not just related to cardiovascular drugs. A review of the FDA safety database over 30 years revealed 2194 cases of which the most common agents were cardiac drugs (26.2%), CNS drugs (21.9%) and anti-infective agents (19.0%). Moreover, 11.7% were determined to be associated with drug interactions [14].
Current approaches to cardiac safety evaluation
Historically, the identification of a compound's propensity to induce TdP has been elucidated through experimentation using empirical protocols or by inference from knowledge about class effects. More recently guidance has been provided from regulatory agencies which outlines the strategy for the evaluation of QTc prolongation, arguably the most significant of which is the ICH E14. Since then the evaluation of the potential for torsadogenicity during clinical development has been centred on the thorough QT (TQT) study. The TQT study is designed to detect (and ideally rule out) small changes in the QTc interval. It is usually a double-blind, double-dummy design consisting of three arms, the investigational product, placebo and an active control (e.g. moxifloxacin), which is included in order to demonstrate assay sensitivity. An active comparator is sometimes employed if a drug exists in the same class that has a known QT prolongation effect. The study drug is investigated at therapeutic (usually highest therapeutic dose) and supra-therapeutic doses. In addition, heart rate effects on QTc interval are characterized using Bazett's and Fridericia's correction factors under the assumption that these are sufficiently robust to account for interindividual differences. From a clinical and pharmacological perspective, the crux of the problem is that the primary analysis of a TQT study is based on the ‘double-delta’ method [15]. The approach relies on the assessment of the upper bound of the 95% one-sided confidence interval for the largest time-matched mean treatment effect on the QTc interval. The results must exclude a 10 ms increase in QTc interval if the drug is to be deemed safe, i.e. a negative study. In fact, the one-sided 95% confidence interval should exclude an effect of >10 ms for every single measurement. Whereas this is thought to be the most suitable approach, it can lead to multiplicity issues and positive bias [16,17]. Clearly, an important limitation of the proposed double-delta method is the absence of concentration−QT relationships. Indeed, the role of exposure−response analysis as a tool to interpret QT data from TQT studies has been recently highlighted by academic and regulatory experts [18]. From a scientific perspective, it means that any regulatory review of QT study based on the evidence gathered in such a trial does not fully address the issue of causality, providing a clear, quantifiable measure of risk. This issue is very well illustrated by the clinical data collected during the TQT study for sitagliptin (Figure 2).
Advantages and limitations of PKPD relationships when assessing QT interval prolongation
Since drugs that prolong the QTc interval have been shown to do so in a concentration-dependent manner [19,20], understanding of the underlying concentration−effect relationship for QTc prolongation opens up the potential to explore causality and to discriminate drug effects from other sources of variability, something that standard methods and experimental protocols are unable to do adequately [21]. Moreover it is possible to establish correlations between the PKPD relationships across species (Figure 3). By contrast, the TQT study addresses a critical regulatory question and advantageously relies on very few assumptions. However, it does not reflect knowledge of the underlying pharmacology and has limitations in its ability to address some fundamental clinical questions. The E14 guidance itself identifies the potential advantages of establishing the relationships between plasma drug concentrations and QTc changes, but the proposed methodology is rather rudimentary. Given that drug concentration data are routinely collected during the TQT study, there has been, however, increasing acceptance by regulatory agencies of the value of additional analysis based on the concentration−QT effect relationship [18]. One example of this is the case of the muscarinic receptor antagonist imidafenacin for overactive bladder. It was approved in Japan at doses of 0.1 mg twice daily in 2007, i.e. prior to implementation of ICH E14 guidance. In order to update the labelling to include doses of 0.2 mg a long term dose escalation study using the same population as the pivotal phase 3 trial was conducted. A population pharmacokinetic model was updated using data from 90 healthy volunteers and 852 patients across nine clinical studies including the new dosing data. QTc data before treatment and at relevant time points post-dose generated 1103 measurements which were used for a concentration−QT analysis. No concentration dependent QTc prolongation relationship was observed and the data were used to form part of the labelling update package [22].
From a clinical perspective, assessing the risk of drug induced TdP, a relatively rare event, by delineating the frequency and duration of QT interval prolongation at supratherapeutic doses in a very small number of relatively healthy subjects is limiting and not as useful as characterizing how changes in the drug exposure alter the QT interval. Patients with co-morbidities, particularly cardiac ones, are often excluded from these studies, as are females and the elderly. Such populations are known to have different QT dynamic properties and clinical risk levels [23]. These studies also exclude subjects with pharmacological or physiological predisposing factors to adverse events such as patients receiving drugs with a propensity for drug−drug interactions or patients with electrolyte imbalances. As such, clinically relevant extrinsic determinants of variability are not accounted for, limiting therefore the ability to generalize the findings in a TQT study to real-life conditions. Furthermore, the TQT study relies on demonstrating a change in the QTc interval of less than 10 ms across all sampling times during the course of the intervention, despite lack of evidence for a strict correlation between a 10 ms prolongation and fatal arrhythmia [24].
In relation to general issues of study design and analysis, it should be noted that the TQT study depends on the detection of small changes in the QTc interval using supratherapeutic drug doses. Such an approach may be prone to high false positive rates and biased estimates [25]. The extent to which bias occurs is variable and can be affected by the study design (particularly in parallel trial designs which have inherent large variability), sample size and patient characteristics [4,26]. Consequently, adequate powering for some TQT study designs often results in very large and expensive trials.
A regulatory dilemma therefore exists since a false positive could result in cessation of development or inappropriately restrictive labelling of a drug. Alternatively, the change may be drug-induced but inappropriately ascribed to a spontaneous variation when in fact a serious hazard may exist [27]. Issues of multiplicity also exist by virtue of the analysis requiring an exclusion of a >10 ms time difference at multiple time points. In fact, it is known that increasing the number of time points, increases the false positive rate when the recommended intersection union test (IUT) is used [25]. In addition, one needs to assume comparable drug effects in healthy subjects and in the target patient population, which may not be necessarily appropriate.
Despite the advantages of the PKPD modelling, the approach can have some important limitations. The major constraints are often related to experimental design. Typical TQT protocols are not optimized to enable the assessment of exposure−response relationships and therefore, to allow one to establish correlations between drug concentrations and QTc interval prolongation. One of the main implications of such a shortcoming is the biased estimation of the pro-arrhythmic effect [25]. This is particularly important if the causal agent(s) are the metabolites, rather than the parent drug. Similarly, time-dependent changes in ion channel expression on cardiac tissue may lead to altered response over time, which may not correlate directly with drug exposure. Such limitations can be overcome by careful consideration of the modelling requirements and assumptions. Population PKPD modelling can be performed using data from multiple studies, yielding more relevant information than traditional random effects meta-analyses.
Another limitation is the variability in QTc measurement and the potential role of covariates, such as demographic characteristics (e.g. gender, ethnicity) [26,28] and disease conditions [29], which can become important confounders when looking for drug-induced changes of around 10 ms. Whereas the efficiency of PKPD-guided designs can been demonstrated theoretically, these issues still represent an obstacle for the implementation of clinical protocols. These points are briefly discussed in the next paragraphs.
Methodological considerations on the use of PKPD modelling
Defining exposure-response relationships in a quantitative manner is central to utilizing experimental data in a way that informs or enhances decision making in drug development and clinical practice [30]. Population PKPD modelling approaches have evolved as a tool to support evidence generation and facilitate the interpretation of experimental data as well as explore hypothetical or extreme conditions, which would not be desirable, necessary or ethical in humans. However, in contrast to the wide range of applications in which efficacy has been evaluated [31–33], the use of population approaches for the systematic characterization of QT interval prolongation remains limited. This is partly explained by the focus of the TQT study on hypothesis testing using a frequentist statistical approach. More than ever, there is clear need for methodological approaches that provide mechanistic insight, rather than simply support statistical inference [10].
From a scientific perspective, one of the major shortcomings in the TQT study is the assessment of drug effects as a discrete, rather than a continuous measure. Nominal doses are used instead of exposure, making the clinical interpretation of pro-arrhythmic risk difficult. On the contrary, population models allow for the integration of data from measurements of all time points and across treatment groups. It also enables one to predict drug effects for clinical scenarios in which the exposure may be different from those observed in a controlled trial, e.g. drug−drug interactions and certain co-morbid conditions, i.e. in situations where metabolic clearance is altered [34]. For drugs with highly variable pharmacokinetics, such a method has enormous clinical value [25].
There are a few published studies exploring the use of PKPD models on QTc interval prolongation [26,35–37]. Yet, despite their findings, such knowledge has not been systematically used to translate drug effects into labelling recommendations with regard to dose selection and benefit−risk for specific subgroups or populations. One example is that of ranolazine, a drug used for chronic angina. A population modelling approach utilized data pooled from 18 clinical studies. A linear model was used to characterize the concentration–effect relationship and it was found that the QTc interval increased by 2.6 ms per mg ml−1 of drug. A sub-analysis of patients with mild to moderate hepatic impairment revealed an increase of 7.1 ms per mg ml−1 of drug. The labelling of ranolazine utilized these data as the basis for contraindicating its use in patients with clinically significant hepatic failure [18]. More so, the knowledge of the PKPD relationship allows the risk to be communicated in a way that is relevant to clinicians. Since ranolazine has large between-subject variability in drug concentrations, the population distribution of pharmacokinetic data enabled the concentration−QT relationship to be expressed as a probability of prolonging the QTc interval in the general population as well as special groups. This has a different clinical utility than merely characterizing the maximum mean change in QTc interval at clinical and/or supratherapeutic doses.
Special cases also exist whereby a more detailed understanding of the PKPD relationship can help with understanding the implications for drug development and subsequent planning. An example of this is when a drug shows intrinsic chronotropic effect. It is essential to be able disentangle the effects on the heart rate from the heart rate correction applied (using the various formulae) for calculation of the QTc interval if the effect on cardiac conduction is to be characterized accurately.
It should be noted, however, that from a conceptual point of view, the risk associated with a novel therapeutic agent cannot be delineated unless the drug-specific and system-specific parameters are distinguished. As such, the quantitative assessment of PKPD relationships using model-based techniques is central to discriminating drug effects from other sources of variability. In fact, this concept has been recently illustrated by the use of an integrated Bayesian approach in which drug-specific parameters were describe separately from other system variables such as heart rate and circadian rhythm [15]. An important feature of the aforementioned approach is the possibility to incorporate prior knowledge regarding system-specific parameters and thereby optimize experimental protocol design. This approach also enables the prediction of the required exposure to induce a clinically relevant increase in the QTc interval.
Statistical concepts in modelling and simulation
Whereas a detailed technical discussion of the methodologies currently available for the assessment of PKPD relationships is beyond the scope of this review, a few important concepts underpinning model identification and parameter estimation are summarized below. They are meant to provide the reader with further understanding of the opportunities and limitations associated with the use of hierachical (population) models.
Non-linear hierarchical modelling
In recent years, the use of hierarchical models has increased considerably as a tool for the characterization of exposure−response relationships and other medical applications [38]. The key difference between classical statistical testing and model-based approaches is the possibility to explore and explain variability in a physiologically and clinically plausible manner. Moreover, when applied in conjunction with Bayesian methodologies, estimates can be obtained which allow direct interpretation of probability. The statistical reasoning behind this is that traditional statistics relies on the likelihood, i.e. the probability of observing the data given a range of parameter values. Bayesian statistics, however, rely on the posterior distribution, which is the distribution of the parameters (i.e. parameter space) given the observed data [31]. Another important aspect of the application of hierarchical (population) models is the focus on the population rather than the individual as the object of the investigation. The approach is particularly suitable when information on individual subjects is limited. Regardless of the density of the data, population models describing concentration−effect relationships should be considered an ideal tool to translate between species (i.e. non-clinical to clinical data) and between clinical trials and the real life population. Lastly, it should be noted that the availability of hierarchical models offers an important opportunity as a study optimization tool (e.g. dose selection, sampling times, treatment duration and population size). These models can also be used to support prediction and extrapolation of data across different age groups, dosing regimens and formulations or delivery forms. Moreover, population models may enable extrapolation of long term efficacy and safety based on short term pharmacokinetic and treatment response data.
Clinical trial simulations
In contrast to meta-analysis, clinical trial simulation (CTS) allows for the investigation of the impact of a range of design characteristics on the power to detect a treatment effect prior to exposing patients to an experimental drug. In a field where most clinical trials have a conservative design, this methodology offers a unique opportunity to evaluate innovative designs. Rather than performing power calculations which only take sample size and endpoint variability into account, CTS allows calculation of power taking into account a multitude of other factors [39]. In general, CTS utilizes two types of model. First, a drug−action (PKPD) model is considered, which comprises pharmacokinetic and pharmacodynamic factors. In chronic diseases the model also accounts for disease progression (Figure 4). Unfortunately, the lack of knowledge about the mechanisms underlying treatment response in many therapeutic indications has prevented the development of mechanistic models. Hence, examples often refer to standard statistical models, such as, for example, the mixed model for repeated measures (MMRM). Such statistical models have, however, a downside in that they often do not incorporate concentration−effect relationships. Secondly, CTS requires a trial execution model. These models simulate other important aspects of the trial, such as dropout, compliance and protocol deviations. Thereby, one can determine all possible outcomes under candidate trial designs, allowing different trial designs to be compared in a strictly quantitative manner. Thus far, very few examples exist in which relevant design factors have been evaluated prospectively as part of the planning of a cardiovascular safety trial.
It is also important to stress that CTS allows investigation of factors that cannot be scrutinized by meta-analysis or empirical design. First, designs which have not been implemented cannot be included in a meta-analysis. Second, it is difficult to separate the influence of multiple design factors, whereas CTS allows evaluation of a single factor at a time. Although meta-analyses may provide valuable information about differences in patient populations and treatment response, it is unfortunate that many investigators consider overall publication review sufficient to gather evidence on the role of design factors, as often suggested in the discussion of meta-analysis results.
If simulated data is to be exchangeable with actual patient data, it is imperative that not only model parameters are unbiased, but that estimates of variability are also accurate. Often interpretation of statistical model results focuses on the predicted values of the treatment effect. This does not necessarily mean that response distributions reflect what occurs in the true patient population. In fact, it is not infrequent to see model misspecifications being corrected by inflated estimates of variability. It is therefore critical for clinicians to understand that standard goodness-of-fit criteria do not take simulation characteristics into account and may therefore not be indicative of the best model. A comparison between simulated and original data can be performed using graphical and statistical tools.
CTS relies on the availability of accurate model parameter and corresponding distributions to investigate ‘what if’ scenarios across a different range of conditions or design features, such as population size, stratification levels, dose range, sampling scheme, and even different endpoints. One of the main advantages of such a virtual or statistical experiment is the possibility to predict ‘trial performance’ and so to identify potential limitations in study and protocol design prior to its implementation and decide if the trial should be performed. In fact, some clinical trial simulations have been evaluated against outcomes from real trials.
Population PKPD modelling and simulation as a tool for integration of safety data during drug development
A major limitation with most models is that they only provide a description of the PKPD relationship. They do not indicate whether development of the drug should be stopped or continued, or what the associated risks are. In fact, most of the proposed models in the published literature have been used as data analysis methodology. By contrast, we envisage the application of population modelling and simulation as a tool for data integration and decision making (Figure 5). PKPD models can provide the basis for a more comprehensive safety pharmacology evaluation which includes assessment of the drug properties in vivo in non-clinical species as well as in humans, supporting the translation of drug effects across species [40]. Utilizing such approaches may ultimately lead to better decision making in the drug development process [41]. Moreover, population PKPD models can be parameterized in such a way that data can be effectively integrated across different phases of drug development, enabling the assessment of cardiac risk in relevant groups in the target population [42].
PKPD modelling has already proven to add considerable value for informed decision making regarding the safety profile of drug candidates [43,44]. In their recent paper, Parkinson and colleagues investigated and quantified the translational relationship for concentration−QTc response between dogs and humans for different compounds with differing ion channel pharmacology, including one drug that shortens the QTc interval. The study has not only highlighted the role of the dog as a predictive model for humans, but also showed whether the observed responses were independent of the underlying pharmacology [45]. The study demonstrated a similar relationship between dog and human independent of the underlying pharmacology at low free drug concentrations and for changes in the QTc interval up to 10 ms but slight differences at higher exposures. The authors recommended a more detailed mechanism-based model using a wider range of drug classes to confirm the predictive value of the model. In addition to characterizing between species differences, population PKPD modelling can also be used to assess in vitro−in vivo correlations. In a recent publication, clinical QT prolongation has been predicted from hERG data [46], but this might be limited to selective hERG blockers.
Another example is the recent evaluation of cardiovascular safety of losmapimod, in which a population PKPD modelling approach utilizing data from six phase 1 studies was used to gain an early insight into the potential effect of the agent on QTc interval and to explore relevant covariates. The availability of a concentration−effect relationship for QTc interval prolongation enabled the assessment of the probability of observing a QT effect in a TQT study in doses up to 60 mg (i.e. supratherapeutic doses), thereby providing confidence in dose selection for the progression of the development programme [[47] ].
Unfortunately, despite the added value PKPD modelling for the evaluation of concentration−effect relationships, no final consensus has been reached within the regulatory agencies in support of the generation of safety data in an integrated way [20,48]. Guidelines still focus on the availability of a series of discreet, independent studies [2,3]. In contrast to quantitative estimates of the pro-arrhythmic effects at therapeutically relevant levels, the various in vitro and in vivo studies simply provide qualitative data for the progression of the compound into the clinical phase, during which the TQT study is often required as a confirmatory step.
From a translational pharmacology perspective, it should also be mentioned that population models enable the identification of covariate effects and therefore provide quantitative estimates of the contribution of patient-specific characteristics, discriminating them from drug-specific effects [49]. Consequently, it is possible to establish correlations between concentration−response relationships across species.
Yet, publications on interspecies correlations for cardiovascular effects are limited and the relationship of exposure−response across species is not entirely understood [44]. Nevertheless, cross-species scaling of pharmacology in recent examples suggests that allometric scaling of data obtained in pre-clinical models may be suitable to predict not only pharmacokinetics but also drug effects in humans [10,50].
Clearly, the use of modelling and simulation to elucidate differences between species imposes fundamental changes to the way experimental safety data are generated. Current toxicological based approaches using extremely high dose levels do not allow for the evaluation of drug effects at exposure levels that are relevant to the clinical setting. Moreover, pharmacokinetic information is often missing or insufficient to ensure accurate prediction of drug concentrations throughout the course of treatment.
In contrast to the limitations in translating preclinical drug effects to humans, the use of PKPD modelling in early clinical development may allow a reduction in the costs associated with progressing compounds unnecessarily. In fact, early clinical development is often the only stage in drug development in which supra-therapeutic doses are explored, therefore providing a valuable opportunity for quantifying QTc effect at relevant exposure levels. One example of the utility of this approach is the evaluation of simulation scenarios in which individual QT and RR interval profiles are generated for a virtual population of healthy subjects and patients, including profiles of patients who would not typically be included in a TQT study. Such scenarios allow one to assess virtually the liability to QTc interval prolongation across a range of conditions that may not be easily controlled or stratified for in a clinical trial (Figure 6). In this case a dedicated TQT study could be implemented only as a confirmatory step.
From a methodological perspective, models can take into consideration hysteresis and other time-dependent factors affecting the concentration−effect curve, which need to be accounted for to assess accurately the magnitude of drug-induced ECG changes [[51] ]. PKPD modelling can also overcome issues of multiplicity testing. In conjunction with Bayesian statistics, other experimental issues, such as statistical power and sensitivity, can be addressed in a more robust manner [52,53]. Another important aspect of Bayesian statistics in the implementation of population PKPD models is the possibility to use prior information to support parameter estimation. This is a particularly powerful resource when considering so-called system-specific properties and other trial design aspects, e.g. effect size and variability of the positive control. Using MCMC simulations, one can evaluate not only the experimental conditions, but also consider additional scenarios to quantify the contribution and consequences of other factors such as the distribution of baseline values and known covariate effects (e.g. age, gender). An elegant application of these concepts has been illustrated by Friberg et al. who evaluated the implications for QTc interval across a wide range of doses of citalopram [54] (Figure 7).
Lastly, it should be noted that PKPD relationships offer an alternative to some important practical and ethical limitations imposed by rigid study designs. Model-based meta-analysis using individual level patient data can provide evidence on the clinical relevance of drug effects taking into account the underlying differences in protocol and study design. One of the best examples on the use of modelling and simulation to investigate pooled data is the work by Florian et al., who have characterized the pro-arrhythmic effects of methadone in methadone maintenance treatment patients [55]. Their analysis was prompted by the ongoing discussion about the reassessment of the risk of cardiac arrhythmias in methadone users. The authors acknowledge that a thorough QT study with single dose or steady-state dosing of methadone in healthy volunteers is not feasible and that previous attempts to correlate the QT-prolonging effects of methadone with dosage and plasma methadone concentrations were of limited value due to the lack of replicate QT measurements at baseline and at multiple time points after dosing for the same individual (Figure 8). This type of analysis yields important new information and guides health care providers in the safe use of drugs, in particular by highlighting the links between dose, exposure and the risk of QT prolongation.
Opportunities for the characterization of drug-induced effects in clinical practice
Whilst the sensitivity of the proposed data analysis methods has been the subject of debate in numerous publications [56–58], less attention has been paid to the implications of overlooking the underlying concentration−QTc effect relationship and consequently to the availability of supporting evidence for extrapolation of the findings to real life conditions, i.e. post-approval in clinical practice [15,18]. In fact, from a clinical standpoint one should raise questions about the reliability of the inferences made from pre-approval clinical trials. Given the patient population enrolled, the background noise and the relatively low frequency of clinically relevant arrhythmogenic effects, clinical trials may or may not accurately detect the frequency and intensity of QTc interval prolongation in the target population.
Although it may be understandable and desirable to characterize a drug's safety profile by using healthy subjects, inclusion/exclusion criteria can undoubtedly lead to a somewhat biased estimation of the drug effects in the patient population who will receive the treatment after approval. In particular, the exclusion of severely ill subgroups or those with higher risk factors for TdP is usually not factored in a quantitative manner when evaluating clinical trial results. These subgroups include females, elderly subjects, those with predisposed cardiac or non-cardiac diseases associated with diminished repolarization reserve, those with pharmacogenetic defects of drug metabolizing enzymes or pharmacological targets, such as the potassium channels, those susceptible to bradycardia or electrolyte imbalance or those receiving drugs with a potential for pharmacokinetic or pharmacodynamic interactions [59,60]. In addition, little importance has been given to the role of other factors contributing to QTc interval prolongation in the patient population, as compared with the observed drug effect in healthy subjects [30]. Consequently, no formal procedures exist to mitigate the impact of such differences or support the management of cardiovascular risk in the target population.
To address these concerns, Chain et al. [[42] ] have recently proposed the use of imputation procedures together with the predicted concentration−effect relationship to identify the effect of other influential covariates contributing to QTc interval prolongation in patients. In contrast to previous applications of modelling and simulation [61–64], simulations are used to explore the role of design factors that have been omitted or excluded from randomized trials. Using d,l-sotalol as a paradigm compound, the authors introduced the concept of not-in-trial simulations as a tool for the evaluation of QTc interval prolongation in real life conditions (Figure 9). Their findings show that co-morbidities and co-medications can have a significant contribution to the observed QT prolongation in the overall population. The impact of such factors cannot be derived empirically from TQT trials in healthy subjects. From a drug development and risk management perspective, the approach represents a natural extension of ongoing efforts within the pharmaceutical industry to improve safety signal detection [65–67] and can be applied to evaluate special cases even before drug approval.
Conclusions
Clear shortcomings from various aspects of the ICH E14 guideline have been identified that limit its clinical value. The use of population PKPD modelling offers an alternative approach to the evaluation of pro-arrhythmic effects. It is evident that the use of concentration−effect relationships underpins the concept of causality, enabling informed decisions and recommendations to be made to drug developers, regulators, patients and prescribers about safe use of a medicinal product. Similar recommendations cannot be achieved by the currently accepted double-delta method. Moreover, the use of a Bayesian approach shows superior accuracy and precision in predicting actual QTc interval prolongation over the entire time course of observations, not just at discrete time points. Another advantage to using a model-based approach is its ability to integrate information across phases of development, across compounds as well as between different species before embarking on any confirmatory study.
The examples used to illustrate modelling and simulation concepts highlight the need for a new paradigm for the assessment of cardiovascular safety, in which evidence generation does not prevail over the role of evidence synthesis, which is by far more encompassing and informative. Clinical researchers, health care providers, regulatory authorities and policy makers have to realise the implications of experimental design to the generation of evidence under controlled conditions, as in the case of randomised clinical trials. Differences in the patient population during drug evaluation (pre-launch) and clinical use (post-launch) cannot be overlooked. Intrinsic and extrinsic factors or covariates contribute to treatment outcome, which in turn alter, counteract or mitigate drug related effects. Hence, as suggested, there is a gap in the translation of safety findings from non-clinical species to clinical trials to real-life conditions, which must be accounted for in risk management. During clinical development one needs to learn before embarking into confirmatory trials. Therefore, focus should be given to data integration (evidence synthesis) and accurate assessment of the underlying PKPD relationships. In any case, the ability to discriminate between drug- and system-specific parameters will remain critical for the success of a model-based approach.
Competing Interests
Both authors have completed the Unified Competing Interest form at http://www.icmje.org/coi_disclosure.pdf (available on request from the corresponding author) and declare no conflict of interest. There are no financial relationships with any organizations that might have an interest in the submitted work in the previous 3 years and no other relationships or activities that could appear to have influenced the submitted work.
References
- 1.Lasser KE, Allen PD, Woolhandler SJ, Himmerlstein DU, Wolfe SM, Bor DH. Timing of new black box warnings and withdrawals for prescription medications. JAMA. 2002;287:2215–2220. doi: 10.1001/jama.287.17.2215. [DOI] [PubMed] [Google Scholar]
- 2.Guidance for Industry. 2005. E14 clinical evaluation of QT/QTc interval prolongation and proarrythmic potential for non-antiarrythmic drugs.
- 3.ICH S7B guidance. 2005. The non-clinical evaluation of the potential for delayed ventricular repolarization (QT interval prolongation). International Conference on Harmonisation of Technical Requirements for Registration of Pharmaceuticals for Human Use.
- 4.Hutmacher MM, Chapel S, Agin MA, Fleishaker JC, Lalonde RL. Performance characteristics for some typical QT study designs under the ICH E-14 guidance. J Clin Pharmacol. 2008;48:215–224. doi: 10.1177/0091270007311921. [DOI] [PubMed] [Google Scholar]
- 5.Nuttall GA, Eckerman KM, Jacob KA, Pawlaski EM, Wigersma SK, Marienau ME, Oliver WC, Narr BJ, Ackerman MJ. Does low-dose droperidol administration increase the risk of drug-induced QT prolongation and torsade de pointes in the general surgical population? Anesthesiology. 2007;107:531–536. doi: 10.1097/01.anes.0000281893.39781.64. [DOI] [PubMed] [Google Scholar]
- 6.Camm AJ, Pakrashi T, Savelieva I. Sudden cardiac death: risk factors, treatment, and prevention. Dial Cardiovasc Med. 2006;11:175–201. [Google Scholar]
- 7.Roden DM. Drug-induced prolongation of the QT interval. N Engl J Med. 2004;10:1013–1022. doi: 10.1056/NEJMra032426. [DOI] [PubMed] [Google Scholar]
- 8.Yang T, Snyders D, Roden DM. Drug block of I(kr): model systems and relevance to human arrhythmias. J Cardiovasc Pharmacol. 2001;38:737–744. doi: 10.1097/00005344-200111000-00010. [DOI] [PubMed] [Google Scholar]
- 9.Gabrielsson J, Green AR. Quantitative pharmacology or pharmacokinetic pharmacodynamic integration should be a vital component in integrative pharmacology. J Pharmacol Exp Ther. 2009;331:767–774. doi: 10.1124/jpet.109.157172. [DOI] [PubMed] [Google Scholar]
- 10.Danhof M, de Lange EC, Della Pasqua OE, Ploeger BA, Voskuyl RA. Mechanism-based pharmacokinetic-pharmacodynamic (PK-PD) modeling in translational drug research. Trends Pharmacol Sci. 2008;29:186–191. doi: 10.1016/j.tips.2008.01.007. [DOI] [PubMed] [Google Scholar]
- 11.Kovács SJ., Jr The duration of the QT interval as a function of heart rate: a derivation based on physical principles and a comparison to measured values. Am Heart J. 1985;110:872–878. doi: 10.1016/0002-8703(85)90472-7. [DOI] [PubMed] [Google Scholar]
- 12.Garnett CE, Zhu H, Malik M, Fossa AA, Zhang J, Badilini F, Li J, Darpö B, Sager P, Rodriguez I. Methodologies to characterize the QT/corrected QT interval in the presence of drug-induced heart rate changes or other autonomic effects. Am Heart J. 2012;163:912–930. doi: 10.1016/j.ahj.2012.02.023. [DOI] [PubMed] [Google Scholar]
- 13.Salvi V, Karnad DR, Panicker GK, Kothari S. Update on the evaluation of a new drug for effects on cardiac repolarization in humans: issues in early drug development. Br J Clin Pharmacol. 2010;159:34–48. doi: 10.1111/j.1476-5381.2009.00427.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Owens RC, Jr, Ambrose PG. Torsades de pointes associated with fluoroquinolones. Pharmacotherapy. 2002;22:663–668. doi: 10.1592/phco.22.8.663.33201. discussion 668–72. [DOI] [PubMed] [Google Scholar]
- 15.Chain AS, Krudys KM, Danhof M, Della Pasqua O. Assessing the probability of drug-induced QTc-interval prolongation during clinical drug development. Clin Pharmacol Ther. 2011;90:867–875. doi: 10.1038/clpt.2011.202. [DOI] [PubMed] [Google Scholar]
- 16.Boos DD, Hoffman D, Kringle R, Zhang J. New confidence bounds for QT studies. Stat Med. 2007;26:3801–3817. doi: 10.1002/sim.2826. [DOI] [PubMed] [Google Scholar]
- 17.Tsong Y, Shen M, Zhong J, Zhang J. Statistical issues of QT prolongation assessment based on linear concentration modeling. J Biopharm Stat. 2008;18:564–584. doi: 10.1080/10543400801995502. [DOI] [PubMed] [Google Scholar]
- 18.Garnett CE, Beasley N, Bhattaram VA, Jadhav PR, Madabushi R, Stockbridge N, Tornøe CW, Wang Y, Zhu H, Gobburu JV. Concentration-QT relationships play a key role in the evaluation of proarrhythmic risk during regulatory review. J Clin Pharmacol. 2008;48:13–18. doi: 10.1177/0091270007307881. [DOI] [PubMed] [Google Scholar]
- 19.Lin Y-L, Chan K. Pharmacokinetic and pharmacodynamic characterization of non-antiarrhythmic QT-prolonging drugs associated with torsades de pointes. Drug Inf J. 2008;42:211–219. [Google Scholar]
- 20.Darpo B, Garnett C. Early QT assessment – how can our confidence in the data be improved? Br J Clin Pharmacol. 2013;76:642–648. doi: 10.1111/bcp.12068. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Bloomfield D, Krishna R. Commentary on the clinical relevance of concentration/QTc relationships for new drug candidates. J Clin Pharmacol. 2008;48:6–8. doi: 10.1177/0091270007312257. [DOI] [PubMed] [Google Scholar]
- 22.Hasegawa C, Ohno T, Nakade S, Shibakawa K, Miyabe H, Ouchi T, Ogawa M. Population pharmacokinetics and exposure-response relationship of a muscarinic receptor antagonist, imidafenacin. Drug Metab Pharmacokinet. 2013;28:203–212. doi: 10.2133/dmpk.dmpk-12-rg-062. [DOI] [PubMed] [Google Scholar]
- 23.Halámek J, Jurák P, Lipoldová J, Leinveber P. QT/RR coupling and gender differences. Comput Cardiol. 2010;37:365–368. [PMC free article] [PubMed] [Google Scholar]
- 24.Hondeghem LM. QT and TdP. QT: an unreliable predictor of proarrhythmia. Acta Cardiol. 2008;63:1–7. doi: 10.2143/AC.63.1.2025324. [DOI] [PubMed] [Google Scholar]
- 25.Chapel S, Hutmacher MM, Bockbrader H, de Greef R, Lalonde RL. Comparison of QTc data analysis methods recommended by the ICH E14 guidance and exposure-response analysis: case study of a thorough QT study of asenapine. Clin Pharmacol Ther. 2013;89:75–80. doi: 10.1038/clpt.2010.220. [DOI] [PubMed] [Google Scholar]
- 26.Darpo B, Karnad DR, Badilini F, Florian J, Garnett CE, Kothari S, Panicker GK, Sarapa N. Are women more susceptible than men to drug-induced QT prolongation? Concentration−QTc modelling in a phase 1 study with oral rac-sotalol. Br J Clin Pharmacol. 2014;77:522–531. doi: 10.1111/bcp.12201. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27.Shah RR. Drug-induced prolongation of the QT interval: regulatory dilemmas and implications for approval and labelling of a new chemical entity. Fund Clin Pharmacol. 2002;16:147–156. doi: 10.1046/j.1472-8206.2002.00083.x. [DOI] [PubMed] [Google Scholar]
- 28.Shah RR. Drug-induced QT interval prolongation: does ethnicity of the thorough QT study population matter? Br J Clin Pharmacol. 2013;75:347–358. doi: 10.1111/j.1365-2125.2012.04415.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.Li X, Ren H, Xu ZR, Liu YJ, Yang XP, Liu JQ. Prevalence and risk factors of prolonged QTc interval among Chinese patients with type 2 diabetes. Exp Diabetes Res. 2012;2012:234084. doi: 10.1155/2012/234084. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30.Bonate PL, Russell T. Assessment of QTc prolongation for non-cardiac-related drugs from a drug development perspective. J Clin Pharmacol. 1999;39:349–358. doi: 10.1177/00912709922007912. [DOI] [PubMed] [Google Scholar]
- 31.Santen G, van Zwet E, Danhof M, Della Pasqua O. From trial and error to trial simulation I: the importance of model-based drug development for antidepressant drugs. Clin Pharmacol Ther. 2009;86:248–254. doi: 10.1038/clpt.2009.105. [DOI] [PubMed] [Google Scholar]
- 32.Maas HJ, Snelder N, Danhof M, Della Pasqua OE. Prediction of attack frequency in migraine treatment. Cephalalgia. 2008;28:847–855. doi: 10.1111/j.1468-2982.2008.01621.x. [DOI] [PubMed] [Google Scholar]
- 33.Harnisch L, Shepard T, Pons G, Della Pasqua O. Modelling and simulation as a tool to bridge efficacy and safety data in special populations. CPT Pharmacometrics Syst Pharmacol. 2013;2:e28. doi: 10.1038/psp.2013.6. doi: 10.1038/psp.2013.6. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34.Charbit B, Alvarez JC, Dasque E, Abe E, Démolis JL, Funck-Brentano C. Droperidol and ondansetron-induced QT interval prolongation: a clinical drug interaction study. Anesthesiology. 2008;109:206–212. doi: 10.1097/ALN.0b013e31817fd8c8. [DOI] [PubMed] [Google Scholar]
- 35.Läer S, Elshoff JP, Meibohm B, Weil J, Mir TS, Zhang W, Hulpke-Wette M. Development of a safe and effective pediatric dosing regimen for sotalol based on population pharmacokinetics and pharmacodynamics in children with supraventricular tachycardia. J Am Coll Cardiol. 2005;46:1322–1330. doi: 10.1016/j.jacc.2005.06.061. [DOI] [PubMed] [Google Scholar]
- 36.Piotrovsky V. Pharmacokinetic-pharmacodynamic modeling in the data analysis and interpretation of drug-induced QT/QTc prolongation. AAPS J. 2005;7:E609–624. doi: 10.1208/aapsj070363. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37.Grosjean P, Urien S. Moxifloxacin versus placebo modeling of the QT interval. Pharmacokinet Pharmacodyn. 2012;39:205–215. doi: 10.1007/s10928-012-9242-8. [DOI] [PubMed] [Google Scholar]
- 38.Duan JZ. Applications of population pharmacokinetics in current drug labelling. J Clin Pharm Ther. 2007;32:57–79. doi: 10.1111/j.1365-2710.2007.00799.x. [DOI] [PubMed] [Google Scholar]
- 39.Gobburu JVS, Lesko L. Quantitative disease, drug and trial models. Annu Rev Pharmacol Toxicol. 2009;49:291–301. doi: 10.1146/annurev.pharmtox.011008.145613. [DOI] [PubMed] [Google Scholar]
- 40.Chain AS, Dubois VF, Danhof M, Sturkenboom MC, Della Pasqua O Cardiovascular Safety Project Team, TI Pharma PKPD Platform. Identifying the translational gap in the evaluation of drug-induced QTc interval prolongation. Br J Clin Pharmacol. 2013;76:708–724. doi: 10.1111/bcp.12082. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 41.Krishna R. Model-based evaluation of QTc interval risk: an increasing emphasis on early decision making. J Clin Pharmacol. 2009;49:1010–1011. doi: 10.1177/0091270009344086. [DOI] [PubMed] [Google Scholar]
- 42.Chain A, Dieleman J, van Noord C, Hofman A, Stricker B, Danhof M, Sturkenboom M, Della Pasqua O. Not-in-trial simulation I: bridging cardiovascular risk from clinical trials to real life conditions. Br J Clin Pharmacol. 2013;76:964–972. doi: 10.1111/bcp.12151. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 43.Cavero I. Using pharmacokinetic/pharmacodynamic modelling in safety pharmacology to better define safety margins: a regional workshop of the Safety Pharmacology Society. Expert Opin Drug Saf. 2007;6:465–471. doi: 10.1517/14740338.6.4.465. [DOI] [PubMed] [Google Scholar]
- 44.Langdon G, Davis JD, McFadyen LM, Dewhurst M, Brunton NS, Rawal JK, Van der Graaf PH, Benson N. Translational pharmacokinetic-pharmacodynamic modelling; application to cardiovascular safety data for PF-00821385, a novel HIV agent. Br J Clin Pharmacol. 2010;69:336–345. doi: 10.1111/j.1365-2125.2009.03594.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 45.Parkinson J, Visser SA, Jarvis P, Pollard C, Valentin JP, Yates JW, Ewart L. Translational pharmacokinetic-pharmacodynamic modeling of QTc effects in dog and human. J Pharmacol Toxicol Methods. 2013;68:357–366. doi: 10.1016/j.vascn.2013.03.007. [DOI] [PubMed] [Google Scholar]
- 46.Jonker DM, Kenna LA, Leishman D, Wallis R, Milligan PA, Jonsson EN. A pharmacokinetic-pharmacodynamic model for the quantitative prediction of dofetilide clinical QT prolongation from human ether-a-go-go-related gene current inhibition data. Clin Pharmacol Ther. 2005;77:572–582. doi: 10.1016/j.clpt.2005.02.004. [DOI] [PubMed] [Google Scholar]
- 47.Yang S, Beerahee M. Losmapimod concentration-QT relationship in healthy volunteers: meta-analysis of data from six clinical trials. Eur J Clin Pharmacol. 2013;69:1261–1267. doi: 10.1007/s00228-012-1469-1. [DOI] [PubMed] [Google Scholar]
- 48.Darpo B, Nebout T, Sager PT. Clinical evaluation of QT/QTc prolongation and proarrhythmic potential for nonantiarrhythmic drugs: the International Conference on Harmonization of Technical Requirements for Registration of Pharmaceuticals for Human Use E14 guideline. J Clin Pharmacol. 2006;46:498–507. doi: 10.1177/0091270006286436. [DOI] [PubMed] [Google Scholar]
- 49.Fleury A, Lave T, Jonsson F, Schmitt M, Hirkaler G, Polonchuk L, Breidenbach A. A pharmacokinetic-pharmacodynamic model for cardiovascular safety assessment of R1551. J Pharmacol Toxicol Methods. 2010;63:123–133. doi: 10.1016/j.vascn.2010.08.003. [DOI] [PubMed] [Google Scholar]
- 50.Zuideveld KP, Van der Graaf PH, Peletier LA, Danhof M. Allometric scaling of pharmacodynamic responses: application to 5-Ht1A receptor mediated responses from rat to man. Pharm Res. 2007;24:2031–2039. doi: 10.1007/s11095-007-9336-y. [DOI] [PubMed] [Google Scholar]
- 51.Ollerstam A, Visser SA, Persson AH, Eklund G, Nilsson LB, Forsberg T, Wiklund SJ, Gabrielsson J, Duker G, Al-Saffar A. Pharmacokinetic-pharmacodynamic modeling of drug-induced effect on the QT interval in conscious telemetered dogs. J Pharmacol Toxicol Methods. 2006;53:174–183. doi: 10.1016/j.vascn.2005.07.002. [DOI] [PubMed] [Google Scholar]
- 52.Dong X, Ding X, Tsong Y. Bayesian approach to assay sensitivity analysis of thorough QT trials. J Biopharm Stat. 2013;23:73–81. doi: 10.1080/10543406.2013.735764. [DOI] [PubMed] [Google Scholar]
- 53.Hosmane B, Locke C, Chiu Y-L. The joint modeling of drug and positive control effects to estimate sample size and power in crossover ‘thorough’ QT/QTc studies. J Biopharm Stat. 2013;23:871–880. doi: 10.1080/10543406.2013.789890. [DOI] [PubMed] [Google Scholar]
- 54.Friberg LE, Isbister GK, Duffull SB. Pharmacokinetic−pharmacodynamic modelling of QT interval prolongation following citalopram overdoses. Br J Clin Pharmacol. 2006;61:177–190. doi: 10.1111/j.1365-2125.2005.02546.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 55.Florian J, Garnett CE, Nallani SC, Rappaport BA, Throckmorton DC. A modeling and simulation approach to characterize methadone QT prolongation using pooled data from five clinical trials in MMT patients. Clin Pharmacol Ther. 2012;91:666–672. doi: 10.1038/clpt.2011.273. [DOI] [PubMed] [Google Scholar]
- 56.Malik M, Hnatkova K, Batchvarov V, Gang Y, Smetana P, Camm AJ. Sample size, power calculations, and their implications for the cost of thorough studies of drug induced QT interval prolongation. Pacing Clin Electrophysiol. 2004;27:1659–1669. doi: 10.1111/j.1540-8159.2004.00701.x. [DOI] [PubMed] [Google Scholar]
- 57.Bonate PL. Effect of assay measurement error on parameter estimation in concentration-QTc interval modeling. Pharm Stat. 2013;12:156–164. doi: 10.1002/pst.1567. [DOI] [PubMed] [Google Scholar]
- 58.Bonate PL. The effects of active metabolites on parameter estimation in linear mixed effect models of concentration-QT analyses. J Pharmacokinet Pharmacodyn. 2013;40:101–115. doi: 10.1007/s10928-012-9292-y. [DOI] [PubMed] [Google Scholar]
- 59.Letsas KP, Efremidis M, Kounas SP, Pappas LK, Gavrielatos G, Alexanian IP, Dimopoulos NP, Filippatos GS, Sideris A, Kardaras F. Clinical characteristics of patients with drug-induced QT interval prolongation and torsade de pointes: identification of risk factors. Clin Res Cardiol. 2009;98:208–212. doi: 10.1007/s00392-008-0741-y. [DOI] [PubMed] [Google Scholar]
- 60.Wolbrette DL. Drugs that cause torsades de pointes and increase the risk of sudden cardiac death. Curr Cardiol Rep. 2004;6:379–384. doi: 10.1007/s11886-004-0041-8. [DOI] [PubMed] [Google Scholar]
- 61.Chan PL, Holford NH. Drug treatment effects on disease progression. Annu Rev Pharmacol Toxicol. 2001;41:625–659. doi: 10.1146/annurev.pharmtox.41.1.625. [DOI] [PubMed] [Google Scholar]
- 62.Gobburu JV, Marroum PJ. Utilisation of pharmacokinetic-pharmacodynamic modelling and simulation in regulatory decision-making. Clin Pharmacokinet. 2001;40:883–892. doi: 10.2165/00003088-200140120-00001. [DOI] [PubMed] [Google Scholar]
- 63.Holford N, Ma SC, Ploeger BA. Clinical trial simulation: a review. Clin Pharmacol Ther. 2010;88:166–182. doi: 10.1038/clpt.2010.114. [DOI] [PubMed] [Google Scholar]
- 64.Kimko HHC, Peck CC. Clinical Trial Simulations: Applications and Trends. New York: Springer; 2011. [Google Scholar]
- 65.Pater C. Methodological considerations in the design of trials for safety assessment of new drugs and chemical entities. Curr Control Trials Cardiovasc Med. 2005;6:1. doi: 10.1186/1468-6708-6-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 66.DiMasi JA, Feldman L, Seckler A, Wilson A. Trends in risks associated with new drug development: success rates for investigational drugs. Clin Pharmacol Ther. 2010;87:272–277. doi: 10.1038/clpt.2009.295. [DOI] [PubMed] [Google Scholar]
- 67.Laverty H, Benson C, Cartwright E, Cross M, Garland C, Hammond T, Holloway C, McMahon N, Milligan J, Park B, Pirmohamed M, Pollard C, Radford J, Roome N, Sager P, Singh S, Suter T, Suter W, Trafford A, Volders P, Wallis R, Weaver R, York M, Valentin J. How can we improve our understanding of cardiovascular safety liabilities to develop safer medicines? Br J Pharmacol. 2011;163:675–693. doi: 10.1111/j.1476-5381.2011.01255.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 68.Totterman M iCardiac Technologies Inc. 2008. The Telemetric and Holter Warehouse Project, January.
- 69.Bloomfield DM, Krishna R, Hreniuk D, Hickey L, Ghosh K, Bergman AJ, Miller J, Gutierrez MJ, Stoltz R, Gottesdiener KM, Herman GA, Wagner JA. A thorough QTc study to assess the effect of sitagliptin, a DPP4 inhibitor, on ventricular repolarization in healthy subjects. J Clin Pharmacol. 2009;49:937–946. doi: 10.1177/0091270009337511. [DOI] [PubMed] [Google Scholar]