Abstract
Objective To quantify the risk of hypoglycaemia associated with the concomitant use of dipeptidyl peptidase-4 (DPP-4) inhibitors and sulphonylureas compared with placebo and sulphonylureas.
Design Systematic review and meta-analysis.
Data sources Medline, ISI Web of Science, SCOPUS, Cochrane Central Register of Controlled Trials, and clinicaltrial.gov were searched without any language restriction.
Study selection Placebo controlled randomised trials comprising at least 50 participants with type 2 diabetes treated with DPP-4 inhibitors and sulphonylureas.
Review methods Risk of bias in each trial was assessed using the Cochrane Collaboration tool. The risk ratio of hypoglycaemia with 95% confidence intervals was computed for each study and then pooled using fixed effect models (Mantel Haenszel method) or random effect models, when appropriate. Subgroup analyses were also performed (eg, dose of DPP-4 inhibitors). The number needed to harm (NNH) was estimated according to treatment duration.
Results 10 studies were included, representing a total of 6546 participants (4020 received DPP-4 inhibitors plus sulphonylureas, 2526 placebo plus sulphonylureas). The risk ratio of hypoglycaemia was 1.52 (95% confidence interval 1.29 to 1.80). The NNH was 17 (95% confidence interval 11 to 30) for a treatment duration of six months or less, 15 (9 to 26) for 6.1 to 12 months, and 8 (5 to 15) for more than one year. In subgroup analysis, no difference was found between full and low doses of DPP-4 inhibitors: the risk ratio related to full dose DPP-4 inhibitors was 1.66 (1.34 to 2.06), whereas the increased risk ratio related to low dose DPP-4 inhibitors did not reach statistical significance (1.33, 0.92 to 1.94).
Conclusions Addition of DPP-4 inhibitors to sulphonylurea to treat people with type 2 diabetes is associated with a 50% increased risk of hypoglycaemia and to one excess case of hypoglycaemia for every 17 patients in the first six months of treatment. This highlights the need to respect recommendations for a decrease in sulphonylureas dose when initiating DPP-4 inhibitors and to assess the effectiveness of this risk minimisation strategy.
Introduction
Hypoglycaemia is a potentially life threatening event associated with an increased risk of hospital admission,1 cardiovascular disease, and mortality.2 3 The ACCORD (Action to Control Cardiovascular Disease in Diabetes) trial of intensive glucose lowering in people with type 2 diabetes found a 2.5-fold increase in hypoglycaemic events. That trial was prematurely stopped owing to increased mortality possibly related to the unfavourable effect of hypoglycaemia in susceptible participants, such as those with underlying coronary diseases.4 5
Hypoglycaemia has emerged as a leading complication of diabetes in older adults (>60 years) with a longer history of the disease. It is the second cause of admission to hospital in people with type 2 diabetes,6 accounts for 20-25% of hospital admissions for adverse drug reactions,1 7 and might precipitate heart failure in those at greatest risk.8 More generally, it can result in falls and fractures in people aged 65 years or more,9 has a negative effect on quality of life,10 11 and, in the long term, may impair the maintenance of euglycaemia and the full benefit of treatments.12 Moreover, the importance of mild to moderate (iatrogenic) hypoglycaemia should not be overlooked as this may lead to unawareness of the hypoglycaemia (through altered adrenergic response to the condition).13 14 15 This may compromise behavioural defences (hunger resulting in carbohydrate ingestion) and increase the risk of recurrent episodes and severe hypoglycaemia.16 17 Therefore, hypoglycaemia is a serious adverse event that must be considered when studying the safety of glucose lowering drugs.
Dipeptidyl peptidase-4 (DPP-4) inhibitors are a recently marketed class of oral glucose lowering drugs. They are indicated as second line treatment in people with type 2 diabetes mellitus not adequately responsive or intolerant to metformin, or in whom other glucose lowering drugs (such as sulphonylureas or thiazolidinediones) do not achieve glycaemic control. These drugs have different mechanisms of action. For instance, target tissue sensitivity to insulin is increased by thiazolidinediones,18 hepatic gluconeogenesis is suppressed by metformin,19 and insulin secretion is increased indirectly by DPP-4 inhibitors (through the inhibition of incretin catabolism20) and directly by sulphonylureas.21 22
Several randomised clinical trials have studied DPP-4 inhibitors both as monotherapy and, more often, in patients treated with other glucose lowering drugs, metformin in particular, but also thiazolidinediones and sulphonylureas.23 When DPP-4 inhibitors have been used as monotherapy, the incidence of hypoglycaemia was comparable to that of placebo or metformin (around 5%),24 25 and a number of randomised controlled trial indicate that this risk is not increased when DPP-4 inhibitors are used in patients treated with metformin or thiazolidinediones, thus confirming their acceptable safety profile.23 26
Conversely, when DPP-4 inhibitors are used with sulphonylureas, an increased incidence of hypoglycaemia has been noted.27 28 This could be related to the higher incidence of hypoglycaemia among patients treated with sulphonylureas (about 20%, which increases with treatment duration),29 which is further increased when patients are treated by a second drug acting on insulin secretion. Although the summaries of the product characteristics of DPP-4 inhibitors acknowledge the increased risk of hypoglycaemia due to this association,30 31 32 33 34 this risk remains insufficiently assessed. We carried out a meta-analysis to quantify the risk of hypoglycaemia associated with the use of DPP-4 inhibitors and sulphonylureas in people with type 2 diabetes mellitus.
Methods
Eligibility criteria
Clinical trials eligible for this meta-analysis were those that: studied the effect of adding one DPP-4 inhibitor to sulphonylureas, with or without other oral glucose lowering drugs, in people with type 2 diabetes; studied one DPP-4 inhibitor used at daily doses approved in clinical practice—alogliptin (Takeda Pharmaceutical), linagliptin (Boehringer Ingelheim), saxagliptin (Astrazeneca), sitagliptin (Merck Sharp & Dohme), and vildagliptin (Novartis); were randomised; were controlled with placebo and sulphonylureas; and included at least 50 participants treated with DPP-4 inhibitors. Reports concerning extension phases of randomised controlled trials were not eligible.
Patient involvement
No patients were involved in setting the research question or the outcome measures, nor were they involved in developing plans for design or implementation of the study. No patients were asked to advise on interpretation or writing up of results. There are no plans to disseminate the results of the research to study participants or the relevant patient community.
Search strategy
We searched Medline, ISI Web of Science, SCOPUS, and the Cochrane Central Register of Controlled Trials on 15 October 2013 using keywords related to DPP-4 inhibitors and randomised controlled trials (see supplementary file for a detailed list of keywords used to search Medline). In addition, we screened articles in the “Related citations in PubMed” section, and conducted a snowballing procedure to examine the references cited in systematic reviews and meta-analyses retrieved through the systematic search. We also periodically checked Clinicaltrials.gov (last search November 2014) to identify unpublished but eligible trials. No time or language restriction was applied to the searches. EndNote X6 for Macintosh (Thomson Reuters) was used to compile the bibliography.
Study selection
Two authors (FS and AP) independently reviewed and screened the title and abstract of potentially relevant randomised controlled trials and determined final eligibility through examination of full texts. Disagreements were resolved through discussion. Each eligible randomised controlled trial was checked for the number of participants treated with DPP-4 inhibitors plus sulphonylureas and placebo plus sulphonylureas, and for the number of participants with at least one episode of hypoglycaemia in each treatment group. If such data were unavailable in the full text, we emailed the authors or study contacts for the information.
Data extraction
Two authors (FS and AP) independently extracted information on the methods (study design, study duration, and use of other glucose lowering drugs allowed); participants’ age, sex, country, setting, and baseline mean glycated haemoglobin A1C (HbA1c) level; intervention (DPP-4 inhibitors and sulphonylureas international non-proprietary names, daily doses, and number of treated patients); and definition of hypoglycaemia. Disagreements were resolved through discussion or revision of the full text.
Quality assessment and evidence of quality
Using the Cochrane Collaboration tool for assessing risk of bias in randomised trials, we determined the quality of the included studies through examination of the full text or the original study protocol (as published or reported in clinicaltrial.gov).35 Quality assessment considered random sequence generation; allocation concealment; blinding of participants, staff, and outcome assessors; incomplete outcome data; selective outcome reporting; and other potential biases. The risk of bias for each of these items was assessed as high, low, or unknown. We used the GRADE framework to determine the strength of evidence of the meta-analysis.36 This approach is used to contextualise or justify recommendations; it grades the quality of evidence resulting from a meta-analysis from very low to high, which corresponds to how likely further research might alter conclusions drawn from the current evidence. “High quality” suggests that it is very unlikely for conclusions about effect estimates to change, whereas “very low quality” means it is very likely for conclusions about effect estimates to change.37
The study was reported in accordance with the preferred reporting items for systematic reviews and meta-analyses (PRISMA) statement (see supplementary file for research checklist).38
Statistical analysis
We compared the risk of hypoglycaemia in patients treated with DPP-4 inhibitors plus sulphonylureas with that in patients treated with placebo plus sulphonylureas. All studies meeting the inclusion criteria were included in the quantitative analysis, irrespective of quality.35
For each study, we computed the risk ratio for hypoglycaemia along with the 95% confidence interval. The pooled risk ratio was computed using fixed effect models (Mantel Haenszel method)39 or, in the event of statistically significant heterogeneity between estimates, random effect models.40 We used the Mantel Haenszel method as it has been shown to have better statistical properties than inverse variance methods when the included studies report few events,41 which is the case in a meta-analysis investigating the risk of hypoglycaemia in trials primarily studying the efficacy of glucose lowering drugs. Statistical heterogeneity among studies was evaluated using the Cochran Q test (P<0.10 considered to be significant), and the I2 index used to estimate the proportion of total variation contributed by variance between studies.42 All P values were two sided.
The primary analysis concerned all studies meeting the inclusion criteria; secondary analyses were performed classifying the DPP-4 inhibitors doses into full and low daily dose (as mentioned in the corresponding summaries of the product characteristics, low daily doses are mostly recommended in patients with renal impairment; see supplementary table 1), and according to the presence of a clear definition of hypoglycaemia. The forest plot of each analysis presents the subgroups that were compared using the Cochran Q test across subgroup results, rather than across individual study results. We also computed an I2 index for subgroup differences; this describes the percentage of the variability in effect estimates from the different subgroups that is due to genuine differences between the subgroups rather than to sampling error (eg, chance).41 Moreover, we conducted sensitivity analyses by excluding studies with a high risk of bias (that is, at least one item), studies allowing the use of insulin, or studies for which one or more patients characteristics were imbalanced among groups.
Publication bias was evaluated by using a funnel plot and Egger’s regression test (P<0.05 considered to be significant).43 We estimated the number of patients needed to be treated to observe one harmful outcome (number needed to harm, NNH) according to the Cochrane recommendations.44 On the assumption that the incidence of hypoglycaemia is related to the length of follow-up, we calculated the assumed control risk for different follow-up scenarios: six months or less, 6.1 to 12 months, and more than one year.44
The analyses were conducted with Review Manager software (RevMan version 5.3, Nordic Cochrane Centre, Cochrane Collaboration) and R software (version 2.15.3).
All relevant aspects related to the search strategy, study selection, data extraction and quality assessment, and data analysis were specified in a synopsis protocol detailing the meta-analysis objective and context, and the principles and modalities of the literature search and the data analysis were developed.
Results
Study selection
The electronic search identified 2379 records, 687 of which were duplicates and removed. Fifteen records were retrieved through other sources. The title and abstract of 1707 individual study records were assessed, 1650 of which were irrelevant and therefore excluded. The remaining 57 records underwent full text examination (see supplementary file for details); 10 studies were finally included in this meta-analysis (fig 1).27 45 46 47 48 49 50 51 52 53
Study characteristics
The 10 included studies comprised a total of 6456 participants, 4020 of whom received DPP-4 inhibitors plus sulphonylureas and 2526 placebo plus sulphonylureas. All the studies were randomised and double blinded. One study included only participants aged 70 years or more.27
In nine of the 10 studies the planned follow-up was 24 weeks or less (or less than six months); one study followed patients for a median drug use time of 76 weeks (around 16 months). In view of these data, it was not possible to provide specific NNHs for the scenarios of follow-up duration. Therefore, the assumed control risk of hypoglycaemia in patients treated with sulphonylureas was calculated from another meta-analysis,29 which included 27 clinical trials. According to study follow-up, the assumed control risk was 11.6% for follow-up of six months or less (seven studies), 13.3% from 6.1 to 12 months (nine studies), and 22.8% for more than one year (11 studies; see supplementary table 2 for details of these studies).
The type of associated sulphonylureas varied across the trials (table 1). In four, drug treatment also included metformin.27 47 50 53 In two, use of insulin was allowed.27 53 Baseline key patient characteristics (namely, mean glycated haemoglobin A1C, mean age, and sex) were well balanced among the patients in each of the groups, with the exception of two studies27 49 in which there was an apparent difference in sex ratio (table 1).
Table 1.
References | Study duration (weeks) | Intervention, daily dose (No of patients) | Associated sulphonylureas | Mean haemoglobin A1c at baseline (%) | Mean age of participants (years) | Male (%) | Definition of hypoglycaemia |
---|---|---|---|---|---|---|---|
Barnett et al27 | 24 | Linagliptin 5 mg (n=95) or placebo (n=43) | Sulphonylureas, not specified | DPP-4 inhibitors: 7.8, placebo: 7.7* | DDP-4 inhibitors: 75, placebo: 75* | DDP-4 inhibitors: 72, placebo: 62* | Plasma glucose ≤3.9 mmol/L, with or without symptoms |
Chacra et al45 | 24 | Saxagliptin 2.5 mg (n=248), saxagliptin 5 mg (n=253), or placebo (n=267) | Glyburide | DDP-4 inhibitors: 8.4-8.5, placebo: 8.4 | DDP-4 inhibitors: 55, placebo: 55 | DDP-4 inhibitors: 45, placebo: 46 | NR |
Garber et al46 | 24 | Vildagliptin 50 mg (n=170) or 100 mg (n=169), or placbeo (n=176) | Glimepiride | DDP-4 inhibitors: 8.5-8.6, placebo: 8.5 | DDP-4 inhibitors: 58-59, placebo: 58 | DDP-4 inhibitors: 59, placebo: 58 | Symptomatic hypoglycaemia confirmed by self monitored blood glucose <3.1 mmol/L |
Hermansen et al47 | 24 | Sitagliptin 100 mg (n=222) or placebo (n=219) | Glimepiride | DDP-4 inhibitors: 8.3, placebo: 8.3 | DDP-4 inhibitors: 56, placebo: 56.5 | DDP-4 inhibitors: 53, placebo: 53 | NR, but hypoglycaemia is included in adverse events of special interest |
Kikuchi et al48 | 12 | Vildagliptin 100 mg (n=102) or placebo (n=100) | Glimepiride | DDP-4 inhibitors: 7.8, placebo: 8.0 | DDP-4 inhibitors: 59, placebo: 60 | DDP-4 inhibitors: 73.5, placebo: 69 | Symptomatic hypoglycaemia, confirmed by self monitored blood glucose <3.1 mmol/L |
Lewin et al49 | 18 | Linagliptin 5 mg (n=161) or placebo (n=84) | Sulphonylureas, not specified | DDP-4 inhibitors: 8.6, placebo: 8.6 | DDP-4 inhibitors: 57, placebo: 56 | DDP-4 inhibitors: 48, placebo: 62 | NR, but hypoglycaemia was recorded and analysed separately from other adverse events |
Owens et al50 | 24 | Linagliptin 5 mg (m=792) or placebo (m=263) | Sulphonylureas, not specified | DDP-4 inhibitors: 8.1, placebo: 8.1 | DDP-4 inhibitors: 58, placebo: 58 | DDP-4 inhibitors: 48, placebo: 47 | NR |
Pratley et al 51 | 26 | Alogliptin 12.5 mg (n=203), alogliptin 25 mg (n=198), or placebo (m=99) | Glyburide | NR | DDP-4 inhibitors: 56.5, placebo: 57 | DDP-4 inhibitors: 52, placebo: 51.5 | Symptomatic hypoglycaemia with blood glucose <3.3 mmol/L or <2.8 mmol/L without symptoms |
Seino et al52 | 12 | Alogliptin 12.5 mg (n=105), alogliptin 25 mg (n=104), or placebo (n=103) | Glimepiride | DDP-4 inhibitors: 8.5%, placebo: 8.6% | DDP-4 inhibitors: 60, placebo: 60 | DDP-4 inhibitors: 66, placebo: 69 | NR |
White et al53 | 76† | Alogliptin any doses (n=1198), or placebo (n=1172) | Sulphonylureas, not specified | DDP-4 inhibitors: 8.0, placebo: 8.0* | DDP-4 inhibitors: 61, placebo: 61‡ | DDP-4 inhibitors: 68, placebo: 69* | NR |
DDP-4=dipeptidyl peptidase-4; haemoblobin A1c =glycated haemoglobin; NR=not reported.
*Data refer to overall study population, not only to patients treated with sulphonylureas.
†Median use (weeks) for patients treated with alogliptin.
‡Median age (years).
Three randomised controlled trials studied linagliptin 5 mg/day in a total of 1038 patients.27 49 50 Vildagliptin 100 mg/day (n=271 participants) was studied in two trials46 48 and vildagliptin 50 mg/day (n=170) in one trial.46 Alogliptin was studied once at 12.5 mg/day (n=308) and once at 25 mg/day (n=302).51 52 One trial studied alogliptin at different doses (from 6.5 mg/day to 25 mg/day) in 1198 patients receiving sulphonylureas.53 Saxagliptin (2.5 mg/day (n=248) and 5 mg/day (n=253))45 and sitagliptin 100 mg/day (n=222)47 were each studied once. Overall, 2526 patients receiving placebo plus sulphonylureas were identified in the 10 included trials (table 1). Six of the 10 trials failed to clearly report the definition of hypoglycaemia (table 1).45 47 49 50 52 53
The risk of reporting bias was high in three of the studies46 47 48; one trial also presented a high risk of detection bias (fig 2, see supplementary file for details).47
Overall, 4020 patients received DPP-4 inhibitors (2096 at full dose, 726 at low dose, and 1198 at undefined dose) plus sulphonylureas, 479 of whom developed hypoglycaemia (311 at full dose, 67 at low dose, and 101 at undefined dose) corresponding to an absolute risk of 11.9%. In total, 2526 received placebo plus sulphonylureas, 169 of whom developed hypoglycaemia, corresponding to an absolute risk of 6.7%.
Meta-analysis
The risk ratio of hypoglycaemia for DPP-4 inhibitors at any dose plus sulphonylureas versus placebo plus sulphonylureas was 1.52 (95% confidence interval 1.29 to 1.80), with no evidence of heterogeneity across the trials (Q=11.2, P=0.26, I2=20%; fig 3).
The NNH was 17 (95% confidence interval 11 to 30) for a treatment duration of six months or less, 15 (9 to 26) for 6.1 to 12 months, and 8 (5 to 15) for more than one year.
When trials with a high risk of detection bias and reporting bias were excluded from the analysis, the pooled risk ratio was 1.40 (1.18 to 1.67; see supplementary figure 1). The risk ratio was 1.61 (1.30 to 2.00) when trials that allowed the use of insulin were excluded. The risk ratio was similar to that of the principal analysis when trials in which an apparent imbalance in sex ratio were excluded (1.52, 1.27 to 1.81; Q=10.70, P=0.15; I2=35%; see supplementary figure 2). The pooled risk ratio in trials reporting a definition of hypoglycaemia was 1.54 (0.99 to 2.42; Q=2.1, P=0.5, I2=0%), whereas in those in which a definition was not reported it was 1.52 (1.27 to 1.82; Q=9.1, P=0.10, I2=45%); these two groups of trials did not differ (Q=0.0, P=0.95, I2=0%; see supplementary figure 3).
In subgroup analysis, there was no difference between low and full dose DPP-4 inhibitors for risk of hypoglycaemia (Q=0.99, P=0.32, I2=0%; fig 4). The risk for DPP-4 inhibitors remained statistically significantly increased at full dose (1.66, 1.34 to 2.06), but not at low dose (1.33, 0.92 to 1.94; fig 4). For DPP-4 inhibitors full dose plus sulphonylureas, the NNH was 13 (8 to 25) for a treatment duration of six months or less, 11 (7 to 22) for 6.1 to 12 months, and 7 (4 to 13) for more than one year.
No clear evidence of publication bias was found on visual inspection of the funnel plot (fig 5), and the Egger test showed no asymmetry (z=1.3; P=0.2). The strength of evidence of this meta-analysis was evaluated as high according to GRADE (table 2).
Table 2.
Quality assessment | No (%) of patients | Effect | Quality | Importance | ||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|
Risk of bias | Inconsistency | Indirectness | Imprecision | Other considerations | All studies | Placebo | Relative risk (95% CI) | Absolute risk (95% CI) | ||||
Not serious* | Not serious† | Not serious | Not serious‡ | Dose-response gradient | 479/4020 (11.9) | 169/2526 (6.7) | 1.52 (1.29 to 1.80) | 35 more per 1000 (from 19 more to 54 more) | High | Critical§ |
*Only three studies were judged to have a high risk of detection bias. Among them, a high risk of reporting bias was found in one study. Nevertheless, when these studies were excluded from analysis, the result did not change substantially.
†No heterogeneity was found among estimates.
‡Sample size is large (n=6526), number of events high (648), and confidence intervals of pooled risk ratio clearly do not cross the line of no effect (lower bound of 95% confidence interval 1.29)
§Hypoglycaemia is the most common adverse reaction related to glucose lowering treatment. It increases the risk of all cause mortality and cardiovascular events. Symptoms related to hypoglycaemia (eg, nervousness, sweating, trembling, weakness, palpitations) affect quality of life.
Discussion
In this meta-analysis we found about a 50% increase in the risk of hypoglycaemia when a dipeptidyl peptidase-4 (DPP-4) inhibitor was added to sulphonylureas to treat people with type 2 diabetes, leading to one excess case of hypoglycaemia for every 17 patients in the first six months of treatment. This risk was confirmed for full doses of DPP-4 inhibitors, whereas it could not be excluded for lower doses.
DPP-4 inhibitors act indirectly on insulin levels by enforcing the incretin effect, which is a response to high oral intake of carbohydrates and fatty acids.20 Such drugs should therefore act on glycaemia only in response to such intakes, thereby protecting patients from hypoglycaemia. However, in patients treated with sulphonylureas, insulin secretion is already stimulated independently of glycaemia and the addition of a reinforced incretin effect on insulin levels leads to an increase in the risk of hypoglycaemia. Given the frequency of this relevant event in people with type 2 diabetes treated with sulphonylureas, the risk associated with the addition of DPP-4 inhibitors would lead to a huge number of cases of induced hypoglycaemia, some of which could be severe.54 55 The present meta-analysis did not allow investigation of the threshold of dose combinations (DPP-4 inhibitors plus sulphonylureas) associated with an increased risk of hypoglycaemia; an individual patient meta-analysis could be helpful in this regard.
The risk of hypoglycaemia related to the addition of a DPP-4 inhibitor to sulphonylurea is acknowledged in the summaries of product characteristics for DPP-4 inhibitors; most recommend using full dose DPP-4 inhibitors but a reduced sulphonylurea dose in patients taking such combinations, although the magnitude of reduction is not stated.30 31 32 33 34 Currently, to what extent this recommendation would lower the number of excess cases of induced hypoglycaemia is unknown. Notably, the suggested individual patient meta-analysis would not fill this knowledge gap as the effect of reducing the dose of sulphonylureas has not been investigated in trials studying DPP-4 inhibitors.
For low doses of DPP-4 inhibitors (half the full dose when applicable), the increase in hypoglycaemia risk was not statistically significant. However, the existence of this risk cannot be fully ruled out by the present results, and a larger sample would be required to increase the precision of the estimates. Furthermore, although the point estimate was lower (risk ratio 1.33 v 1.66 for full doses), which suggests a potential dose effect, no heterogeneity was found between low and full doses of DPP-4 inhibitors, yet this could result from a lack of power in the heterogeneity test (low dose group was half the size of the high dose group).
Strengths and limitations of this study
The present analysis has important strengths. Firstly, it is based on a large sample of patients; over 4000 treated with a combination of DPP-4 inhibitors and sulphonylureas, and over 2500 treated with placebo and sulphonylureas. Secondly, the quality of each study included was high according to the Cochrane Collaboration tool for risk of bias assessment. The present meta-analysis used data concerning all currently marketed DPP-4 inhibitors (alogliptin, linagliptin, saxagliptin, sitagliptin, and vildagliptin), and results were consistent within studies, with no heterogeneity being found among estimates. Thirdly, there was no evidence of publication bias; the funnel plot was balanced and the Egger test was not statistically significant. Overall, the quality of evidence provided by the present meta-analysis was assessed as high according to GRADE.
Nevertheless, the meta-analysis does have certain limitations. Firstly, in the main analysis we included certain studies that presented a high risk for detection and reporting bias,46 47 48 but exclusion of these studies did not meaningfully change the pooled estimates. Secondly, three studies could not be included because data were not available for the risk of hypoglycaemia in patients receiving sulphonylureas.56 57 58 However, in view of the GRADE framework, including results from these studies would be unlikely to change the results owing to the size of the present meta-analysis, the high number of hypoglycaemia cases, and the confidence intervals of the pooled risk ratio that clearly do not cross the line of no effect.36 The absence of heterogeneity in estimates found from the 10 included studies further supports this hypothesis. Thirdly, the results of this meta-analysis are dominated by the results of three studies that account for more than 80% of the pooled results of the principal analysis45 50 53; a sensitivity analysis without these studies did not substantially change the results of the meta-analysis (data not shown). Fourthly, the definition of hypoglycaemia varied among the included randomised controlled trials, and it was not reported in six. Other authors did not perform a meta-analysis on hypoglycaemia risk on the basis of this lack of homogeneity in its definition across the trials23; nevertheless, in the present analysis this could be considered as a minor limitation, as the risk did not differ between trials with or without a clear definition of hypoglycaemia. The incidence of hypoglycaemia also varied among studies; however, this did not have any impact on the estimation of the pooled risk (no statistical heterogeneity was found) nor on the number needed to treat to harm (NNH) calculation, which was based on an external assumed control risk of hypoglycaemia retrieved from 27 clinical studies included in a meta-analysis in the Cochrane Library.29 In the present study, the pooled risk ratio was retrieved mainly from studies with a follow-up of less than six months. Thus, the NNH calculation for other study durations is based on the assumption of a constant risk over time. In the absence of relevant data, the most reliable estimation of NNH is that reported for the first six months of treatment.
Clinical importance
It is important to underline that hypoglycaemia is the most common adverse reaction related to glucose lowering drugs and in itself is a serious clinical event. Even when not directly life threatening, it is associated with an increased risk of all cause mortality, cardiovascular disease, cardiovascular mortality, and hospital admission.2 3 6 Moreover, hypoglycaemia stimulates both the sympathetic and the renin-angiotensin-aldosterone systems and thus results in symptomatic heart failure and hospital admission in at risk individuals.8 59 This is an important factor of which clinicians should be aware. In addition, hypoglycaemia and its related symptoms (eg, nervousness, sweating, trembling, weakness, palpitations) negatively affect quality of life and disrupt many daily activities such as driving, work performance, and leisure activities.10 11 More importantly, mild to moderate iatrogenic hypoglycaemia can decrease the usual adrenergic response to hypoglycaemia.13 This may cause hypoglycaemia unawareness and compromise behavioural defences (hunger resulting in sugar ingestion), which in turn can lead to severe hypoglycaemia.16 17 It is thus important to lower the risk of mild to moderate hypoglycaemia, which remains a serious adverse event. Adequate information about the risk of hypoglycaemia, whatever its severity, should thus be considered of primary importance for patients and health professionals involved in the management of people with diabetes. Reaching good glycated haemoglobin levels should not be at the expense of hypoglycaemic events, which could outweigh the benefit of preventing risks associated with raised blood glucose concentrations. Thus, the risk shown by the findings in this systematic review and meta-analysis for all severities of hypoglycaemia should not be minimised by considering that only severe episodes would be of clinical concern.
Conclusions
This meta-analysis found about a 50% increase in the risk of hypoglycaemia associated with the addition of DPP-4 inhibitors to sulphonylureas in people with type 2 diabetes. This adverse event, commonly experienced by people treated for diabetes, would lead to the occurrence of one excess case of hypoglycaemia in every 17 treated patients treated for six months. This potentially represents a huge number of attributable cases worldwide. These results clearly highlight the need to respect existing recommendations for dose reduction of sulphonylureas when initiating treatment with DPP-4 inhibitors, and the urgency to determine the efficacy of this measure in minimising the risk of hypoglycaemia.
What is already known on this topic
Hypoglycaemia is a serious event that could be related to increased morbidity and mortality in people with type 2 diabetes
The risk of hypoglycaemia is known to increase when dipeptidyl peptidase-4 (DPP-4) inhibitors are used concomitantly with sulphonylureas
However, the magnitude of this risk has not yet been measured
What this study adds
Addition of DPP-4 inhibitors to sulphonylurea in people with type 2 diabetes is associated with a 50% increased risk of hypoglycaemia and to one excess case for every 17 patients in the first six months of treatment
Thus the recommendations for a reduction of sulphonylurea dose when initiating DPP-4 inhibitors must be followed, even though the effectiveness of this risk minimisation strategy has not yet been assessed
Web Extra.
Extra material supplied by the author
Contributors: FS conceived and designed the study; acquired, analysed, and interpreted the data; and drafted the article. He had full access to all the data in the study and takes responsibility for the integrity of the data and the accuracy of the data analysis. NM conceived and designed the study, and analysed and interpreted the data. MA and PR analysed and interpreted the data. ER and FDP conceived and designed the study, and interpreted the data. BB conceived and designed the study, and analysed and interpreted the data. AP conceived and designed the study; acquired and interpreted the data; drafted the article; and investigated the accuracy and integrity of any part of the work. AP is the guarantor. All authors revised the article critically for important intellectual content and gave final approval of the version to be published.
Funding: This study was not funded (Philip Robinson holds the position of medical writer and is employed as such by the University of Bordeaux pharmacology department). All the researchers involved performed this study in the context of their research activities. The authors would like to thank the EXAMINE study group for the availability of the data related to the EXAMINE trial.
Competing interests: All authors have completed the ICMJE uniform disclosure form at www.icmje.org/coi_disclosure.pdf (available on request from the corresponding author) and declare: no support from any organisation for the submitted work. FS, MA, ER, FdP, and BB, and have no financial relationships with any organisations that might have an interest in the submitted work in the previous three years. NM and PR have had specified relationships on other matters with Novartis and Takeda, which might have an interest in the submitted work. AP has had specified relationships on other matters with Novartis, which might have an interest in the submitted work. BB, NM, and AP have had specified relationships on other matters with public regulatory agencies and with health care insurance systems that might have an interest in the submitted work. All authors declare no other relationships or activities that could appear to have influenced the submitted work.
Ethical approval: Not required.
Data sharing: No additional data available.
Transparency: FS (corresponding author) and AP (manuscript’s guarantor) affirm that the manuscript is honest, accurate, and transparent, and that no important aspects of the study have been omitted.
References
- 1.Kilbridge PM, Campbell UC, Cozart HB, Mojarrad MG. Automated surveillance for adverse drug events at a community hospital and an academic medical center. J Am Med Inform Assoc 2006;13:372-7. 10.1197/jamia.M2069 pmid:16622159. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Goto A, Arah OA, Goto M, Terauchi Y, Noda M. Severe hypoglycaemia and cardiovascular disease: systematic review and meta-analysis with bias analysis. BMJ 2013;347:f4533 10.1136/bmj.f4533 pmid:23900314. [DOI] [PubMed] [Google Scholar]
- 3.Currie CJ, Peters JR, Tynan A, et al. Survival as a function of HbA(1c) in people with type 2 diabetes: a retrospective cohort study. Lancet 2010;375:481-9. 10.1016/S0140-6736(09)61969-3 pmid:20110121. [DOI] [PubMed] [Google Scholar]
- 4.Bonds DE, Miller ME, Bergenstal RM, et al. The association between symptomatic, severe hypoglycaemia and mortality in type 2 diabetes: retrospective epidemiological analysis of the ACCORD study. BMJ 2010;340:b4909 10.1136/bmj.b4909 pmid:20061358. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Gerstein HC, Miller ME, Genuth S, et al. ACCORD Study Group. Long-term effects of intensive glucose lowering on cardiovascular outcomes. N Engl J Med 2011;364:818-28. 10.1056/NEJMoa1006524 pmid:21366473. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Huang ES, Laiteerapong N, Liu JY, John PM, Moffet HH, Karter AJ. Rates of complications and mortality in older patients with diabetes mellitus: the diabetes and aging study. JAMA Intern Med 2014;174:251-8. 10.1001/jamainternmed.2013.12956 pmid:24322595. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Budnitz DS, Lovegrove MC, Shehab N, Richards CL. Emergency hospitalizations for adverse drug events in older Americans. N Engl J Med 2011;365:2002-12. 10.1056/NEJMsa1103053 pmid:22111719. [DOI] [PubMed] [Google Scholar]
- 8.Gilbert RE, Krum H. Heart failure in diabetes: effects of anti-hyperglycaemic drug therapy. Lancet 2015;385:2107-17. 10.1016/S0140-6736(14)61402-1 pmid:26009231. [DOI] [PubMed] [Google Scholar]
- 9.Johnston SS, Conner C, Aagren M, Ruiz K, Bouchard J. Association between hypoglycaemic events and fall-related fractures in Medicare-covered patients with type 2 diabetes. Diabetes Obes Metab 2012;14:634-43. 10.1111/j.1463-1326.2012.01583.x pmid:22335246. [DOI] [PubMed] [Google Scholar]
- 10.Lorber D, Anderson J, Arent S, et al. American Diabetes Association. Diabetes and driving. Diabetes Care 2012;35(Suppl 1):S81-6. 10.2337/dc12-s081 pmid:22187475. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Frier BM. Hypoglycaemia in diabetes mellitus: epidemiology and clinical implications. Nat Rev Endocrinol 2014;10:711-22. 10.1038/nrendo.2014.170 pmid:25287289. [DOI] [PubMed] [Google Scholar]
- 12. International Hypoglycaemia Study Group. Minimizing hypoglycemia in diabetes. Diabetes Care 2015;38:1583-91. 10.2337/dc15-0279 pmid:26207052. [DOI] [PubMed] [Google Scholar]
- 13.Harrison TR. Harrison’s principles of internal medicine. French 18th Edition McGraw-Hill, 1970. [Google Scholar]
- 14.Cryer PE. Hypoglycemia-associated autonomic failure in diabetes. Handb Clin Neurol 2013;117:295-307. 10.1016/B978-0-444-53491-0.00023-7 pmid:24095133. [DOI] [PubMed] [Google Scholar]
- 15.Cryer PE. Mechanisms of hypoglycemia-associated autonomic failure in diabetes. N Engl J Med 2013;369:362-72. 10.1056/NEJMra1215228 pmid:23883381. [DOI] [PubMed] [Google Scholar]
- 16.Sen Gupta P, Green AN, Chowdhury TA. Hypoglycaemia. BMJ 2011;342:d567 10.1136/bmj.d567 pmid:21325388. [DOI] [PubMed] [Google Scholar]
- 17.Cove DH. Hypoglycaemia unawareness. BMJ 2011;342:d1474 10.1136/bmj.d1474 pmid:21385812. [DOI] [PubMed] [Google Scholar]
- 18.Cariou B, Charbonnel B, Staels B. Thiazolidinediones and PPARγ agonists: time for a reassessment. Trends Endocrinol Metab 2012;23:205-15. 10.1016/j.tem.2012.03.001 pmid:22513163. [DOI] [PubMed] [Google Scholar]
- 19.Kirpichnikov D, McFarlane SI, Sowers JR. Metformin: an update. Ann Intern Med 2002;137:25-33. 10.7326/0003-4819-137-1-200207020-00009 pmid:12093242. [DOI] [PubMed] [Google Scholar]
- 20.Drucker DJ. Biological actions and therapeutic potential of the glucagon-like peptides. Gastroenterology 2002;122:531-44. 10.1053/gast.2002.31068 pmid:11832466. [DOI] [PubMed] [Google Scholar]
- 21.McIntosh CH, Demuth HU, Pospisilik JA, Pederson R. Dipeptidyl peptidase IV inhibitors: how do they work as new antidiabetic agents?Regul Pept 2005;128:159-65. 10.1016/j.regpep.2004.06.001 pmid:15780435. [DOI] [PubMed] [Google Scholar]
- 22.Campbell RK. Glimepiride: role of a new sulfonylurea in the treatment of type 2 diabetes mellitus. Ann Pharmacother 1998;32:1044-52. 10.1345/aph.17360 pmid:9793597. [DOI] [PubMed] [Google Scholar]
- 23.Karagiannis T, Paschos P, Paletas K, Matthews DR, Tsapas A. Dipeptidyl peptidase-4 inhibitors for treatment of type 2 diabetes mellitus in the clinical setting: systematic review and meta-analysis. BMJ 2012;344:e1369 10.1136/bmj.e1369 pmid:22411919. [DOI] [PubMed] [Google Scholar]
- 24.Keating GM. Alogliptin: a review of its use in patients with type 2 diabetes mellitus. Drugs 2015;75:777-96. 10.1007/s40265-015-0385-y pmid:25855222. [DOI] [PubMed] [Google Scholar]
- 25.Forst T, Koch C, Dworak M. Vildagliptin versus insulin in patients with type 2 diabetes mellitus inadequately controlled with sulfonylurea: results from a randomized, 24 week study. Curr Med Res Opin 2015;31:1079-84. 10.1185/03007995.2015.1039936 pmid:25867771. [DOI] [PubMed] [Google Scholar]
- 26.Richter B, Bandeira-Echtler E, Bergerhoff K, Lerch CL. Dipeptidyl peptidase-4 (DPP-4) inhibitors for type 2 diabetes mellitus. Cochrane Database Syst Rev 2008;(2):CD006739.pmid:18425967. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27.Barnett AH, Huisman H, Jones R, von Eynatten M, Patel S, Woerle HJ. Linagliptin for patients aged 70 years or older with type 2 diabetes inadequately controlled with common antidiabetes treatments: a randomised, double-blind, placebo-controlled trial. Lancet 2013;382:1413-23. 10.1016/S0140-6736(13)61500-7 pmid:23948125. [DOI] [PubMed] [Google Scholar]
- 28.Salvo F, Moore N, Pariente A. Linagliptin for elderly patients with type 2 diabetes. Lancet 2014;383:307 10.1016/S0140-6736(14)60103-3 pmid:24461122. [DOI] [PubMed] [Google Scholar]
- 29.Hemmingsen B, Schroll JB, Lund SS, et al. Sulphonylurea monotherapy for patients with type 2 diabetes mellitus. Cochrane Database Syst Rev 2013;4:CD009008.pmid:23633364. [DOI] [PubMed] [Google Scholar]
- 30.Takeda. Summary of Product Characteristics. Vipidia. Last access date 05/12/2014. Secondary Takeda. Summary of Product Characteristics. Vipidia. Last access date 05/12/2014. www.ema.europa.eu/docs/en_GB/document_library/EPAR_-_Product_Information/human/002182/WC500152271.pdf.
- 31.Ingelheim B. Summary of Product Characteristics. Trajenta. Last access date 05/12/2014. Secondary Boehringer Ingelheim. Summary of Product Characteristics. Trajenta. Last access date 05/12/2014. www.ema.europa.eu/docs/en_GB/document_library/EPAR_-_Product_Information/human/002110/WC500115745.pdf.
- 32.AstraZeneca. Summary of Product Characteristics. Onglyza. Last access date 05/12/2014. Secondary AstraZeneca. Summary of Product Characteristics. Onglyza. Last access date 05/12/2014. www.ema.europa.eu/docs/en_GB/document_library/EPAR_-_Product_Information/human/001039/WC500044316.pdf.
- 33.Merck Sharp & Dohme. Summary of Product Characteristics. Januvia. Last access date 05/12/2014. Secondary Merck Sharp & Dohme. Summary of Product Characteristics. Januvia. Last access date 05/12/2014. www.ema.europa.eu/docs/en_GB/document_library/EPAR_-_Product_Information/human/000722/WC500039054.pdf.
- 34.Novartis. Summary of Product Characteristics. Galvus. Last access date 05/12/2014. Secondary Novartis. Summary of Product Characteristics. Galvus. Last access date 05/12/2014. www.ema.europa.eu/docs/en_GB/document_library/EPAR_-_Product_Information/human/000771/WC500020327.pdf.
- 35.Higgins JP, Altman DG, Gøtzsche PC, et al. Cochrane Bias Methods Group Cochrane Statistical Methods Group. The Cochrane Collaboration’s tool for assessing risk of bias in randomised trials. BMJ 2011;343:d5928 10.1136/bmj.d5928 pmid:22008217. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 36.Guyatt GH, Oxman AD, Schünemann HJ, Tugwell P, Knottnerus A. GRADE guidelines: a new series of articles in the Journal of Clinical Epidemiology. J Clin Epidemiol 2011;64:380-2. 10.1016/j.jclinepi.2010.09.011 pmid:21185693. [DOI] [PubMed] [Google Scholar]
- 37.Balshem H, Helfand M, Schünemann HJ, et al. GRADE guidelines: 3. Rating the quality of evidence. J Clin Epidemiol 2011;64:401-6. 10.1016/j.jclinepi.2010.07.015 pmid:21208779. [DOI] [PubMed] [Google Scholar]
- 38.Liberati A, Altman DG, Tetzlaff J, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. PLoS Med 2009;6:e1000100 10.1371/journal.pmed.1000100 pmid:19621070. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 39.Greenland S. Quantitative methods in the review of epidemiologic literature. Epidemiol Rev 1987;9:1-30.pmid:3678409. [DOI] [PubMed] [Google Scholar]
- 40.DerSimonian R, Laird N. Meta-analysis in clinical trials. Control Clin Trials 1986;7:177-88. 10.1016/0197-2456(86)90046-2 pmid:3802833. [DOI] [PubMed] [Google Scholar]
- 41.Deeks JJ, Higgins JPT, Altman DG. Analysing data and undertaking meta-analyses. In: Higgins JPT, Green S, eds. Cochrane Handbook for Systematic Reviews of Interventions Version 5.1.0 (updated March 2011). The Cochrane Collaboration, 2011, Available from handbook.cochrane.org. [Google Scholar]
- 42.Higgins JP, Thompson SG. Quantifying heterogeneity in a meta-analysis. Stat Med 2002;21:1539-58. 10.1002/sim.1186 pmid:12111919. [DOI] [PubMed] [Google Scholar]
- 43.Egger M, Davey Smith G, Schneider M, Minder C. Bias in meta-analysis detected by a simple, graphical test. BMJ 1997;315:629-34. 10.1136/bmj.315.7109.629 pmid:9310563. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 44.Schünemann HJ, Oxman AD, Vist GE, et al. Interpreting results and drawing conclusions. In: Higgins JPT, Green S, eds. Cochrane Handbook for Systematic Reviews of Interventions Version 5.1.0 (updated March 2011). The Cochrane Collaboration, 2011, Available from handbook.cochrane.org. [Google Scholar]
- 45.Chacra AR, Tan GH, Apanovitch A, Ravichandran S, List J, Chen R. CV181-040 Investigators. Saxagliptin added to a submaximal dose of sulphonylurea improves glycaemic control compared with uptitration of sulphonylurea in patients with type 2 diabetes: a randomised controlled trial. Int J Clin Pract 2009;63:1395-406. 10.1111/j.1742-1241.2009.02143.x pmid:19614786. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 46.Garber AJ, Foley JE, Banerji MA, et al. Effects of vildagliptin on glucose control in patients with type 2 diabetes inadequately controlled with a sulphonylurea. Diabetes Obes Metab 2008;10:1047-56. 10.1111/j.1463-1326.2008.00859.x pmid:18284434. [DOI] [PubMed] [Google Scholar]
- 47.Hermansen K, Kipnes M, Luo E, Fanurik D, Khatami H, Stein P. Sitagliptin Study 035 Group. Efficacy and safety of the dipeptidyl peptidase-4 inhibitor, sitagliptin, in patients with type 2 diabetes mellitus inadequately controlled on glimepiride alone or on glimepiride and metformin. Diabetes Obes Metab 2007;9:733-45. 10.1111/j.1463-1326.2007.00744.x pmid:17593236. [DOI] [PubMed] [Google Scholar]
- 48.Kikuchi M, Haneda M, Koya D, et al. Efficacy and tolerability of vildagliptin as an add-on to glimepiride in Japanese patients with Type 2 diabetes mellitus. Diabetes Res Clin Pract 2010;89:216-23. 10.1016/j.diabres.2010.04.017 pmid:20537746. [DOI] [PubMed] [Google Scholar]
- 49.Lewin AJ, Arvay L, Liu D, Patel S, von Eynatten M, Woerle HJ. Efficacy and tolerability of linagliptin added to a sulfonylurea regimen in patients with inadequately controlled type 2 diabetes mellitus: an 18-week, multicenter, randomized, double-blind, placebo-controlled trial. Clin Ther 2012;34:1909-19 e15. [DOI] [PubMed]
- 50.Owens DR, Swallow R, Dugi KA, Woerle HJ. Efficacy and safety of linagliptin in persons with type 2 diabetes inadequately controlled by a combination of metformin and sulphonylurea: a 24-week randomized study. Diabet Med 2011;28:1352-61. 10.1111/j.1464-5491.2011.03387.x pmid:21781152. [DOI] [PubMed] [Google Scholar]
- 51.Pratley RE, Kipnes MS, Fleck PR, Wilson C, Mekki Q. Alogliptin Study 007 Group. Efficacy and safety of the dipeptidyl peptidase-4 inhibitor alogliptin in patients with type 2 diabetes inadequately controlled by glyburide monotherapy. Diabetes Obes Metab 2009;11:167-76. 10.1111/j.1463-1326.2008.01016.x pmid:19125778. [DOI] [PubMed] [Google Scholar]
- 52.Seino Y, Hiroi S, Hirayama M, Kaku K. Efficacy and safety of alogliptin added to sulfonylurea in Japanese patients with type 2 diabetes: A randomized, double-blind, placebo-controlled trial with an open-label, long-term extension study. J Diabetes Investig 2012;3:517-25. 10.1111/j.2040-1124.2012.00226.x pmid:24843617. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 53.White WB, Cannon CP, Heller SR, et al. EXAMINE Investigators. Alogliptin after acute coronary syndrome in patients with type 2 diabetes. N Engl J Med 2013;369:1327-35. 10.1056/NEJMoa1305889 pmid:23992602. [DOI] [PubMed] [Google Scholar]
- 54.Schopman JE, Simon AC, Hoefnagel SJ, Hoekstra JB, Scholten RJ, Holleman F. The incidence of mild and severe hypoglycaemia in patients with type 2 diabetes mellitus treated with sulfonylureas: a systematic review and meta-analysis. Diabetes Metab Res Rev 2014;30:11-22. 10.1002/dmrr.2470 pmid:24030920. [DOI] [PubMed] [Google Scholar]
- 55.Del Prato S, Taskinen MR, Owens DR, et al. Efficacy and safety of linagliptin in subjects with type 2 diabetes mellitus and poor glycemic control: pooled analysis of data from three placebo-controlled phase III trials. J Diabetes Complications 2013;27:274-9. 10.1016/j.jdiacomp.2012.11.008 pmid:23403068. [DOI] [PubMed] [Google Scholar]
- 56.A 24-week, Multicentre, Randomised, Double-Blind, Placebo-Controlled Phase IIIb Study to Evaluate Efficacy and Safety of Saxagliptin in Combination With Metformin and Sulfonylurea in Subjects With Type 2 Diabetes Who Have Inadequate Glycaemic Control With Combination of Metformin and Sulfonylurea. Study number: NCT01128153, 2012.
- 57.Lukashevich V, Schweizer A, Shao Q, Groop PH, Kothny W. Safety and efficacy of vildagliptin versus placebo in patients with type 2 diabetes and moderate or severe renal impairment: a prospective 24-week randomized placebo-controlled trial. Diabetes Obes Metab 2011;13:947-54. 10.1111/j.1463-1326.2011.01467.x pmid:21733061. [DOI] [PubMed] [Google Scholar]
- 58.Scirica BM, Bhatt DL, Braunwald E, et al. SAVOR-TIMI 53 Steering Committee and Investigators. Saxagliptin and cardiovascular outcomes in patients with type 2 diabetes mellitus. N Engl J Med 2013;369:1317-26. 10.1056/NEJMoa1307684 pmid:23992601. [DOI] [PubMed] [Google Scholar]
- 59.Hoffman RP. Sympathetic mechanisms of hypoglycemic counterregulation. Curr Diabetes Rev 2007;3:185-93. 10.2174/157339907781368995 pmid:18220670. [DOI] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.