Abstract
Type 2 diabetes mellitus (T2D) is responsible for an important premature mortality. Pharmacists involved in community-based pharmaceutical care services could help patients with diabetes through education and management as they participate in their regular and long-term care. This meta-analysis aimed to evaluate the association between interventions led by pharmacists in the primary care setting and mean change in HbA1c levels. Randomized controlled trials and quasi-experimental studies with a control group were included. Standardized mean differences (SMD) and their 95% confidence intervals (95% CI) were calculated to compare the mean change in HbA1c values between baseline and end of the intervention in each group. Subgroup analyses were performed to explore heterogeneity. Twelve articles were included. The results showed that pharmacist’s interventions significantly reduced HbA1c compared to usual care with an overall SMD of −0.67 (95% CI = [−0.87; −0.48], p < 0.0001). Even if no significant difference between subgroups were found, the reduction of HbA1c seemed more important when baseline HbA1c was ≥8.5%, the intervention occurred monthly, in a primary care center and in countries with a lower human development index. Our results suggest that pharmacists-led interventions in the primary care setting can improve glycemic control for adults with T2D.
Keywords: diabetes mellitus, pharmacists, primary health care, meta-analysis
1. Introduction
Diabetes mellitus is a chronic disease that affects an increasing number of people around the world. According to a World Health Organization (WHO) report, its age-standardized prevalence worldwide skyrocketed from 4.7% of the adult population in 1980 to 8.5% in 2014, hence, representing 422 million people [1].
The most frequent type of diabetes mellitus, representing 85% to 95% of diabetes, is type 2 diabetes mellitus (T2D). The main risk factors for T2D are familial history of diabetes, sedentary lifestyle and obesity [2].
The global economic burden of diabetes constantly increases and it is estimated that it would exceed two trillion USD in 2030 [3].
Above all, diabetes mellitus is responsible for a staggering premature mortality and leads to early morbidity. Guidelines have historically selected glycemic control as the main outcome measure for diabetes mellitus care. Glycated hemoglobin (HbA1c) reflects the mean blood sugar level for the last three months and the American Diabetes Association (ADA) recommends its measurement at least twice a year [4]. Hyperglycemia is significantly associated with diabetes risks for complication especially microvascular. Stratton et al. have highlighted that for each 1% decrease in mean HbA1c, the decrease of the risk of complications from diabetes is of 21% [5]. HbA1c is thus considered a good marker for the risk of complications among population with diabetes.
Diabetes mellitus leads to and is associated with cardiovascular diseases. Co-existence of essential hypertension and T2D is very common and hypertension is twice more common in patients with diabetes than in those without diabetes [6]. Both diseases are at risk of cardiovascular events and lowering blood pressure is particularly beneficial in patients with diabetes. Thus, diabetes care should include hypertension management.
Patients are in frequent contact with pharmacists, making the latter particularly appropriate healthcare workers for supporting people with long-term conditions like diabetes mellitus [7].
Moving from a drug retail role to healthcare providers, they are involved in the regular and long-term care of patients with diabetes [8]. They also play a key role in acute complication identification, referring patients to their general practitioner if needed. An educational role is also awaited from the pharmacist to address underlying self-determinants or barriers that may be negatively impacting an individual’s ability to manage their condition in a broader sense. Finally, some countries have extended pharmacists’ skills to monitoring, like community pharmacists in Quebec (Canada) who are now allowed to prescribe glycemia and HbA1c measurements.
A cohort study, part of the Asheville project in the USA in the beginning of the 2000s, showed a better glycemic control at short- and long-term with targeted and repeated interventions in direct contact with the patient, by trained community pharmacists [9].
Clinical trials and meta-analyses have also highlighted a beneficial effect of various interventions led by pharmacists for patients with diabetes. Indeed, a meta-analysis by Presley et al., focusing on pharmacist’s interventions to improve medication adherence, showed beneficial effects of these interventions on several outcomes including HbA1c for adult patients with type 1 or type 2 diabetes [10]. Pharmacists’ interventions could therefore lead to a better diabetes control and a reduction of the risk of complication.
Nonetheless, to our knowledge, none of the meta-analyses showing a beneficial effect of pharmacists interventions on diabetes control [10,11,12,13,14,15,16,17,18] focused on interventions in the primary care setting only (community pharmacies or primary care centers) in the control of T2D. Firstly, other meta-analyses on the same topic included studies with type 1 and type 2 adults with diabetes, without distinction between these two types [10,11,12,13,18]. Type 1 diabetes mellitus (T1D) is different from T2D regarding origin, patient profile, risk factors, and treatment. Patients with T1D are generally younger and educational approaches to manage insulin therapy, glycemic monitoring, and very long-term conditions without curative perspectives are a priority. The care of patients with T2D is different and includes several pharmacological treatment approaches starting with oral antidiabetic drugs. Patients’ profiles are different from patients with T1D in terms of comorbidities management, long-term conditions, and challenges for morbi-mortality reduction. Consequently, pharmacists’ activities and interventions are different between these patients. Pharmacists’ activities proposed to patients with T2D have specific outcomes including the promotion of physical activity, healthy diet, and lifestyle. Secondly, most published meta-analyses reported studies led in different care settings, including tertiary care/hospital setting [10,11,13,14,15,16,17,18]. Regarding settings, primary care represents the cornerstone of the health system and the first contact for initial and long-term diabetes management. Most subjects with T2D see their general practitioner and pharmacist several times a year. Indeed, primary care providers deliver the majority of care to patients with T2D [19].
To our knowledge, no meta-analysis, showing the significant impact of pharmacists’ interventions on HbA1c, were focused on interventions in the primary care setting only (community pharmacies or primary care centers) in the control of T2D.
Thus, the primary objective of this systematic review and meta-analysis is to evaluate the association between interventions led by community pharmacists or pharmacists in primary care centers and the mean change in HbA1c levels. The secondary objective is to study the association between these interventions and blood pressure control.
2. Materials and Methods
2.1. Search Strategy
A bibliographic search was performed in the following databases: Pubmed, Cochrane, and Embase. The two keywords “diabetes” and “pharmacist” were used, combined using the Boolean Operator “AND”. All studies were searched from the start date of each database, up to July 2021. The detailed search strategy is given in Appendix A. In every meta-analysis identified about pharmacists’ interventions and T2D, references were checked for potential additional studies
2.2. Study Selection
The study selection was performed by two reviewers (C.C. and L.K.). First, they reviewed independently all titles and abstracts. Any disagreement was discussed and then resolved among the two reviewers (C.C. and L.K.) and when necessary the opinion of 2 other reviewers was requested (C.M. and F.S.). Then, all full texts of the articles included based on the titles and abstracts were independently reviewed by the same two persons (C.C. and L.K.). Any disagreement on the full text selection was discussed and solved, with 2 other reviewers if necessary (C.M. and F.S.).
2.2.1. Inclusion Criteria
Randomized controlled trials and quasi-experimental studies with a control group were included if they evaluated an intervention performed by a pharmacist in the primary care setting (community pharmacies or primary care centers) for patients with T2D, compared with usual pharmaceutical care. To be included, each article should have reported mean HbA1c levels in each group at baseline and at the end of the study (with standard deviation), or the mean change in HbA1c levels between baseline and the end of the study in each group (with the standard deviation of this mean difference or its 95% confidence interval (95% CI)).
2.2.2. Exclusion Criteria
Studies were excluded if
-
-
they were retrospective studies, observational studies and quasi-experimental pretest posttest designs with no control group;
-
-
the intervention was not considered to be part of the primary care (e.g., hospital setting, clinical pharmacist interventions);
-
-
there was no physical encounter between the pharmacist and the patient or if no education or counselling was proposed by the pharmacist;
-
-
the evaluated intervention was performed by a multidisciplinary team (e.g., pharmacists associated with nurses, dieticians, endocrinologist) because it would have been difficult to estimate the precise impact of the pharmacist, except for the cooperation between the pharmacist and the general practitioner because it constitutes the cornerstone of primary care and the pharmacist often makes recommendations to the general practitioner;
-
-
they evaluated the impact of the intervention on other chronic diseases (e.g., arterial hypertension) with no distinct results for the patients with diabetes.
2.3. Outcomes
The primary outcome of this meta-analysis was the mean change in HbA1c levels, commonly used in clinical practice to monitor glycemic control.
The secondary outcome was the mean change in systolic blood pressure (SBP). Focus was made on SBP only, as SBP and diastolic blood pressure (DBP) frequently display a linear relationship [20] and epidemiological studies suggest that SBP should be the primary target of antihypertensive therapy [21].
To evaluate the association between the pharmacist’s intervention and the outcomes, the mean change in HbA1c and SBP between baseline and the end of the intervention in each group was used.
2.4. Data Extraction
One of the reviewers (C.C.) extracted the data from the included studies. All data were double-checked by the second reviewer (L. K.). The extracted information from the full text of the study were: first author, year of publication, study design, country of the study site, intervention setting (i.e., community pharmacies or primary care centers), intervention type (e.g., education, medication review), intervention duration and frequency, pharmacist’s specific training for the study, inclusion and exclusion criteria of the patients, patients’ mean age (years), number of subjects in each group, mean baseline HbA1c (%), mean baseline SBP (mmHg), mean final HbA1c and/or mean change between baseline and the end of the intervention (and standard deviation or 95% CI), mean final SBP and/or mean change between baseline and the end of the intervention (and standard deviation or 95% CI). We recorded the level of development of each study’s country using the Human Development Index (HDI) [22]. The HDI is calculated based on 3 key elements of human development: life expectancy at birth, education and national income per capita. A HDI of 0.8 or higher indicates a very high human development of the country.
2.5. Risk of Bias Assessment
To assess the risk of bias of the included studies, the Cochrane’s risk of bias criteria for Effective Practice and Organization of Care (EPOC) reviews was used [23]. This tool can be used for randomized trials, non-randomized trials and controlled before-after studies that evaluate the effects of health care interventions. Nine criteria were investigated: random sequence generation, allocation concealment, protection against contamination, selective outcome reporting, knowledge of the allocated interventions adequately prevented during the study, incomplete outcome data, baseline outcome measurements similar (i.e., baseline HbA1c levels), baseline characteristics similar, and other risks of bias.
Each item was scored as “Low risk”, “High Risk”, or “Unclear Risk”. Two reviewers (C.C. and L.K.) completed the assessment independently and any disagreement was discussed and solved. The EPOC risk of bias tool is presented in Supplementary Materials file S1.
Moreover, potential publication bias was evaluated with a funnel plot.
2.6. Statistical Analysis
The association between each outcome (HbA1c and SBP) and the intervention was evaluated quantitatively by meta-analysis, using random-effect models (DerSimonian-Laird method). Inverse variance weighting was used for pooling, that is, the weight given to each study was the inverse of the variance of the effect estimate. Pooled effect estimates were calculated as a weighted average of the intervention effects estimated in the individual studies.
For the primary outcome, the mean change in HbA1c levels between the baseline and the end of the intervention was compared between the intervention and the control group. Standardized mean differences (SMD) were calculated using the Hedges’ g statistic and presented with their 95% CI.
When mean difference between baseline and the end of the intervention in each group was missing, it was calculated from mean baseline and mean final HbA1c in each group and when the standard deviation of the mean difference was missing, it was computed from the 95% CI of the mean difference. If it was not possible to compute the missing values, especially regarding the standard deviation of the mean difference before and after intervention, the corresponding author was contacted and asked for the missing data. Between-study heterogeneity was assessed using the Q-test, the I2 statistic (percentage of between-study variation due to statistical heterogeneity rather than chance alone), and the τ2 (between-study variance, using the DerSimonian–Laird estimator).
For the secondary outcome (SBP), the same analysis as for HbA1c was conducted.
Subgroup analyses according to baseline HbA1c levels, age of the included participants, duration of intervention, frequency of intervention, country development (HDI) and intervention setting (community pharmacies or primary healthcare centers/clinics/units) were performed to explore heterogeneity among studies on the primary outcome, as recommended by Cochrane [24]. Selection of variables for subgroups analyses was done from previous studies and meta-analyses about diabetes and pharmacist’s interventions [17].
The characteristics of each group were described with the number of included patients, the mean age of the included patients, the mean baseline HbA1c levels, and the mean baseline SBP.
A sensitivity analysis was performed with studies for which mean HbA1c levels at the end of the intervention (and their standard deviation) were available to assess the robustness of the primary analysis results.
All analyses were performed with R software, version 4.0.5 (R Core Team (2020). R Foundation for Statistical Computing, Vienna, Austria), using the meta package (version 5.2-0, Balduzzi S, Rücker G, Schwarzer G, 2019).
This meta-analysis was performed in accordance with the Preferred Reporting Items for Systematic Reviews and Meta-analysis (PRISMA) recommendations [25] (Supplementary Materials file S2).
3. Results
Through database and reference searching, a total of 3835 abstracts were screened and 48 full-text articles were assessed for eligibility. At the end of the full-text assessment, 12 articles [26,27,28,29,30,31,32,33,34,35,36,37] were included in this meta-analysis. The main reasons for exclusion were interventions not corresponding to the inclusion criteria (e.g., secondary or tertiary care, no education or counselling), no data on HbA1c in each group and no full-text found (e.g., conference abstract). The details are shown in Figure 1.
3.1. Study Characteristics
The 12 studies included in this review were conducted in different countries all over the world: four in Europe [26,31,35,36] (i.e., United Kingdom, Spain, Belgium, and France), one in Australia [34], one in the United States of America [29] (USA), two in Brazil [28,37], and four in the Middle East and Asia [27,30,32,33] (i.e., Malaysia, Indonesia, Iran, Pakistan). Eleven studies were randomized controlled trials [26,27,29,30,31,32,33,34,35,36,37] and one study was a quasi-experimental controlled study [28]. Most of the studies took place in community pharmacies [26,28,29,31,32,34,35,36] (eight studies), the others in primary care units/clinics/centers [27,30,33,37]. The duration of the pharmacist intervention ranged from 5 to 13 months. The majority of these interventions occurred monthly [27,28,30,31,32,34,35,37].
All evaluated interventions provided education about diabetes to the patients, the topics varied according to the study (e.g., lifestyle, self-care, diet, adherence, complications of diabetes, drug use). Most pharmacists also provided medication review [26,27,28,29,31,32,33,34,37] (nine studies) and some, who identified drug related problems, formulated pharmacist’s interventions to the prescribers [27,28,29,33,37]. In 11 studies, the pharmacists followed a specific training program about diabetes [26,27,28,29,30,31,32,34,35,36,37].
The population of interest was slightly different among the studies with different inclusion and exclusion criteria, especially regarding the age, the HbA1c level and the use of insulin. The detailed characteristics of each study are presented in Table 1.
Table 1.
Study | Country; HDI | Study Design | Intervention Duration | Setting | Intervention Type | Frequency | Pharmacist Training | Inclusion/Exclusion Criteria |
---|---|---|---|---|---|---|---|---|
Ali 2012 [26] | United-Kingdom; HDI = 0.932 |
Randomized controlled study; Randomization at the patient level |
12 months | 2 community pharmacies | Pharmaceutical care package: targeted medicine use review (compliance and counseling), comprehensive and individualized education, lifestyle modification counseling | Every month the first 2 months, then every 3 months | 8 h training program: update on diabetes management and referrals, overview of the use of diagnostic equipment | T2D, >18 y/o, oral medication (no insulin), no significant co-morbidity, HbA1C ≥ 7% |
Ayadurai 2018 [27] | Malaysia; HDI = 0.810 |
Randomized controlled study; Randomization at the patient level | 6 months | 7 primary healthcare practices (health clinics) | Simplified tool to manage T2D: medication related concerns, recommendations to the prescribers, education | Monthly | 2h online training program to use the tool | T2D, >21 y/o, on multiple medications (including for other chronic conditions) and/or have other diseases in addition to diabetes, HbA1C > 8% (or fasting blood sugar > 7.0 mmol/L or 2 h post prandial sugar level > 8.5 mmol/L) |
Correr 2011 [28] | Brazil; HDI = 0.765 |
Quasi-experimental controlled study | 12 months | 6 community pharmacies | PFU program: comprehensive and systematic medication outcome assessment, suggesting changes in the medication, education | Monthly | Training on basic concepts and procedures of pharmacotherapy follow-up, diabetes care, glucose and blood pressure measurement | T2D, >30 y/o, using either oral hypoglycemiants or insulin |
Doucette 2009 [29] | USA; HDI = 0.926 |
Randomized controlled study; Randomization at the patient level |
12 months | 7 community pharmacies | Assessment of clinical markers, review of medications and self-care behaviors, identifying drug therapy problems, recommendation of drug therapy change and education (diabetes self-care) | Quarterly | Training in diabetes management: 15 h self-study certificate program in diabetes management and live training (pathophysiology, therapeutics, self-care…) | T2D, HbA1C ≥ 7.0% |
Fajriansyah 2020 [30] | Indonesia; HDI = 0.718 |
Randomized controlled trial; Randomization at the center level | 6 months | 4 primary health care centers (Puskesmas) | Education about T2D causes and symptoms, importance of therapy, therapies available, guidelines for the treatment, purpose of controlling blood sugar levels, lifestyle | Monthly | 8 h training with experts | T2D, 18 ≤ age ≥ 65 y/o, HbA1C ≥ 6.5% |
Fornos 2006 [31] | Spain; HDI = 0.904 |
Randomized controlled trial; Randomization at the patient level | 13 months | 14 community pharmacies | PFU program: prevent, detect and solve the problems related to the drugs used, information about drug (correct use, adverse reaction, interaction), assessment of lifestyle and health education actions | Monthly | Educational program to increase knowledge about diabetes and 18h of trainingin the PFU program and in the proper use of the measuring tools | T2D, on oral antidiabetics > 2 months |
Jahangard-Rafsanjani 2014 [32} | Iran; HDI = 0.783 |
Randomized controlled trial; Randomization at the patient level |
5 months | 1 community pharmacy | Diabetes education program on diet management, physical activity, diabetes complications, discussion about medication-related problems and self-care issues | Monthly | 4 h training: pathophysiology and pharmacotherapy, 3-day workshop on diabetes education | T2D, oral hypoglycemic medications, HbA1C > 7% within the preceding month |
Javaid 2019 [33] | Pakistan; HDI = 0.557 |
Randomized controlled trial; Randomization at the patient level |
9 months | 1 primary care clinic | Comprehensive pharmaceutical care plan: assessment for drug related problems, suggestions for therapy changes, verbal and readable education (insulin administration, medication adherence, treatment goals, self-care, dietary, lifestyle, monitoring of blood glucose, footcare and hygiene...) | Quarterly | NA | T2D, >18 y/o, HbA1c > 8%, |
Krass 2007 [34] | Australia; HDI = 0.944 |
Randomized controlled trial; Randomization at the pharmacy level | 6 months | 56 community pharmacies | Review of self-monitoring of blood glucose, disease, medication, self-management and lifestyle education (physical activity, weight loss), adherence support, medication review and detection of drug-related problems | Monthly | Diabetes education manual for self-directed learning and a 2-day workshop (pharmacotherapy, dietary management, role-playing exercises, training on the use of measuring tools) | T2D with:
|
Mehuys 2011 [35] | Belgium; HDI = 0.931 |
Randomized controlled trial; Randomization at the pharmacy level | 6 months | 66 community pharmacies | Education on diabetes and its complications, about the correct use of oral hypoglycemic agents, facilitation of medication adherence, healthy lifestyle education, reminders about annual eye and foot examinations | At each prescription-refill visit | Training session on the pathophysiology of diabetes and its non-pharmacological and pharmacological management | T2D, 45 ≤ age ≥ 75, BMI ≥ 25 kg/m2, treatment with oral hypoglycemic medication for ≥ 12 months |
Michiels 2019 [36] | France; HDI = 0.901 |
Randomized controlled trial; Randomization at the pharmacy level | 6 months | 174 community pharmacies | Structured and tailored information on diabetes diet, medication management and diabetes complications | 3 interviews | Information on the study by phone, face to face training and a guide explaining how to perform the interviews | T2D, HbA1c level > 7%, with ≤3 different oral antidiabetic drugs |
Mourao 2013 [37] | Brazil; HDI = 0.765 |
Randomized controlled trial; Randomization at the patient level |
6 months | 6 primary health care units | Care plan including pharmacotherapy changes if necessary and education about non-pharmacological issues (aetiology, pathophysiology, complications, treatment goals, lifestyle) and pharmacological treatments (proper dosage, side-effects, drug storage) | Monthly | Training in pharmaceutical care and diabetes management | T2D, ≥18 y/o, with post-prandial capillary glucose ≥180 mg/dL and HbA1c ≥ 7 %, under ≥1 oral antidiabetic medications for ≥6 months |
Abbreviations: HDI = Human Development Index; h = hour; T2D = type 2 diabetes mellitus; y/o = years old; HbA1c = glycated hemoglobin; PFU = Pharmacotherapy follow-up; NA = not available.
The overall mean age of the study participants ranged from 50.4 to 66.6 years old. The overall mean baseline HbA1c level ranged from 7.5% to 10.9% and overall mean baseline SBP ranged from 119.0 to 146.7 mmHg (Table 2).
Table 2.
Study | Patients (n) | Mean Age (years) | Mean Baseline HbA1c (%) | Mean Baseline SBP (mmHg) | ||||
---|---|---|---|---|---|---|---|---|
Intervention | Control | Intervention | Control | Intervention | Control | Intervention | Control | |
Ali 2012 [26] | 23 | 23 | 66.4 | 66.8 | 8.2 | 8.1 | 146.3 | 136.2 |
Ayadurai 2018 [27] | 55 | 69 | 55 | 58 | 10.68 | 10.32 | 137 | 137.8 |
Correr 2011 [28] | 50 | 46 | 58.1 | 59.5 | 9.9 | 8.6 | 135 | 147.7 |
Doucette 2009 [29] | 31 | 35 | 58.7 | 61.2 | 7.99 | 7.91 | 118.2 | 119.8 |
Fajriansyah 2020 [30] | 109 | 111 | mean age of both groups: 57.7 | 8.45 | 8.9 | |||
Fornos 2006 [31] | 56 | 56 | 62.4 | 64.9 | 8.4 | 7.8 | 143 | 148 |
Jahangard-Rafsanjani 2014 [32] | 45 | 40 | 57.3 | 55.9 | 7.6 | 7.5 | 132 | 136.4 |
Javaid 2019 [33] | 83 | 52 | 50.3 | 50.4 | 11 | 10.7 | 145 | 133 |
Krass 2007 [34] | 157 | 142 | mean age of both groups: 62 | 8.9 | 8.3 | 135 | 133 | |
Mehuys 2011 [35] | 148 | 132 | 63 | 62.3 | 7.7 | 7.3 | ||
Michiels 2019 [36] | 189 | 188 | 65.1 | 66.3 | 7.9 | 7.7 | 134.4 | 137 |
Mourao 2013 [37] | 50 | 50 | 60 | 61.3 | 9.9 | 9.5 | 152.9 | 140.4 |
Abbreviations: HbA1c = glycated hemoglobin; SBP = systolic blood pressure.
3.2. Risk of Bias Assessment
The risk of bias assessment with the EPOC criteria showed variability in the quality of the included studies. There was low risk of bias induced by the knowledge of the allocated intervention and low risk of bias of selective outcome reporting. Regarding the random sequence generation, 11 studies were randomized controlled studies but four of them did not describe with enough details the randomization process (unclear risk) and one study was a non-randomized controlled one (high risk). There were some concerns regarding differences between the two groups of the baseline characteristics (high or unclear risk for six studies) and the baseline outcomes (high risk for two studies). The two most important risks of bias, found at high risk in 7 out of 12 studies, were the presence of incomplete outcome data for patients at the end of the intervention regarding the primary outcome (e.g., patients lost to follow-up) and the risk of contamination of the intervention between the groups when the randomization was at the patient level and not at the pharmacy or center level. The summary of these results is available in Appendix B.
Regarding publication bias, the analysis of the funnel plot did not find any major bias (Appendix C).
3.3. Meta-Analysis
3.3.1. Primary Outcome
Of the 12 studies included in this meta-analysis, 10 reported adequate data to be included in the primary analysis [26,27,28,29,30,31,32,34,35,37] (i.e., mean change in HbA1c values between baseline and the end of the intervention and the standard deviation of this difference in each group were available or necessary data to compute them were available). Indeed, it was not possible for two studies to calculate, or collect the missing data regarding the standard deviation of the mean difference before and after intervention [33,36].
The results of the primary analysis, evaluating the impact of the pharmacist intervention using the mean change in HbA1c values between baseline and the end of the intervention in the intervention group compared to the usual care group, are presented in Figure 2. A total of 1196 subjects were included, and seven studies showed a beneficial effect [27,28,30,31,34,35,37]. The overall SMD was −0.67 (95% CI = [−0.87; −0.48], p < 0.0001), showing that pharmacist’s interventions significantly reduced HbA1c compared to usual care in T2D patients. Heterogeneity among the included studies was high and significant (I2 = 61%, p < 0.01).
The sensitivity analysis, comparing the mean HbA1c level at the end of the intervention in the intervention group compared to the usual care group, included nine studies [26,27,30,31,32,33,34,35,36] and 1391 patients, which had the necessary data available (i.e., mean HbA1c values and standard deviation at the end of the intervention, in each group). This analysis showed a significant reduction of HbA1c in the intervention group compared to the usual care group (SMD = −0.58 95% IC = [−0.93; −0.22], p = 0.0016). This result is consistent with the primary analysis.
3.3.2. Subgroups Analysis
No significant difference, in the reduction of HbA1c levels, between subgroups created according to baseline HbA1c level (<8.5% vs. ≥8.5%), age (≤60 years old or >60 years old), duration of intervention (≤6 months vs. >6 months), frequency of intervention (every month or less often than monthly), HDI (≥0.8, indicating a very high human development [38] vs. <0.8), and intervention setting were found.
The reduction of HbA1c seemed more important when baseline HbA1c was ≥8.5%, the intervention occurred every month, in a primary care center and in countries with a lower human development index (Figure 3).
3.3.3. Secondary Outcome
Five studies, representing 565 patients, reported adequate data to be included in the analysis of the secondary outcome [27,28,29,34,37]. The impact of the intervention on SBP was evaluated using the mean change between baseline and final measurements in the intervention group compared to the control group.
The results were not significant, with an overall SMD of −0.22 (IC 95% = [−0.54; 0.11], p = 0.19). Heterogeneity was high and significant (I2 = 72%, p < 0.01) (Figure 4).
4. Discussion
The results highlight the beneficial effect of pharmacist-led interventions in the primary care setting for T2D patients on glycemic control as measured by HbA1c.
These results are consistent with other meta-analyses on this topic when including T1D and T2D patients [12] or studies led in the secondary and tertiary care setting [11].
The two most important points of the pharmacist’s interventions in the included studies were education about diabetes mellitus and medication review.
When accurately described in the articles reviewed, most of the interventions in the included studies referred to the diabetes self-management education (DSME). The ADA defines DSME as an education, brought by all health care professionals, to improve knowledge and aptitudes of the patient to perform diabetes self-care [39]. Seven primordial behaviors for self-management of diabetes have been defined because evidence showed that they were associated with better outcomes [40]. Among these identified behaviors, one can find healthy diet, physical activity, adherence to medication and monitoring of blood glucose. These key elements are reported in the studies of this analysis. It is crucial that this education is part of each professional care for patients with T2D.
A closer look at the interventions on diabetes treatments pointed out that 10 of 12 studies included drug review/management. Medication review consists in a structured evaluation of a patient’s medicines with the aim of optimizing medicines use and improving health outcomes. This entails detecting drug related problems and formulating interventions [41]. A review from Jokanovic et al. in 2017, about pharmacist-led medication review, reported 35 out of 45 studies with beneficial effects on glycemic control [42].
Even if the comparisons between subgroups were not statistically significant, the pharmacist intervention seemed to have more beneficial effects on HbA1c levels in patients with higher baseline HbA1c values, living in countries with a lower HDI, when it was conducted every month and in a primary care center. These results are consistent with another meta-analysis led by Aguiar et al. which highlighted that the impact of the pharmacist tended to be more important when the mean baseline HbA1c levels were more than 9.0% and when the intervention was led in other outpatient settings compared with a community pharmacy [17].
These findings regarding the setting could be explained by the fact that primary care centers often offer to the patients a multidisciplinary care and direct cooperation between professionals, with focus on T2D for specialized centers. These could have influenced the intervention and led to better results in these patients, compared to the community pharmacies where it can be more difficult for the pharmacists to have interactions with other professionals [43,44]. Moreover, there might be a different level of experience in the management of chronic diseases between pharmacists working in different settings. Nonetheless, the role of the community pharmacist is crucial in diabetes care, as the most accessible healthcare professional in many countries, and their full integration in existing care models of chronic diseases needs to be strengthened [7].
Concerning the benefits on higher baseline HbA1c levels and in developing countries, the results are consistent with literature data [11,14]. Indeed, diabetes prevalence increases quickly in developing countries while access to the necessary care can be challenging [45]. Patients with poorer glycemic control might lack adequate care and education that can be highly improved with pharmacists’ interventions. Margins for improvement are also more important with higher baseline HbA1c levels. It has already been discussed that there is a critical need for efficient primary care structures to manage chronic diseases in low and middle-income countries [46].
Despite including only controlled trials led in the primary care setting, heterogeneity was high. Statistical heterogeneity refers to the differences between studies in the effect of the evaluated intervention that are not attributable to chance alone. It can be explained, among many other elements, by the study setting, the characteristics of the study population and the type of intervention [47].
This heterogeneity was explored with subgroups analyses. Indeed, it is interesting to note that heterogeneity was less important (<50%) in studies where overall mean baseline HbA1C was less than 8.5%, age was above 60 years old, the intervention lasted more than six months, the HDI of the country was more than 0.8 and the setting was a community pharmacy.
Heterogeneity can also be explained by methodological differences between studies. One of the biggest risks of bias was the risk of contamination of the intervention. It is the case when randomization is not at the pharmacy or center level. Indeed, a professional who has been trained for a specific intervention is at risk of also modifying their usual care practice for patients in the control group. These patients may also interact with patients in the intervention group, benefit from advice and change their self-care attitude. This can dilute the effect of the intervention and lead a real difference between groups to go unnoticed. Among the 10 studies included in the primary analysis, three brought non-significant results [26,29,32] and they were all RCTs with randomization at the patient level. However, contamination when randomization is at the patient level can be avoided with a good study design. Cluster-randomized trials can be difficult to implement because they need a larger sample size and can be associated with recruitment bias [48].
Regarding the secondary outcome, unlike a meta-analysis performed by Fazel et al. [13], no beneficial effect of the pharmacist on SBP was found. This result might be explained by a lack of power, having only 565 patients included, and by the fact that the interventions were really focused on diabetes care, and not especially on blood pressure control, even if this is an important element of care in this population with a higher cardiovascular risk.
This meta-analysis was, to our knowledge, the first one to focus especially on pharmacist-led interventions in the primary care setting for patients with T2 diabetes. Included studies were only controlled trials, owing to their high level of evidence. In order to be exhaustive and prevent missing potential studies, broad research keywords were used in each database.
However, this study has some limitations. The main one might be the small number of included studies. Precise inclusion criteria were used to focus only on T2D and primary care but this allowed only 12 studies to be included, out of the 3835 abstracts initially screened. Moreover, it was not possible to retrieve the necessary data for the primary analysis for 2 studies. But the sensitivity analysis, performed with studies for which mean HbA1c levels at the end of the intervention was available, included these two studies and brought similar results. The lack of statistical power might explain the non-significant results between subgroups. Moreover, some of the variables chosen for subgroups analyses might be associated. It would have been interesting to explore the effect of each variable independently of the others on the reduction of HbA1c level with a meta-regression but the number of included studies in this meta-analysis was not sufficient.
5. Conclusions
The results of this systematic review and meta-analysis show that pharmacists-led interventions in the primary care setting can improve glycemic control for adults with type 2 diabetes. Long-term and repeated interventions, including thorough patient education about the disease, prevention of complications and medication review can lead to a significant improvement of diabetes control. HbA1c is a biomarker reflecting glycemic control and remains an intermediate endpoint in the context of T2D evolution and complications. Further studies are needed to evaluate the impact of these interventions performed by pharmacists on clinical outcomes, including microvascular but also macrovascular complications such as cardio-vascular events.
Supplementary Materials
The following supporting information can be downloaded at: https://www.mdpi.com/article/10.3390/ijerph19063156/s1, Document S1: Suggested risk of bias criteria for EPOC reviews; Table S2: PRISMA 2009 Checklist.
Appendix A
Search Strategy
PubMed (July 5th, 2021): (“diabetes mellitus”[MeSH Terms] OR (“diabetes”[All Fields] AND “mellitus”[All Fields]) OR “diabetes mellitus”[All Fields] OR “diabetes”[All Fields] OR “diabetes insipidus”[MeSH Terms] OR (“diabetes”[All Fields] AND “insipidus”[All Fields]) OR “diabetes insipidus”[All Fields]) AND (“pharmacists”[MeSH Terms] OR “pharmacists”[All Fields] OR “pharmacist”[All Fields])
Cochrane (July 5th, 2021): (Trials matching “diabetes” in All Text AND “pharmacist” in All Text)—(Word variations have been searched)
Embase (July 6th, 2021): Pharmacist:ab,ti AND diabetes:ab,ti AND [embase]/lim NOT ([embase]/lim AND [medline]/lim)
Appendix B
Appendix C
Author Contributions
Study concept and design: C.C., L.K., F.S., C.M.; Acquisition of data: C.C., L.K.; Analysis and interpretation of data: C.C., L.K., F.S., C.M.; Drafting of the manuscript: C.C., L.K., F.S., C.M.; Critical revision of the manuscript for important intellectual content: C.C., L.K., F.S., C.M. All authors have read and agreed to the published version of the manuscript.
Funding
This research did not receive any specific grant from funding agencies in the public, commercial, or not-for-profit sectors.
Conflicts of Interest
The authors declare no conflict of interest.
Footnotes
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.
References
- 1.World Health Organization . Global Report on Diabetes. World Health Organization; Geneva, Switzerland: 2016. [Google Scholar]
- 2.International Diabetes Federation . IDF Diabetes Atlas. 6th ed. International Diabetes Federation, Executive Office; Brussels, Belgium: 2013. [Google Scholar]
- 3.Bommer C., Sagalova V., Heesemann E., Manne-Goehler J., Atun R., Bärnighausen T., Davies J., Vollmer S. Global Economic Burden of Diabetes in Adults: Projections From 2015 to 2030. Diabetes Care. 2018;41:963–970. doi: 10.2337/dc17-1962. [DOI] [PubMed] [Google Scholar]
- 4.American Diabetes Association Glycemic targets: Standards of medical care in diabetes—2020. Diabetes Care. 2020;43((Suppl. S1)):S66–S76. doi: 10.2337/dc20-S006. [DOI] [PubMed] [Google Scholar]
- 5.Stratton I.M. Association of glycaemia with macrovascular and microvascular complications of type 2 diabetes (UKPDS 35): Prospective observational study. BMJ. 2000;321:405–412. doi: 10.1136/bmj.321.7258.405. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Grossman A., Grossman E. Blood pressure control in type 2 diabetic patients. Cardiovasc. Diabetol. 2017;16:3. doi: 10.1186/s12933-016-0485-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Brewster S., Holt R., Portlock J., Price H. The role of community pharmacists and their position in the delivery of diabetes care: An update for medical professionals. Postgrad. Med. J. 2020;96:473–479. doi: 10.1136/postgradmedj-2020-137511. [DOI] [PubMed] [Google Scholar]
- 8.Mossialos E., Courtin E., Naci H., Benrimoj S., Bouvy M., Farris K., Noyce P., Sketris I. From “retailers” to health care providers: Transforming the role of community pharmacists in chronic disease management. Health Policy. 2015;119:628–639. doi: 10.1016/j.healthpol.2015.02.007. [DOI] [PubMed] [Google Scholar]
- 9.Cranor C.W., Bunting B.A., Christensen D.B. The Asheville Project: Long-term clinical and economic outcomes of a community pharmacy diabetes care program. J. Am. Pharm. Assoc. 2003;43:173–184. doi: 10.1331/108658003321480713. [DOI] [PubMed] [Google Scholar]
- 10.Presley B., Groot W., Pavlova M. Pharmacy-led interventions to improve medication adherence among adults with diabetes: A systematic review and meta-analysis. Res. Soc. Adm. Pharm. 2019;15:1057–1067. doi: 10.1016/j.sapharm.2018.09.021. [DOI] [PubMed] [Google Scholar]
- 11.Jeong S., Lee M., Ji E. Effect of pharmaceutical care interventions on glycemic control in patients with diabetes: A systematic review and meta-analysis. Ther. Clin. Risk Manag. 2018;14:1813–1829. doi: 10.2147/TCRM.S169748. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Deters M.A., Laven A., Castejon A., Doucette W.R., Ev L.S., Krass I., Mehuys E., Obarcanin E., Schwender H., Laeer S. Effective interventions for diabetes patients by community pharmacists: A meta-analysis of pharmaceutical care components. Ann. Pharmacother. 2018;52:198–211. doi: 10.1177/1060028017733272. [DOI] [PubMed] [Google Scholar]
- 13.Fazel M.T., Bagalagel A., Lee J.K., Martin J.R., Slack M.K. Impact of diabetes care by pharmacists as part of health care team in ambulatory settings: A systematic review and meta-analysis. Ann. Pharmacother. 2017;51:890–907. doi: 10.1177/1060028017711454. [DOI] [PubMed] [Google Scholar]
- 14.Nogueira M., Otuyama L.J., Rocha P.A., Pinto V.B. Pharmaceutical care-based interventions in type 2 diabetes mellitus: A systematic review and meta-analysis of randomized clinical trials. Einstein. 2020;18:eRW4686. doi: 10.31744/einstein_journal/2020RW4686. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Collins C., Limone B.L., Scholle J.M., Coleman C.I. Effect of pharmacist intervention on glycemic control in diabetes. Diabetes Res. Clin. Pract. 2011;92:145–152. doi: 10.1016/j.diabres.2010.09.023. [DOI] [PubMed] [Google Scholar]
- 16.Bukhsh A., Khan T.M., Lee S.W.H., Lee L.H., Chan K.G., Goh B.H. Efficacy of Pharmacist Based Diabetes Educational Interventions on Clinical Outcomes of Adults with Type 2 Diabetes Mellitus: A Network Meta-Analysis. Front. Pharmacol. 2018;9:339. doi: 10.3389/fphar.2018.00339. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Aguiar P.M., Brito G.d.C., Lima T.d.M., Santos A.P.A.L., Lyra D.P., Storpirtis S. Investigating sources of heterogeneity in randomized controlled trials of the effects of pharmacist interventions on glycemic control in type 2 diabetic patients: A systematic review and meta-Analysis. PLoS ONE. 2016;11:e0150999. doi: 10.1371/journal.pone.0150999. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Machado M., Bajcar J., Guzzo G.C., Einarson T.R. Sensitivity of patient outcomes to pharmacist interventions. Part I: Systematic review and meta-analysis in diabetes management. Ann. Pharmacother. 2007;41:1569–1582. doi: 10.1345/aph.1K151. [DOI] [PubMed] [Google Scholar]
- 19.Shrivastav M., Gibson W., Shrivastav R., Elzea K., Khambatta C., Sonawane R., Sierra J.A., Vigersky R. Type 2 Diabetes Management in Primary Care: The Role of Retrospective, Professional Continuous Glucose Monitoring. Diabetes Spectr. 2018;31:279–287. doi: 10.2337/ds17-0024. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Gavish B., Ben-Dov I.Z., Bursztyn M. Linear relationship between systolic and diastolic blood pressure monitored over 24 h: Assessment and correlates. J. Hypertens. 2008;26:199–209. doi: 10.1097/HJH.0b013e3282f25b5a. [DOI] [PubMed] [Google Scholar]
- 21.Strandberg T.E., Pitkala K. What is the most important component of blood pressure: Systolic, diastolic or pulse pressure? Curr. Opin. Nephrol. Hypertens. 2003;12:293–297. doi: 10.1097/00041552-200305000-00011. [DOI] [PubMed] [Google Scholar]
- 22.United Nations Development Programme Human Development Reports: Human Development Index (HDI) [(accessed on 14 May 2021)]. Available online: http://hdr.undp.org/en/content/human-development-index-hdi.
- 23.Cochrane Effective Practice and Organisation of Care (EPOC) EPOC Resources for Review Authors. 2017. [(accessed on 16 May 2021)]. Available online: Epoc.cochrane.org/resources/epoc-resources-review-authors.
- 24.Higgins J.P.T., Thomas J., Chandler J., Cumpston M., Li T., Page M.J., Welch V.A., editors. Cochrane Handbook for Systematic Reviews of Interventions. 2nd ed. John Wiley & Sons; Hoboken, NJ, USA: 2019. [Google Scholar]
- 25.Moher D., Liberati A., Tetzlaff J., Altman D.G., The PRISMA Group Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement. PLoS Med. 2009;6:e1000097. doi: 10.1371/journal.pmed.1000097. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Ali M., Schifano F., Robinson P., Phillips G., Doherty L., Melnick P., Laming L., Sinclair A., Dhillon S. Impact of community pharmacy diabetes monitoring and education programme on diabetes management: A randomized controlled study. Diabet. Med. J. Br. Diabet. Assoc. 2012;29:e326–e333. doi: 10.1111/j.1464-5491.2012.03725.x. [DOI] [PubMed] [Google Scholar]
- 27.Ayadurai S., Sunderland V.B., Tee L.B.G., Md Said S.N., Hattingh H.L. Structured tool to improve clinical outcomes of type 2 diabetes mellitus patients: A randomized controlled trial. J. Diabetes. 2018;10:965–976. doi: 10.1111/1753-0407.12799. [DOI] [PubMed] [Google Scholar]
- 28.Correr C.J., Melchiors A.C., Fernandez-Llimos F., Pontarolo R. Effects of a pharmacotherapy follow-up in community pharmacies on type 2 diabetes patients in Brazil. Int. J. Clin. Pharm. 2011;33:273–280. doi: 10.1007/s11096-011-9493-2. [DOI] [PubMed] [Google Scholar]
- 29.Doucette W.R., Witry M.J., Farris K.B., McDonough R.P. Community pharmacist-provided extended diabetes care. Ann. Pharmacother. 2009;43:882–889. doi: 10.1345/aph.1L605. [DOI] [PubMed] [Google Scholar]
- 30.Fajriansyah, Iskandarsyah A., Puspitasari I.M., Lestari K. Impact of pharmacist counseling on health-related quality of life of patients with type 2 diabetes mellitus: A cluster randomized controlled study. J. Diabetes Metab. Disord. 2020;19:675–682. doi: 10.1007/s40200-020-00528-x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.Fornos J.A., Andrés N.F., Andrés J.C., Guerra M.M., Egea B. A pharmacotherapy follow-up program in patients with type-2 diabetes in community pharmacies in Spain. Pharm. World Sci. PWS. 2006;28:65–72. doi: 10.1007/s11096-006-9003-0. [DOI] [PubMed] [Google Scholar]
- 32.Jahangard-Rafsanjani Z., Sarayani A., Nosrati M., Saadat N., Rashidian A., Hadjibabaie M., Ashouri A., Radfar M., Javadi M., Gholami K. Effect of a community pharmacist–delivered diabetes support program for patients receiving specialty medical care: A randomized controlled trial. Diabetes Educ. 2015;41:127–135. doi: 10.1177/0145721714559132. [DOI] [PubMed] [Google Scholar]
- 33.Javaid Z., Imtiaz U., Khalid I., Saeed H., Khan R.Q., Islam M., Saleem Z., Sohail M.F., Danish Z., Batool F. A randomized control trial of primary care-based management of type 2 diabetes by a pharmacist in Pakistan. BMC Health Serv. Res. 2019;19:409. doi: 10.1186/s12913-019-4274-z. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34.Krass I., Armour C.L., Mitchell B., Brillant M., Dienaar R., Hughes J., Lau P., Peterson G., Stewart K., Taylor S., et al. The Pharmacy Diabetes Care Program: Assessment of a community pharmacy diabetes service model in Australia. Diabet. Med. J. Br. Diabet. Assoc. 2007;24:677–683. doi: 10.1111/j.1464-5491.2007.02143.x. [DOI] [PubMed] [Google Scholar]
- 35.Mehuys E., Van Bortel L., De Bolle L., Van Tongelen I., Annemans L., Remon J.P., Giri M. Effectiveness of a community pharmacist intervention in diabetes care: A randomized controlled trial: Effectiveness of a pharmacist intervention in diabetes care. J. Clin. Pharm. Ther. 2011;36:602–613. doi: 10.1111/j.1365-2710.2010.01218.x. [DOI] [PubMed] [Google Scholar]
- 36.Michiels Y., Bugnon O., Chicoye A., Dejager S., Moisan C., Allaert F.A., Hunault C., Romengas L., Méchin H., Vergès B. Impact of a community pharmacist-delivered information program on the follow-up of type-2 diabetic patients: A cluster randomized controlled study. Adv Ther. 2019;36:1291–1303. doi: 10.1007/s12325-019-00957-y. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37.Mourão A.O.M., Ferreira W.R., Martins M.A.P., Moreira Reis A.M., Gaede Carrillo M.R., Guimaraes A.G., Ev L.S. Pharmaceutical care program for type 2 diabetes patients in Brazil: A randomised controlled trial. Int. J. Clin. Pharm. 2013;35:79–86. doi: 10.1007/s11096-012-9710-7. [DOI] [PubMed] [Google Scholar]
- 38.United Nations Development Programme Human Development Reports: Human Development Index and Its Components. [(accessed on 24 May 2021)]. Available online: http://hdr.undp.org/en/composite/HDI.
- 39.Powers M.A., Bardsley J., Cypress M., Duker P., Funnell M.M., Hess Fischl A., Maryniuk M.D., Siminerio L., Vivian E. Diabetes self-management education and support in type 2 diabetes: A joint position statement of the American Diabetes Association, the American Association of Diabetes Educators, and the Academy of Nutrition and Dietetics. Clin. Diabetes Publ. Am. Diabetes Assoc. 2016;34:70–80. doi: 10.2337/diaclin.34.2.70. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 40.Shrivastava S.R., Shrivastava P.S., Ramasamy J. Role of self-care in management of diabetes mellitus. J. Diabetes Metab. Disord. 2013;12:14. doi: 10.1186/2251-6581-12-14. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 41.Griese-Mammen N., Hersberger K.E., Messerli M., Leikola S., Horvat N., van Mil J.W., Kos M. PCNE definition of medication review: Reaching agreement. Int. J. Clin. Pharm. 2018;40:1199–1208. doi: 10.1007/s11096-018-0696-7. [DOI] [PubMed] [Google Scholar]
- 42.Jokanovic N., Tan E.C., Sudhakaran S., Kirkpatrick C.M., Dooley M.J., Ryan-Atwood T.E., Bell J.S. Pharmacist-led medication review in community settings: An overview of systematic reviews. Res. Soc. Adm. Pharm. 2017;13:661–685. doi: 10.1016/j.sapharm.2016.08.005. [DOI] [PubMed] [Google Scholar]
- 43.Chui M.A., Stone J.A., Odukoya O.K., Maxwell L. Facilitating collaboration between pharmacists and physicians using an iterative interview process. J. Am. Pharm. Assoc. 2014;54:35–41. doi: 10.1331/JAPhA.2014.13104. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 44.Ilardo M.L., Speciale A. The community pharmacist: Perceived barriers and patient-centered care communication. Int. J. Environ. Res. Public Health. 2020;17:536. doi: 10.3390/ijerph17020536. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 45.Karachaliou F., Simatos G., Simatou A. The Challenges in the Development of Diabetes Prevention and Care Models in Low-Income Settings. Front. Endocrinol. 2020;11:518. doi: 10.3389/fendo.2020.00518. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 46.Beaglehole R., Epping-Jordan J., Patel V., Chopra M., Ebrahim S., Kidd M., Haines A. Improving the prevention and management of chronic disease in low-income and middle-income countries: A priority for primary health care. Lancet. 2008;372:940–949. doi: 10.1016/S0140-6736(08)61404-X. [DOI] [PubMed] [Google Scholar]
- 47.Sterne J.A.C., Sutton A.J., Ioannidis J.P.A., Terrin N., Jones D.R., Lau J., Carpenter J., Rücker G., Harbord R.M., Schmid C.H., et al. Recommendations for examining and interpreting funnel plot asymmetry in meta-analyses of randomised controlled trials. BMJ. 2011;343:d4002. doi: 10.1136/bmj.d4002. [DOI] [PubMed] [Google Scholar]
- 48.Torgerson D.J. Contamination in trials: Is cluster randomisation the answer? BMJ. 2001;322:355. doi: 10.1136/bmj.322.7282.355. [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.