Skip to main content
PLOS One logoLink to PLOS One
. 2022 Apr 1;17(4):e0265971. doi: 10.1371/journal.pone.0265971

Effects of regional limb perfusion technique on concentrations of antibiotic achieved at the target site: A meta-analysis

Laurel E Redding 1, Elizabeth J Elzer 2, Kyla F Ortved 1,*
Editor: Richard Evans3
PMCID: PMC8974993  PMID: 35363825

Abstract

Intravenous regional limb perfusions (RLP) are widely used in equine medicine to treat distal limb infections, including synovial sepsis. RLPs are generally deemed successful if the peak antibiotic concentration (Cmax) in the sampled synovial structure is at least 8–10 times the minimum inhibitory concentration (MIC) for the bacteria of interest. Despite extensive experimentation and widespread clinical use, the optimal technique for performing a successful perfusion remains unclear. The objective of this meta-analysis was to examine the effect of technique on synovial concentrations of antibiotic and to assess under which conditions Cmax:MIC ≥ 10. A literature search including the terms “horse”, “equine”, and “regional limb perfusion” between 1990 and 2021 was performed. Cmax (μg/ml) and measures of dispersion were extracted from studies and Cmax:MIC was calculated for sensitive and resistant bacteria. Variables included in the analysis included synovial structure sampled, antibiotic dose, tourniquet location, tourniquet duration, general anesthesia versus standing sedation, perfusate volume, tourniquet type, and the concurrent use of local analgesia. Mixed effects meta-regression was performed, and variables significantly associated with the outcome on univariable analysis were added to a multivariable meta-regression model in a step-wise manner. Sensitivity analyses were performed to assess the robustness of our findings. Thirty-six studies with 123 arms (permutations of dose, route, location and timing) were included. Cmax:MIC ranged from 1 to 348 for sensitive bacteria and 0.25 to 87 for resistant bacteria, with mean (SD) time to peak concentration (Tmax) of 29.0 (8.8) minutes. Meta-analyses generated summary values (θ) of 42.8 x MIC and 10.7 x MIC for susceptible and resistant bacteria, respectively, though because of high heterogeneity among studies (I2 = 98.8), these summary variables were not considered reliable. Meta-regression showed that the only variables for which there were statistically significant differences in outcome were the type of tourniquet and the concurrent use of local analgesia: perfusions performed with a wide rubber tourniquet and perfusions performed with the addition of local analgesia achieved significantly greater concentrations of antibiotic. The majority of arms achieved Cmax:MIC ≥ 10 for sensitive bacteria but not resistant bacteria. Our results suggest that wide rubber tourniquets and concurrent local analgesia should be strongly considered for use in RLP and that adequate therapeutic concentrations (Cmax:MIC ≥ 10) are often achieved across a variety of techniques for susceptible but not resistant pathogens.

Introduction

Intravenous regional limb perfusion (RLP) is widely used in equine medicine to treat distal limb infections including synovial sepsis, osteomyelitis and cellulitis [13]. This technique is an accepted means of delivering high concentrations of antibiotics via the peripheral vasculature to regions of the limb isolated by a tourniquet [4]. It is proposed that the injection of the antibiotic increases local venous pressure and creates a concentration gradient both of which drive the antibiotic into peripheral tissues [5, 6]. One of the major advantages of RLP is the ability to achieve high concentrations of antibiotics in local tissues while maintaining low systemic concentrations [6]. This allows otherwise toxic and prohibitively expensive antibiotics to be used when indicated. Despite the widespread clinical use of regional limb perfusion in the horse, the optimal technique remains unclear.

A plethora of experimental studies evaluating different RLP techniques have been performed over the past two decades. In most experimental studies, the success of RLP is measured by quantifying the peak antibiotic concentration (Cmax) achieved in the synovial fluid of selected synovial structures and calculating the ratio of Cmax to the minimum inhibitory concentration (MIC), determined for the antibiotic and bacteria of interest. A Cmax:MIC of at least 8:1 to 10:1 has been recommended for aminoglycosides to be effective [7]. As recently reviewed by Biasutti et al. (2021), commonly investigated factors affecting the success of RLP include tourniquet type, tourniquet duration, tourniquet location in relation to the synovial structure sampled, perfusate volume, the use of general and regional anesthesia, and antibiotic dose [4]. Agreement among studies on the effects of each factor varies.

Meta-analysis allows statistical combination of results of multiple studies, weighted according to sample size and study precision. This technique increases statistical power and provides evidence for clinical decision making and future research needs [8]. The volume and variability of results in the RLP literature provides an opportunity for meta-analytic synthesis. The objective of this meta-analysis was to evaluate the effect of RLP technique on synovial concentrations of antibiotic and to assess under which conditions Cmax:MIC ≥ 10. Variables examined included tourniquet type, tourniquet duration, general anesthesia versus standing sedation, perfusate volume, antibiotic dose, synovial structure sampled, and the concurrent use of local analgesia.

Materials and methods

This meta-analysis was conducted according the recommendations of the PRISMA statement [8]. A protocol for Systematic Review and registration was not required.

Literature search

A literature search was carried out using PubMed/MEDLINE for date range January 1990 to December 2021. Search terms used included “horse”, “equine”, “regional limb perfusion”. Secondary searches were performed using the search engines of veterinary trade journals. Additional papers were identified in the bibliographies of relevant articles. Studies were included if they 1) involved equine species, 2) consisted of prospective, randomized studies comparing the effects of two or more techniques for intravenous RLP or pharmacokinetic studies of intravenous RLP of individual antibiotics; and 3) measured synovial concentration of the antibiotic at the time of tourniquet removal. Studies of intra-osseous RLP, RLP with two antibiotics mixed in one syringe, RLP using substances other than antibiotics, and studies that measured antibiotic concentrations in tissues other than synovial fluid were excluded. Studies examining clinical outcome (e.g., survival, return to use) and not synovial antibiotic concentration were also excluded. Any study for which it was not possible to extract or obtain the required data was excluded. Individual studies were evaluated for risk of bias with respect to randomization, incomplete reporting of outcome data, and selective outcome reporting.

Outcomes assessed

Because the most commonly cited therapeutic target for RLP is Cmax:MIC ≥ 10 for the most common equine orthopedic pathogens, the primary outcome measure for this study was Cmax:MIC. Since the most commonly isolated equine orthopedic pathogens are Staphylococcus aureus and Enterobacteriaceae [911], MICs for susceptible and resistant strains of these bacteria were obtained from the Clinical and Laboratory Standards Institute (CLSI) [12]. The mean peak concentration of antibiotic and the standard errors were then transformed to multiples of the minimum inhibitory concentration (MIC) for susceptible (MICsus) and resistant organisms (MICres).

Data extraction

Identification of eligible articles against predetermined inclusion and exclusion criteria, and extraction of data was performed by blindly by two authors (EJE and KFO). Discrepancies were resolved by consensus. Data collected for purposes of uniquely identifying studies were article title, authors’ names, journal name, year of publication, volume, and page numbers. The outcome extracted from all studies was the mean peak concentration (Cmax) of antibiotic in μg/ml and measures of dispersion. Because standard errors of the outcome are required as input for a meta-analysis, we estimated these values for the arms where they were not provided in the original paper. In studies where only a standard deviation was given, the standard error (SE) was calculated as:

SE=SDn

where SD is the standard deviation and n is the number of horses in the arim.

When a standard deviation was missing but a 95% confidence interval was provided (n = 13 arms), the standard deviation was estimated as: [13]

SD=n*upperlimitofCI-lowerlimitofCI3.92

When a standard deviation was missing but a range of values was provided (n = 54 arms), the standard deviation was estimated as:

SD=upperlimitofrange-lowerlimitofrangeξn

Where ξ(n) = 2*E(Zn) and E(Zn) is the expected value of the Z-statistic for the sample size n. [14] Values for ξ(n) are provided as supplementary material, as reported by Wan et al. [14]

In a small number of case (n = 6 arms), only an interquartile range (IQR) for the outcome was provided. In those cases, SD was calculated as:

SD=upperlimitofIQR-lowerlimitofIQRη(n)

where η(n) = 2*E(Z(3Q+1)) and Q = (n-1)/4. Values for η(n) are provided as supplementary material, as reported by Wan et al. [14]. When measures of dispersion were not provided in the text of the manuscript (2 manuscripts, 5 arms), these values were extracted from manuscript figures using WebPlotDigitizer (v.4.3) [15].

Other data extracted from the studies included the number of horses perfused, tourniquet type and pressure (for pneumatic tourniquets), tourniquet location, antibiotic used, perfusate volume, synovial structure sampled, times of sampling, peak antibiotic concentration achieved, and time of peak antibiotic concentration. Tourniquet type was divided into three categories (wide rubber, pneumatic with ≤ 400 mmHg pressure, pneumatic with > 400 mmHg pressure). Tourniquet time was divided into two categories (≤ 25 minutes and > 25 minutes). Perfusate volume was divided into three categories (6–30 mL, 40–60 mL, and 100–120 mL). Antibiotic dose was divided into three categories (< 1/3 systemic dose, 1/3-2/3 systemic dose, and > 2/3 systemic dose). An interaction term for structure sampled and tourniquet number and location was also generated, where “near” denoted structures sampled near the distal limit of perfusion (i.e., the distal interphalangeal joint, the metacarpophalangeal joint, and any carpal or tarsal joint isolated by a second distal tourniquet) and “far” denoted structures sampled remotely from the distal limit of perfusion (i.e., any carpal or tarsal joint not isolated by a second distal tourniquet).

Data analysis

Because most studies reported multiple RLP arms with varying parameters, we considered each arm to be a unique study. However, to account for clustering of arms within studies, we performed random-effects meta-analyses for each outcome (multiples of MIC for susceptible organisms and resistant organisms). Heterogeneity between studies was assessed by calculating I2 and Cochran’s Q statistics following the meta-analysis. Briefly, I2 provides an estimate of the percentage of variability in results across studies that is due to real differences and not due to chance, while the Q statistic tests the null hypothesis that the summary measure is the same across studies and that variations are simply caused by chance.

To further explore sources of heterogeneity among studies and their effects on the outcome, mixed effects meta-regression was performed. Variables significantly associated with the outcome on univariable meta-regression (p<0.10) were added to a multivariable meta-regression model. Backwards elimination was then performed in a stepwise manner to identify the parameters that remained statistically significantly associated with the outcome, using a Bonferroni-corrected p-value of 0.006. Forest plots were generated to visualize the results of the meta-regression and identify situations in which Cmax:MIC ≥ 10. Meta-analysis and meta-regression were performed using the “meta” package in Stata v.16.0 (StataCorp, College Station, TX). Postestimation regression diagnostics were performed using the “metapred” package in Stata, including verification of normality of residuals, identification of outlying values using standardized residuals, and detection of influencing values using Cook’s distance.

Sensitivity analyses

Because measures of dispersion were not always provided in all studies, standard deviations frequently needed to be estimated. The formulae used to estimate standard deviation require certain assumptions, such as a normal distribution of results, that may not always be met. We therefore performed sensitivity analyses to compare results of the meta-regression in all studies and in only the studies where standard deviations/errors were extracted directly from the study rather than estimated. Because there was some variation in the type of antibiotic used across different studies, we also performed sensitivity analyses to compare results of the meta-regression in all studies and in studies of amikacin (the most frequently used antibiotic) only. Finally, we repeated meta-regression excluding arms identified as being outliers or having outsized influence on the results of the model.

Results

Description of included studies

The above search strategy identified 158 peer-reviewed publications. After the full application of inclusion criteria, 39 studies remained (Fig 1). No studies were excluded due to excessive risk of bias. During preliminary data gathering, one study with a Cmax:MIC value of 1,571 was deemed to be an outlier and was excluded [16].

Fig 1. Flow diagram of included studies.

Fig 1

Thirty-six studies were deemed appropriate for meta-analysis. Characteristics of the included studies and relevant MICs from the CLSI are described in Table 1 and S1 Table. Overall, studies contained measured outcomes for between 1 and 8 different combinations of perfusion technique, for a total of 123 permutations of perfusion technique (or “arms”) among all studies. For one study (Kelmer et al. 2013), we were unable to obtain measures of dispersion for one of the arms, therefore the final number of arms in the meta-analysis was 122.

Table 1. Study characteristics for included studies.

Study Number First Author (year) Number of Arms Parameters Varied Number of Horses Antimicrobial Measure of Dispersion
1 Murphey (1999) [17] 4 • Synovial structure sampled 8 Amikacin Standard error
• Tourniquet time
2 Butt (2001) [18] 3 • Synovial structure sampled 6 Amikacin Standard deviation
3 Scheuch (2002) [19] 1 5 Amikacin Standard error
4 Rubio-Martinez (2005) [20] 6 • Synovial structure sampled 6 Vancomycin Range
• Tourniquet time
5 Parra-Sanchez (2006) [21] 2 • Antimicrobial 7 Amikacin Enrofloxacin Range
6 Errico (2008) [22] 2 • Synovial structure sampled 6 Amikacin Standard deviation
7 Levine (2010) [23] 2 • Tourniquet type 6 Amikacin Range
8 Alkabes (2011) [24] 2 • Tourniquet type 6 Amikacin Range
9 Beccar-Varela (2011) [25] 1 8 Amikacin Range
10 Hyde (2013) [26] 3 • Volume 6 Gentamicin Range
11 Kelmer (2013) [27] 2 • Synovial structure sampled 6 Erythromycin 95% Confidence interval
12 Kelmer (2013) [28] 3 • Volume 6 Amikacin 95% Confidence interval
• Vessel
• Dose
13 Lallemand (2013) [29] 1 6 Marbofloxacin Standard deviation
14 Mahne (2014) [30] 4 • General anesthesia 8 Amikacin Standard deviation
• Local analgesia
15 Zantingh (2014) [31] 1 6 Amikacin Interquartile range
16 Kelmer (2015) [32] 2 • Synovial structure sampled 4 Chloramphenicol Standard deviation
17 Sole (2015) [33] 4 • Synovial structure sampled 8 Amikacin Standard deviation
• Tourniquet location
18 Aristizabal (2016) [34] 8 • Synovial structure sampled 6 Amikacin Standard deviation
• Tourniquet location
• Tourniquet time
19 Colbath (2016) [35] 2 • Local analgesia 7 Amikacin Interquartile range
20 Godfrey (2016) [36] 2 • Volume 8 Amikacin 95% Confidence interval
21 Harvey (2016) [37] 4 • Dose 6 Amikacin Range
• Torniquet location
22 Kilcoyne (2016) [38] 4 • Synovial structure sampled 7 Amikacin Standard deviation
• Tourniquet location
23 Moser (2016) [5] 16 • Volume 6 Amikacin 95% Confidence interval
• Synovial structure sampled
• Tourniquet location
• Tourniquet time
24 Oreff (2016) [39] 3 • Volume 7 Amikacin Range
25 Dahan (2017) [40] 1 6 Imipenem Interquartile range
26 Kelmer (2017) [41] 2 • Synovial structure sampled 5 Imipenem Standard deviation
27 Oreff (2017) [42] 1 8 Ceftazidime Range
28 Schoonover (2017) [43] 12 • Tourniquet location 6 Amikacin 95% CI
• Synovial structure sampled
• Tourniquet time
29 Fontenot (2018) [44] 1 9 Meropenem Standard deviation
30 Kilcoyne (2018) [45] 4 • Tourniquet location 7 Amikacin Standard deviation
• Tourniquet time
31 Dahan (2019) [46] 1 6 Amikacin Interquartile range
32 Snowden (2019) [47] 3 • Tourniquet type Polymixin B Range
• Synovial structure sampled
33 Gustafsson (2020) [48] 6 • Tourniquet time 6 Amikacin Standard deviation
34 Gustafsson (2021) [49] 2 • Antimicrobial 10 Trimethoprim Sulfadiazine Interquartile range
35 Gustafsson (2021) [50] 2 • Tourniquet time 11 Metronidazole Standard deviation
36 Kilcoyne (2021) [51] 6 • Tourniquet time 7 Amikacin Range

The outcome variable Cmax:MIC ranged from 1 to 348 for susceptible organisms, and from 0.25 to 87 for resistant organisms, and the mean (SD) time to peak concentration (Tmax) was 29.0 (8.8) minutes. Meta-analyses generated summary values (θ) of 42.8 x MIC and 10.7 x MIC for susceptible and resistant organisms, respectively. However, the heterogeneity in study designs and perfusion parameters (drug, timing, synovial structure, etc.) across studies was high. I2, which represents the percentage of residual between-study variation relative to the total variability, was equal to 98.8, which reflects large heterogeneity (S1 and S2 Figs) [52]. As a result, summary measures were not considered reliable.

On univariable meta-regression, three variables were statistically significantly associated with the outcome: volume of the perfusate, the type of tourniquet used, and addition of local analgesia. High volumes of perfusate (100–120 mL) resulted in significantly higher (23.4 x MIC, p = 0.014) concentrations than low volumes (30 mL or less). Concentrations were not statistically significantly different for medium (40–60 mL) and low volumes.

Pneumatic tourniquets achieved lower concentrations than wide rubber tourniquets, with pressures greater and lower than 400 mm Hg achieving 29.4 and 1.74 fewer MICs, respectively. However, this effect was only statistically significant for pneumatic tourniquets with pressures greater than 400 mm Hg (p<0.001).

Perfusates with added analgesia–either via the addition of mepivacaine to the infusion or the administration of a nerve block before the infusion—achieved significantly higher levels of antibiotics (32.8 x MIC, p<0.001) than perfusions without analgesia.

On multivariable meta-regression, the volume of perfusate was no longer significantly associated with the outcome. Pneumatic tourniquets with pressures greater than 400 mmHg achieved significantly lower concentrations (20.3 x MIC fewer, p = 0.006) than wide rubber tourniquets, while perfusates with added analgesia achieved greater concentrations (22.4 x MIC more, p<0.004). As shown in Fig 2, for susceptible bacteria, more than 10x MIC was achieved for all subgroups. However, as shown in Fig 3, for resistant bacteria, more than 10 x MIC was achieved for only rubber tourniquets and perfusates with added analgesia.

Fig 2. Forest plot by subgroups retained in the final multivariable meta-regression showing concentrations of antibiotics achieved in the synovial structure (multiples of the MIC) for susceptible bacteria.

Fig 2

The vertical red line represents 10x MIC. Red circles represent point estimates, red horizontal lines represent 95% confidence intervals. The green diamond represents the summary measure θ, but this measure is not considered reliable due to the high heterogeneity between studies.

Fig 3. Forest plot by subgroups retained in the final multivariable meta-regression showing concentrations of antibiotics achieved in the synovial structure (multiples of the MIC) for resistant bacteria.

Fig 3

Red circles represent point estimates, red horizontal lines represent 95% confidence intervals. The green diamond represents the summary measure θ, but this measure is not considered reliable due to the high heterogeneity between studies.

Finally, meta-analysis showed that synovial structure, % systemic dose, tourniquet location, general anesthesia vs. standing, and tourniquet time were not statistically significantly associated with the outcome (Figs 4 and 5).

Fig 4. Forest plot by subgroups with variables for which there were no statistically significant differences in outcome.

Fig 4

The concentrations of antibiotics achieved in the synovial structure (multiples of the MIC) for susceptible bacteria are shown. The vertical red line represents 10x MIC. Red circles represent point estimates, red horizontal lines represent 95% confidence intervals. The green diamond represents the summary measure θ, but this measure is not considered reliable due to the high heterogeneity between studies.

Fig 5. Forest plot by subgroups with variables for which there were no statistically significant differences in outcome.

Fig 5

The concentrations of antibiotics achieved in the synovial structure (multiples of the MIC) for resistant bacteria are shown. The vertical red line represents 10x MIC. Red circles represent point estimates, red horizontal lines represent 95% confidence intervals. The green diamond represents the summary measure θ, but this measure is not considered reliable due to the high heterogeneity between studies.

Sensitivity analyses

Sensitivity analyses (Table 2) showed that similar trends and degrees of significance were achieved for meta-regression, regardless of the groups of arms used. Coefficients tended to be biased towards the null when considering all arms relative to the above-mentioned subgroups of arms.

Table 2. Sensitivity analyses showed that similar trends and degrees of significance were achieved for meta-regression, regardless of the groups used.

All arms (n = 122) Arms where standard deviations not estimated from range (n = 64) Arms of amikacin only (n = 95)
Variable Coefficient P-value 95% CI Coefficient P-value 95% CI Coefficient P-value 95% CI
Tourniquet type
• Rubber [Ref] [Ref] [Ref] [Ref] [Ref] [Ref] [Ref] [Ref] [Ref]
• Pneumatic <400 mm Hg 3.72 0.789 -23.4–30.9 5.97 0.790 -38.1–50.0 3.36 0.883 -41.4–48.1
• Pneumatic >400 mm HG -20.3 0.006 -34.9-(-5.69) -22.9 0.102 -50.5–4.53 -25.7 0.008 -44.7-(-6.71)
Local analgesia
• None [Ref] [Ref] [Ref] [Ref] [Ref] [Ref] [Ref] [Ref] [Ref]
• Local analgesia 24.0 0.004 7.80–40.2 38.7 0.005 11.5–66.0 37.8 0.001 14.5–61.0

Coefficients tended to be biased towards the null when considering all arms relative to subgroups of arms.

Discussion

While other studies have qualitatively examined the effect of variability in perfusion parameters on levels of antibiotics achieved in the synovial structure, this was the first study to do so quantitatively using meta-analytic methods. This meta-analysis combined data from 36 studies and 123 arms to evaluate the effects of several variables on synovial concentrations of antibiotic. Interestingly, upon univariable meta-regression, only perfusate volume, tourniquet type and the concurrent use of local analgesia significantly affected the outcome, while tourniquet type and concurrent use of local analgesia were the only two variables retained in the final multivariable meta-regression.

Although volume of perfusate was not significantly associated with the outcome in the final multivariable analysis, we did find that higher volumes of perfusate achieved higher levels of Cmax than lower levels. Larger volumes likely achieve higher intravascular pressures facilitating diffusion of the antibiotic into peripheral tissues. When RLP is used clinically it is generally repeated daily for varying periods of time i.e., days to weeks. Therefore, the potential complications of repeated large volume perfusions, including vasculitis, when RLP is used clinically, must be considered. Selecting the lowest perfusate volume that reliably achieves an efficacious Cmax:MIC would be clinically beneficial. From this meta-analysis, low, medium and high volume perfusions achieved Cmax:MIC ≥ 10 for sensitive bacteria, while only high volume perfusions achieved Cmax:MIC ≥ 10 for resistant bacteria. Therefore, clinicians are encouraged to consider the bacterial sensitivity when selecting their RLP technique.

The final model demonstrated that tourniquet type and the concurrent use of local analgesia were the two most important variables associated with synovial concentrations of antibiotic. Our meta-analysis showed that pneumatic tourniquets were associated with lower antibiotic concentrations than wide rubber tourniquets and that pneumatic tourniquets with pressures > 400mm Hg were the least successful at achieving Cmax:MIC ≥ 10. One suggested benefit of pneumatic tourniquets is the ability to standardize pressure between horses, while benefits of rubber tourniquets include less risk of pressure loss associated with leakage or bursting of pneumatic tourniquets. Clinically, wide rubber tourniquets are economical, easy to use and accessible, and their efficacy is clearly supported by the current body of literature.

Regional limb perfusion was first performed under general anesthesia to limit the animal’s movement. However, the clinical application of RLP is much simpler and more accessible using standing sedation, and RLPs performed under general anesthesia and standing sedation achieve similar synovial concentrations of antibiotics [30, 34, 35]. Nevertheless, horse movement under standing sedation has been cited as a plausible reason for perfusion failure [23, 35]. In the present study, we found that the concurrent use of local analgesia, either via locoregional nerve blocks or the addition of a local anesthetic to the perfusate, was strongly and significantly associated with achieving high Cmax in synovial structures. Tourniquet-associated pain is a reported complication of use in human medicine [53]. Concurrent use of analgesia alongside RLP appears useful in limiting animal discomfort and subsequent movement, thus decreasing the risk of tourniquet failure. Errico et al. (2008) [22], based on preliminary studies, also suggested that weight shifting due to tourniquet associated pain leads to doubling of the intravascular pressure distal to the tourniquet which can lead to systemic leakage. Based on this meta-analysis, concurrent analgesia appears to be particularly important when treating resistant bacterial infections.

Other parameters that were not found to be statistically significantly associated with higher synovial concentrations of antibiotic included the duration of the perfusion, where the tourniquet was placed relative to the synovial structure (i.e., near or far), whether the horse was standing or under general anesthesia, and the dose of antibiotic (percent of systemic dose). Therapeutic concentrations of antibiotics have been achieved in synovial fluid in 10 minutes [38], 15 minutes [2], 20 minutes [34], 30 minutes [17], and 45 minutes after tourniquet placement [20]. Although we found that the mean time to peak concentration was 29.0 minutes, Cmax:MIC ≥ 10 is reached earlier. Because studies only collect synovial fluid at predetermined time points, it is not possible to determine exactly when Cmax:MIC ≥ 10. Only 16 arms in 5 studies examined synovial fluid antibiotic concentration at time < 30 minutes. These included 2 arms that examined concentrations at 10 minutes, 12 that examined concentrations at 20 minutes, and 2 that examined concentrations at 25 minutes. Of these arms, 12/16 achieved Cmax:MIC ≥ 10 for sensitive bacteria and 6/16 achieved Cmax:MIC ≥ 10 for resistant bacteria (S1 Table). When using RLP to treat clinical infections, leaving a tourniquet in place for 30 minutes may be advisable when feasible to achieve the highest Cmax possible. However, individual horse behavior, movement, and response to sedation during RLP can be unpredictable, and shorter perfusate times may be necessary.

Several experiments have measured synovial fluid Cmax in multiple synovial structures to evaluate the effect of distance from tourniquet to synovial structure on antibiotic concentration. Although some researchers have hypothesized that Cmax will be lower in synovial structures that are further away from the tourniquet, studies have shown that a proximal tourniquet with perfusion into the cephalic or saphenous vein can produce high levels of antibiotics in distant synovial structures such as the distal interphalangeal joint [5, 43]. The results of our meta-analysis suggest that high concentrations of antibiotics are achieved in synovial structures regardless of tourniquet location. This is advantageous, as horses can be more reactive to needle placement in palmar/plantar digital veins compared to cephalic or saphenous veins. Additionally, this may allow clinicians to begin regional limb perfusions in a more proximal location, allowing for more distal locations to be used in sequential treatments if there are complications such as phlebitis.

Therapeutic concentrations of antibiotic in synovial fluid have been achieved using doses ranging from 2% [17] to 91% [16] of the recommended systemic dose. Some researchers and clinicians have recommended performing regional limb perfusion with 1/3 of the systemic dose of the desired antibiotic [25], while others have suggested administering the full systemic dose via the RLP without concurrent systemic administration [54]. The lack of statistical significance of dose on Cmax:MIC in this meta-analysis may be influenced by the small number of studies evaluating high doses of antibiotics. Of the 123 arms, 115 arms used < 1/3 of the systemic dose of the antibiotic. From this data, administering 1/3 of the systemic dose can be considered efficacious for susceptible bacteria and that administration of high doses is not necessary to achieve Cmax:MIC ≥ 10. However, treatment of infections with resistant bacteria may require higher doses to achieve an effective Cmax:MIC.

Limitations of this study are those typically associated with meta-analyses, most notably the presence of heterogeneity among the studies. We sought to explore heterogeneity by performing meta-regression, as recommended by the Cochrane group [55], but we were ultimately unable to generate trustworthy summary values for Cmax across all conditions. A benefit of our meta-analysis is that it is unlikely that there was significant publication bias among considered studies, as our outcome was a continuous value (concentration of antibiotic) rather than a categorical success/failure outcome for which negative findings might not be published. The inclusion of experimental studies only rather than observational studies or randomized controlled trials also means that issues of randomization, bias, and dropout, which are typically used as markers of study quality in meta-analyses [56, 57], are not applicable here. Moreover, since the trends in our findings persisted with sensitivity analyses, we believe our findings to be relatively robust.

Conclusions

As expected, the considerable heterogeneity in technique between studies precluded reporting of an overall summary measure for Cmax:MIC for RLP. However, our meta-regressions allowed us to narrow in on the parameters that most affected synovial concentrations of antibiotic, the most important of which appear to be the type of tourniquet and the delivery of analgesia along with the antibiotic. Our results suggest that wide rubber tourniquets and concurrent local analgesia should be strongly considered for use in RLP. Our results also indicate that adequate therapeutic concentrations (≥10x MIC) can often be achieved across a variety of techniques for susceptible but not resistant pathogens.

Supporting information

S1 Fig. Forest plot of all studies included in the meta-analysis showing Cmax:MIC for susceptible bacteria.

A vertical red line depicts 10x MIC.

(PDF)

S2 Fig. Forest plot of all studies included in the meta-analysis showing Cmax:MIC for resistant bacteria.

A vertical red line depicts 10x MIC.

(PDF)

S1 Table. Study characteristics including Cmax, measures of dispersion and calculated Cmax:MIC for susceptible and resistant bacteria for included arms.

lpdv = lateral palmar digital vein; saph = saphenous; ceph = cephalic; DIPJ = distal interphalangeal joint; MCPJ = metacarphophalangeal joint; TCJ = tarsocrural joint; RCJ = radiocarpal joint; MCJ = middle carpal joint; DFTS = digital flexor tendon sheath.

(XLSX)

S2 Table. Values of ξ (n) in the formula (7) and the formula (12) for Q ≤ 20.

Modified from Wan et al. 2014. [14].

(DOCX)

S3 Table. Values of η (n) in the formula (12) and the formula (15) for Q ≤ 20, where n = 4Q + 1.

Modified from Wan et al. 2014. [14].

(DOCX)

S1 Checklist. PRISMA 2020 checklist.

(DOCX)

Data Availability

All relevant data are within the paper and its Supporting information files.

Funding Statement

The authors received no specific funding for this work.

References

  • 1.Whitehair KJ, Blevins WE, Fessler JF, Van Sickle DC, White MR, Bill RP. Regional perfusion of the equine carpus for antibiotic delivery. Vet Surg. 21: 279–85. Available: http://www.ncbi.nlm.nih.gov/pubmed/1455636 [DOI] [PubMed] [Google Scholar]
  • 2.Whitehair KJ, Bowersock TL, Blevins WE, Fessler JF, White MR, Van Sickle DC. Regional limb perfusion for antibiotic treatment of experimentally induced septic arthritis. Vet Surg. 1992;21: 367–373. doi: 10.1111/j.1532-950x.1992.tb01713.x [DOI] [PubMed] [Google Scholar]
  • 3.Rubio-Martínez LM, Elmas CR, Black B, Monteith G. Clinical use of antimicrobial regional limb perfusion in horses: 174 cases (1999–2009). J Am Vet Med Assoc. 2012;241: 1650–1658. doi: 10.2460/javma.241.12.1650 [DOI] [PubMed] [Google Scholar]
  • 4.Biasutti SA, Cox E, Jeffcott LB, Dart AJ. A review of regional limb perfusion for distal limb infections in the horse. Equine Vet Educ. 2021;33: 263–277. doi: 10.1111/EVE.13243 [DOI] [Google Scholar]
  • 5.Moser DK, Schoonover MJ, Holbrook TC, Payton ME. Effect of Regional Intravenous Limb Perfusate Volume on Synovial Fluid Concentration of Amikacin and Local Venous Blood Pressure in the Horse. Vet Surg. 2016;45: 851–858. doi: 10.1111/vsu.12521 [DOI] [PubMed] [Google Scholar]
  • 6.Rubio-Martínez LM, Cruz AM. Antimicrobial regional limb perfusion in horses. J Am Vet Med Assoc. 2006;228: 706–12, 655. doi: 10.2460/javma.228.5.706 [DOI] [PubMed] [Google Scholar]
  • 7.Moore RD, Lietman PS, Smith CR. Clinical response to aminoglycoside therapy: importance of the ratio of peak concentration to minimal inhibitory concentration. J Infect Dis. 1987;155: 93–99. doi: 10.1093/infdis/155.1.93 [DOI] [PubMed] [Google Scholar]
  • 8.Moher D, Liberati A, Tetzlaff J, Altman DG. Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement. 2009;6: 1–5. doi: 10.1371/journal.pmed.1000097 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9.Schneider RK, Bramlage LR, Moore RM, Mecklenburg L, Kohn C, Gabel AA. A retrospective study of 192 horses affected with septic arthritis/tenosynovitis. Equine Vet J. 1992;24: 436–442. doi: 10.1111/j.2042-3306.1992.tb02873.x [DOI] [PubMed] [Google Scholar]
  • 10.Ahern BJ, Richardson DW, Boston RC, Schaer TP. Orthopedic Infections in Equine Long Bone Fractures and Arthrodeses Treated by Internal Fixation: 192 Cases (1990–2006). Vet Surg. 2010;39: 588–593. doi: 10.1111/j.1532-950X.2010.00705.x [DOI] [PubMed] [Google Scholar]
  • 11.Curtiss AL, Stefanovski D, Richardson DW. Surgical site infection associated with equine orthopedic internal fixation: 155 cases (2008–2016). Vet Surg. 2019;48: 685–693. doi: 10.1111/vsu.13216 [DOI] [PubMed] [Google Scholar]
  • 12.VET01SEd5 | Performance Standards for Antimicrobial Disk and Dilution Susceptibility Tests for Bacteria Isolated From Animals, 5th Edition. [cited 30 Dec 2021]. https://clsi.org/standards/products/veterinary-medicine/documents/vet01s/
  • 13.Higgins J, Li T, Deeks J. Choosing effect measures and computing estimates of effect. In: Higgins J, Thomas J, Chandler J, Cumpston M, Li T, Page M, et al., editors. Cochrane Handbook for Systematic Reviews of Interventions. 2021. www.training.cochrane.org/handbook
  • 14.Wan X, Wang W, Liu J, Tong T. Estimating the sample mean and standard deviation from the sample size, median, range and/or interquartile range. BMC Med Res Methodol. 2014;14: 135. doi: 10.1186/1471-2288-14-135 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15.Rohatgi A. WebPlotDigitizer. 2020. https://automeris.io/WebPlotDigitizer/
  • 16.Pille F, De Baere S, Ceelen L, Dewulf J, Croubels S, Gasthuys F, et al. Synovial fluid and plasma concentrations of ceftiofur after regional intravenous perfusion in the horse. Vet Surg. 34: 610–7. doi: 10.1111/j.1532-950X.2005.00095.x [DOI] [PubMed] [Google Scholar]
  • 17.Murphey ED, Santschi EM, Papich MG. Regional intravenous perfusion of the distal limb of horses with amikacin sulfate. J Vet Pharmacol Ther. 1999;22: 68–71. doi: 10.1046/j.1365-2885.1999.00180.x [DOI] [PubMed] [Google Scholar]
  • 18.Butt TD, Bailey J V, Dowling PM, Fretz PB. Comparison of 2 techniques for regional antibiotic delivery to the equine forelimb: intraosseous perfusion vs. intravenous perfusion. Can Vet J = La Rev vétérinaire Can. 2001;42: 617–22. Available: http://www.ncbi.nlm.nih.gov/pubmed/11519271 [PMC free article] [PubMed] [Google Scholar]
  • 19.Scheuch BC, Van Hoogmoed LM, Wilson WD, Snyder JR, MacDonald MH, Watson ZE, et al. Comparison of intraosseous or intravenous infusion for delivery of amikacin sulfate to the tibiotarsal joint of horses. Am J Vet Res. 2002;63: 374–80. Available: http://www.ncbi.nlm.nih.gov/pubmed/11911572 [DOI] [PubMed] [Google Scholar]
  • 20.Rubio-Martínez L, López-Sanromán J, Cruz AM, Santos M, San Roman F. Medullary plasma pharmacokinetics of vancomycin after intravenous and intraosseous perfusion of the proximal phalanx in horses. Vet Surg. 2005;34: 618–624. doi: 10.1111/j.1532-950X.2005.00096.x [DOI] [PubMed] [Google Scholar]
  • 21.Parra-Sanchez A, Lugo J, Boothe DM, Gaughan EM, Hanson RR, Duran S, et al. Pharmacokinetics and pharmacodynamics of enrofloxacin and a low dose of amikacin administered via regional intravenous limb perfusion in standing horses. Am J Vet Res. 2006;67: 1687–1695. doi: 10.2460/ajvr.67.10.1687 [DOI] [PubMed] [Google Scholar]
  • 22.Errico JA, Trumble TN, Bueno ACD, Davis JL, Brown MP. Comparison of two indirect techniques for local delivery of a high dose of an antimicrobial in the distal portion of forelimbs of horses. Am J Vet Res. 2008;69: 334–342. doi: 10.2460/ajvr.69.3.334 [DOI] [PubMed] [Google Scholar]
  • 23.Levine DG, Epstein KL, Ahern BJ, Richardson DW. Efficacy of three tourniquet types for intravenous antimicrobial regional limb perfusion in standing horses. Vet Surg. 2010;39: 1021–4. doi: 10.1111/j.1532-950X.2010.00732.x [DOI] [PubMed] [Google Scholar]
  • 24.Alkabes SB, Adams SB, Moore GE, Alkabes KC. Comparison of two tourniquets and determination of amikacin sulfate concentrations after metacarpophalangeal joint lavage performed simultaneously with intravenous regional limb perfusion in horses. Am J Vet Res. 2011;72: 613–619. doi: 10.2460/ajvr.72.5.613 [DOI] [PubMed] [Google Scholar]
  • 25.Beccar-Varela AM, Epstein KL, White CL. Effect of experimentally induced synovitis on amikacin concentrations after intravenous regional limb perfusion. Vet Surg. 2011;40: 891–897. doi: 10.1111/j.1532-950X.2011.00875.x [DOI] [PubMed] [Google Scholar]
  • 26.Hyde RM, Lynch TM, Clark CK, Slone DE, Hughes FE. The influence of perfusate volume on antimicrobial concentration in synovial fluid following intravenous regional limb perfusion in the standing horse. Can Vet J. 2013;54: 363–367. [PMC free article] [PubMed] [Google Scholar]
  • 27.Kelmer G, Martin-Jimenez T, Saxton AM, Catasus C, Elliot SB, Lakritz J. Evaluation of regional limb perfusion with erythromycin using the saphenous, cephalic, or palmar digital veins in standing horses. J Vet Pharmacol Ther. 2013;36: 434–440. doi: 10.1111/jvp.12028 [DOI] [PubMed] [Google Scholar]
  • 28.Kelmer G, Bell GC, Martin-Jimenez T, Saxton AM, Catasus C, Elliot SB, et al. Evaluation of regional limb perfusion with amikacin using the saphenous, cephalic, and palmar digital veins in standing horses. J Vet Pharmacol Ther. 2013;36: 236–240. doi: 10.1111/j.1365-2885.2012.01414.x [DOI] [PubMed] [Google Scholar]
  • 29.Lallemand E, Trencart P, Tahier C, Dron F, Paulin A, Tessier C. Pharmacokinetics, pharmacodynamics and local tolerance at injection site of marbofloxacin administered by regional intravenous limb perfusion in standing horses. Vet Surg. 2013;42: 649–657. doi: 10.1111/j.1532-950X.2013.12030.x [DOI] [PubMed] [Google Scholar]
  • 30.Mahne AT, Rioja E, Marais HJ, Villarino NF, Rubio-Martinez LM. Clinical and pharmacokinetic effects of regional or general anaesthesia on intravenous regional limb perfusion with amikacin in horses. Equine Vet J. 2014;46: 375–379. doi: 10.1111/evj.12125 [DOI] [PubMed] [Google Scholar]
  • 31.Zantingh AJ, Schwark WS, Fubini SL, Watts AE. Accumulation of amikacin in synovial fluid after regional limb perfusion of amikacin sulfate alone and in combination with ticarcillin/clavulanate in horses. Vet Surg. 2014;43: 282–288. doi: 10.1111/j.1532-950X.2014.12119.x [DOI] [PubMed] [Google Scholar]
  • 32.Kelmer G, Tatz AJ, Famini S, Bdolah-Abram T, Soback S, Britzi M. Evaluation of regional limb perfusion with chloramphenicol using the saphenous or cephalic vein in standing horses. J Vet Pharmacol Ther. 2015;38: 35–40. doi: 10.1111/jvp.12140 [DOI] [PubMed] [Google Scholar]
  • 33.Sole A, Spriet M, Galuppo LD, Padgett KA, Borjesson DL, Wisner ER, et al. Scintigraphic evaluation of intra-arterial and intravenous regional limb perfusion of allogeneic bone marrow-derived mesenchymal stem cells in the normal equine distal limb using (99m) Tc-HMPAO. Equine Vet J. 2012;44: 594–9. doi: 10.1111/j.2042-3306.2011.00530.x [DOI] [PubMed] [Google Scholar]
  • 34.Aristizabal FA, Nieto JE, Guedes AG, Dechant JE, Yamout S, Morales B, et al. Comparison of two tourniquet application times for regional intravenous limb perfusions with amikacin in sedated or anesthetized horses. Vet J. 2016;208: 50–54. doi: 10.1016/j.tvjl.2015.10.017 [DOI] [PubMed] [Google Scholar]
  • 35.Colbath AC, Wittenburg LA, Gold JR, McIlwraith CW, Moorman VJ. The Effects of Mepivacaine Hydrochloride on Antimicrobial Activity and Mechanical Nociceptive Threshold During Amikacin Sulfate Regional Limb Perfusion in the Horse. Vet Surg. 2016;45: 798–803. doi: 10.1111/vsu.12515 [DOI] [PubMed] [Google Scholar]
  • 36.Godfrey JL, Hardy J, Cohen ND. Effects of regional limb perfusion volume on concentrations of amikacin sulfate in synovial and interstitial fluid samples from anesthetized horses. Am J Vet Res. 2016;77: 582–588. doi: 10.2460/ajvr.77.6.582 [DOI] [PubMed] [Google Scholar]
  • 37.Harvey A, Kilcoyne I, Byrne BA, Nieto J. Effect of Dose on Intra-Articular Amikacin Sulfate Concentrations Following Intravenous Regional Limb Perfusion in Horses. Vet Surg. 2016;45: 1077–1082. doi: 10.1111/vsu.12564 [DOI] [PubMed] [Google Scholar]
  • 38.Kilcoyne I, Dechant JE, Nieto JE. Evaluation of 10-minute versus 30-minute tourniquet time for intravenous regional limb perfusion with amikacin sulfateinstanding sedated horses. Vet Rec. 2016;178: 585. doi: 10.1136/vr.103609 [DOI] [PubMed] [Google Scholar]
  • 39.Oreff GL, Dahan R, Tatz AJ, Raz T, Britzi M, Kelmer G. The Effect of Perfusate Volume on Amikacin Concentration in the Metacarpophalangeal Joint Following Cephalic Regional Limb Perfusion in Standing Horses. Vet Surg. 2016;45: 625–630. doi: 10.1111/vsu.12490 [DOI] [PubMed] [Google Scholar]
  • 40.Dahan R, Britzi M, Sutton GA, Sorek S, Kelmer G. Evaluation of the Pharmacokinetic Properties of a Combination of Marbofloxacin and Imipenem Administered by Regional Limb Perfusion to Standing Horses. J Equine Vet Sci. 2017;53: 1–7. doi: 10.1016/j.jevs.2016.12.012 [DOI] [Google Scholar]
  • 41.Kelmer G, Tatz AJ, Kdoshim E, Britzi M, Segev G. Evaluation of the pharmacokinetics of imipenem following regional limb perfusion using the saphenous and the cephalic veins in standing horses. Res Vet Sci. 2017;114: 64–68. doi: 10.1016/j.rvsc.2017.02.020 [DOI] [PubMed] [Google Scholar]
  • 42.Oreff GL, Tatz AJ, Dahan R, Segev G, Haberman S, Britzi M, et al. Pharmacokinetics of ceftazidime after regional limb perfusion in standing horses. Vet Surg. 2017;46: 1120–1125. doi: 10.1111/vsu.12720 [DOI] [PubMed] [Google Scholar]
  • 43.Schoonover MJ, Moser DK, Young JM, Payton ME, Holbrook TC. Effects of tourniquet number and exsanguination on amikacin concentrations in the radiocarpal and distal interphalangeal joints after low volume intravenous regional limb perfusion in horses. Vet Surg. 2017;46: 675–682. doi: 10.1111/vsu.12662 [DOI] [PubMed] [Google Scholar]
  • 44.Fontenot RL, Langston VC, Zimmerman JA, Wills RW, Sloan PB, Mochal-King CA. Meropenem synovial fluid concentrations after intravenous regional limb perfusion in standing horses. Vet Surg. 2018;47: 852–860. doi: 10.1111/vsu.12940 [DOI] [PubMed] [Google Scholar]
  • 45.Kilcoyne I, Nieto JE, Knych HK, Dechant JE. Time required to achieve maximum concentration of amikacin in synovial fluid of the distal interphalangeal joint after intravenous regional limb perfusion in horses. Am J Vet Res. 2018;79: 282–286. doi: 10.2460/ajvr.79.3.282 [DOI] [PubMed] [Google Scholar]
  • 46.Dahan R, Oreff GL, Tatz AJ, Raz T, Britzi M, Kelmer G. Pharmacokinetics of regional limb perfusion using a combination of amikacin and penicillin in standing horses. Can Vet J = La Rev Vet Can. 2019;60: 294–299. Available: https://pubmed.ncbi.nlm.nih.gov/30872853/ [PMC free article] [PubMed] [Google Scholar]
  • 47.Snowden R, Schumacher J, Blackford J, Cypher E, Cox S, Sun X, et al. Tarsocrural joint polymyxin B concentrations achieved following intravenous regional limb perfusion of the drug via a saphenous vein to healthy standing horses. Am J Vet Res. 2019;80: 1099–1106. doi: 10.2460/ajvr.80.12.1099 [DOI] [PubMed] [Google Scholar]
  • 48.Gustafsso K, Tatz A, Dahan R, Britzi M, Soback S, Sutton G, et al. Time to Peak Concentration of Amikacin in the Antebrachiocarpal Joint Following Cephalic Intravenous Regional Limb Perfusion in Standing Horses. Vet Comp Orthop Traumatol. 2020;33: 327–332. doi: 10.1055/s-0040-1714418 [DOI] [PubMed] [Google Scholar]
  • 49.Gustafsson K, Tatz AJ, Dahan R, Ahmad WA, Britzi M, Sutton GA, et al. Synovial Concentration of Trimethoprim-Sulphadiazine Following Regional Limb Perfusion in Standing Horses. Anim an open access J from MDPI. 2021;11: 2085. doi: 10.3390/ani11072085 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 50.Gustafsson K, Tatz AJ, Dahan R, Britzi M, Soback S, Ahmad WA, et al. The Concentration of Metronidazole in the Distal Interphalangeal Joint following Intravenous Regional Limb Perfusion via the Cephalic Vein in Standing Horses. Vet Comp Orthop Traumatol. 2021;34: 287–293. doi: 10.1055/s-0041-1726083 [DOI] [PubMed] [Google Scholar]
  • 51.Kilcoyne I, Nieto JE, Galuppo LD, Dechant JE. Time required to achieve maximum amikacin concentration in the synovial fluid of the tarsocrural joint following administration of the drug by intravenous regional limb perfusion in horses. Am J Vet Res. 2021;82: 99–104. doi: 10.2460/ajvr.82.2.99 [DOI] [PubMed] [Google Scholar]
  • 52.Higgins JPT, Thompson SG. Quantifying heterogeneity in a meta-analysis. Stat Med. 2002;21: 1539–1558. doi: 10.1002/sim.1186 [DOI] [PubMed] [Google Scholar]
  • 53.Kumar K, Railton C, Tawfic Q. Tourniquet application during anesthesia: “What we need to know?” J Anaesthesiol Clin Pharmacol. 2016;32: 424–430. doi: 10.4103/0970-9185.168174 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 54.Ahern B, Richardson D. Surgical site infection and the use of antimicrobials. 4th ed. Auer J, Stick J, editors. W.B. Saunders; 2012. [Google Scholar]
  • 55.Deeks J, Higgins J, Altman D. Analysing data and undertaking meta-analyses. 6.2. In: Higgins J, Thomas J, Chandler J, Cumpston M, Page M, Welch V, editors. Cochrane Handbook for Systematic Reviews of Interventions. 6.2. Cochrane; 2021. www.training.cochrane.org/handbook
  • 56.Jadad AR, Moore RA, Carroll D, Jenkinson C, Reynolds DJM, Gavaghan DJ, et al. Assessing the quality of reports of randomized clinical trials: is blinding necessary? Control Clin Trials. 1996;17: 1–12. doi: 10.1016/0197-2456(95)00134-4 [DOI] [PubMed] [Google Scholar]
  • 57.Viswanathan M, Ansari M, Berkman N, Chang S, Hartling L, McPheeters M, et al. Assessing the Risk of Bias of Individual Studies in Systematic Reviews of Health Care Interventions—PubMed. In: Agency for Healthcare Research and Quality (US), editor. Methods Guide for Effectiveness and Comparative Effectiveness Reviews. 2012. https://pubmed.ncbi.nlm.nih.gov/22479713/. [PubMed]

Decision Letter 0

Richard Evans

25 Feb 2022

PONE-D-22-00403Effects of regional limb perfusion technique on concentrations of antibiotic achieved at the target site: a meta-analysisPLOS ONE

Dear Dr. Ortved,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

Thank you for writing a concise, well-organized manuscript--that makes it easier to review. The reviewers tried hard to ask clarifying questions and suggest edits without excessive nit-picking. The most challenging aspect in the re-writing will be addressing the Type I error inflation issue.

Please submit your revised manuscript by Apr 11 2022 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: https://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols.

We look forward to receiving your revised manuscript.

Kind regards,

Richard Evans

Academic Editor

PLOS ONE

Journal Requirements:

When submitting your revision, we need you to address these additional requirements.

1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at

https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf  and

https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf

2. Please review your reference list to ensure that it is complete and correct. If you have cited papers that have been retracted, please include the rationale for doing so in the manuscript text, or remove these references and replace them with relevant current references. Any changes to the reference list should be mentioned in the rebuttal letter that accompanies your revised manuscript. If you need to cite a retracted article, indicate the article’s retracted status in the References list and also include a citation and full reference for the retraction notice.

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

Reviewer #2: Yes

**********

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

Reviewer #2: Yes

**********

3. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

**********

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

**********

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: There are some inconsistencies in the results and discussion that are critical to have fixed prior to acceptance of this manuscript.

February 11, 2022

Comments to the authors.

Overall, this manuscript is well written and adds significant information to previously published literature for regional limb perfusion in horses.

There are a few introduction, results, and discussion points that could be expanded on. The most critical discussion point and figure results that need to be clarified are also critical.

In several areas in the manuscript it is confusing as to whether pneumatic tourniquets > 400 mm Hg achieved higher MICs than pneumatic tourniquets <400 mm Hg. I have noted all areas that I found a discrepancy. However the entire manuscript should be reviewed to ensure this is clarified.

Lines 298- 299 Should read tourniquest <400 mm Hg pressures instead of > 400 mm Hg pressure

Lines 310- 316. Can the authors also discuss other possibilities why local anesthesia could enhance the effectiveness of the regional limb perfusion if any.

Lines 324- 325. What time period is 10x> MIC typically reached in regional limb perfusion. For example it might say.. Typically the CMAX:MIC>10 is reached by 15- 20 minutes. However, the mean time to peak concentrations are at 29 minutes.

Lines 331 to 339 You might also include.. This may allow the clinician to start proximal with the regional limb perfusion and on sequential treatments go more distal if there is a problem with a previous regional limb perfusion site.

Line 348 I would state... Administering 1/3 the systemic dose can be considered efficacious... The inclusion of no more than 1/3 the systemic dose leaves the authors open to “what about < 2%...

Figures S1 and S2 appear to be mislabeled where the Pneumatic tourniquet > 400 should be listed second, below the rubber tourniquet with the higher MIC. Beneath that the tourniquet < 400 should be listed third below the rubber tourniquet with the lowest MIC. A small label at the top of S1 and S2 stating susceptible bacteria and resistant bacteria would be helpful.

Please clarify what the significance is in including Table S2 and S3 for the readers as a modified table.

Both Figures and Tables appear the same. Probably they should all be labeled either Figures or Tables.

Reviewer #2: I have four comments:

1. Using the word "trial" for a study arm was a little confusing because trial is commonly used in a clinical trial, which is a study. Trial is also used in veterinary gait analyses. In line 154, it appears that trial and study are defined somewhat interchangeably. I think it would help your readers to change trial to arm or group. For what it's worth, Wikipedia's entry for meta-regression uses the word arm.

2. It is not necessary to include the univariate regression analysis. The multivariate regression is superior to the univariate one, so the univariate analysis adds nothing to the article, and that's especially true when the two analyses give different results. As it stands, it appears that readers have to make up their own minds about which analysis to believe. However, if the univariate truly adds something to the understanding of the data, then keep it in, but please explain why.

3. The forest plots caused me the most difficulty.

4. I understand the forest plots are used to visualize the meta-regression results but are effect sizes on the forest plot from the multiple regression, univariate regression, or raw data?

There are several things on the plots that I wasn't sure about:

1. The heading on the 4th column is "effect size with 95% CI," but effect size isn't mentioned in the text. How is it defined?

2. Please describe:

3. what Qb(1) means

4. what do all the p-values in the last column mean. What is being tested?

5. What is Q(121)? Is 121 correct, or should it be Q(122)?

6. There appear to be three heterogeneity statistics, but I think only one is described in the manuscript. Please define them in the statistics section. (Or just keep one of them.)

7. In line 245, you state, "Finally, meta-analysis showed that synovial structure, % systemic dose, tourniquet location, general anesthesia vs. standing, and tourniquet time were not statistically significantly associated with the outcome (Figs 4 and 5).

But in figure 5, tourniquet time has a p=0.02. Why is that not statistically significant?

That raises a larger question. I didn't see a cutoff for statistical significance in the manuscript. The contemporary approach in a study like this would be to call it an exploratory study and omit a cutoff and any mention of statistical significance. The p-values would be used like effects sizes to find the best therapy. Alternatively, you could do some kind of Type I error inflation correction and then use that method to give an overall error rate of 5%.

But as the analysis stands, with a 0.05 cutoff for each test, some of your results may be false-positive discoveries.

***if heterogeneous, how do you justify the regression?

**********

6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: No

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

PLoS One. 2022 Apr 1;17(4):e0265971. doi: 10.1371/journal.pone.0265971.r002

Author response to Decision Letter 0


2 Mar 2022

Comments to the authors.

Overall, this manuscript is well written and adds significant information to previously published literature for regional limb perfusion in horses.

There are a few introduction, results, and discussion points that could be expanded on. The most critical discussion point and figure results that need to be clarified are also critical.

In several areas in the manuscript it is confusing as to whether pneumatic tourniquets > 400 mm Hg achieved higher MICs than pneumatic tourniquets <400 mm Hg. I have noted all areas that I found a discrepancy. However the entire manuscript should be reviewed to ensure this is clarified.

- The authors thank the reviewers for their comments and suggestions for the article. We believe we have addressed each issue and that the manuscript is improved thanks to the careful review.

Lines 298- 299 Should read tourniquets <400 mm Hg pressures instead of > 400 mm Hg pressure

- Based on our analysis, tourniquets with a pressure > 400mm Hg were actually the least successful in achieving Cmax:MIC ≥ 10. We were surprised by this result as we thought higher pressure tourniquets would be more effective, however, after review of the data we found that this was not the case.

Lines 310- 316. Can the authors also discuss other possibilities why local anesthesia could enhance the effectiveness of the regional limb perfusion if any.

- Thank you for your comment. We have added the following to the discussion: “Errico et al. (2008), based on preliminary studies, also suggested that weight shifting due to tourniquet associated pain leads to doubling of the intravascular pressure distal to the tourniquet which can lead to systemic leakage.” We do not have any evidence for other mechanisms of action. (Line 345-348)

Lines 324- 325. What time period is 10x> MIC typically reached in regional limb perfusion. For example it might say.. Typically the CMAX:MIC>10 is reached by 15- 20 minutes. However, the mean time to peak concentrations are at 29 minutes.

- Unfortunately, only 16 trials in 5 studies examined synovial fluid antibiotic concentration at time < 30 minutes. There were 2 trials that examined concentrations at 10 minutes, 12 that examined concentrations at 20 minutes, and 2 that examined concentrations at 25 minutes. Of these trials, 12/16 achieved Cmax:MIC ≥ 10 for sensitive bacteria and 6/16 achieved Cmax:MIC ≥ 10 for resistant bacteria. This information has been added to the discussion. (Line 358-362)

Lines 331 to 339 You might also include.. This may allow the clinician to start proximal with the regional limb perfusion and on sequential treatments go more distal if there is a problem with a previous regional limb perfusion site.

- Thank you for the comment. We think this is a very important point and added the following to the discussion: “Additionally, this may allow clinicians to begin regional limb perfusions in a more proximal location allowing for more distal locations in the vein to be used in sequential treatments if there are complications such as phlebitis”. (Line 377-380)

Line 348 I would state... Administering 1/3 the systemic dose can be considered efficacious... The inclusion of no more than 1/3 the systemic dose leaves the authors open to “what about < 2%...

- This sentence has been changed as suggested.

Figures S1 and S2 appear to be mislabeled where the Pneumatic tourniquet > 400 should be listed second, below the rubber tourniquet with the higher MIC. Beneath that the tourniquet < 400 should be listed third below the rubber tourniquet with the lowest MIC. A small label at the top of S1 and S2 stating susceptible bacteria and resistant bacteria would be helpful.

- Based on our analysis, tourniquets with a pressure > 400mm Hg were actually the least successful in achieving Cmax:MIC. We were surprised by this result as we thought higher pressure tourniquets would be more effective, however, after review of the data we found that this was not the case.

Please clarify what the significance is in including Table S2 and S3 for the readers as a modified table.

- The value is in providing full transparency and enabling other authors to repeat our analyses should they wish to. It is true that the full tables can be accessed directly from the primary paper, but we believed including them as supplementary material was in the spirit of promoting accessibility and reproducibility. If the reviewer believes them to be superfluous, we are fine to remove them.

Both Figures and Tables appear the same. Probably they should all be labeled either Figures or Tables.

- We have separated figures and tables based off the appearance they have. We are happy to defer to the editors on this issue.

Reviewer #2: I have four comments:

1. Using the word "trial" for a study arm was a little confusing because trial is commonly used in a clinical trial, which is a study. Trial is also used in veterinary gait analyses. In line 154, it appears that trial and study are defined somewhat interchangeably. I think it would help your readers to change trial to arm or group. For what it's worth, Wikipedia's entry for meta-regression uses the word arm.

- Thank you for your suggestion. We agree and are happy to change “trial” to “arm”.

2. It is not necessary to include the univariate regression analysis. The multivariate regression is superior to the univariate one, so the univariate analysis adds nothing to the article, and that's especially true when the two analyses give different results. As it stands, it appears that readers have to make up their own minds about which analysis to believe. However, if the univariate truly adds something to the understanding of the data, then keep it in, but please explain why.

- The authors feel that that univariate analysis is useful for clinicians and readers alike to see a graphic representation of the data so that they can assess Cmax:MIC for each variable even if differences in the variable do not significantly impact the outcome. If we only focus on the multivariate analysis, it is difficult for readers to, for example, look at our analysis and say “Ah yes, tourniquet time was not significant but all times did achieve Cmax:MIC>10”.

3 and 4. The forest plots caused me the most difficulty. I understand the forest plots are used to visualize the meta-regression results but are effect sizes on the forest plot from the multiple regression, univariate regression, or raw data?

- We agree that the forest plots are difficult to read and interpret simply because there are so many arms included in all of the studies, but we believe it best practice to include these raw data in at least some form in the manuscript. What is labeled “Effect size” should actually be “multiples of MIC” – it just happens that the default label for our software is “Effect size”. We have changed this label to “multiples of MIC” to clarify.

There are several things on the plots that I wasn't sure about:

1. The heading on the 4th column is "effect size with 95% CI," but effect size isn't mentioned in the text. How is it defined?

- See previous comment about labels.

2. Please describe what Qb(1) means.

- Qb is a test of the group differences within the subgroup on univariable analysis. We have removed it from the figures to avoid confusion.

3. What do all the p-values in the last column mean. What is being tested?

- Thank you for bringing this to our attention. These are default outputs from the software, which is expecting an effect size, and the p-value is testing the hypothesis that the coefficient is significantly different from one. Since this hypothesis testing is not relevant in this case, we have removed it from the figures.

5. What is Q(121)? Is 121 correct, or should it be Q(122)?

- This is Cochran’s Q, which is a measure of heterogeneity. 121 is correct, because there was one arm for which we were not able to get measures of dispersion, so the total number of arms contributing to the meta-analysis is 122 (you’ll see in the Forest plot of all studies that “Study 13” is missing). But thank you for catching this – we had missed it! We have added this explanation to the Results section.

6. There appear to be three heterogeneity statistics, but I think only one is described in the manuscript. Please define them in the statistics section. (Or just keep one of them.)

- We have decided to keep only the I2 and Cochran Q tests. We have added explanation to the methods and removed the other statistics from the figures.

7. In line 245, you state, "Finally, meta-analysis showed that synovial structure, % systemic dose, tourniquet location, general anesthesia vs. standing, and tourniquet time were not statistically significantly associated with the outcome (Figs 4 and 5).

But in figure 5, tourniquet time has a p=0.02. Why is that not statistically significant?

- The test of group differences in this figure shows results of univariable analysis. To avoid confusion, we have removed the Qb and its p-value from the figure, since the p-value of the multivariable meta-regression was the one that we considered of most importance. We also removed the p-values from the right hand column, since these p-values had to do with the default output of the software, which is an effect size (OR or RR).

That raises a larger question. I didn't see a cutoff for statistical significance in the manuscript. The contemporary approach in a study like this would be to call it an exploratory study and omit a cutoff and any mention of statistical significance. The p-values would be used like effects sizes to find the best therapy. Alternatively, you could do some kind of Type I error inflation correction and then use that method to give an overall error rate of 5%.

But as the analysis stands, with a 0.05 cutoff for each test, some of your results may be false-positive discoveries.

- We agree that a Type 1 error inflation correction is warranted at this point, and we have used a Bonferroni-corrected p-value of 0.006 (0.05 divided by the 8 independent variables being tested). The two variables that were found to be statistically significant with the uncorrected p-value remain so with the corrected p-value.

***if heterogeneous, how do you justify the regression?

- As indicated by the Cochran Review, the meta-regression is used to explore sources of heterogeneity, not to obtain a summary measure despite heterogeneity. Therefore, we believe the regression is appropriate here.

Attachment

Submitted filename: Reviewer Comments RLP.docx

Decision Letter 1

Richard Evans

11 Mar 2022

Effects of regional limb perfusion technique on concentrations of antibiotic achieved at the target site: a meta-analysis

PONE-D-22-00403R1

Dear Dr. Ortved,

We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements.

Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication.

An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at http://www.editorialmanager.com/pone/, click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org.

If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

Kind regards,

Richard Evans

Academic Editor

PLOS ONE

Additional Editor Comments (optional):

Thank you for responding promptly to our comments. One last thing to double-check: Near the bottom of your responses, you state, "we have used a Bonferroni-corrected p-value of 0.006 (0.05 divided by the 8 independent variables being tested)." However, the Bonferroni correction should be 0.05 divided by the number of statistical tests, not the number of independent variables. I'm assuming that in your case, those two adjustments are the same. Please check that your inferences don't change using the correct Bonferroni correction.

Acceptance letter

Richard Evans

16 Mar 2022

PONE-D-22-00403R1

Effects of regional limb perfusion technique on concentrations of antibiotic achieved at the target site: a meta-analysis

Dear Dr. Ortved:

I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department.

If your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org.

If we can help with anything else, please email us at plosone@plos.org.

Thank you for submitting your work to PLOS ONE and supporting open access.

Kind regards,

PLOS ONE Editorial Office Staff

on behalf of

Dr. Richard Evans

Academic Editor

PLOS ONE

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Supplementary Materials

    S1 Fig. Forest plot of all studies included in the meta-analysis showing Cmax:MIC for susceptible bacteria.

    A vertical red line depicts 10x MIC.

    (PDF)

    S2 Fig. Forest plot of all studies included in the meta-analysis showing Cmax:MIC for resistant bacteria.

    A vertical red line depicts 10x MIC.

    (PDF)

    S1 Table. Study characteristics including Cmax, measures of dispersion and calculated Cmax:MIC for susceptible and resistant bacteria for included arms.

    lpdv = lateral palmar digital vein; saph = saphenous; ceph = cephalic; DIPJ = distal interphalangeal joint; MCPJ = metacarphophalangeal joint; TCJ = tarsocrural joint; RCJ = radiocarpal joint; MCJ = middle carpal joint; DFTS = digital flexor tendon sheath.

    (XLSX)

    S2 Table. Values of ξ (n) in the formula (7) and the formula (12) for Q ≤ 20.

    Modified from Wan et al. 2014. [14].

    (DOCX)

    S3 Table. Values of η (n) in the formula (12) and the formula (15) for Q ≤ 20, where n = 4Q + 1.

    Modified from Wan et al. 2014. [14].

    (DOCX)

    S1 Checklist. PRISMA 2020 checklist.

    (DOCX)

    Attachment

    Submitted filename: Reviewer Comments RLP.docx

    Data Availability Statement

    All relevant data are within the paper and its Supporting information files.


    Articles from PLoS ONE are provided here courtesy of PLOS

    RESOURCES