Skip to main content
Implementation Science Communications logoLink to Implementation Science Communications
. 2021 Oct 27;2:123. doi: 10.1186/s43058-021-00219-5

Cost analysis of a coaching intervention to increase use of transradial percutaneous coronary intervention

Kevin I Duan 1,2,, Christian D Helfrich 1,3, Sunil V Rao 4,5, Emily L Neely 1, Christine A Sulc 1, Diana Naranjo 1,3, Edwin S Wong 1,3
PMCID: PMC8554885  PMID: 34706775

Abstract

Background

The transradial approach (TRA) to cardiac catheterization is safer than the traditional transfemoral approach (TFA), with similar clinical effectiveness. However, adoption of TRA remains low, representing less than 50% of catheterization procedures in 2015. Peer coaching is one approach to facilitate implementation; however, the costs of this strategy for cardiac procedures such as TRA are unclear.

Methods

We conducted an activity-based costing analysis (ABC) of a multi-center, hybrid type III implementation trial of a coaching intervention designed to increase the use of TRA. We identified the key activities of the intervention and determined the personnel, resources, and time needed to complete each activity. The personnel cost per hour and the activity duration were then used to estimate the cost of each activity and the total variable cost of the implementation. Fixed costs related to designing and running the implementation were calculated separately. All costs are reported in 2019 constant US dollars.

Results

The total cost of the coaching intervention implementation was $374,863. Of the total cost, $367,752 were variable costs due to travel, preparatory work, in-person coaching, post-intervention evaluation, and administrative time. We estimated fixed costs of $7112. The mean marginal cost of implementing the intervention at only one additional medical center was $52,536.

Conclusions

We provide granular cost estimates of a conceptually rooted implementation strategy designed to increase the uptake of TRA for cardiac catheterization. We estimate that implementation costs stemming from the coaching approach would be offset after the conversion of approximately 409 to 1363 catheterizations from TFA to TRA. Our estimates provide benchmarks of the expected costs of implementing evidence-based, but expertise-intensive, cardiac procedures.

Trial registration

ISRCTN, ISRCTN66341299. Registered 7 July 2020—retrospectively registered

Supplementary Information

The online version contains supplementary material available at 10.1186/s43058-021-00219-5.


Contributions to the literature.

  • Economic evaluation remains limited in implementation science. Few studies provide detailed cost analysis as part of implementation trials, particularly related to coaching interventions for medical procedures.

  • We used an activity-based costing methodology to provide a detailed cost analysis of an implementation trial aimed at increasing the use of the transradial cardiac catheterization technique.

  • Our cost estimates can be used by health system leaders seeking to expand the use of transradial cardiac catheterization in their facilities. Our analysis and methodology serve as a model to other implementation trials planning to perform cost analysis.

Background

Cardiac catheterization is a common cardiac procedure used in the treatment of coronary heart disease [1]. Catheterization can be performed by accessing either the femoral artery in the groin or the radial artery in the wrist [2, 3]. The transfemoral approach (TFA) has historically been the most common method of performing cardiac catheterization in the United States (US) [4]. However, subsequent research demonstrates that the transradial approach (TRA) is preferred, due to improved outcomes, decreased complications, and lower costs [58]. This evidence supporting TRA is reflected in professional society clinical practice guidelines, which have been updated to state a preference for TRA [9, 10]. In the US, implementation of TRA has been improving (25% in 2014), but still lags behind TRA rates in Europe and Asia (e.g., almost 50% in the UK in 2012) [5, 11, 12].

Within the US Department of Veterans Affairs (VA), TRA accounted for 36% of diagnostic catheterizations and 32% of percutaneous coronary interventions (PCI) by 2015 [13]. The predominance of the femoral approach persists despite up to 94% of VA cardiologists rating TRA as superior to TFA on almost all counts: safety, patient comfort, and ease of monitoring patients post-procedure [14]. Furthermore, use of TRA in VA is heterogeneous, with several VA catheterization labs accounting for the majority of VA-wide TRA volume [15].

Several barriers have prevented broader uptake of TRA both within and outside of VA [14, 16, 17]. For cardiologists inexperienced in TRA, the approach initially takes significantly longer, incurs higher radiation exposure due to increased fluoroscopy use, and results in more crossovers (when an operator begins a procedure via one route but has to complete it via the alternative route) [1820]. Because TFA effectively achieves the same end as TRA, it is costly for cardiologists who are already proficient in TFA to invest sufficient time and effort to master new skills to execute TRA. Moreover, the TRA learning curve is not linear, with operators exhibiting slow improvement initially, so they likely perceive little payoff from their initial efforts to perform TRA [21]. Similar costs in time and effort exist for other members of the cardiac catherization team: case preparation, equipment selection, and post-procedure monitoring all change in small but important ways for TRA and take time to become routine [22].

Every complex skill presents a learning curve, and coaching by an experienced peer has long been demonstrated as a method of shortening the learning curve and improving skill acquisition in medicine [23]. Peer coaching helps inexperienced clinicians develop new heuristics (i.e., mental shortcuts for performing the skill) and routines (i.e., sets of inter-dependent actions among team members) [24]. This is achieved through demonstration of skills, explanation of underlying thinking and approaches, and corrective feedback [24]. However, the challenge of peer coaching is that it is time intensive and requires access to an experienced peer, who may be difficult for operators to identify and geographically remote. We sought to test a peer-coaching intervention to increase the speed uptake of TRA. Clinical trial ISRCTN66341299 was a stepped-wedge implementation trial of a coaching intervention designed to increase uptake of TRA at 7 Veterans Affairs Medical Centers (VAMCs) in the US. The coaching strategy was informed by (1) conceptual models related to implementation and the theory of expert skill development [25, 26] and (2) prior empirical findings related to how clinical practices adopt new skills [22, 2729].

Cost and financial resources are often cited as a barrier to the adoption of evidence-based practices (EBPs) such as TRA [30]. As such, there is a need to better describe costs in implementation trials to provide health system leaders a full understanding of the economic ramifications of implementation. Transparent and full cost analysis is also an important step towards the reproducibility of strategies to improve uptake of EBPs. While there is an increasing inclusion of cost analyses in clinical drug trials, there are few cost analyses in implementation trials [31, 32]. The goal of the present analysis was to examine the cost of the coaching implementation strategy from the implementation trial.

Methods

Study setting and implementation trial overview

This descriptive economic analysis examined implementation costs within a hybrid type-III implementation trial (Clinical Trials Identifier: ISRCTN66341299). The trial took place from March 2018 to March 2020. A stepped-wedge trial design was employed such that catherization teams at seven VAMCs were randomized (in sets of two to three sites) to receive a coaching intervention during one of three steps, each four months apart (Fig. 1). Cardiology-specific site characteristics are summarized in Table 1. The trial compared the rate of TRA use before and after the coaching intervention. The stepped-wedge design allowed sites to serve both as internal controls in pre-post comparison and to control for secular trends by comparing sites between steps. The control arm was usual care pre-intervention. At the end of the trial period, catherization teams at all sites had received the coaching intervention. Each site was represented by a catherization lab team, comprising a cardiologist with 1–2 nurses and/or radiology technicians (i.e., 2–3 members per catherization lab team). The coaching intervention (described in detail in the “Coaching implementation strategy” section) was designed to mitigate a well-documented learning curve for TRA [18, 19]. The underlying hypothesis was that most operators, trained on TFA, never perform TRA consistently enough to achieve proficiency. On the rare occasions they do perform TRA, they tend to perform it on the lowest risk patients who benefit the least [33]. The coaching intervention was designed to reduce the learning curve and introduce external accountability. The primary outcome was procedure-level odds of TRA, and secondary outcomes were clinical outcomes expected to improve with TRA, such as bleeding complications, and measures of TRA proficiency, including contrast volume and an implementation fidelity checklist completed at the conclusion of the coaching visit.

Fig. 1.

Fig. 1

Stepped wedge design

Table 1.

Site characteristics

Participants (n = 7 sites) Non-participants (n = 73 sites)*
Interventional cardiologists (mean, SD) 4.7 (0.8) 3.7 (1.9)
Diagnostic case volume (mean, SD) 595 (226) 410 (219)
% TRA (mean, range) 27% (2.5–64%) 54% (0–93%)
PCI volume (mean, SD) 230 (139) 126 (934)
% TRA (mean, range) 22% (2–44%) 46% (0–95%)
Facility bed size (mean, SD) 135 (66) 103 (42)
Academic affiliation (n, %) 7 (100%) 73 (100%)
Onsite surgical backup (n, %) 4 (57%) 37 (51%)

Abbreviations: SD, standard deviation; TRA, transradial approach; PCI, percutaneous coronary intervention

*Non-participant sites include all VA facilities that have a cardiac catheterization lab

Coaching implementation strategy

The coaching intervention included two primary components: (1) an in-person team-based training at an experienced catheterization lab, and (2) a participant site visit by the coaching team approximately 1–2 months later, during which coaches observed a series of pre-scheduled TRA cases performed by the participants, and provided feedback and support. The training component consisted of a day-long training course that included three elements: (1) didactic sessions, (2) simulation, and (3) observing cases performed by TRA coaches (see Additional file 1 for course agenda). Catheterization teams sent 2 to 3 participants (one cardiologist along with a cardiac catheterization nurse and/or radiology technician) to the training course held at a central site, which was capable of hosting up to 10 catheterization lab teams at a time. The course began with didactic lectures for all participants followed by research on TRA, information on common issues encountered and discussion of the TRA technique. In the afternoon, the participants observed live cases performed by a highly proficient team. Participants also observed pre-procedure set-up, and post-procedure care and monitoring. The cases ranged from diagnostic to PCI cases.

Approximately 1 month following participation in the training course, an experienced interventionalist and nurse (members of the coaching team) conducted a 1-day coaching visit to the participants’ catheterization lab. The purpose of this visit was to address any challenges, including helping teams recognize opportunities for improvement. Coaching visits involved coach/participant meetings and observing live cases. The coaching visit also involved supervised, hands-on training. A coaching approach was important because it focused on corrective, non-punitive feedback. The coaching visit was timed to occur after the participants had returned to their catheterization lab and had an opportunity to apply what they learned at the training course and encounter challenges. At the time of the coaching visit, the participant sites were likely not yet proficient and therefore at risk of not adopting TRA. It is at this high-risk point that we believed coaches could help troubleshoot and offer encouragement.

Data sources

The primary source of data were detailed study records tracking attendance and time involved in meetings and seminars related to the coaching strategy. Costs associated with travel were derived from VA travel reimbursement records. Interview logs were used to ascertain the time devoted to coaching interviews. We surveyed a random sample of implementation participants to ascertain time devoted to preparation for implementation activities. Salaries of participants used to monetize time devoted to the coaching strategy were derived from VA Personnel and Accounting Integrated Data (PAID).

Costing methodology overview

Implementation costs for the coaching strategy primarily consist of the opportunity cost of time devoted to implementation activities [34]. To calculate these costs, we conducted activity-based costing (ABC). ABC is a method of calculating cost that was first developed in the business sector and has since been applied to health care settings [35]. As implied by the name, this method of micro-costing relies on dividing a service or product—in our case, the coaching intervention—into sub-component activities. The cost of each activity can then be estimated by calculating both the labor cost per unit time of involved personnel and the length of time it takes to complete a given activity to estimate the total cost. This technique, and its derivative method, time-driven activity-based costing (TDABC), have been previously used in cost studies in health care, but there has been limited use in implementation science, particularly in implementation trials [36, 37]. We chose to use traditional ABC, and not TDABC, given the time inputs available from participants for our analysis. For this study, we took the perspective of the health care system in calculating cost. We excluded personnel time and activities that were directly related to research, such that the results of this study are representative of implementation of the coaching intervention alone. Research staff that attended the training sessions were excluded from the cost analysis. Administrative time devoted to research was excluded by staff estimates of percent full-time equivalents (FTE). As an overview of our ABC methodology, we followed the following steps: (1) we divided the coaching intervention into sub-component activities that were then categorized as variable costs (travel, preparatory work, in-person coaching, post-intervention evaluation and administrative time) and fixed costs (intervention development, computers). (2) We determined labor costs per hour for each participant and coach. (3) We collected time estimates for each activity and personnel type from surveys, activity logs, conference agendas, and key informants. (4) We obtained full study costs for each activity by multiplying personnel-level time estimates (in hours) with the individual hourly wage rate and summed across all three randomization clusters. We then estimated per VAMC and per cluster average costs by repeating the calculation for the full study cost described above, but only including participant personnel assigned to a VAMC or cluster. For the per VAMC and per cluster calculations, coach costs were divided and equally attributed across VAMCs and clusters. Finally, we estimated costs per personnel, per cluster by multiplying average labor cost for each personnel type with the average time spent on each activity by each personnel type.

Labor cost per hour

A key input variable in calculating variable and fixed costs using the ABC method is the labor cost per unit time. We calculated the labor cost per hour for a given individual by dividing their total annual salary by the number of working hours per year. Total annual salary was inclusive of bonus, performance pay, and a 30% increase to reflect the cost of benefits [38]. To calculate the working hours per year, we assumed 261 weekdays per year, 8-h workdays and an “applied rate” of 80% for all participants. The applied rate is defined as the proportion of an employee’s time that is devoted to productive working hours (i.e., excluding vacation, holidays, sick leave and continuing medical education). The VA Health Economics Resource Center recommends using a rate of 80–85% for VA salaries, and we selected the lower bound of the recommended range for a conservative estimate [38]. We then used the calculated labor cost per hour for a given individual to calculate the variable and fixed costs, by multiplying the number of hours an individual spent on a given activity by the labor cost per hour.

Variable costs

We subcategorized the variable costs into five components: (1) travel, (2) preparatory work, (3) in-person coaching, (4) post-intervention evaluation, and (5) the administrative time devoted to logistical support and coordination of the implementation. These costs are categorized as variable costs, because they varied with each randomization cluster based on the number of personnel and the amount of travel that was involved in a given cluster. For the components of travel, preparatory work, in-person coaching, and post-intervention evaluation, the time spent performing each activity was multiplied by the labor cost per hour for a given individual to estimate the cost of the activity. Travel primarily consisted of trips to the 1-day learning lab and coaching visits by the TRA coaching team to each participating site. Direct travel costs related to flights, hotels, and other travel-related expenses were obtained from travel reimbursement claims and the VA travel software system. The time spent in transit for personnel that traveled was estimated using the Google Flights website [39]. Local personnel incurred no travel costs. The administrative time spent coordinating travel was based on the percent FTE devoted to this task estimated by project administrative staff. The preparatory work primarily entailed the coaches updating presentation materials for the didactic portion of the learning lab, coordinating the learning lab schedule with the catheterization laboratory’s clinical schedule, and meetings before and after the learning lab and coaching visit to huddle and debrief. For preparatory work, we obtained estimates from key informants of the average time coaches and participants spent reviewing materials prior to the in-person learning lab and in-person coaching visits. In-person coaching was described above in the “Coaching implementation strategy” section. For in-person coaching time, we obtained meeting agendas for both learning labs and coaching visits to estimate the time spent in coaching sessions. Post-intervention qualitative evaluation entailed telephone interviews (generally about 20 min) about participant experience and an online survey assessing their perceptions of TRA vs TFA, barriers to TRA, and workplace climate. Time spent by participants on post-intervention activities was estimated using the average of survey time logs and exit interview times. These average times were applied to all participants. Finally, the costs associated with administrative activities were obtained by estimating the percent FTE devoted to tasks required to coordinate and run the intervention by administrative staff. These duties include conducting the post-intervention evaluation interviews and surveys described above. The administrative time devoted to arranging travel was calculated separately as part of travel. The cost of materials was assumed to be minimal as teaching materials were transmitted electronically.

Fixed costs

The main fixed costs were the time devoted to coaching intervention development and the cost of computing resources. Intervention development entailed establishing the initial schedule and content for the learning lab, drafting the didactic content, and developing an implementation fidelity checklist. The coaching intervention development was considered a fixed cost since the same intervention was applied to all participating sites. To estimate the one-time cost of developing these materials, we reviewed the in-person coaching agendas of both the classroom sessions and the site visits to ascertain the actual number of presentations delivered. Estimates of the time spent developing each presentation was estimated by the coaches. We included the cost of computing resources as a fixed cost, annuitized using a 5-year linear depreciation based on the recommended product lifespan of computers that is outlined by the United States Internal Revenue Service property depreciation recommendations [40]. We then attributed this annual cost to the 2 years during which the intervention was conducted. The cost of purchasing computer equipment was obtained by averaging the 10 most common products in a government price catalog [41].

Analysis

We report cumulative implementation cost for the full study across the 7 participating sites for each cost subcomponent (e.g., fixed, variable costs). Next, we report the mean marginal cost of adding one VAMC to an existing coaching intervention program by calculating the average variable cost per VAMC. We also present univariate statistics of VAMC-level implementation costs including means, medians, standard deviations (SD) and interquartile ranges. Finally, we report the cost of implementing the intervention at only one VAMC (i.e., the startup cost of starting the coaching intervention de novo), which includes the entire fixed cost, as well as the mean variable costs for one VAMC.

Sensitivity analyses

We performed multiple sensitivity analyses. First, we conducted a sensitivity analysis to evaluate how changes to travel inputs affected implementation costs. A significant amount of travel was involved for both coaches and participants for this nationwide implementation trial. A similar coaching intervention implemented at a regional level may yield lower costs if appropriate expertise is available. Therefore, in this sensitivity analysis, we assumed no air travel took place and that participant sites were located 1 h away from a hypothetical centralized center of TRA expertise. We also assumed no administrative time arranging travel. Second, we conducted a sensitivity analysis of how the same intervention would cost outside of the VA. VA salaries are generally lower than in community practice, which may underestimate total implementation costs if the coaching intervention was employed outside of VA [42]. Therefore, our second sensitivity analysis utilized national mean salaries for community interventional cardiologists and catheterization lab staff from 2019, instead of VA salaries [43, 44]. Furthermore, conference room space was not rented since all training was done in federal facilities at zero cost. Correspondingly, the second sensitivity analysis also included the cost of renting small conference rooms from federal facilities, estimated using the US General Services Administration list of meeting facilities [45]. Third, we conducted a sensitivity analysis of the cost of training all of the interventional cardiologists at the study sites. We applied the mean number of interventional cardiologists (Table 1) to all 7 study sites and used the site-specific mean salary of cardiologists in order to perform this sensitivity analysis.

Cost analysis was performed using Microsoft Excel. All costs were inflation adjusted to 2019 dollars using the Consumer Price Index [46, 47]. We adhered to the CHEERS reporting guidelines where appropriate.

Results

Time devoted to activities and labor cost per hour

Within a given randomization cluster, participants spent a mean of 4.5 h preparing ahead of organized coaching activities and a mean of 13.6 h at in-person sessions (training session and site visit). In total, physician participants devoted a mean of 24.7 h (SD = 2.2) to the intervention and nurse/radiology technicians devoted a mean of 24.0 h (SD = 2.4) to the intervention for a given randomization cluster (Table 2). Compared with participants, coaches spent more time traveling, but less time preparing for sessions ahead of organized activities and at in-person sessions. Labor costs per hour were similar between participants and coaches, within each type of role (physician and nurse/radiology technician, respectively).

Table 2.

Personnel-level characteristics, mean time per activity, and costs per personnel per randomization cluster

Participant—Physician (mean n = 2) Participant—Nurse/Radiation Technician (mean n = 2.67) Coach—Physician (mean n = 4.33) Coach—Nurse/Radiation Technician (mean n = 1.67)
Characteristics
 Years in practice (median, IQR) 12 (9.25–17.75) 10.5 (2.5–20.5) N/A**** N/A****
Time per activity
 Travel, (hours; mean (SD)) 6.1 (2.1) 5.4 (2.4) 7.0 (6.8) 13.0 (4.8)
 Preparation (hours; mean (SD))** 4.5*** 4.5*** 0.7 (0.3) 0.9 (0.2)
 In-person coaching (hours; mean (SD)) 13.6 (0.08) 13.6 (0.06) 9.5 (3.4) 12.0 (2.3)
 Evaluation (hours; mean (SD)) 0.5 (0.06) 0.5 (0.06) 0**** 0****
 Total time (hours; mean (SD)) 24.7 (2.2) 24.0 (2.4) 17.2 (9.7) 25.9 (6.4)
Costs
 Variable costs
  Labor cost/hr (2019 dollars; mean (SD)) $269 (30) $70 (23) $257 (15) $75 (4)
   Total labor cost (2019 dollars; mean (SD)) $6652 (1028) $1690 (574) $4450 (2570) $1952 (559)
   Direct travel cost (2019 dollars; mean (SD)) $982 (281) $1096 (181) $1142 (737) $1783 (738)
   Apportioned administrative cost (2019 dollars; mean (SD)) $3683***** $3683***** N/A***** N/A*****
 Total variable cost (2019 dollars; mean (SD)) $11,318 (1079) $6469 (695) $5593 (3193) $3735 (1285)
 Apportioned fixed cost (2019 dollars; mean (SD)) $474***** $474***** N/A***** N/A*****
Total cost (2019 dollars; mean (SD)) $11,792 (1079) $6943 (695) $5593 (3193) $3735 (1285)

Abbreviations: SD, standard deviation; IQR, interquartile range

Mean time per activity and personnel-level costs are calculated as averages of the activities of a given coach/participant within a randomization cluster

**Learning time for participants, preparation time for coaches

***Based on reported estimates by key informants, applied to both physician and nurse/technologist roles, no SD reported

****Coaches did not participate in post-intervention evaluations or report years in practice

*****Fixed costs and administrative portion of variable costs were apportioned equally to participants only, as the target of the intervention. No SD reported

Variable costs

The total variable cost was $367,752 across 7 VAMCs (Table 3). In terms of variable cost subcomponents, travel costs were $230,979 ($43,318 direct costs, $44,256 travel time cost, $143,405 travel-specific administrative time), preparatory costs were $12,583, in-person coaching costs were $67,959, post-intervention evaluation costs were $984, and general administrative time costs were $55,247. The mean marginal cost per VAMC was $52,536 (SD = $4530), and the median was $54,575 (IQR = $49,985–$55,391).

Table 3.

Variable, fixed, and total costs for the full study, per site and per randomization cluster

graphic file with name 43058_2021_219_Tab3_HTML.jpg

Abbreviations: VAMC, Veterans Affairs Medical Center; SD, standard deviation; IQR, interquartile range

*Means and SD were not calculated as this was total aggregate cost, and not average

**Administrative time was divided across 7 VAMCs or 3 clusters as an estimate. No SD or IQR is reported

Fixed costs

The total fixed cost of the intervention was $7112 (Table 3), which consisted of intervention curriculum development ($5588) and computer cost ($1524).

Total costs

The total overall cost of implementation of TRA coaching intervention was $374,863 for 7 VAMCs (Table 3). The mean marginal cost of adding one VAMC to the implementation program was $52,536 as described above. The total cost of implementing the TRA coaching intervention at one VAMC was $59,648, which was the sum of fixed costs ($7112) plus the mean marginal cost of adding one VAMC.

Sensitivity analysis

When assuming 1 h of local travel with no air travel, accommodation or administrative time spent arranging travel, the total overall cost of implementation of the TRA coaching intervention was $156,796 for 7 VAMCs (Additional file 1). The mean marginal cost of adding one hospital to the implementation program using only local travel was $21,383. The total cost of implementing the TRA coaching intervention at one hospital was $28,495, which included $7112 in fixed costs plus the mean marginal cost from our sensitivity analysis. When assuming a non-VA setting of implementation by including national average salaries and room rental costs, the total overall cost of implementation of the TRA coaching intervention was $394,860 for 7 VAMCs (Additional file 1). When assuming that all interventional cardiologists at each study site were trained, the total overall cost of implementation of the TRA coaching intervention was $577,883 for 7 VAMCs (Additional file 1).

Discussion

This study describes the costs of implementing a coaching intervention to increase use of TRA for cardiac catheterization within a large integrated health system using an ABC methodology. We estimated a total implementation cost of $374,863. Considering the per catheterization savings of $275–$916 (depending on the type of case) associated with TRA [7, 48, 49], we estimate that the implementation cost is approximately equal to converting 409–1363 cases from TFA to TRA. At the time of enrollment, VA sites eligible for our study performed an average of 650 catheterizations annually with a median TRA rate of 28%. As such, potential savings associated with implementing TRA catheterizations could be realized within only 1–2 years.

The majority of the implementation cost (88%) was driven by the high opportunity cost of personnel time. Specifically, time spent traveling to the in-person sessions, paying for travel expenses, and making travel arrangements represented 62% of the total implementation cost. Due to the administrative complexity of arranging travel through the VA, a significant amount of administrative effort was spent on this activity, which accounted for 38% of total costs.

Implementation costs could be dramatically reduced by conducting part, or all, of the coaching implementation strategy virtually. This would also facilitate access to TRA experts for health systems without internal experts. The didactic portion could be easily delivered remotely with current technology, either via remote teleconferencing or pre-recorded lectures. Emerging technologies such as virtual reality (VR) and haptic feedback devices could allow participants to experience the TRA-case portion of the coaching intervention remotely [50]. It may even be possible to create libraries of VR-recorded cases or simulated game cases representing common problems experienced during TRA catheterization. However, at this point, evidence is sparse about the relative effectiveness and costs of virtual versus in-person coaching [50]. Alternatively, a regional implementation strategy could not only reduce time spent traveling, but it would also reduce direct travel costs and the administrative burden. Our sensitivity analysis found that a regional strategy involving only driving locally and excluding the high administrative burden or coordinating travel reduced total implementation costs by 58% to a total of $156,795.91. However, a regional strategy may not be feasible if expertise is limited.

As health systems consider implementing interventions to increase uptake of the TRA, this analysis provides detailed cost estimates that can be used in budgetary analyses. Furthermore, this coaching intervention and its associated implementation costs serve as a useful model for broader dissemination of other interventional cardiology procedures. The use of minimally invasive cardiovascular procedures is growing [51] due to their favorable safety and efficacy profiles [52, 53]. Procedures like transcatheter aortic valve replacement (TAVR) currently remain concentrated in centers of expertise. However, with a recent change in the Centers for Medicare and Medicaid Services procedural volume requirements, many more hospitals will be eligible to perform these procedures [54]. As growth of new catheter-based cardiovascular procedures accelerates, coaching interventions like the one described in this study will likely be needed as access is expanded. This cost analysis and the methods used can serve as the basis of future implementation trials for other coaching interventions to foster uptake of evidence-based cardiology procedures.

There are several limitations to this study. First, the TRA coaching intervention was implemented within the VA, a large, integrated health care system in the US. As such, certain aspects of the reported cost estimates may not be directly generalizable to other settings. Specifically, VA travel costs are higher due to fare class requirements for airline tickets, and VA salaries are generally lower than those in the community [42]. At the same time, it is also possible that implementing a TRA intervention outside of an integrated network like the VA (i.e., across different health care systems) could prove to be more time-intensive and costly than our experience within the VA. We performed sensitivity analysis to enhance generalizability of cost estimates outside of the VA. Second, several estimates of the time required to complete a given activity (such as preparatory time and intervention development) were obtained by key informants. These estimates were subject to recall bias. Other estimates of activity time such as in-person coaching, and travel time are more accurate as they were based on meeting records and flight times. Third, we did not collect detailed data on how the duration and intensity of training varied across sites, which prevents analysis of potentially important patterns of site-level variation. However, given the structured nature of the intervention and the short time frame of the sessions (1 day each for the training program and site visit), large variation in time is unlikely. Similarly, we did not collect data regarding an individual’s baseline experience with TRA as a surrogate for how ready they were to transition to the TRA. Baseline experience may have an important role in contributing to variation in cost at the participant-level. Prior to the intervention, only 22–27% of cardiac catheterization cases at our study sites were performed using TRA (Table 1). This rate of TRA adoption would be considered low, given that TRA is now regarded as the default approach and should represent the majority of cases [9]. We expect settings with similarly low levels of baseline TRA experience would lead to similar costs to our study. In settings with higher levels of baseline TRA experience, we expect costs to be lower than reported in our study because the 1-day training course and 1-day site visit could be shortened or consolidated. Fourth, we excluded costs related to research from this analysis, so that our cost estimates represent implementation alone. However, it can be difficult for participants to distinguish between research and implementation in real-world settings, which could have led to over- or under-estimation of implementation costs [55]. Fifth, this cost analysis included the costs of activities that were part of pre-implementation planning and the implementation itself. Sustainment of the intervention after implementation was not part of the implementation trial. As a result, costs associated with these activities were not included in the estimates reported. Finally, given that only one cardiologist and 1–2 nurse/technicians participated from each site, our supposition was that other staff at participating sites would learn TRA through local observation and teaching. We made this supposition based on the many benefits to TRA and easily teachable techniques. However, if this does not occur in practice, our cost estimates will be an underestimate, as we estimated in our sensitivity analysis that formally training all cardiologists would be much more expensive.

Conclusions

In conclusion, this study provides a detailed cost analysis of the implementation of a coaching intervention to increase usage of TRA in cardiac catheterization. The use of the ABC methodology provides granular and transparent cost estimations that enhance the reproducibility of the intervention and the ability of health system leaders to make informed budgetary decisions when considering broader adoption.

Supplementary Information

Additional file 1. (30.8KB, docx)
43058_2021_219_MOESM2_ESM.docx (19KB, docx)

Additional file 2. Completed CHEERS reporting guidelines.

Disclaimer

The views expressed here are those of the authors and do not necessarily reflect the position or policy of the Department of Veterans Affairs.

Abbreviations

EBPs

Evidence-based practices

FTE

Full-time equivalents

PAID

VA Personnel and Accounting Integrated Data

PCI

Percutaneous coronary intervention

TAVR

Transcatheter aortic valve replacement

ABC

Activity-based costing

TFA

Transfemoral approach

TRA

Transradial approach

US

United States

VA

US Department of Veterans Affairs

VAMCs

Veterans Affairs Medical Centers

Authors’ contributions

CDH and SVR conceived the study and obtained funding. KID, CDH, SVR, and ESW contributed to the study design. KID, ELN, CAS, and ESW contributed to the data acquisition and analysis. KID and ESW interpreted the data. KID and ESW drafted the manuscript. KID, CDH, SVR, ELN, CAS, and DN and ESW substantively revised the manuscript.

Funding

This study was supported by grants from The Department of Veterans Affairs Health Services Research & Development grant 1I01HX002043-01A2, IIR15-362, and the National Heart, Lung, and Blood Institute Grant T32HL007287.

Availability of data and materials

The data used for this study includes identifiable, private salary data and is therefore not available.

Declarations

Ethics approval and consent to participate

The VA Central Institutional Review Board approved this study (IRB# 00772).

Consent for publication

Not applicable

Competing interests

The authors declare that they have no competing interests.

Footnotes

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

References

  • 1.Alkhouli M, Alqahtani F, Kalra A, Gafoor S, Alhajji M, Alreshidan M, Holmes DR, Lerman A. Trends in characteristics and outcomes of hospital inpatients undergoing coronary revascularization in the United States, 2003-2016. JAMA Netw Open. 2020;3(2):e1921326. doi: 10.1001/jamanetworkopen.2019.21326. [DOI] [PubMed] [Google Scholar]
  • 2.Jolly SS, Yusuf S, Cairns J, Niemelä K, Xavier D, Widimsky P, Budaj A, Niemelä M, Valentin V, Lewis BS, Avezum A, Steg PG, Rao SV, Gao P, Afzal R, Joyner CD, Chrolavicius S, Mehta SR. Radial versus femoral access for coronary angiography and intervention in patients with acute coronary syndromes (RIVAL): a randomised, parallel group, multicentre trial. The Lancet. 2011;377(9775):1409–1420. doi: 10.1016/S0140-6736(11)60404-2. [DOI] [PubMed] [Google Scholar]
  • 3.Valgimigli M, Gagnor A, Calabró P, Frigoli E, Leonardi S, Zaro T, Rubartelli P, Briguori C, Andò G, Repetto A, Limbruno U, Cortese B, Sganzerla P, Lupi A, Galli M, Colangelo S, Ierna S, Ausiello A, Presbitero P, Sardella G, Varbella F, Esposito G, Santarelli A, Tresoldi S, Nazzaro M, Zingarelli A, de Cesare N, Rigattieri S, Tosi P, Palmieri C, Brugaletta S, Rao SV, Heg D, Rothenbühler M, Vranckx P, Jüni P. Radial versus femoral access in patients with acute coronary syndromes undergoing invasive management: a randomised multicentre trial. The Lancet. 2015;385(9986):2465–2476. doi: 10.1016/S0140-6736(15)60292-6. [DOI] [PubMed] [Google Scholar]
  • 4.Rao SV, Cohen MG, Kandzari DE, Bertrand OF. Gilchrist IC. The transradial approach to percutaneous coronary intervention. Journal of the American College of Cardiology. 2010;55(20):2187–2195. doi: 10.1016/j.jacc.2010.01.039. [DOI] [PubMed] [Google Scholar]
  • 5.Feldman DN, Swaminathan RV, Kaltenbach LA, Baklanov DV, Kim LK, Wong SC, Minutello RM, Messenger JC, Moussa I, Garratt KN, Piana RN, Hillegass WB, Cohen MG, Gilchrist IC, Rao SV. Adoption of radial access and comparison of outcomes to femoral access in percutaneous coronary intervention: an updated report from the National Cardiovascular Data Registry (2007–2012) Circulation. 2013;127(23):2295–2306. doi: 10.1161/CIRCULATIONAHA.112.000536. [DOI] [PubMed] [Google Scholar]
  • 6.Andò G, Capodanno D. Radial versus femoral access in invasively managed patients with acute coronary syndrome: a systematic review and meta-analysis. Ann Intern Med. 2015;163(12):932–940. doi: 10.7326/M15-1277. [DOI] [PubMed] [Google Scholar]
  • 7.Amin AP, House JA, Safley DM, Chhatriwalla AK, Giersiefen H, Bremer A, et al. Costs of transradial percutaneous coronary intervention. JACC: Cardiovascular Interventions. 2013;6(8):827–834. doi: 10.1016/j.jcin.2013.04.014. [DOI] [PubMed] [Google Scholar]
  • 8.Lindner SM, McNeely CA, Amin AP. The value of transradial. interv cardiol Clin. 2020;9(1):107–115. doi: 10.1016/j.iccl.2019.08.004. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9.Mason PJ, Shah B, Tamis-Holland JE, Bittl JA, Cohen MG, Safirstein J, Drachman DE, Valle JA, Rhodes D, Gilchrist IC, On behalf of the American Heart Association Interventional Cardiovascular Care Committee of the Council on Clinical Cardiology; Council on Cardiovascular and Stroke Nursing; Council on Peripheral Vascular Disease; and Council on Genomic and Precision Medicine An update on radial artery access and best practices for transradial coronary angiography and intervention in acute coronary syndrome: a scientific statement from the American Heart Association. Circ Cardiovasc Interv. 2018;11(9):e000035. doi: 10.1161/HCV.0000000000000035. [DOI] [PubMed] [Google Scholar]
  • 10.Roffi M, Patrono C, Collet J-P, Mueller C, Valgimigli M, Andreotti F, Bax JJ, Borger MA, Brotons C, Chew DP, Gencer B, Hasenfuss G, Kjeldsen K, Lancellotti P, Landmesser U, Mehilli J, Mukherjee D, Storey RF, Windecker S, ESC Scientific Document Group 2015 ESC guidelines for the management of acute coronary syndromes in patients presenting without persistent ST-segment elevation: Task Force for the Management of acute coronary syndromes in patients presenting without persistent ST-segment elevation of the European Society of Cardiology (ESC) Eur Heart J. 2016;37(3):267–315. doi: 10.1093/eurheartj/ehv320. [DOI] [PubMed] [Google Scholar]
  • 11.Ratib K, Mamas MA, Anderson SG, Bhatia G, Routledge H, De Belder M, et al. Access site practice and procedural outcomes in relation to clinical presentation in 439,947 patients undergoing percutaneous coronary intervention in the United Kingdom. JACC: Cardiovascular Interventions. 2015;8(1):20–29. doi: 10.1016/j.jcin.2014.06.026. [DOI] [PubMed] [Google Scholar]
  • 12.Masoudi FA, Ponirakis A, de Lemos JA, Jollis JG, Kremers M, Messenger JC, et al. Executive summary: trends in U.S. Cardiovascular Care. Journal of the American College of Cardiology. 2017;69:1424–1426. doi: 10.1016/j.jacc.2016.12.004. [DOI] [PubMed] [Google Scholar]
  • 13.Waldo SW, Gokhale M, O’Donnell CI, Plomondon ME, Valle JA, Armstrong EJ, Schofield R, Fihn SD, Maddox TM. Temporal trends in coronary angiography and percutaneous coronary intervention. JACC: Cardiovascular Interventions. 2018;11(9):879–888. doi: 10.1016/j.jcin.2018.02.035. [DOI] [PubMed] [Google Scholar]
  • 14.Helfrich CD, Tsai TT, Rao SV, Lemon JM, Eugenio EC, Vidovich MI, Shroff AR, Speiser BS, Bryson CL. Perceptions of advantages and barriers to radial-access percutaneous coronary intervention in VA cardiac catheterization laboratories. Cardiovasc Revasc Med. 2014;15(6-7):329–333. doi: 10.1016/j.carrev.2014.08.006. [DOI] [PubMed] [Google Scholar]
  • 15.Gutierrez A, Tsai TT, Stanislawski MA, Vidovich M, Bryson CL, Bhatt DL, Grunwald GK, Rumsfeld J, Rao SV. Adoption of transradial percutaneous coronary intervention and outcomes according to center radial volume in the veterans affairs healthcare system: insights from the Veterans Affairs Clinical Assessment, Reporting, and Tracking (CART) Program. Circ Cardiovasc Interv. 2013;6(4):336–346. doi: 10.1161/CIRCINTERVENTIONS.113.000110. [DOI] [PubMed] [Google Scholar]
  • 16.Tremmel JA. Launching a successful transradial program. J Invasive Cardiol. 2009;21 8 Suppl A:3A-10A. [PubMed]
  • 17.Elgharib NZ, Shah UH, Coppola JT. Transradial cardiac catheterization and percutaneous coronary intervention: a review. Coron Artery Dis. 2009;20(8):487–493. doi: 10.1097/MCA.0b013e32832f37fc. [DOI] [PubMed] [Google Scholar]
  • 18.Ball WT, Sharieff W, Jolly SS, Hong T, Kutryk MJB, Graham JJ, Fam NP, Chisholm RJ, Cheema AN. Characterization of operator learning curve for transradial coronary interventions. Circ Cardiovasc Interv. 2011;4(4):336–341. doi: 10.1161/CIRCINTERVENTIONS.110.960864. [DOI] [PubMed] [Google Scholar]
  • 19.Hess CN, Peterson ED, Neely ML, Dai D, Hillegass WB, Krucoff MW, Kutcher MA, Messenger JC, Pancholy S, Piana RN, Rao SV. The learning curve for transradial percutaneous coronary intervention among operators in the united states: a study from the National Cardiovascular Data Registry. Circulation. 2014;129(22):2277–2286. doi: 10.1161/CIRCULATIONAHA.113.006356. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20.Wagener JF, Rao SV. A comparison of radial and femoral access for cardiac catheterization. Trends in Cardiovascular Medicine. 2015;25(8):707–713. doi: 10.1016/j.tcm.2015.03.012. [DOI] [PubMed] [Google Scholar]
  • 21.Abbott JD. The pace of transradial procedural learning. Circulation. 2014;129(22):2250–2252. doi: 10.1161/CIRCULATIONAHA.114.010061. [DOI] [PubMed] [Google Scholar]
  • 22.Zussman BM, Tonetti DA, Stone J, Brown M, Desai SM, Gross BA, Jadhav A, Jovin TG, Jankowitz BT. Maturing institutional experience with the transradial approach for diagnostic cerebral arteriography: overcoming the learning curve. J NeuroIntervent Surg. 2019;11(12):1235–1238. doi: 10.1136/neurintsurg-2019-014920. [DOI] [PubMed] [Google Scholar]
  • 23.Ericsson KA. Deliberate practice and the acquisition and maintenance of expert performance in medicine and related domains: Acad Med. 2004;79 Supplement:S70–S81. [DOI] [PubMed]
  • 24.Ericsson KA. Acquisition and maintenance of medical expertise: a perspective from the expert-performance approach with deliberate practice. Academic Medicine. 2015;90(11):1471–1486. doi: 10.1097/ACM.0000000000000939. [DOI] [PubMed] [Google Scholar]
  • 25.Kitson A, Harvey G, McCormack B. Enabling the implementation of evidence based practice: a conceptual framework. Qual Health Care. 1998;7(3):149–158. doi: 10.1136/qshc.7.3.149. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 26.Kitson AL, Rycroft-Malone J, Harvey G, McCormack B, Seers K, Titchen A. Evaluating the successful implementation of evidence into practice using the PARiHS framework: theoretical and practical challenges. Implementation Sci. 2008;3(1):1. doi: 10.1186/1748-5908-3-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 27.Edmondson AC, Bohmer R, Pisano G. Learning new technical and interpersonal routines in operating room teams: the case of minimally invasive cardiac surgery. In: Griffith TL, editor. Research on Managing Groups and Teams: Technology. Stamford, Conn: JAI Press; 2000. [Google Scholar]
  • 28.Kauth MR, Sullivan G, Blevins D, Cully JA, Landes RD, Said Q, Teasdale TA. Employing external facilitation to implement cognitive behavioral therapy in VA clinics: a pilot study. Implementation Sci. 2010;5(1):75. doi: 10.1186/1748-5908-5-75. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 29.Stetler CB, Legro MW, Rycroft-Malone J, Bowman C, Curran G, Guihan M, Hagedorn H, Pineros S, Wallace CM. Role of “external facilitation” in implementation of research findings: a qualitative evaluation of facilitation experiences in the Veterans Health Administration. Implementation Sci. 2006;1(1):23. doi: 10.1186/1748-5908-1-23. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 30.Bach-Mortensen AM, Lange BCL, Montgomery P. Barriers and facilitators to implementing evidence-based interventions among third sector organisations: a systematic review. Implementation Sci. 2018;13(1):103. doi: 10.1186/s13012-018-0789-7. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 31.Moore TJ, Zhang H, Anderson G, Alexander GC. Estimated costs of pivotal trials for novel therapeutic agents approved by the US Food and Drug Administration, 2015-2016. JAMA Intern Med. 2018;178(11):1451–1457. doi: 10.1001/jamainternmed.2018.3931. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 32.Hoomans T, Severens JL. Economic evaluation of implementation strategies in health care. Implementation Sci. 2014;9(168):s13012-014-0168-y. doi: 10.1186/s13012-014-0168-y. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 33.Rao SV, Krucoff MW. Radial First: Paradox+Proficiency=Opportunity. JAHA. 2013;2(3):e000281. doi: 10.1161/JAHA.113.000281. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 34.Torgerson DJ, Donaldson C, Reid DM. Private versus social opportunity cost of time: valuing time in the demand for health care. Health Econ. 1994;3(3):149–155. doi: 10.1002/hec.4730030304. [DOI] [PubMed] [Google Scholar]
  • 35.Baker JJ. Activity-based costing and activity-based management for health care. Aspen: Gaithersburg, Md; 1998. [Google Scholar]
  • 36.Keel G, Savage C, Rafiq M, Mazzocato P. Time-driven activity-based costing in health care: a systematic review of the literature. Health Policy. 2017;121(7):755–763. doi: 10.1016/j.healthpol.2017.04.013. [DOI] [PubMed] [Google Scholar]
  • 37.Cidav Z, Mandell D, Pyne J, Beidas R, Curran G, Marcus S. A pragmatic method for costing implementation strategies using time-driven activity-based costing. Implementation Sci. 2020;15(1):28. doi: 10.1186/s13012-020-00993-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 38.HERC: Cost of VA Staff & Labor. https://www.herc.research.va.gov/include/page.asp?id=cost-stf-labor. Accessed 13 Jul 2020.
  • 39.Google Flights. https://www.flights.google.com/. Accessed 13 Jul 2020.
  • 40.U.S. Internal Revenue Service. How To Depreciate Property. Department of the Treasury; 2021. https://www.irs.gov/pub/irs-pdf/p946.pdf.
  • 41.US General Services Administration. GSA Advantage Computer Catalog. https://www.gsaadvantage.gov/advantage/ws/search/advantage_search?searchType=1&q=1:4ADV.GSS.V4LT.STD*. .
  • 42.VETERANS HEALTH ADMINISTRATION: Better data and evaluation could help improve physician staffing, recruitment, and retention strategies. United States Government Accountability Office; 2017. https://www.gao.gov/assets/690/687853.pdf. .
  • 43.Merritt Hawkins. 2019 Review of Physician and Advanced Practitioner Recruiting Incentives. 2019. /trends-and-insights/article/reports/2019-Review-of-Physician-and-Advanced-Practitioner-Recruiting-Incentives/. .
  • 44.U.S. Bureau of Labor Statistics. Cardiovascular Technologists and Technicians. 2019. https://www.bls.gov/oes/2018/may/oes292031.htm. Accessed 28 Apr 2021.
  • 45.General Services Administration. Federal Meeting Facilities. https://www.gsa.gov/policy-regulations/policy/real-property-policy/federal-meeting-facilities. Accessed 27 Apr 2021.
  • 46.Dunn A, Grosse SD, Zuvekas SH. Adjusting health expenditures for inflation: a review of measures for health services research in the United States. Health Serv Res. 2018;53(1):175–196. doi: 10.1111/1475-6773.12612. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 47.Home CPI. U.S. Bureau of Labor Statistics. https://www.bls.gov/cpi/. .
  • 48.Amin AP, Patterson M, House JA. Giersiefen H, Spertus JA, Baklanov DV, et al. Costs associated with access site and same-day discharge among medicare beneficiaries undergoing percutaneous coronary intervention: an evaluation of the current percutaneous coronary intervention care pathways in the United States. JACC Cardiovasc Interv. 2017;10(4):342–351. doi: 10.1016/j.jcin.2016.11.049. [DOI] [PubMed] [Google Scholar]
  • 49.Mitchell MD, Hong JA, Lee BY, Umscheid CA, Bartsch SM, Don CW. Systematic review and cost-benefit analysis of radial artery access for coronary angiography and intervention. Circ Cardiovasc Qual Outcomes. 2012;5(4):454–462. doi: 10.1161/CIRCOUTCOMES.112.965269. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 50.Rangarajan K, Davis H, Pucher PH. Systematic review of virtual haptics in surgical simulation: a valid educational tool? J Surg Educ. 2020;77(2):337–347. doi: 10.1016/j.jsurg.2019.09.006. [DOI] [PubMed] [Google Scholar]
  • 51.Sedrakyan A, Dhruva SS, Sun T, Mao J, Gaudino MFL, Redberg RF. Trends in use of transcatheter aortic valve replacement by age. JAMA. 2018;320(6):598–600. doi: 10.1001/jama.2018.9938. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 52.Leon MB, Smith CR, Mack MJ, Makkar RR, Svensson LG, Kodali SK, Thourani VH, Tuzcu EM, Miller DC, Herrmann HC, Doshi D, Cohen DJ, Pichard AD, Kapadia S, Dewey T, Babaliaros V, Szeto WY, Williams MR, Kereiakes D, Zajarias A, Greason KL, Whisenant BK, Hodson RW, Moses JW, Trento A, Brown DL, Fearon WF, Pibarot P, Hahn RT, Jaber WA, Anderson WN, Alu MC, Webb JG. Transcatheter or surgical aortic-valve replacement in intermediate-risk patients. N Engl J Med. 2016;374(17):1609–1620. doi: 10.1056/NEJMoa1514616. [DOI] [PubMed] [Google Scholar]
  • 53.Mack MJ, Leon MB, Thourani VH, Makkar R, Kodali SK, Russo M, Kapadia SR, Malaisrie SC, Cohen DJ, Pibarot P, Leipsic J, Hahn RT, Blanke P, Williams MR, McCabe JM, Brown DL, Babaliaros V, Goldman S, Szeto WY, Genereux P, Pershad A, Pocock SJ, Alu MC, Webb JG, Smith CR. Transcatheter aortic-valve replacement with a balloon-expandable valve in low-risk patients. N Engl J Med. 2019;380(18):1695–1705. doi: 10.1056/NEJMoa1814052. [DOI] [PubMed] [Google Scholar]
  • 54.Thompson MP, Brescia AA, Hou H, Pagani FD, Sukul D, Dimick JB, Likosky DS. Access to transcatheter aortic valve replacement under new medicare surgical volume requirements. JAMA Cardiol. 2020;5(6):729–732. doi: 10.1001/jamacardio.2020.0443. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 55.Sohn H, Tucker A, Ferguson O, Gomes I, Dowdy D. Costing the implementation of public health interventions in resource-limited settings: a conceptual framework. Implementation Sci. 2020;15(1):86. doi: 10.1186/s13012-020-01047-2. [DOI] [PMC free article] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

Additional file 1. (30.8KB, docx)
43058_2021_219_MOESM2_ESM.docx (19KB, docx)

Additional file 2. Completed CHEERS reporting guidelines.

Data Availability Statement

The data used for this study includes identifiable, private salary data and is therefore not available.


Articles from Implementation Science Communications are provided here courtesy of BMC

RESOURCES