Abstract
Background:
Only half of patients with hypertension have adequately controlled blood pressure. Clinical decision support (CDS) has the potential to overcome barriers to delivering guideline-recommended care and improve hypertension management. However, optimal strategies for scaling CDS have not been well established, particularly in small, independent primary care practices which often lack the resources to effectively change practice routines. Practice facilitation is an implementation strategy that has been shown to support process changes. Our objective is to evaluate whether practice facilitation provided with hypertension-focused CDS can lead to improvements in blood pressure control for patients seen in small primary care practices.
Methods/Design:
We will conduct a cluster randomized control trial to compare the effect of hypertension-focused CDS plus practice facilitation on BP control, as compared to CDS alone. The practice facilitation intervention will include an initial training in the CDS and a review of current guidelines along with follow-up for coaching and integration support. We will randomize 46 small primary care practices in New York City who use the same electronic health record vendor to intervention or control. All patients with hypertension seen at these practices will be included in the evaluation. We will also assess implementation of CDS in all practices and practice facilitation in the intervention group.
Discussion:
The results of this study will inform optimal implementation of CDS into small primary care practices, where much of care delivery occurs in the U.S. Additionally, our assessment of barriers and facilitators to implementation will support future scaling of the intervention.
ClinicalTrials.gov Identifier: NCT05588466
Hypertension (HTN) is the most prevalent modifiable risk factor for cardiovascular disease (CVD) among U.S. adults and a major cause of disability and premature death.1–3 Furthermore, nationally there are significant racial and ethnic disparities in HTN prevalence and control,4 which may contribute to disparities in CVD outcomes.5–7
Despite the availability of published guidelines for the treatment of HTN,1,8 half of U.S. adults diagnosed with HTN have poorly controlled blood pressure (BP), and more than half of non-Hispanic Black, non-Hispanic Asian, and Hispanic adults have poorly controlled BP.4 In one study of small primary care practices, BP control was variable across practices but did not differ among racial and ethnic groups9, while in another New York City-based study, non-Hispanic black patients and Hispanic patients had lower rates of BP control as compared to white patients10. Among other contributing factors to inadequate BP control, one reason is provider-related: there is inadequate provider uptake of evidence-based guidelines for HTN. This is due to a lack of knowledge on how to manage specific subgroups (e.g., the elderly), skepticism about guideline recommendations, and perceptions that patients are non-adherent to medications.11
Electronic health record (EHR)-based clinical decision support (CDS) has the potential to overcome barriers to delivering guideline-recommended care and improve HTN management. CDS has been shown to improve HTN management, especially in the context of studies that restricted the population to those with other CVD-related diseases such as diabetes or heart failure.12–16 In prior work, we found that a CDS for HTN management, implemented in Federally Qualified Health Centers (FQHCs) in New York City (NYC), was associated with a significant increase in BP control and improved process of care measures, such as scheduling follow-up visits.17 Further, research has shown the potential of health information technology approaches to mitigate racial healthcare disparities.63
While the effectiveness of CDS has been demonstrated in large academic medical center settings,12,18–23 there is limited information regarding effective approaching to implementing and scaling of CDS in small independent primary care practices, where the majority of primary care office visits occur.24–26 Small independent practices face challenges in redesigning their systems and care processes to meet regulatory requirements for practice transformation. Most small independent practices lack the resources and staff expertise needed to coordinate system changes without external assistance.27 One implementation strategy that may effectively overcome such barriers is practice facilitation (PF).
Practice facilitation, typically delivered by trained staff (facilitators), provides external support and expertise to facilitate changes tailored to the workflow and context of each practice. A systematic review found that primary care practices are almost three times more likely to adopt evidence-based guidelines through practice facilitation.28 A key role for facilitators is to help practices implement evidence-based system changes, such as CDS, that promote the adoption of guideline-recommended care. Despite growing evidence on the effectiveness of practice facilitation, this implementation strategy remains largely untested in scaling up of CDS for small independent practices.
We describe the design and methods of a two-arm cluster randomized trial that will test the comparative effectiveness of scaling up CDS for hypertension management using practice facilitation versus CDS without facilitation alone in small, independent primary care practices. We hypothesize that practice facilitation plus CDS will improve BP control as compared to CDS alone. We will also assess the implementation process.
Methods
This is a two-arm cluster randomized control trial to compare the effect of CDS alone with CDS plus PF on BP control. The units of randomization are primary care practices located in New York City.
Conceptual Models
Our intervention and its assessment are based on three conceptual frameworks: the Technology Acceptance Model (TAM),29,30 the 5 Rights of CDS,31 and RE-AIM (reach, effectiveness, adoption, implementation, maintenance).32 Both TAM and the 5 Rights of CDS provide guidance on CDS development and identifying potential barriers to adoption and implementation. TAM asserts that perceptions of usefulness and ease of use by end users will directly influence the intention to use a new technology, leading in turn to its adoption.33 The 5 Rights of CDS describes principles of CDS design – delivering the right information, to the right person, using the right format, in the right channel, at the right time during the workflow – that are critical to achieving both maximal perceived usefulness and perceived ease.31 We hypothesize that the addition of PF will enhance perceived usability and usefulness and thus result in greater adoption of CDS-recommended care and improved patient outcomes. The RE-AIM framework includes outcome measures considered most relevant to the real-world implementation and translation of research findings into practice.32
Setting and Eligibility
The study is being conducted at small primary care practices that have an existing partnership with the New York City (NYC) Department of Health and Mental Hygiene (DOHMH) through DOHMH’s NYC REACH, a free membership organization which provides member practices with programming for EHR optimization, practice facilitation, and quality improvement support.34,35 We will specifically include sites that are using MDLand (MDLand International Group, Great Neck, NY) for its EHR vendor. Prior to the intervention, MDLand did not have an existing HTN-focused CDS.
Eligibility criteria for practices to participate include: 1) active signed membership agreement with DOHMH; 2) using the MDLand EHR for at least one year; 3) meet a minimum sample size requirement of 188 patients with diagnosed HTN; 4) have no plans to participate in another CVD-related QI initiative; 5) have no plans to change EHRs in the next 18 months; 6) willing to identify a staff member to collaborate on all aspects of the intervention; and 7) agree to the study terms, including randomization, data sharing, participation in PF, and the completion of surveys.
All patients meeting eligibility criteria will be included in the study analysis if they were seen at practices enrolled in the study for at least 12 months. Patient inclusion is based on standard inclusion for BP control measures: 1) an outpatient clinic visit with an HTN diagnosis based on the ICD-10 code in the prior 12 months; 2) age 18–85 years; 3) not pregnant; and 4) not have end-stage kidney disease as defined by an ICD-10 code for dialysis or transplantation.36 In a prior study we conducted in a similar group of small primary care practices, the population had a race/ethnicity breakdown of: 28.1% Hispanic patients, 21.5% non-Hispanic black patients, 17.0% non-Hispanic white patients, and 17.5% Asian patients; 47.5% of these patients had Medicaid insurance.37
CDS Intervention
All sites enrolled in the trial will receive a HTN-focused CDS within the MDLand EHR. The CDS is based on our prior work developing a CDS within another EHR that had been associated with improvements in BP control in a group of federally qualified health centers.17,38 The CDS will include the key functions developed in the prior study,17 including passive alerts, order sets, documentation templates, a medication adherence questionnaire, and monthly reports. The CDS will also include a clinical reminder related to medication adherence that was not present in the earlier CDS. Adherence will be measured using the proportion of days covered (PDC), made available through EHR-pharmacy linkage via Surescripts (Surescripts, LLC).39 The complete set of features is listed in Table 1.
Table 1.
Clinical decision support (CDS) features.
| CDS Feature | Description |
|---|---|
| Alerts | Passive alerts will be related to elevated BP or low medication adherence. BP measurements greater than or equal to 140/90 will be colored in red (based on the National Quality Forum [NQF] quality metric).36 In addition to the color-coding of BP values, two passive alerts will be used in the patient summary. One passive alert, the “HTN Alert,” appears in the patient header for any patient who has a diagnosis of HTN. The alert is color-coded based on last BP value; if the last BP measurement is ≥140 systolic or ≥90 diastolic, the alert turns red. Otherwise, the alert is white. Clicking on this alert will display the patient’s most recent BP and most recent PDC score. The second passive alert, the “Med Adherence Alert” shows for patients who have not completed a medication adherence questionnaire (see below) within the past six months. If the patient also has not completed a medication adherence questionnaire (see below) within the past six months, an additional red alert is added to the header, indicating the patient is due for the questionnaire. Passive alert notification occurs when PDC data is available for a patient’s HTN medications; over 80% PDC shows a green alert, 50–79% a yellow alert, and <50% a red alert. |
| Order Sets | Order sets will be based on guideline-based management and include: recommended medication regimens, common test orders associated with HTN management (e.g., blood chemistry panel orders), orders for follow-up appointments, and patient education materials that can be used to facilitate patient engagement, decision-making, and treatment adherence. |
| Documentation Template | A preconfigured template to record counseling provided to patients on diet, physical activity, smoking cessation, and home self-monitoring; as well as to record patient self-management plans, including goals and action plans. |
| Medication Adherence Tools | Standardized medication adherence questionnaires designed to identify potential non-adherence for staff to perform and document in the EHR. The questionnaire will be an adapted version of the Morisky Green Levine scale, which was utilized in the AHRQ EvidenceNOW study. |
| HTN Panel Summaries | EHR-accessed reports with the distribution of BP control among patients with HTN who were seen by a given provider in the prior months. Reports include information on the percentage of patients in each category with a follow-up visit in the next three months, PDC scores of HTN patients, and patients in need of follow-up to ensure prescriptions are refilled. Reports can be filtered based on patient BP control status. |
Pre-implementation CDS Refinement.
Prior to the intervention, we used several approaches to maximize the usefulness and usability of the intervention. First, the study team worked closely with MDLand to develop an initial prototype of the CDS. Second, we presented the prototype to our Provider Advisory Council (PAC), consisting of primary care providers at affiliated practices. We elicited feedback on specific components of the CDS and included questions on content, appropriateness, and usability. We then integrated this feedback into CDS development. Third, we recruited providers from two sites not involved in the trial for usability testing. Usability testing was performed at the provider sites using the EHR testing environment. Providers were given a clinical scenario in which they were asked to use the EHR, including the CDS features, during a hypothetical clinic visit for a patient with HTN, to simulate clinical practice. Providers were asked to “think aloud” to verbalize their impressions of the tool and offer feedback while interacting with the CDS in order to identify usability issues.40,41 After the testing, providers were surveyed on satisfaction with its navigation, interface, and perceived usability. This feedback was then used to finalize the CDS for the trial.42
Practice Facilitation Intervention
Intervention sites will receive the practice facilitation intervention to support the use of CDS (Table 2). Each site will be assigned a practice facilitator who will conduct one-on-one on-site tailored visits combined with remote support (i.e., phone call, WebEx, email) to deliver the intervention over a 12-month period. Each intervention practice will have 12 encounters (including on-site and remote visits) with their assigned PF. Practice Facilitators will be guided by a custom practice facilitator guide, developed for this program; this guide leverages best practices and resources included in the DOHMH’s HTN Action Kit.43 Our PF strategy is grounded in the concept of tailoring quality improvement to maximize a practice’s existing resources and builds upon commonly accepted practice staff roles, responsibilities, and activities.28,44–49 For each encounter, the PF will document facilitation activities performed, a utilization assessment of the CDS, and a narrative summary of each visit. PFs will not collect information on baseline medication intensification and or other HTN management strategies.
Table 2.
Details of Practice Facilitation Intervention.
| Intervention | CDS | CDS + PF |
|---|---|---|
| “Kickoff” Meeting | 60-minute “kickoff” meetings at individual sites in the first month to establish aims and provide training on how to use the CDS. | 60-minute “kickoff” meetings at individual sites in the first month to establish aims, define roles and responsibilities, and assess site workflow. Practice facilitators will assess workflow using a standardized tool and findings will be used to tailor the intervention. Assessment will include determining the routine process for acting on information. |
| Initial Meeting | Not provided. | On-site PF meeting in the second month lasting 60 minutes to provide training on how to use the CDS and review current guidelines for managing HTN. |
| Monthly On-site Meetings | Not provided. | On-site or virtual monthly PF meetings (based on practice preference) in months 3 to 6 lasting 60 minutes to support CDS integration into clinical workflow. Will include: training a site to track performance (including the use of a dashboard function to facilitate audit and feedback), establishing goals, training one improvement using PDSA (Plan-Do-Study-Act) cycles, providing coaching, and providing CDS technical assistance. |
| Phone and Email Exchanges | Phone and email exchanges as needed in the first 3 months. | Phone and email exchanges as needed in the first 6 months. |
| Remote “Check-in” | Not provided. | Remote “check-in” phone or virtual meetings in months 7 to 12 to assess sustainability and provide coaching as needed. |
Practice facilitators will have a minimum of a master’s degree, prior clinical and managerial experience, and a minimum of one year of experience as a facilitator. Facilitators attended a one-day training on MDLand functionality and operations and completed a 92-hour practice facilitator certification program led by a university, with a classroom component and field practicum component. We supplement this prior training with information related to the intervention, including information related to evidence-based treatment for HTN and CDS functionality. Each practice facilitator reports to a manager who provides managerial oversight for multiple concurrent practice facilitation programs including this one. Because of concurrent oversight responsibilities, each manager assumes a maximum of two facilitators for this specific project. Managers meet each week with their team to review the weekly schedule, anticipated challenges, and determine if additional expertise or assistance from information technology or other project staff is needed. These meetings will provide opportunities for problem-solving and will help facilitators develop and maintain relationships, gain content knowledge, and monitor practices’ progress by reviewing structured weekly activity reports and narrative reports.
Control Sites
All sites in the control arm will receive the CDS intervention. In addition, control sites will receive an initial kickoff meeting to provide initial training on the CDS. Practice Facilitators will also be available to respond to questions electronically for the first three months of the intervention.
Recruitment and Randomization
Eligible practices were sent recruitment emails from DOHMH. Additionally, DOHMH staff who have existing relationships with these practices followed up after the initial recruitment materials were distributed. Prior to randomization, a sampling frame of eligible practices that agreed to participate was developed, which included basic information such as practices’ patient population size (small, medium, large), and proportion of patients with HTN (low vs. high – using 50th percentile as cut point). These two factors were used as strata. We then conducted a block cluster randomization with balanced allocation to randomized practices within each stratum by using random digit generation to either intervention or control group.
Measures
Primary Outcome
The primary outcome is the change in the percentage of patients who have achieved BP control in the post-intervention versus pre-intervention study periods. BP control is defined as BP <140/9036,50 in the mean of the last two EHR-recorded measurements on different days in each study period; for patients with multiple readings on the same day, we will use the average of those measurements. We will use the last two recorded measures to balance increased reliability with multiple BP measurements51 with study timeline limitations. Due to variability in uptake, we will not utilize home BP readings. Patients without BP measurements in the post-intervention period will be considered lost to follow-up.
Secondary Clinical Outcomes
Secondary outcomes will include change in systolic and diastolic BP between the pre- and post-intervention period.8 We will also measure adherence to HTN medications using Surescripts data, which is linked to the MDLand EHR data and contains a record of pharmacy fills.52 These data are updated on a near continuous basis in the EHR. We will obtain patient-level fill data at the end of the study period and use them to calculate PDC; we expect to have data available for ≥80% of patients.39 Adherence will be defined as PDC of at least 80%.53,54
Implementation Outcomes.
Implementation Outcomes are described in Table 3. Reach will be assessed by calculating the proportion of patients with elevated BP for whom the CDS was triggered (i.e., the sensitivity or recall of the CDS). We will assess the adoption of guideline recommendations by calculating the proportion of encounters with elevated BP in which there was an intensification (change in dose or frequency) or change of BP medication and the proportion in which a follow-up appointment was scheduled within one month.8 These will be calculated using de-identified patient-level data received from MDLand, specifically through automated analysis of EHR data. Assessment of implementation will include fidelity and acceptability. Fidelity will be measured using EHR data assessing whether providers use various components of the CDS as intended and using practice facilitator documentation and reports to assess their activities. Acceptability will focus on perceived usefulness and usability of the CDS.29 To assess maintenance, at 15 months, we will ask providers about plans and barriers to continued use of CDS, and will also assess outcomes data.
Table 3.
Description of outcome measures, organized according to the RE-AIM framework.
| RE-AIM Domain | Level of Assessment | Measure | Data Source |
|---|---|---|---|
| Reach | Patient |
|
EHR database query |
| Setting/Organization |
|
Practice recruitment tracking logs | |
| Effectiveness | Patient | Primary outcome:
|
EHR database query Surescripts database via EHR database query |
| Adoption | Patient/Encounter |
|
EHR database query |
| Provider |
|
12-month survey; semi-structured interview | |
| Implementation | Patient/Encounter |
|
EHR database query |
| Practice Facilitation |
|
PF review logs | |
| Provider |
|
Semi-structured interview; 12-month survey | |
| Maintenance | Provider |
|
Semi-structured interview; EHR data |
Statistical Analysis
Practice and individual characteristics at baseline will be compared between the study arms to assess the comparability of the two study groups. Descriptive statistics will include frequency distributions, means, standard deviations, and standardized differences between groups.
We will apply a multilevel mixed-effects modeling framework to examine the impact of the CDS interventions on BP control and measurements. For the primary outcome, changes in BP control from pre-intervention to post-intervention will be assessed by the study arm and compared using a multilevel generalized linear mixed model with a binary distribution for residual errors and a logit link function. We will develop a model that includes BP control (1=yes, 0=no) as outcome of interest, one between-group fixed effect factor (study arm: 1=CDS plus PF compared to 0=CDS only), one within-group fixed effect factor (time: 1=post-intervention compared to 0=pre-intervention), and a two-way group-by-time fixed effect interaction term (study arm × time) to estimate odds ratios and 95% confidence intervals to predict BP control within and between the two study arms. The model will also incorporate random effects to account for non-independence and correlation of BP control within patients (level 1) and the hierarchical clustering of patients within practice sites (level 2). In addition to the random effects, the model also accounts for any potential temporal trend by including and assessing time as a fixed effect for each time point. To account for any baseline imbalance between arms, the model will include any baseline characteristics that have standardized differences between groups of 10% or greater; such characteristics will include patient demographics, visit diagnosis, practice-specific characteristics such as the number of providers, and the availability of Surescripts data.
The change in BP control from pre-intervention to post-intervention will be directly measured by the group × time interaction term within each intervention group and then compared between the two intervention groups. As the result, baseline BP control will be included as one of the repeated outcomes measures and both the pre-intervention and post-intervention outcome measurements are response variables, assuming that (1) the two study arms are not different systematically at baseline since they represent two random samples from the same population; (2) any potential baseline differences can be attributed to random chance; and (3) there are no problems with the randomization process and no significant measurement error issues. To ensure however, that our assumptions regarding the equality of pre-intervention BP values are correct, before building the final model we will conduct explanatory data analysis to check whether there is a statistically significant differences in the pre-intervention BP values between the two study arms. If we detect a potential difference in the pre-intervention BP, we will then run two sensitivity analyses by developing additional conditional multi-level mixed-effects models. In the first sensitivity analysis, we will develop a conditional mixed-effects baseline constrained model. This model is an extension of our original multilevel generalized linear mixed model adjusting for the pre-intervention BP values by omitting the differences at pre-intervention period. We will also conduct a second sensitivity analysis by developing a mixed-effect longitudinal covariance model, in which we adjust for the pre-intervention BP control value as an independent variable.
Sample Size Consideration
We estimated our sample size by adjusting for a pre- to post-intervention cluster design effect at the practice level.55,56 We used a previously published intra-cluster correlation coefficient (ICC)= 0.015 for BP control among those with hypertensive medication use.57 Additionally, we assumed a baseline BP control rate of 73%, based on BP control achieved among similar practices in our prior work;17 and 30% attrition to account for the potentially high number of individuals who are missing a follow-up BP measurement. Using this method, given a pre-specified number of 40 practices (20 practices per study arm) using a two-sided test, alpha=0.05, and 85% power, we needed a minimum number of 188 individuals per practice per cluster, to detect a 5% change in proportion of individuals with BP control between study groups. We chose 5% for our effect size as one systematic review found the use of practice facilitation increased odds that primary care practices would adopt evidence-based practice by 2.8,28 while another systematic review found that practice facilitation improved rates of cardiovascular disease outcomes, including BP control, by 10%.58 Given the possibility of practice dropout, we recruited 6 additional practices, for a total of 46 practices into our study.
Qualitative Analysis
We will conduct qualitative interviews to obtain a more in-depth understanding of potential barriers to CDS adoption, implementation, and maintenance. We will use purposeful sampling to identify providers from various practices and continue to interview providers until saturation is reached. Questions will be guided by our conceptual frameworks and will include facilitators and barriers to adoption, perceived value of the CDS, experience with using the CDS, how the CDS fits into workflow and workload, perceived efficiency and effectiveness in enhancing patient care and adherence, and long-term sustainability. Interviews will be audio-recorded and transcribed verbatim by an outside vendor. Qualitative data will be analyzed using a constant comparative analytic method in which we begin with open codes and progressively group and refine codes into categories.59 Initially, two coders will review a selection of interviews and develop codes to describe the content of interviews for the development of an initial code list. Emergent themes will be informed by TAM and the Five Rights of CDS framework. The codebook will be updated and revised throughout the review process. Once all interviews are coded, the investigative team will meet to discuss and identify code clusters, relationships between codes, and common themes.
Discussion
HTN is a major cause of morbidity and mortality, but patient outcomes can be improved through guideline-targeted BP control. CDS can lead to greater adherence to HTN management guidelines and to mitigation of racial disparities of care,63 but most studies have been conducted in large health care systems and have not considered optimal implementation of CDS across many practices with separate ownership, staff, and unique existing processes.18,27 This study will specifically target small, independent primary care practices, where much of primary care is delivered and where support in implementing effective system changes like CDS may be needed.24–26,60 We propose testing the effectiveness of practice facilitation for CDS on BP control in such practices. The CDS is adapted from a tool which was found to be effective in federally qualified health centers, and applied for this project to small, independent, urban practices.17 This study will provide much-needed guidance on how to optimize implementation and adoption of an evidence-based CDS in the small practice primary care setting. Results can guide future work by technical assistance organizations, Independent Practice Associations (IPAs), Accountable Care Organizations (ACOs), and Local Health Departments (LHDs) seeking to implement CDS or similar interventions across groups of providers.
To fill this knowledge gap, we will be conducting a prospective, randomized trial to test the comparative effectiveness of two implementation strategies for CDS implementation: practice facilitation versus usual vendor support (e.g., brief information shared via user training documents). Few prospective studies have tested the comparative effectiveness of implementation strategies for CDS, which may limit our understanding of the factors influencing success.61 Although a number of meta-regression analyses have evaluated implementation factors associated with CDS success, such studies are limited by their observational nature.22,62–64 This study will add to our knowledge of optimal implementation strategies for CDS.
Practice facilitation is an ideal strategy to implement CDS, as practice facilitation has been shown to improve the adoption of evidence-based guidelines.28 Practice facilitation is associated with sustained improvements in guideline adherence even after the intervention has ended.45,65,66 However, the use of practice facilitation in the implementation of CDS remains largely untested, particularly in small independent practices. Our proposed trial will create a new evidence base to guide the implementation of CDS in the small practice setting by a technical assistance provider across a group of multiple unrelated practices, considering providers’ perspectives and feedback on the technology and the implementation process to improve usability and sustainability of the CDS.
There are a number of potential limitations in our study design. First, our study is focused on practices in New York City, which may limit generalizability. Nonetheless, we believe many small independent practices face similar challenges related to the adoption of evidence-based guidelines, including limited practice resources, staffing, and diverse patient populations, regardless of their location. Second, there is potential for variation in PF implementation across sites. For this reason, we are collecting implementation data to understand variation and its impact on success. Third, our measure of adherence is based on pharmacy fills available through Surescripts, which may miss medication fills if purchased without insurance or at certain pharmacies that are not linked with Surescripts. Nonetheless, Surescripts should include such data for the majority of patients in our population.52 Further, we will limit our analysis of adherence to patients with Surescripts data and statistically account for any differences between groups in the availability of Surescripts data. Fourth, patients may also regularly fill a prescription but not take the medication, resulting in a high PDC but low adherence. To address this, practice facilitators will inform providers of the limitations of the PDC and underscore the importance of performing a more thorough adherence screening beyond review of the PDC alone. Fifth, while our proposal is limited to one new EHR vendor, the core components of the CDS are based on existing functionality available in most certified systems, the guidelines from which this CDS is built are publicly available, and the design of the PDC calculation algorithm is publicly available; therefore, we believe this effort will provide the blueprint for other EHR systems to implement a similar CDS. Sixth, as we do not have a control group, we will not be able to evaluate the effectiveness of the CDS itself. Seventh, given the high baseline rate of BP control observed in baseline data, there may be a ceiling effect for opportunity in improvement. This may limit our ability to find a difference in effect between groups. Eighth, the study will not capture any direct patient input about their hypertension management or health behaviors.
Upon completion, this trial will answer the question of whether using practice facilitation to support implementation of a hypertension focused CDS can improve BP control as compared to CDS without practice facilitation. The study will also determine if practice facilitation leads to improvements in important process measures including guideline-concordant patient follow-up and medication adherence. Concurrently, we will measure barriers and facilitators to implementation of the intervention, which will allow for future scaling of the intervention if shown to be successful. If the intervention is not associated with improved outcomes, the assessment of implementation will inform our understanding of limitations to success. The study is strengthened by grounding in conceptual frameworks, focus on small independent practices, and incorporation of pharmacy fill data to detect medication adherence at the point of care through CDS.
Acknowledgement
This study is supported by grant R18HS027120 from the Agency for Healthcare Research and Quality (AHRQ)
References
- 1.Chobanian AV, Bakris GL, Black HR, et al. Seventh report of the Joint National Committee on Prevention, Detection, Evaluation, and Treatment of High Blood Pressure. Hypertension. Dec 2003;42(6):1206–52. doi: 10.1161/01.HYP.0000107251.49515.c2 [DOI] [PubMed] [Google Scholar]
- 2.Danaei G, Ding EL, Mozaffarian D, et al. The preventable causes of death in the United States: comparative risk assessment of dietary, lifestyle, and metabolic risk factors. PLoS Med. Apr 28 2009;6(4):e1000058. doi: 10.1371/journal.pmed.1000058 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.You-Hsien Lin H, Yen CY, Lim LM, et al. Microscopic Haematuria and Clinical Outcomes in Patients With Stage 3–5 Nondiabetic Chronic Kidney Disease. Sci Rep. Oct 16 2015;5:15242. doi: 10.1038/srep15242 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Yoon SS, Carroll MD, Fryar CD. Hypertension Prevalence and Control Among Adults: United States, 2011–2014. NCHS Data Brief. Nov 2015;(220):1–8. [PubMed] [Google Scholar]
- 5.Willey JZ, Moon YP, Kahn E, et al. Population attributable risks of hypertension and diabetes for cardiovascular disease and stroke in the northern Manhattan study. J Am Heart Assoc. Sep 16 2014;3(5):e001106. doi: 10.1161/JAHA.114.001106 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Carnethon MR, Pu J, Howard G, et al. Cardiovascular Health in African Americans: A Scientific Statement From the American Heart Association. Circulation. Nov 21 2017;136(21):e393–e423. doi: 10.1161/CIR.0000000000000534 [DOI] [PubMed] [Google Scholar]
- 7.Balfour PC Jr., Rodriguez CJ, Ferdinand KC. The Role of Hypertension in Race-Ethnic Disparities in Cardiovascular Disease. Curr Cardiovasc Risk Rep. Apr 2015;9(4)doi: 10.1007/s12170-015-0446-5 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Whelton PK, Carey RM, Aronow WS, et al. 2017 ACC/AHA/AAPA/ABC/ACPM/AGS/APhA/ASH/ASPC/NMA/PCNA Guideline for the Prevention, Detection, Evaluation, and Management of High Blood Pressure in Adults: A Report of the American College of Cardiology/American Heart Association Task Force on Clinical Practice Guidelines. J Am Coll Cardiol. Nov 7 2017;doi: 10.1016/j.jacc.2017.11.006 [DOI] [PubMed] [Google Scholar]
- 9.Shelley D, Blechter B, Siman N, et al. Quality of Cardiovascular Disease Care in Small Urban Practices. The Annals of Family Medicine. 2018;16(Suppl 1):S21–S28. doi: 10.1370/afm.2174 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.April‐Sanders AK, Golestaneh L, Zhang L, Swett K, Meissner P, Rodriguez CJ. Hypertension Treatment and Control in a New York City Health Care System. Journal of the American Heart Association. 2022;11(14)doi: 10.1161/jaha.122.026077 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Khatib R, Schwalm JD, Yusuf S, et al. Patient and healthcare provider barriers to hypertension awareness, treatment and follow up: a systematic review and meta-analysis of qualitative and quantitative studies. PLoS One. 2014;9(1):e84238. doi: 10.1371/journal.pone.0084238 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Ali SM, Giordano R, Lakhani S, Walker DM. A review of randomized controlled trials of medical record powered clinical decision support system to improve quality of diabetes care. Int J Med Inform. Mar 2016;87:91–100. doi: 10.1016/j.ijmedinf.2015.12.017 [DOI] [PubMed] [Google Scholar]
- 13.Jeffery R, Iserman E, Haynes RB, Team CSR. Can computerized clinical decision support systems improve diabetes management? A systematic review and meta-analysis. Diabet Med. Jun 2013;30(6):739–45. doi: 10.1111/dme.12087 [DOI] [PubMed] [Google Scholar]
- 14.Litvin CB, Hyer JM, Ornstein SM. Use of Clinical Decision Support to Improve Primary Care Identification and Management of Chronic Kidney Disease (CKD). J Am Board Fam Med. Sep-Oct 2016;29(5):604–12. doi: 10.3122/jabfm.2016.05.160020 [DOI] [PubMed] [Google Scholar]
- 15.Qian Q, Manning DM, Ou N, et al. ACEi/ARB for systolic heart failure: closing the quality gap with a sustainable intervention at an academic medical center. Comparative Study. Journal of hospital medicine : an official publication of the Society of Hospital Medicine. Mar 2011;6(3):156–60. doi: 10.1002/jhm.803 [DOI] [PubMed] [Google Scholar]
- 16.Riggio JM, Sorokin R, Moxey ED, Mather P, Gould S, Kane GC. Effectiveness of a clinical-decision-support system in improving compliance with cardiac-care quality measures and supporting resident training. Academic medicine : journal of the Association of American Medical Colleges. Dec 2009;84(12):1719–26. doi: 10.1097/ACM.0b013e3181bf51d6 [DOI] [PubMed] [Google Scholar]
- 17.Shelley D, Tseng TY, Matthews AG, et al. Technology-driven intervention to improve hypertension outcomes in community health centers. Am J Manag Care. Dec 2011;17(12 Spec No.):SP103–10. [PubMed] [Google Scholar]
- 18.Bright TJ, Wong A, Dhurjati R, et al. Effect of clinical decision-support systems: a systematic review. Ann Intern Med. Jul 03 2012;157(1):29–43. doi: 10.7326/0003-4819-157-1-201207030-00450 [DOI] [PubMed] [Google Scholar]
- 19.Brenner SK, Kaushal R, Grinspan Z, et al. Effects of health information technology on patient outcomes: a systematic review. J Am Med Inform Assoc. Sep 2016;23(5):1016–36. doi: 10.1093/jamia/ocv138 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Jaspers MW, Smeulers M, Vermeulen H, Peute LW. Effects of clinical decision-support systems on practitioner performance and patient outcomes: a synthesis of high-quality systematic review findings. J Am Med Inform Assoc. May 01 2011;18(3):327–34. doi: 10.1136/amiajnl-2011-000094 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Jones SS, Rudin RS, Perry T, Shekelle PG. Health information technology: an updated systematic review with a focus on meaningful use. Ann Intern Med. Jan 07 2014;160(1):48–54. doi: 10.7326/M13-1531 [DOI] [PubMed] [Google Scholar]
- 22.Roshanov PS, Fernandes N, Wilczynski JM, et al. Features of effective computerised clinical decision support systems: meta-regression of 162 randomised trials. BMJ. Feb 14 2013;346:f657. doi: 10.1136/bmj.f657 [DOI] [PubMed] [Google Scholar]
- 23.Souza NM, Sebaldt RJ, Mackay JA, et al. Computerized clinical decision support systems for primary preventive care: a decision-maker-researcher partnership systematic review of effects on process of care and patient outcomes. Implement Sci. Aug 03 2011;6:87. doi: 10.1186/1748-5908-6-87 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.Hing E, Schappert SM. Generalist and specialty physicians: supply and access, 2009–2010. NCHS Data Brief. Sep 2012;(105):1–8. [PubMed] [Google Scholar]
- 25.Hing E, Uddin S. Visits to primary care delivery sites: United States, 2008. NCHS Data Brief. Oct 2010;(47):1–8. [PubMed] [Google Scholar]
- 26.Kane CK. Updated Data on Physician Practice Arrangements: Physician Ownership Drops Below 50 Percent. Chicago: American Medical Association; 2017. Policy Research Perspectives. Available at: https://www.ama-assn.org/sites/default/files/media-browser/public/health-policy/PRP-2016-physician-benchmark-survey.pdf. [Google Scholar]
- 27.Bodenheimer T, Pham HH. Primary care: current problems and proposed solutions. Health Aff (Millwood). May 2010;29(5):799–805. doi: 10.1377/hlthaff.2010.0026 [DOI] [PubMed] [Google Scholar]
- 28.Baskerville NB, Liddy C, Hogg W. Systematic review and meta-analysis of practice facilitation within primary care settings. Ann Fam Med. Jan-Feb 2012;10(1):63–74. doi: 10.1370/afm.1312 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.Venkatesh V, Bala H. Technology acceptance model 3 and a research agenda on interventions. Decision sciences. 2008;39(2):273–315. [Google Scholar]
- 30.Venkatesh V, Davis FD. A theoretical extension of the technology acceptance model: Four longitudinal field studies. Management science. 2000;46(2):186–204. [Google Scholar]
- 31.Osheroff JA. Improving Medication Use and Outcomes with Clinical Decision Support:: A Step by Step Guide. HIMSS; 2009: [Google Scholar]
- 32.Glasgow RE, Vogt TM, Boles SM. Evaluating the public health impact of health promotion interventions: the RE-AIM framework. Am J Public Health. Sep 1999;89(9):1322–7. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33.Davis FD. Perceived usefulness, perceived ease of use, and user acceptance of information technology. MIS quarterly. 1989:319–340. [Google Scholar]
- 34.Samantaray R, Njoku VO, Brunner JW, Raghavan V, Kendall ML, Shih SC. Promoting electronic health record adoption among small independent primary care practices. Am J Manag Care. May 2011;17(5):353–8. [PubMed] [Google Scholar]
- 35.NYC Reach. Available at: http://nycreach.org/.
- 36.National Quality Forum. Measures. Available at: http://www.qualityforum.org/QPS/.
- 37.Shelley DR, Gepts T, Siman N, et al. Cardiovascular Disease Guideline Adherence: An RCT Using Practice Facilitation. American Journal of Preventive Medicine. 2020;58(5):683–690. doi: 10.1016/j.amepre.2019.12.013 [DOI] [PubMed] [Google Scholar]
- 38.Millery M, Shelley D, Wu D, Ferrari P, Tseng TY, Kopal H. Qualitative evaluation to explain success of multifaceted technology-driven hypertension intervention. Am J Manag Care. Dec 2011;17(12 Spec No.):SP95–102. [PubMed] [Google Scholar]
- 39.Blecker S, Adhikari S, Zhang H, et al. Validation of EHR medication fill data obtained through electronic linkage with pharmacies. J Manag Care Spec Pharm. Oct 2021;27(10):1482–1487. doi: 10.18553/jmcp.2021.27.10.1482 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 40.Montini T, Schenkel AB, Shelley DR. Feasibility of a computerized clinical decision support system for treating tobacco use in dental clinics. J Dent Educ. Apr 2013;77(4):458–62. [PubMed] [Google Scholar]
- 41.Shelley DR, Ogedegbe G, Anane S, et al. Testing the use of practice facilitation in a cluster randomized stepped-wedge design trial to improve adherence to cardiovascular disease prevention guidelines: HealthyHearts NYC. Implement Sci. Jul 4 2016;11(1):88. doi: 10.1186/s13012-016-0450-2 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 42.Mann DM, Chokshi SK, Kushniruk A. Bridging the Gap Between Academic Research and Pragmatic Needs in Usability: A Hybrid Approach to Usability Evaluation of Health Care Information Systems. JMIR Hum Factors. Nov 28 2018;5(4):e10721. doi: 10.2196/10721 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 43.NYC Health. Public Health Detailing Action Kits. Available at: https://www1.nyc.gov/site/doh/providers/resources/public-health-action-kits.page.
- 44.Bodenheimer T, Wagner EH, Grumbach K. Improving primary care for patients with chronic illness: the chronic care model, Part 2. JAMA. Oct 16 2002;288(15):1909–14. [DOI] [PubMed] [Google Scholar]
- 45.Hogg W, Baskerville N, Nykiforuk C, Mallen D. Improved preventive care in family practices with outreach facilitation: understanding success and failure. J Health Serv Res Policy. Oct 2002;7(4):195–201. doi: 10.1258/135581902320432714 [DOI] [PubMed] [Google Scholar]
- 46.Grimshaw J, McAuley LM, Bero LA, et al. Systematic reviews of the effectiveness of quality improvement strategies and programmes. Qual Saf Health Care. Aug 2003;12(4):298–303. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 47.Grol R, Grimshaw J. From best evidence to best practice: effective implementation of change in patients’ care. Lancet. Oct 11 2003;362(9391):1225–30. doi: 10.1016/S0140-6736(03)14546-1 [DOI] [PubMed] [Google Scholar]
- 48.Shojania KG, Grimshaw JM. Evidence-based quality improvement: the state of the science. Health Aff (Millwood). Jan-Feb 2005;24(1):138–50. doi: 10.1377/hlthaff.24.1.138 [DOI] [PubMed] [Google Scholar]
- 49.Knox L, Taylor EF, Geonnotti K, et al. Developing and Running a Primary Care Practice Facilitation Program A HowTo Guide. 2011.
- 50.Centers for Medicare and Medicaid Services. MIPS Overview. Available at: https://qpp.cms.gov/mips/overview.
- 51.Powers BJ, Olsen MK, Smith VA, Woolson RF, Bosworth HB, Oddone EZ. Measuring blood pressure for decision making and quality reporting: where and how many measures? Ann Intern Med. Jun 21 2011;154(12):781–8, W-289–90. doi: 10.7326/0003-4819-154-12-201106210-00005 [DOI] [PubMed] [Google Scholar]
- 52.Surescripts. National Progress Report 2016. Available at: http://surescripts.com/news-center/national-progress-report-2016/.
- 53.Choudhry NK, Shrank WH, Levin RL, et al. Measuring concurrent adherence to multiple related medications. Am J Manag Care. Jul 2009;15(7):457–64. [PMC free article] [PubMed] [Google Scholar]
- 54.Martin BC, Wiley-Exley EK, Richards S, Domino ME, Carey TS, Sleath BL. Contrasting measures of adherence with simple drug use, medication switching, and therapeutic duplication. Ann Pharmacother. Jan 2009;43(1):36–44. doi: 10.1345/aph.1K671 [DOI] [PubMed] [Google Scholar]
- 55.Rutterford C, Copas A, Eldridge S. Methods for sample size determination in cluster randomized trials. Int J Epidemiol. Jun 2015;44(3):1051–67. doi: 10.1093/ije/dyv113 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 56.Hemming K, Girling AJ, Sitch AJ, Marsh J, Lilford RJ. Sample size calculations for cluster randomised controlled trials with a fixed number of clusters. BMC Med Res Methodol. Jun 30 2011;11:102. doi: 10.1186/1471-2288-11-102 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 57.Singh J, Liddy C, Hogg W, Taljaard M. Intracluster correlation coefficients for sample size calculations related to cardiovascular disease prevention and management in primary care practices. BMC Res Notes. Mar 20 2015;8:89. doi: 10.1186/s13104-015-1042-y [DOI] [PMC free article] [PubMed] [Google Scholar]
- 58.Wang A, Pollack T, Kadziel LA, et al. Impact of Practice Facilitation in Primary Care on Chronic Disease Care Processes and Outcomes: a Systematic Review. Journal of General Internal Medicine. 2018;33(11):1968–1977. doi: 10.1007/s11606-018-4581-9 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 59.Bradley EH, Curry LA, Devers KJ. Qualitative data analysis for health services research: developing taxonomy, themes, and theory. Health Serv Res. Aug 2007;42(4):1758–72. doi: 10.1111/j.1475-6773.2006.00684.x [DOI] [PMC free article] [PubMed] [Google Scholar]
- 60.Liaw WR, Jetty A, Petterson SM, Peterson LE, Bazemore AW. Solo and Small Practices: A Vital, Diverse Part of Primary Care. Ann Fam Med. Jan-Feb 2016;14(1):8–15. doi: 10.1370/afm.1839 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 61.Van de Velde S, Roshanov P, Kortteisto T, et al. Tailoring implementation strategies for evidence-based recommendations using computerised clinical decision support systems: protocol for the development of the GUIDES tools. Implement Sci. Mar 5 2016;11:29. doi: 10.1186/s13012-016-0393-7 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 62.Kawamoto K, Houlihan CA, Balas EA, Lobach DF. Improving clinical practice using clinical decision support systems: a systematic review of trials to identify features critical to success. BMJ. Apr 2 2005;330(7494):765. doi: 10.1136/bmj.38398.500764.8F [DOI] [PMC free article] [PubMed] [Google Scholar]
- 63.Lobach D, Sanders GD, Bright TJ, et al. Enabling health care decisionmaking through clinical decision support and knowledge management. Evid Rep Technol Assess (Full Rep). Apr 2012;(203):1–784. [PMC free article] [PubMed] [Google Scholar]
- 64.Murphy EV. Clinical decision support: effectiveness in improving quality processes and clinical outcomes and factors that may influence success. Yale J Biol Med. Jun 2014;87(2):187–97. [PMC free article] [PubMed] [Google Scholar]
- 65.Hogg W, Lemelin J, Moroz I, Soto E, Russell G. Improving prevention in primary care: Evaluating the sustainability of outreach facilitation. Can Fam Physician. May 2008;54(5):712–20. [PMC free article] [PubMed] [Google Scholar]
- 66.Stange KC, Goodwin MA, Zyzanski SJ, Dietrich AJ. Sustainability of a practice-individualized preventive service delivery intervention. Am J Prev Med. Nov 2003;25(4):296–300. [DOI] [PubMed] [Google Scholar]
