Skip to main content
Elsevier - PMC COVID-19 Collection logoLink to Elsevier - PMC COVID-19 Collection
. 2022 Dec 17;125:107053. doi: 10.1016/j.cct.2022.107053

Best practices to reduce COVID-19 in group homes for individuals with serious mental illness and intellectual and developmental disabilities: Protocol for a hybrid type 1 effectiveness-implementation cluster randomized trial

Julie H Levison a,b,, David Krane a, Karen Donelan a, Kelly Aschbrenner c, Hao D Trieu a, Cindy Chau a, Anna Wilson a, Nicolas M Oreskovic b,d, Kelly Irwin e, Lisa I Iezzoni a, Haiyi Xie f, Ronita Samuels a, Paula Silverman g, Joey Batson g, Ahmed Fathi g, Stefanie Gamse g, Sibyl Holland g, Jessica Wolfe g, Kim Shellenberger g, Elizabeth Cella g, Bruce Bird g, Brian G Skotko d,h,1, Stephen Bartels a,b,1
PMCID: PMC9758744  PMID: 36539061

Abstract

Background

People with serious mental illness (SMI) and intellectual disabilities and/or developmental disabilities (ID/DD) living in group homes (GHs) and residential staff are at higher risk for COVID-19 infection, hospitalization, and death compared with the general population.

Methods

We describe a hybrid type 1 effectiveness-implementation cluster randomized trial to assess evidence-based infection prevention practices to prevent COVID-19 for residents with SMI or ID/DD and the staff in GHs. The trial will use a cluster randomized design in 400 state-funded GHs in Massachusetts for adults with SMI or ID/DD to compare effectiveness and implementation of “Tailored Best Practices” (TBP) consisting of evidence-based COVID-19 infection prevention practices adapted for residents with SMI and ID/DD and GH staff; to “General Best Practices” (GBP), consisting of required standard of care reflecting state and federal standard general guidelines for COVID-19 prevention in GHs. External (i.e., community-based research staff) and internal (i.e., GH staff leadership) personnel will facilitate implementation of TBP. The primary effectiveness outcome is incident SARS-CoV-2 infection and secondary effectiveness outcomes include COVID-19-related hospitalizations and mortality in GHs. The primary implementation outcomes are fidelity to TBP and rates of COVID-19 vaccination. Secondary implementation outcomes are adoption, adaptation, reach, and maintenance. Outcomes will be assessed at baseline, 3-, 6-, 9-, 12-, and 15-months post-randomization.

Conclusions

This study will advance knowledge on comparative effectiveness and implementation of two different strategies to prevent COVID-19-related infection, morbidity, and mortality and promote fidelity and adoption of these interventions in high-risk GHs for residents with SMI or ID/DD and staff.

Clinical Trial Registration Number: NCT04726371.

Keywords: Serious mental illness, Intellectual disabilities, Developmental disabilities, COVID-19, Coronavirus, Group homes

1. Introduction

There are approximately 14.2 million adults with serious mental illness2 (SMI) and nearly 7.4 million individuals with an intellectual and/or developmental disability (ID/DD) in the US [[1], [2], [3]]. Factors that disproportionately increase the risk of COVID-19 among adults with SMI or intellectual and ID/DD include high rates of comorbid medical conditions, exposures to others in congregate living, and behavioral and cognitive risk factors [[4], [5], [6], [7], [8], [9], [10], [11], [12], [13], [14], [15], [16], [17], [18], [19], [20], [21]]. In persons with SMI, chronic obstructive pulmonary disease, cardiovascular disease, and diabetes, are two to three times more prevalent than the general population, increasing the risk of hospitalization and death from COVID-19 [[4], [5], [6], [7], [8]]. In persons with ID/DD, higher rates of congenital heart disease, obesity, chronic lung disease, lower immune function, cancer, and diabetes, predispose to more severe outcomes from respiratory infections [[9], [10], [11], [12]]. Cognitive, behavioral, and/or physical disabilities also create challenges with adherence to hand hygiene, physical distancing, and use of face masks mitigating the risk of COVID-19 [[17], [18], [19]]. Residing in group homes (GHs) and other congregate living environments presents additional risk factors for developing COVID-19.

Staff in GHs risk exposure to SARS-CoV-2 infection associated with direct care of residents, working in multiple GHs or jobs, use of public transportation, and inadequate access to facemasks [22,23]. Front-line workers with limited English language proficiency may not have access to linguistically appropriate health information [24,25]. This combination of factors may elevate COVID-19 risk in staff of GHs.

Despite payment reforms and state mandated best practices for COVID-19 prevention in GHs [26,27], as of May 2020 during the early phase of the SARS-CoV-2 pandemic, rates of COVID-19 for residents with SMI or ID/DD were eight times higher (12%), and for staff two times higher (3%), compared to the general population in the surrounding “hot spot” communities (1.5%) selected for this study [[28], [29], [30]]. A lack of knowledge on how to best tailor COVID-19 prevention practices for vulnerable and underserved residents with special needs, and residential staff who are at risk for COVID-19 and severe disease, motivates this clinical trial. We describe a protocol for a hybrid type 1 effectiveness-implementation cluster randomized trial to test evidence-based COVID-19 prevention practices and the implementation of this intervention in GHs caring for individuals with SMI or ID/DD and residential staff.

2. Methods

2.1. Overview

This is a protocol for a hybrid type 1 effectiveness-implementation cluster randomized trial, to assess the effectiveness of evidence-based COVID-19 prevention practices tailored for adults with SMI and ID/DD and staff in GHs called “Tailored Best Practices” or TBP compared to “Generic Best Practices” (GBP) consisting of standard of care for adults with SMI and ID/DD and staff in GHs. Consistent with a hybrid type 1 effectiveness-implementation trial, we will simultaneously collect data on the process and outcomes of implementation [31]. Implementation and effectiveness outcomes at the GH-level will be assessed at baseline and every three months post-randomization up to a 15-month follow-up. This protocol was approved by the Institutional Review Boards of Mass General Brigham and Massachusetts Departments of Developmental Services (DDS) and Mental Health (DMH).

2.1.1. Study population and setting

Eligibility criteria are adults 18 years and older with serious mental illness (SMI) including schizophrenia-spectrum and affective disorders with persistent functional impairment [32] or intellectual and/or developmental disabilities (ID/DD) living in GHs. The GHs in this study are operated by six human service provider organizations in Massachusetts with 400 GHs with approximately 3300 staff and 2600 residents. GHs refer to group assisted living environments designed to provide both housing and support services 24 h a day to individuals with mental health conditions, or ID/DD. These homes are regulated by Massachusetts DDS and DMH. Residential care staff support residents in activities of daily living, teach skills needed for greater independence, promote community integration and inclusion, and facilitate access to needed behavioral and medical health care.

2.1.2. Site recruitment

The chief executive officers of each of the six provider organizations provided a letter of commitment to participate in the trial and written consent for their sites to be included in the study. To facilitate execution, each provider organization will hire a full-time project manager dedicated to fulfilling the objectives of the study.

2.2. Trial design

This study will employ a cluster randomized trial design randomized at the level of the GH. To ensure equal distribution of important factors between the two study arms, we will utilize a stratified block randomization scheme generated by a study investigator (HY) and stratified based on key variables. Randomization will be blinded and clusters randomized after recruitment. We will randomize approximately n = 200 GHs to the intervention, TBP, and approximately n = 200 GHs to the control comparison, GBP, equally divided by GHs for persons with SMI and ID/DD. Stratification factors will include race and ethnicity of GH staff and residents and a COVID-19 infection risk score based on ranking GHs (i.e., low, medium, high) by prior COVID-19 infections and vaccination of residents and staff (Appendix A). In a three-month observation period pre-randomization, we will assess the baseline use of preventive practices and rates of COVID-19 in each GH to distinguish the effect of the introduction of the TBP intervention. Fig. 1 (below) provides a schematic of the trial design.

Fig. 1.

Fig. 1

Hybrid type 1 effectiveness-implementation cluster randomized trial design.

Abbreviations: ID/DD: Intellectual and/or developmental disabilities; SMI: Serious mental illness.

Within each site, we will conduct repeated measurement across six time points (baseline, 3-, 6-, 9-, 12-, and 15-months post-randomization) so that observed and latent time effects can be modeled in the presence of fluctuations in incidence over time.

2.2.1. Logic model

We developed a logic model as the theoretical framework to inform the hybrid trial design consistent with the format by Smith and colleagues (Fig. 2 ) [33]. This framework will support collection of data on the process and outcomes of the implementation and analysis plan and determinants of implementation: intervention characteristics, inner setting, outer setting, individuals involved, and the implementation process [33,34]. The determinants consist of factors that may facilitate or impede implementation based on characteristics of GHs for adults with SMI or ID/DD and key stakeholder input. The intervention tested in this randomized trial, called “Tailored Best Practices”, consists of a multi-component intervention including motivational interviewing, interactive education, trusted messengers, and measurement and feedback to improve uptake of screening, testing, vaccination, face mask use, and hand washing. The intervention, strategies, and outcomes are described below.

Fig. 2.

Fig. 2

Logic Model for the Assessment of COVID-19 Effectiveness and Implementation Outcomes.

2.2.2. Community engagement and stakeholder feedback

The project will be guided by principles of community-engaged research and will employ a multi-stakeholder COVID-19 Quality Improvement Collaborative that we developed for this proposal to provide ongoing feedback [35,36]. Members of this collaborative include residents with SMI and ID/DD, caregivers/guardians, provider organization staff, clinicians, and public health and government officials (Appendix A).

2.3. Tailored best practices intervention

TBP consists of a multi-component intervention tailored to residents with SMI or ID/DD and the staff who work in GHs to encourage adherence to current best practices for prevention of COVID-19. The components of TBP were determined by the following data-informed, stakeholder-engaged approach. First, we conducted a review of the literature on interventions to promote adherence to prevention of COVID-19 and other respiratory infections relevant to individuals with SMI or ID/DD (Appendix B). Second, we solicited feedback from employees within participating provider organizations on their experiences with COVID-19 in GHs. Third, we conducted 36 key informant interviews with staff and 24 key-informant interviews with residents, to identify barriers and facilitators to implementing recommended best practices for COVID-19 prevention. Fourth, we used a validated simulation model [37] to determine the comparative effectiveness of different COVID-19 preventive practices (screening, isolation, contact tracing, use of personal protective practices (PPP), vaccination) based on previously collected GH data. Finally, we convened the COVID-19 Quality Improvement Collaborative, the multi-constituency stakeholder working group described above, to identify priorities for TBP.

Through this staged process, we selected the following four core components of TBP:

(1) Motivational Interviewing, (2) Interactive Education, (3) Trusted Messengers, and (4) Measurement, Feedback, and a facilitated House Plan for COVID-19 prevention practices including screening, testing, use of face masks by staff, hand hygiene, and vaccination. The four components of the TBP intervention are described in detail below.

2.3.1. Motivational interviewing

Motivational interviewing (MI) is effective in promoting health behavior change in individuals with SMI [38,39]. MI also has the potential to reduce vaccine hesitancy [40,41]. We adapted principles of MI to focus on COVID-19 prevention practices. The interventionist delivering MI is a staff member, referred to here as a coach, who is hired and primarily supervised by the community-based provider organization. The coaches will be trained in MI and subsequently supervised in biweekly sessions by a board certified adult psychiatrist (SB), with extensive experience providing training in MI in the context of multi-component interventions. MI training will include eliciting personal goals and discussing wellness behavior practices, COVID-19 prevention, tradeoffs of different prevention approaches, and aligning goals for COVID-19 prevention with overall personal goals. Coaches will deliver MI sessions primarily in small groups with separate sessions for residents and staff. GH Program Directors will encourage residents with SMI and staff (serving residents with SMI or ID/DD) to participate in an MI session within the first eight months post-randomization. A follow-up session may occur in the latter seven months of the intervention period if necessary. Residents with ID/DD will not receive the MI component of TBP due to a lack of supporting evidence of effectiveness for individuals with ID/DD requiring the need for adaptation and validation in this population [42].

2.3.2. Interactive education

Interactive education can serve as an important adjunct in health behavior change [[43], [44], [45]]. The Interactive Education component of our TBP will be available to residents and staff in multiple formats to accommodate the needs and preferences of each GH. The research team will create a COVID-19 Educational Toolkit — a collection of materials (e.g., fact sheets, videos, social stories) curated by COVID-19 physician experts. The Educational Toolkit will contain materials that are tailored to people with SMI or ID/DD, non-English language speakers, and people identifying as racial and ethnic minorities. Materials will use simple messaging, low text, and imagery reflecting a multicultural audience, with multilingual versions available [46]. Throughout the study, the toolkit will be amended with evidence-based emergent information on COVID-19 prevention. Materials will be vetted by stakeholder working groups to provide input on appropriateness and accuracy. Residents with SMI and staff will receive Interactive Education during MI sessions. Because residents with ID/DD do not participate in MI sessions, Program Directors will present materials from the toolkit to the residents as Interactive Education. Residents and staff will also have the opportunity to have small group Interactive Education sessions with a COVID-19 physician expert specifically devoted to answering health questions related to COVID-19. All residents and staff will receive Interactive Education within the first eight months of the intervention and an optional “booster session” thereafter based on need indicated by intervention fidelity measures.

2.3.3. Trusted messengers

Trusted messengers, including peers with lived experience, have been demonstrated to be an effective source of health promotion, since personal narratives can support health behavior change when the audience identifies with the message delivered [47,48]. The Trusted Messenger component of TBP will be available in a peer testimonial video or an in-person peer testimonial during a group MI session. Since video testimonials from peers provide an easy to access and scalable format, we will create five peer testimonial videos featuring frontline staff, Certified Peer Specialists, residents, and legal guardians conveying their personal stories with COVID-19 and emphasizing why they chose to receive a COVID-19 vaccine. Residents and staff will view these videos during group MI sessions. In-person trusted messenger sessions consist of the staff, managers, and residents—who have on-going and familiar personal relationships in the GH—sharing their personal stories and experiences related to receiving vaccinations. Coaches will leverage the role of peers to provide trusted information on the potential benefits of TBP.

For individuals with ID/DD or SMI who have legal guardians, coaches will offer a “peer testimonial” video of a family member's perspective on COVID-19 vaccination as a “Trusted Messenger” component. In addition to Trusted Messenger videos, coaches will collaborate with GH Program Directors to identify resident and staff peers who may be willing to share their personal experiences during MI sessions and thus function as supporting “trusted messengers.” All residents and staff will receive a form of Trusted Messenger within the first eight months of the intervention and an optional “booster session” thereafter based on need indicated by intervention fidelity measures.

2.3.4. Measurement, feedback, and facilitated house plan to improve Fidelity to COVID-19 prevention practices

Audit and feedback is an effective approach to facilitate chronic disease management and uptake of infectious disease testing [49,50]. At baseline, 3-, 6-, 9, 12-, and 15-months post-randomization all Program Directors will complete a survey to assess the results of the GH's COVID-19 Best Practices Fidelity, a primary implementation outcome of this study. The survey consists of questions on the frequency and number of staff and residents participating in COVID-19 prevention practices, including screening, testing, use of face masks, physical distancing, handwashing, and vaccination. GHs follow U.S. Centers for Disease Control guidelines for physical distance of six feet between individuals for the prevention of COVID-19 [51]. Mechanisms for maintaining this physical distance in GHs may include floor markers indicating physical distance standards during routines (e.g., waiting on line for medication administration or food or using bathroom or laundry facilities). Following completion of the survey, coaches will provide Program Directors a numeric dashboard (Fig. 3 ) to provide data-based feedback with respect to accomplishments and areas in need of improvement to optimize fidelity to TBP. Each visual display will include a numeric summary of the GH's fidelity performance in relation to the average performance of other GHs in their organization. After receiving the statistical dashboard, each GH will receive assistance from the coaches in creating a GH-specific “House Plan” with actionable steps to improve fidelity performance. Coaches will work with the Program Directors to review areas that need improvement, discuss barriers to increasing the GH's success in adherence to COVID-19 prevention measures, set attainable goals, and identify target completion dates.

Fig. 3.

Fig. 3

COVID-19 Best Practices Fidelity Dashboard.

2.3.5. Implementation strategies

As shown in Fig. 2, we will implement TBP using established implementation strategies including community and stakeholder engagement, external facilitation by “facilitation coaches,” and internal facilitation by GH program directors based on the Expert Recommendations for Implementing Change (ERIC) taxonomy [52]. Community and stakeholder engagement will facilitate organization buy-in to eliminate barriers and maximize facilitators. External facilitators will be the “Implementation Coaches” from the community-based research team. As described by Ritchie et al. (2017), facilitation is “a multi-faceted process” that uses “implementation science knowledge and interventions to help and enable others to understand what they need to change, plan and execute changes, and address barriers to change efforts” [53]. External facilitation will motivate behavioral change at the level of staff and residents in GHs so that the intervention is delivered within the local context of the organization and GH. Internal facilitation will be provided by GH Program Directors. Coaches and Program Directors will meet regularly to discuss updated statistical dashboards and review progress made towards reaching pre-determined goals established in the home-specific “House Plan.”

2.4. Generic best practices comparator

The GBP control condition will receive standard recommended best practices for preventing COVID-19 based on recommendations by the CDC and policies of the Massachusetts Executive Office of Health and Human Services. GBP will be implemented by (1) distribution of standard guidelines from the Massachusetts Executive Office of Health and Human Services for public health prevention and management of COVID-19 [27], and (2) standard virtual training of the staff of the GHs in COVID-19 prevention practices outlined by the Office of Health and Human Services. Over the course of the study, the GBP condition will reflect up-to-date recommendations consistent with CDC and mandates from Massachusetts state policy.

2.5. Outcomes and measures

Effectiveness and implementation outcomes are summarized in Table 1 , evaluated at baseline, 3-, 6-, 9-, 12-, and 15-months post-randomization and analyzed at the level of the GH.

Table 1.

Summary of primary and secondary effectiveness and implementation outcomes for a hybrid type 1 effectiveness-implementation cluster randomized control trial of a multi-component intervention to prevent COVID-19 in residents with serious mental illness and intellectual and developmental disabilities and staff based in GHs in Massachusetts.

Outcomes Description Source Frequency
Effectiveness Outcomes
Primary effectiveness outcome: COVID-19 Infection New incidence of COVID-19 from laboratory testing of residents and staff Secondary data routinely collected by the 6 participating provider organizations Every 3 months beginning at baseline
Secondary effectiveness outcome: Hospitalization New hospitalizations of GH residents due to COVID-19 Secondary data routinely collected by the 6 participating provider organizations Every 3 months beginning at baseline
Secondary effectiveness outcome: Mortality New deaths of GH residents due to COVID-19 Secondary data routinely collected by the 6 participating provider organizations Every 3 months beginning at baseline



Implementation Outcomes
Primary implementation outcome: COVID-19 Best Practices Fidelity A score calculated based on GH engagement in up to 9 COVID-19 prevention activities (described below) Surveys of GH Program Directors Every 3 months beginning at baseline
Primary implementation outcome: COVID-19 Vaccination Receipt of COVID-19 vaccination Secondary data routinely collected by the 6 participating provider organizations Every 3 months beginning from initial introduction of the COVID-19 vaccine
Secondary implementation outcome: Adoption Score calculated using Acceptability, Appropriateness, and Feasibility measures informed by the RE-AIM implementation framework [54] Surveys of GH Program Directors Every 3 months beginning at baseline
Secondary implementation outcome: Adaptation Open-ended responses on changes made to the TBP or GBP and the reasons for adaptation Surveys of GH Program Directors Every 3 months beginning at baseline
Secondary implementation outcome: Reach The percentage of GHs with at least 80% COVID-19 Best Practices Fidelity Surveys of GHs Program Directors Every 3 months beginning at baseline
Secondary implementation outcome: Maintenance The percentage of GHs maintaining at least 80% COVID-19 Best Practices Fidelity at 15-month follow-up Surveys of GH Program Directors Once at the end of the 15-month trial

2.5.1. Effectiveness outcomes and measures

The primary effectiveness outcome will be COVID-19 incidence defined as new laboratory-confirmed SARS-CoV-2 cases among residents and staff in GHs. Secondary effectiveness outcomes will be GH rates of COVID-19-related hospitalization and mortality in residents. These data will be collected from standardized, routine reporting of these indices by each of the provider organizations.

2.5.2. Implementation outcomes and measures

Implementation outcomes will be informed by the RE-AIM Framework (Reach Effectiveness, Adoption, Implementation, and Maintenance) [55,56]. The primary implementation outcomes measure uptake of Best Practices for COVID-19 prevention as dictated by the Massachusetts Executive Office of Health and Human Services. The nine core elements of Best Practices for COVID-19 prevention are: 1) Screening; 2) Testing; 3) Use of Face Masks; 4) Physical Distancing; 5) Hand Hygiene; 6) Cleaning of the Physical Environment; 7) Staff Use of Gowns and Gloves; 8) Vaccination; and 9) Education and Training in Screening and Testing, PPP, and Vaccination. Fidelity will be measured by the COVID-19 Best Practices Fidelity Scale developed for this project. We followed a priori methodology for constructing fidelity scales for evidence-based practices, and the final instrument will be refined with input from key stakeholders [57]. The fidelity scale will assess adherence to the delivery of nine core elements of Best Practices for COVID-19 prevention. In addition to overall fidelity to the nine core practices rated by surveying the program directors, we will also evaluate implementation effectiveness for the primary prevention target of vaccination of GH residents and staff as a co-primary implementation outcome based on electronically collected data from the participating six agencies. The co-primary implementation outcome of COVID-19 vaccination rates reflects findings from our simulation model and CDC recommendations recognizing vaccination as the most important measure in preventing COVID-19, as well as the added value of collecting validated numerical rates of vaccination documented by the provider organizations in addition to survey-based data rated by providers.

A secondary implementation outcome will be Best Practices Adoption, evaluated using Acceptability, Appropriateness, and Feasibility measures of Best Practices for COVID-19 prevention (See Appendix B) [54]. Program directors of GHs will be assessed on fidelity, adoption, and adaptation of the Best Practices for COVID-19 prevention. Evaluation of Adaptation will consist of open-ended responses by program directors on changes they made to the TBP or GBP and the reasons for adaptation. Reach is defined as the percentage of GHs with a score of at least 80% on the Best Practices Fidelity scale. Maintenance is the percentage of GHs maintaining a score of at least 80% on the Best Practices Fidelity at 15-month follow-up. At each data collection point, Reach will be assessed using the Best Practices Fidelity ratings from the Program Director surveys. Maintenance will be calculated using these same ratings following the 15-month follow-up period.

2.6. Sample size, power, and analytic plan

A generalized linear mixed-effects model (GLMM) will be used for analyses. Group (TBP vs. GBP), time (baseline, 3-, 6-, 9-, 12- and 15-months), and group*time interaction will be specified as fixed effects. Intercept and slope at GH level will be specified as random effects to take the intraclass correlation coefficient (ICC) due to repeated measures into account. The treatment effect (i.e., effectiveness of TBP compared to GBP) will be reflected by group*time interaction. To ensure causal relationship between treatment models (TBP vs. GBP) and outcomes, any baseline characteristics associated with both treatment and outcomes will be included in the model as covariate. A stratification factor (baseline COVID-19 incidence) will be included as a covariate. For continuous measures (e.g., Best Practices Fidelity and COVID-19 vaccination rates), identity link and normal distribution will be specified. For COVID-19 incidence, hospitalization, and mortality rates, log link and Poisson or negative binomial distribution (e.g., log-linear model with offset term) will be specified. An additional evaluation of fidelity will include a dichotomous outcome of a threshold of achieving at least 80% Best Practices Fidelity, logit link and binomial distribution will be specified. Subgroup analyses will examine outcomes by type of facility (SMI vs. ID/DD). We will explore outcome differences related to the proportion of ethnic/racial minorities by facility. We will test group*time*facility and group*time*facility*race/ethnicity interactions, followed by subgroup stratified analyses.

For power calculations (Table 2 ) we assume a 2-tailed test with significance level 0.05, intraclass correlation (ICC) of 0.02 to account for the nested effect of the stratification factors of highest and lowest prevalence of COVID-19 infection within GBP and TBP within four administrative groupings of group homes, and ICC of 0.50 for repeated measures at the GH level [58]. For the primary implementation outcome, the continuous Best Practices Fidelity score, we will have 80% power to detect minimum 0.21 standardized mean difference between intervention and control (Cohen's d = 0.21). For a dichotomous fidelity threshold of 80% Best Practices Fidelity, we will have 80% power to detect 7.2% difference (Cohen's d = 0.33). Given COVID-19 incidence as of May 2020 rates based on available COVID-19 prevalence data for GHs residents and staff, we will have at least 80% power to detect 6–10% percentage point difference of COVID-19 infection between GBP and TBP (Table 2). We use conservative assumptions, given the possibility of undetected COVID-19 in GHs. The primary outcome will be COVID-infections in both staff and residents and correction for type I error will be controlled by Bonferroni's method [59]. We plan to examine outcomes among staff versus residents and SMI versus ID/DD homes in subgroup analyses.

Table 2.

Power calculations.

Population Estimated COVID-19 Prevalence
Difference
Cohen's da
Power
Control (GBP) Intervention (TBP)
Residents with SMI & Residents with ID/DD combined 26.5% 17.8% 8.7% 0.28 80%
Group home staff 13.1% 6.8% 6.3% 0.38 80%
a

Small effect = 0.2; Medium effect = 0.5 [60].

3. Discussion

Individuals with ID/DD or SMI and front-line staff in GHs are disproportionately at-risk of COVID-19 infection and compromised health outcomes. To address this prevention challenge, we will evaluate the effectiveness and implementation of a COVID-19 prevention intervention tailored to individuals with ID/DD and SMI in GHs. We anticipate a variety of challenges in conducting and evaluating the outcomes of this study including the special characteristics of the study sample, the GH setting, and the evolving nature of the COVID-19 pandemic. Our study sample includes residents of GHs with SMI, residents with ID/DD, and the staff of the GHs. In aggregate, our study sample presents the advantage of a generalizable array of providers and residents in public sector behavioral health residential care. However, we anticipate heterogeneity in outcomes that will require assessment in subgroup analyses. Including group home staff in the study sample allows for observation of a critical component of prevention of COVID-19 as potential vectors and as providers of key prevention measures. However, workforce shortages and high rates of staff turnover present a substantial challenge to delivering the TBP intervention and to assessment [61]. High staff turnover in the GHs may impede the ability to deliver the intervention longitudinally and track outcomes as staff move in and out of homes.

The evolving nature of the COVID-19 pandemic with respect to incidence, viral variants, recommended preventive interventions, and the introduction of vaccines during the study timeframe also provides novel methodological challenges, while also providing an opportunity for a dynamic, real-world study in infectious disease prevention. Accordingly, we have selected a pragmatic design to allow for adaptations in trial procedures and intervention content that is responsive to a dynamic pandemic environment and includes the changing epidemiology of SARS-CoV-2, knowledge of COVID-19, state and national policies, and the environmental context [62]. Accordingly, we defined the primary implementation outcome, COVID-19 Best Practices Fidelity, to be a dynamic measure with a flexible denominator, including only the COVID-19 prevention practices that are relevant at the measurement time points. In addition, during the planning phase of the intervention development, we anticipated the introduction of COVID-19 vaccination by adding this strategy as soon as Phase II/III data were available for COVID-19 vaccinations in 2021 in the United States. Based on our validated simulation model determining that vaccination is the most effective strategy for preventing COVID-19, we designated COVID-19 vaccination as a co-primary implementation outcome (in addition to the aggregate fidelity measure of the 9 prevention practices). This presented the added advantage of data based on actual rates of vaccination documented by the provider organizations in addition to survey-based data rated by providers [63,64]. At the same time, with increased availability and uptake of COVID-19 vaccinations during implementation of this protocol, we may find limited ability to detect a difference in COVID-19 effectiveness outcomes.

The design of this study evaluates outcomes for Tailored Best Practices (TBP) delivered with a specific implementation strategy (community and stakeholder engagement with internal and external facilitation) compared to Generic Best Practices (GBP) including usual implementation. As such we will not be able to distinguish the effect of the intervention and implementation strategies. We recognize that a study design with a third arm potentially could provide the capacity to differentiate the effect of the intervention from the implementation strategy. However, a three-armed randomized trial was not feasible due to the urgency and imperative expressed by our community partnering organizations to implement the most robust implementation and intervention aimed at reducing incidence and mortality from COVID-19 in as many GHs as possible; combined with the additional required number of GHs that would be required to achieve statistical power beyond a practical capacity to conduct the study.

Major strengths of this study include the hybrid type 1 effectiveness-implementation design evaluating TBP effectiveness compared to GBP, in conjunction with detailed collection of implementation process and outcome measures for the intervention. The methodology is informed by community-based participatory research and as such we will incorporate key stakeholders including residents, staff, caregivers, and public health and government officials to optimize intervention acceptability and sustainability.

4. Summary

People with serious mental illness (SMI) and intellectual disabilities or developmental disabilities (ID/DD) living in GHs (group homes) and residential staff are at higher risk for COVID-19 infection, hospitalization, and death compared with the general population.

This two-arm effectiveness-implementation trial will assess evidence-based infection prevention practices to prevent COVID-19 for residents with SMI or ID/DD and the staff in GHs in a hybrid type 1 effectiveness-implementation cluster randomized design consisting of 400 state-funded GHs for adults with SMI or ID/DD by comparing “Tailored Best Practices” (TBP) to “General Best Practices” (GBP). This study will advance knowledge on the effectiveness of two different interventions to prevent COVID-19-related infection, morbidity, and mortality and related implementation strategies to promote fidelity and adoption of these interventions in high-risk GHs for residents with SMI or ID/DD and staff with potential implications for optimal infection preventive practices in GHs for vulnerable populations across the nation.

4.1. Institutional ethics approval and informed consent

This study has been approved by the Mass General Brigham Institutional Review Board, the Massachusetts Department of Mental Health Institutional Review Board, and the Massachusetts Department of Developmental Services Research Review Committee. These entities have also granted a waiver of consent from residents and staff for COVID-monitoring data routinely collected by the participating provider organizations. Provider organization Chief Executive Officers have provided written consent for their sites to be included in the study. We will obtain informed consent from all survey participants or their legal guardians, where applicable, prior to the administration of study surveys.

Author contributions statement

Levison: Conceptualization, Methodology, Investigation, Resources, Writing - Original Draft, Writing - Review & Editing, Supervision, Project administration; Krane: Conceptualization, Methodology, Investigation, Resources, Writing - Original Draft, Writing - Review & Editing, Visualization; Donelan: Methodology, Investigation, Resources, Writing - Review & Editing; Aschbrenner: Conceptualization, Methodology, Resources, Writing - Review & Editing; Trieu: Conceptualization, Methodology, Investigation, Resources, Writing - Review & Editing, Supervision, Project administration; Chau: Conceptualization, Investigation, Resources, Writing - Review & Editing; Wilson: Conceptualization, Methodology, Software, Investigation, Resources, Data Curation, Writing - Review and Editing; Oreskovic: Conceptualization, Writing - Review & Editing; Irwin: Conceptualization, Writing - Review & Editing; Iezzoni: Writing - Review & Editing; Xie: Methodology, Writing - Review & Editing; Samuels: Writing - Review & Editing; Silverman: Conceptualization, Writing - Review & Editing; Batson: Conceptualization, Writing - Review & Editing; Fathi: Conceptualization, Writing - Review & Editing; Gamse: Conceptualization, Writing - Review & Editing; Holland: Conceptualization, Project administration; Wolfe: Conceptualization, Writing - Review & Editing, Supervision, Project administration; Shellenberger: Conceptualization, Writing - Review & Editing, Supervision, Project administration; Cella: Conceptualization, Writing - Review & Editing, Supervision, Project administration; Bird: Conceptualization, Writing - Review & Editing, Supervision, Project administration, Funding acquisition; Skokto: Conceptualization, Writing - Review & Editing, Supervision, Project administration, Funding acquisition; Bartels: Conceptualization, Writing - Review & Editing, Supervision, Project administration, Funding acquisition.

Declaration of Competing Interest

The authors declare the following financial interests/personal relationships which may be considered as potential competing interests:

Dr. Skotko occasionally consults on the topic of Down syndrome through Gerson Lehrman Group. He receives remuneration from Down syndrome non-profit organizations for speaking engagements and associated travel expenses. Dr. Skotko receives annual royalties from Woodbine House, Inc., for the publication of his book, Fasten Your Seatbelt: A Crash Course on Down Syndrome for Brothers and Sisters. Within the past two years, he has received research funding from F. Hoffmann-La Roche, Inc., AC Immune, and LuMind Research Down Syndrome Foundation to conduct clinical trials for people with Down syndrome. Dr. Skotko is occasionally asked to serve as an expert witness for legal cases where Down syndrome is discussed. Dr. Skotko serves in a non-paid capacity on the Honorary Board of Directors for the Massachusetts Down Syndrome Congress and the Professional Advisory Committee for the National Center for Prenatal and Postnatal Down Syndrome Resources. Dr. Skotko has a sister with Down syndrome.

Acknowledgements

We wish to thank the “In This Together” COVID-19 Research Group for their input on the trial protocol: Elizabeth Ryan; Hannah Frigand; Jeff Keilson; Albert Milne; Brian Kremer; Janet Rico; Jeanne Doherty; Jennifer Urff; Eliza Williamson; Leo Sarkissian; Nicole Atchue; Jahnaa Scully; James Green; Faith Burch; Adeola Adejinmi; Stephanie Costin; Cameron Vilain; Shane McDonald; Annette Foote; John Odams; Tony Davies; Serena Dee; Catherine Boyle; Liz Thorpe; Danny Valez; Patrick Shea; Star Perry; Sasha Greene; Naomi Willinsky; Luciano Garcia; Francis Odongo; Babette Nana; Raissa Kaba; Patricia Nickerson; Kelli Devereaux; Raman Olaogun; Jory Agate; Jane Martin; Robert Cadigan; Stephen Scully; Triscia Hennessey; Jenny O'Meara; Debbie Wilson; Kenneth McDonough; Jose Nascimento; James Paradise; Wibens Cazeau; Matt Samati; Jasmine Vardigans; Rosemary Wooten; Melissa Kwiatkowski; Larry Fitzpatrick; Tanika Thomas; Sharin Lee; Esther Shagba; Wandy Saint Phard; and Cierra Bloom. We thank the Massachusetts Departments of Mental Health and Developmental Services for their support and collaboration on this protocol. This work was supported by the Patient-Centered Outcomes Research Institute (PCORI) (award number COVID-2020C2-10803). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript. The statements in this publication are solely the responsibility of the authors and do not necessarily represent the views of PCORI, its Board of Governors or Methodology Committee. The statements in this publication also do not necessarily represent the official views of Harvard University and its affiliated academic health care centers, the Massachusetts Department of Mental Health, or the Massachusetts Department of Developmental Services.

Footnotes

2

Abbreviations: SMI: serious mental illness; ID/DD: intellectual disabilities/developmental disabilities; group homes: GHs; TBP: Tailored Best Practices; GBP: Generic Best Practices; PPP: personal protective practices; MI: Motivational Interviewing.

Appendix A

Supplementary data to this article can be found online at https://doi.org/10.1016/j.cct.2022.107053.

Appendix A. Supplementary data

Supplementary data: Appendices A and B

mmc1.docx (1.3MB, docx)

Data availability

No data was used for the research described in the article.

References

  • 1.Key Substance Use and Mental Health Indicators in the United States: Results from the 2020 National Survey on Drug Use and Health. 2020. https://www.samhsa.gov/data/sites/default/files/reports/rpt35325/NSDUHFFRPDFWHTMLFiles2020/2020NSDUHFFR1PDFW102121.pdf (accessed July 8, 2022)
  • 2.CDC Health Care for Individuals with Intellectual Disabilities, Cent. Dis. Control Prev. 2019. https://www.cdc.gov/grand-rounds/pp/2019/20191015-intellectual-disabilities.html (accessed July 11, 2022)
  • 3.FY 2017 RISP Infographics | How Many People with Intellectual or Developmental Disabilities Live in the United States? 2020. https://publications.ici.umn.edu/risp/2017/infographics/people-with-idd-in-the-united-states-and-the-proportion-who-receive-services (accessed August 12, 2022)
  • 4.Walker E.R., McGee R.E., Druss B.G. Mortality in mental disorders and global disease burden implications: a systematic review and meta-analysis. JAMA Psychiatry. 2015;72:334–341. doi: 10.1001/jamapsychiatry.2014.2502. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5.Bartels S.J., DiMilia P. Why serious mental illness should be designated a health disparity and the paradox of ethnicity, lancet. Psychiatry. 2017;4:351–352. doi: 10.1016/S2215-0366(17)30111-6. [DOI] [PubMed] [Google Scholar]
  • 6.Janssen E.M., McGinty E.E., Azrin S.T., Juliano-Bult D., Daumit G.L. Review of the evidence: prevalence of medical conditions in the United States population with serious mental illness. Gen. Hosp. Psychiatry. 2015;37:199–222. doi: 10.1016/j.genhosppsych.2015.03.004. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.Guan W.-J., Liang W.-H., Zhao Y., Liang H.-R., Chen Z.-S., Li Y.-M., Liu X.-Q., Chen R.-C., Tang C.-L., Wang T., Ou C.-Q., Li L., Chen P.-Y., Sang L., Wang W., Li J.-F., Li C.-C., Ou L.-M., Cheng B., Xiong S., Ni Z.-Y., Xiang J., Hu Y., Liu L., Shan H., Lei C.-L., Peng Y.-X., Wei L., Liu Y., Hu Y.-H., Peng P., Wang J.-M., Liu J.-Y., Chen Z., Li G., Zheng Z.-J., Qiu S.-Q., Luo J., Ye C.-J., Zhu S.-Y., Cheng L.-L., Ye F., Li S.-Y., Zheng J.-P., Zhang N.-F., Zhong N.-S., He J.-X. China medical treatment expert group for COVID-19, comorbidity and its impact on 1590 patients with COVID-19 in China: a nationwide analysis. Eur. Respir. J. 2020;55:2000547. doi: 10.1183/13993003.00547-2020. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8.Berlin I., Thomas D., Le Faou A.-L., Cornuz J. COVID-19 and smoking, nicotine Tob. Res. Off. J. Soc. Res. Nicotine Tob. 2020;22:1650–1652. doi: 10.1093/ntr/ntaa059. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9.Capone G., Stephens M., Santoro S., Chicoine B., Bulova P., Peterson M., Jasien J., Smith A.J. Down syndrome medical interest group (DSMIG-USA) adult health workgroup, co-occurring medical conditions in adults with down syndrome: a systematic review toward the development of health care guidelines. Part II. Am. J. Med. Genet. A. 2020;182:1832–1845. doi: 10.1002/ajmg.a.61604. [DOI] [PubMed] [Google Scholar]
  • 10.Capone G.T., Chicoine B., Bulova P., Stephens M., Hart S., Crissman B., Videlefsky A., Myers K., Roizen N., Esbensen A., Peterson M., Santoro S., Woodward J., Martin B., Smith D. Down syndrome medical interest group DSMIG-USA adult health care workgroup, co-occurring medical conditions in adults with down syndrome: a systematic review toward the development of health care guidelines. Am. J. Med. Genet. A. 2018;176:116–133. doi: 10.1002/ajmg.a.38512. [DOI] [PubMed] [Google Scholar]
  • 11.Kinnear D., Morrison J., Allan L., Henderson A., Smiley E., Cooper S.-A. Prevalence of physical conditions and multimorbidity in a cohort of adults with intellectual disabilities with and without down syndrome: cross-sectional study. BMJ Open. 2018;8 doi: 10.1136/bmjopen-2017-018292. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12.O’Leary L., Cooper S.-A., Hughes-McCormack L. Early death and causes of death of people with intellectual disabilities: a systematic review. J. Appl. Res. Intellect. Disabil. JARID. 2018;31:325–342. doi: 10.1111/jar.12417. [DOI] [PubMed] [Google Scholar]
  • 13.Zimmerman S., Sloane P.D., Katz P.R., Kunze M., O’Neil K., Resnick B. The need to include assisted living in responding to the COVID-19 pandemic. J. Am. Med. Dir. Assoc. 2020;21:572–575. doi: 10.1016/j.jamda.2020.03.024. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.Solis J., Franco-Paredes C., Henao-Martínez A.F., Krsak M., Zimmer S.M. Structural vulnerability in the U.S. revealed in three waves of COVID-19. Am. J. Trop. Med. Hyg. 2020;103:25–27. doi: 10.4269/ajtmh.20-0391. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15.Jenq G.Y., Mills J.P., Malani P.N. Preventing COVID-19 in assisted living facilities-a balancing act. JAMA Intern. Med. 2020;180:1106–1107. doi: 10.1001/jamainternmed.2020.2224. [DOI] [PubMed] [Google Scholar]
  • 16.Hakim D. ‘It's Hit our Front Door’: Homes for the Disabled See a Surge of COVID-19, N. Y. Times. 2020. https://www.nytimes.com/2020/04/08/nyregion/coronavirus-disabilities-group-homes.html
  • 17.Druss B.G. Addressing the COVID-19 pandemic in populations with serious mental illness. JAMA Psychiatry. 2020;77:891–892. doi: 10.1001/jamapsychiatry.2020.0894. [DOI] [PubMed] [Google Scholar]
  • 18.Armitage R., Nellums L.B. The COVID-19 response must be disability inclusive. Lancet Public Health. 2020;5 doi: 10.1016/S2468-2667(20)30076-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19.Shinn A.K., Viron M. Perspectives on the COVID-19 pandemic and individuals with serious mental illness. J. Clin. Psychiatry. 2020;81 doi: 10.4088/JCP.20com13412. 20com13412. [DOI] [PubMed] [Google Scholar]
  • 20.Li Y., Cen X., Cai X., Temkin-Greener H. Racial and ethnic disparities in COVID-19 infections and deaths across U.S. nursing homes. J. Am. Geriatr. Soc. 2020;68:2454–2461. doi: 10.1111/jgs.16847. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21.Gorges R.J., Konetzka R.T. Factors associated with racial differences in deaths among nursing home residents with COVID-19 infection in the US. JAMA Netw. Open. 2021;4 doi: 10.1001/jamanetworkopen.2020.37431. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22.Van Houtven C.H., DePasquale N., Coe N.B. Essential long-term care workers commonly hold second jobs and double- or triple-duty caregiving roles. J. Am. Geriatr. Soc. 2020;68:1657–1660. doi: 10.1111/jgs.16509. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 23.True S., Claxton G., Chidambaram P. 2020, COVID-19 and Workers at Risk: Examining the Long-Term Care Workforce, KFF. 2020. https://www.kff.org/coronavirus-covid-19/issue-brief/covid-19-and-workers-at-risk-examining-the-long-term-care-workforce/ (accessed August 2, 2021)
  • 24.Kelly C., Craft Morgan J., Kemp C.L., Deichert J. A profile of the assisted living direct care workforce in the United States. J. Appl. Gerontol. 2020;39:16–27. doi: 10.1177/0733464818757000. [DOI] [PubMed] [Google Scholar]
  • 25.Browne C.V., Braun K.L. Globalization, Women’s migration, and the long-term-care workforce. The Gerontologist. 2008;48:16–24. doi: 10.1093/geront/48.1.16. [DOI] [PubMed] [Google Scholar]
  • 26.Bartels S.J., Baggett T.P., Freudenreich O., Bird B.L. COVID-19 emergency reforms in Massachusetts to support behavioral health care and reduce mortality of people with serious mental illness. Psychiatr. Serv. 2020;71:1078–1081. doi: 10.1176/appi.ps.202000244. [DOI] [PubMed] [Google Scholar]
  • 27.Residential and Congregate Care Programs 2019 Novel Coronavirus (COVID-19) Guidance. 2020. https://www.mass.gov/info-details/covid-19-public-health-guidance-and-directives (accessed July 8, 2022)
  • 28.COVID-19 Response Reporting Mass.gov. 2020. https://www.mass.gov/info-details/covid-19-response-reporting (accessed September 27, 2022)
  • 29.COVID in the U.S.: Latest Map and Case Count - The New York Times. 2020. https://www.nytimes.com/interactive/2021/us/covid-cases.html (accessed August 2, 2021)
  • 30.CDC COVID Data Tracker, Cent. Dis. Control Prev. 2020. https://covid.cdc.gov/covid-data-tracker (accessed August 2, 2021)
  • 31.Curran G.M., Bauer M., Mittman B., Pyne J.M., Stetler C. Effectiveness-implementation hybrid designs: combining elements of clinical effectiveness and implementation research to enhance public health impact. Med. Care. 2012;50:217–226. doi: 10.1097/MLR.0b013e3182408812. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 32.American Psychiatric Association . Fifth edition. American Psychiatric Association; 2013. Diagnostic and Statistical Manual of Mental Disorders. [DOI] [Google Scholar]
  • 33.Smith J.D., Li D.H., Rafferty M.R. The implementation research logic model: a method for planning, executing, reporting, and synthesizing implementation projects. Implement. Sci. 2020;15:84. doi: 10.1186/s13012-020-01041-8. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 34.Keith R.E., Crosson J.C., O’Malley A.S., Cromp D., Taylor E.F. Using the consolidated framework for implementation research (CFIR) to produce actionable findings: a rapid-cycle evaluation approach to improving implementation. Implement. Sci. 2017;12:15. doi: 10.1186/s13012-017-0550-7. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 35.Schlechter C.R., Del Fiol G., Lam C.Y., Fernandez M.E., Greene T., Yack M., Schulthies S., Nelson M., Bohner C., Pruhs A., Siaperas T., Kawamoto K., Gibson B., Nahum-Shani I., Walker T.J., Wetter D.W. Application of community – engaged dissemination and implementation science to improve health equity. Prev. Med. Rep. 2021;24 doi: 10.1016/j.pmedr.2021.101620. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 36.Minkler M., Salvatore A.L., Chang C. Oxford University Press; 2017. Participatory Approaches for Study Design and Analysis in Dissemination and Implementation Research. [DOI] [Google Scholar]
  • 37.Baggett T.P., Scott J.A., Le M.H., Shebl F.M., Panella C., Losina E., Flanagan C., Gaeta J.M., Neilan A., Hyle E.P., Mohareb A., Reddy K.P., Siedner M.J., Harling G., Weinstein M.C., Ciaranello A., Kazemian P., Freedberg K.A. 2020. Management Strategies for People Experiencing Sheltered Homelessness during the COVID-19 Pandemic: Clinical Outcomes and Costs, Infectious Diseases (except HIV/AIDS) [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 38.Bartels S.J., Pratt S.I., Aschbrenner K.A., Barre L.K., Naslund J.A., Wolfe R., Xie H., McHugo G.J., Jimenez D.E., Jue K., Feldman J., Bird B.L. Pragmatic replication trial of health promotion coaching for obesity in serious mental illness and maintenance of outcomes. Am. J. Psychiatry. 2015;172:344–352. doi: 10.1176/appi.ajp.2014.14030357. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 39.Bartels S.J., Pratt S.I., Aschbrenner K.A., Barre L.K., Jue K., Wolfe R.S., Xie H., McHugo G., Santos M., Williams G.E., Naslund J.A., Mueser K.T. Clinically significant improved fitness and weight loss among overweight persons with serious mental illness. Psychiatr. Serv. Wash. DC. 2013;64:729–736. doi: 10.1176/appi.ps.003622012. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 40.Gagneur A., Gosselin V., Dubé È. Motivational interviewing: a promising tool to address vaccine hesitancy. Vaccine. 2018;36:6553–6555. doi: 10.1016/j.vaccine.2017.10.049. [DOI] [PubMed] [Google Scholar]
  • 41.Lemaitre T., Carrier N., Farrands A., Gosselin V., Petit G., Gagneur A. Impact of a vaccination promotion intervention using motivational interview techniques on long-term vaccine coverage: the PromoVac strategy. Hum. Vaccines Immunother. 2019;15:732–739. doi: 10.1080/21645515.2018.1549451. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 42.Frielink N., Embregts P. Modification of motivational interviewing for use with people with mild intellectual disability and challenging behaviour. J. Intellect. Develop. Disabil. 2013;38:279–291. doi: 10.3109/13668250.2013.809707. [DOI] [PubMed] [Google Scholar]
  • 43.Alsan M., Stanford F.C., Banerjee A., Breza E., Chandrasekhar A.G., Eichmeyer S., Goldsmith-Pinkham P., Ogbu-Nwobodo L., Olken B.A., Torres C., Sankar A., Vautrey P.-L., Duflo E. Comparison of knowledge and information-seeking behavior after general COVID-19 public health messages and messages tailored for black and Latinx communities : a randomized controlled trial. Ann. Intern. Med. 2021;174:484–492. doi: 10.7326/M20-6141. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 44.O’Leary S.T., Narwaney K.J., Wagner N.M., Kraus C.R., Omer S.B., Glanz J.M. Efficacy of a web-based intervention to increase uptake of maternal vaccines: an RCT. Am. J. Prev. Med. 2019;57:e125–e133. doi: 10.1016/j.amepre.2019.05.018. [DOI] [PubMed] [Google Scholar]
  • 45.Bechini A., Lorini C., Zanobini P., Mandò Tacconi F., Boccalini S., Grazzini M., Bonanni P., Bonaccorsi G. Utility of healthcare system-based interventions in improving the uptake of influenza vaccination in healthcare Workers at Long-Term Care Facilities: a systematic review. Vaccines. 2020;8 doi: 10.3390/vaccines8020165. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 46.CDC Patients with Intellectual and Developmental Disabilities & COVID-19, Cent. Dis. Control Prev. 2022. https://www.cdc.gov/vaccines/covid-19/hcp/disabilities.html (accessed January 31, 2022)
  • 47.Burger A.E., Reither E.N., Mamelund S.-E., Lim S. Black-white disparities in 2009 H1N1 vaccination among adults in the United States: a cautionary tale for the COVID-19 pandemic. Vaccine. 2021;39:943–951. doi: 10.1016/j.vaccine.2020.12.069. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 48.Nan X., Daily K., Richards A., Holt C., Wang M.Q., Tracy K., Qin Y. The role of trust in health information from medical authorities in accepting the HPV vaccine among African American parents. Hum. Vaccines Immunother. 2019;15:1723–1731. doi: 10.1080/21645515.2018.1540825. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 49.Ivers N., Jamtvedt G., Flottorp S., Young J.M., Odgaard-Jensen J., French S.D., O’Brien M.A., Johansen M., Grimshaw J., Oxman A.D. Audit and feedback: effects on professional practice and healthcare outcomes. Cochrane Database Syst. Rev. 2012 doi: 10.1002/14651858.CD000259.pub3. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 50.Hocking J.S., Wood A., Temple-Smith M., Braat S., Law M., Bulfone L., Jones C., van Driel M., Fairley C.K., Donovan B., Guy R., Low N., Kaldor J., Gunn J. The impact of removing financial incentives and/or audit and feedback on chlamydia testing in general practice: a cluster randomised controlled trial (ACCEPt-able) PLoS Med. 2022;19 doi: 10.1371/journal.pmed.1003858. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 51.Archive of CDC Covid Pages 2020. https://public4.pagefreezer.com/browse/CDC%20Covid%20Pages/11-05-2022T12:30/https://www.cdc.gov/coronavirus/2019-ncov/community/group-homes.html (accessed October 11, 2022)
  • 52.Powell B.J., Waltz T.J., Chinman M.J., Damschroder L.J., Smith J.L., Matthieu M.M., Proctor E.K., Kirchner J.E. A refined compilation of implementation strategies: results from the expert recommendations for implementing change (ERIC) project. Implement. Sci. 2015;10:21. doi: 10.1186/s13012-015-0209-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 53.Ritchie M.J., Parker L.E., Edlund C.N., Kirchner J.E. Using implementation facilitation to foster clinical practice quality and adherence to evidence in challenged settings: a qualitative study. BMC Health Serv. Res. 2017;17:294. doi: 10.1186/s12913-017-2217-0. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 54.Weiner B.J., Lewis C.C., Stanick C., Powell B.J., Dorsey C.N., Clary A.S., Boynton M.H., Halko H. Psychometric assessment of three newly developed implementation outcome measures. Implement. Sci. 2017;12:108. doi: 10.1186/s13012-017-0635-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 55.Glasgow R.E., Estabrooks P.E. Pragmatic applications of RE-AIM for health care initiatives in community and clinical settings. Prev. Chronic Dis. 2018;15:E02. doi: 10.5888/pcd15.170271. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 56.Glasgow R.E., Harden S.M., Gaglio B., Rabin B., Smith M.L., Porter G.C., Ory M.G., Estabrooks P.A. RE-AIM planning and evaluation framework: adapting to new science and practice with a 20-year review. Front. Public Health. 2019;7:64. doi: 10.3389/fpubh.2019.00064. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 57.Bond G.R., Drake R.E. Assessing the Fidelity of evidence-based practices: history and current status of a standardized measurement methodology. Admin. Pol. Ment. Health. 2020;47:874–884. doi: 10.1007/s10488-019-00991-6. [DOI] [PubMed] [Google Scholar]
  • 58.Ahn C., Heo M., Zhang S. Sample Size Calculations for Clustered and Longitudinal Outcomes in Clinical Research. 2015. http://www.crcnetbase.com/isbn/9781466556263
  • 59.Westfall P.H., Tobias R.D., Wolfinger R.D. SAS Institute; 2011. Multiple Comparisons and Multiple Tests Using SAS. [Google Scholar]
  • 60.Cohen J. 2nd ed. L. Erlbaum Associates; Hillsdale, N.J: 1988. Statistical Power Analysis for the Behavioral Sciences. [Google Scholar]
  • 61.Low wages and pandemic gut staffing support for those with disabilities. US News World Rep. 2021 www.usnews.com/news/health-news/articles/2021-09-24/low-wages-and-pandemic-gut-staffing-support-for-those-with-disabilities (accessed January 31, 2022) [Google Scholar]
  • 62.Hekler E.B., Klasnja P., Riley W.T., Buman M.P., Huberty J., Rivera D.E., Martin C.A. Agile science: creating useful products for behavior change in the real world, Transl. Behav. Med. 2016;6:317–328. doi: 10.1007/s13142-016-0395-7. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 63.Oliver S.E., Gargano J.W., Marin M., Wallace M., Curran K.G., Chamberland M., McClung N., Campos-Outcalt D., Morgan R.L., Mbaeyi S., Romero J.R., Talbot H.K., Lee G.M., Bell B.P., Dooling K. The advisory committee on immunization practices’ interim recommendation for use of Pfizer-BioNTech COVID-19 Vaccine — United States, December 2020. MMWR Morb. Mortal. Wkly Rep. 2020;69:1922–1924. doi: 10.15585/mmwr.mm6950e2. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 64.Oliver S.E., Gargano J.W., Marin M., Wallace M., Curran K.G., Chamberland M., McClung N., Campos-Outcalt D., Morgan R.L., Mbaeyi S., Romero J.R., Talbot H.K., Lee G.M., Bell B.P., Dooling K. The advisory committee on immunization practices’ interim recommendation for use of moderna COVID-19 vaccine — United States, December 2020. MMWR Morb. Mortal. Wkly Rep. 2021;69:1653–1656. doi: 10.15585/mmwr.mm695152e1. [DOI] [PMC free article] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

Supplementary data: Appendices A and B

mmc1.docx (1.3MB, docx)

Data Availability Statement

No data was used for the research described in the article.


Articles from Contemporary Clinical Trials are provided here courtesy of Elsevier

RESOURCES