Skip to main content
JMIR Research Protocols logoLink to JMIR Research Protocols
. 2021 May 21;10(5):e27650. doi: 10.2196/27650

Engaging Caregivers and Providers of Children With Sickle Cell Anemia in Shared Decision Making for Hydroxyurea: Protocol for a Multicenter Randomized Controlled Trial

Anna M Hood 1,, Heather Strong 2, Cara Nwankwo 3, Yolanda Johnson 2, James Peugh 2, Constance A Mara 2, Lisa M Shook 4,5, William B Brinkman 4,6, Francis J Real 4,6, Melissa D Klein 4,6, Rogelle Hackworth 7, Sherif M Badawy 8,9, Alexis A Thompson 8,9, Jean L Raphael 10, Amber M Yates 11, Kim Smith-Whitley 12,13, Allison A King 14,15, Cecelia Calhoun 15, Susan E Creary 16, Connie M Piccone 17, Aimee K Hildenbrand 18,19, Steven K Reader 18,19, Lynne Neumayr 20,21,22, Emily R Meier 23, Amy E Sobota 24, Sohail Rana 25, Maria Britto 4,26,27, Kay L Saving 28, Marsha Treadwell 29, Charles T Quinn 4,30, Russell E Ware 4,5, Lori E Crosby 2,4,27
Editor: Thomas Derrick
PMCID: PMC8178738  PMID: 34018965

Abstract

Background

Sickle cell anemia (SCA) is a genetic blood disorder that puts children at a risk of serious medical complications, early morbidity and mortality, and high health care utilization. Until recently, hydroxyurea was the only disease-modifying treatment for this life-threatening disease and has remained the only option for children younger than 5 years. Evidence-based guidelines recommend using a shared decision-making (SDM) approach for offering hydroxyurea to children with SCA (HbSS or HbS/β0 thalassemia) aged as early as 9 months. However, the uptake remains suboptimal, likely because caregivers lack information about hydroxyurea and have concerns about its safety and potential long-term side effects. Moreover, clinicians do not routinely receive training or tools, especially those that provide medical evidence and consider caregivers’ preferences and values, to facilitate a shared discussion with caregivers.

Objective

The aim of this study is to understand how best to help parents of young children with sickle cell disease and their clinicians have a shared discussion about hydroxyurea (one that considers medical evidence and parent values and preferences).

Methods

We designed our study to compare the effectiveness of two methods for disseminating hydroxyurea guidelines to facilitate SDM: a clinician pocket guide (ie, usual care) and a clinician hydroxyurea SDM toolkit (H-SDM toolkit). Our primary outcomes are caregiver reports of decisional uncertainty and knowledge of hydroxyurea. The study also assesses the number of children (aged 0-5 years) who were offered and prescribed hydroxyurea and the resultant health outcomes.

Results

The Ethics Committee of the Cincinnati Children’s Hospital Medical Center approved this study in November 2017. As of February 2021, we have enrolled 120 caregiver participants.

Conclusions

The long-term objective of this study is to improve the quality of care for children with SCA. Using multicomponent dissemination methods developed in partnership with key stakeholders and designed to address barriers to high-quality care, caregivers of patients with SCA can make informed and shared decisions about their health.

Trial Registration

ClinicalTrials.gov NCT03442114; https://clinicaltrials.gov/ct2/show/NCT03442114

International Registered Report Identifier (IRRID)

DERR1-10.2196/27650

Keywords: dissemination, decisional uncertainty, quality of care, child health, NHLBI guidelines

Introduction

Background

Sickle cell anemia (SCA) is a genetic blood disorder that affects approximately 100,000 individuals in the United States [1]. It is the most common disorder identified by newborn screening, with approximately 1 in 2000 babies born with SCA in the United States each year [2]. SCA is a chronic disease that is associated with significant morbidity and early mortality [3]. Until 2017, hydroxyurea was the only approved disease-modifying treatment for individuals with SCA, and it has remained the only treatment option for children younger than 5 years [4]. Hydroxyurea has many beneficial effects, including reduced pain and acute chest syndrome episodes, reduced hospital admissions, and less need for blood transfusions, among patients with SCA [5,6]. In 2014, the National Heart, Lung, and Blood Institute (NHLBI) published guidelines that recommended clinicians offer hydroxyurea to children with SCA (HbSS and HbS/β0 thalassemia), beginning as early as 9 months of age [7]. Previously, medical providers only offered hydroxyurea to children with SCA with persistent pain or other severe SCA-related complications. Despite these guidelines, hydroxyurea uptake remains low in young children with SCA [8]. Barriers to taking hydroxyurea include a lack of caregiver knowledge about hydroxyurea, providers’ hesitancy to prescribe hydroxyurea, and concerns about poor adherence to the treatment [9].

NHLBI guidelines encourage using shared decision making (SDM) when providers offer hydroxyurea, which involves a collaborative process wherein clinicians, patients, and families work together to reach a mutual agreement about the course of treatment [7,10]. However, the only widely distributed tool to assist providers in implementing the NHLBI guidelines for hydroxyurea is a clinician pocket guide developed by the American Society of Hematology (ASH) [8]. The pocket guide was a critical first step, but it only targeted clinician motivation. Pocket guides do not provide training to build clinician self-efficacy in prescribing medications, feedback to reinforce behavior change, or decision support tools to help clinicians engage and support caregivers in SDM.

Objectives

We developed the hydroxyurea SDM toolkit (H-SDM toolkit), which is a caregiver-centered, technology-enhanced decision support tool. We designed the H-SDM toolkit to strengthen SDM, reduce caregiver uncertainty, allay potential fears, increase the offering of hydroxyurea, and ultimately improve hydroxyurea uptake [10,11]. In this paper, we present a protocol for a multisite randomized controlled trial (RCT; ENGAGE HU). The objective of the ENGAGE HU trial is to determine whether the use of the H-SDM toolkit is more effective than the ASH clinician pocket guide (ie, usual care) as a dissemination method. This study aims to improve the quality of the available evidence so that caregivers and providers have the appropriate tools to make an informed decision about hydroxyurea.

Methods

Framework

The Reach, Effectiveness, Adoption, Implementation, and Maintenance (RE-AIM) model provides a framework for evaluating dissemination methods that can improve the sustainable adoption and implementation of effective, generalizable, and evidence-based interventions by attending to 5 factors: (1) Reach: does the intervention reach the intended population?; (2) Efficacy or effectiveness: does the intervention impact the essential outcomes?; (3) Adoption: is the intervention supported by staff, settings, or institutions?; (4) Implementation: is the intervention delivered consistently?; and (5) Maintenance: what is in place to ensure that the intervention continues over time? [12]. We developed our study plan using RE-AIM because this framework improves the quality, speed, and impact of dissemination methods [13].

Specific Aims

The H-SDM toolkit engages both caregivers and clinicians and targets (1) clinician motivation and self-efficacy and (2) caregiver readiness. Therefore, we propose that it will lead to change in caregiver’s and clinician’s behavior, which will increase SDM about hydroxyurea between caregivers and clinicians as well as improve decisional outcomes (ie, decisional uncertainty, hydroxyurea knowledge, and satisfaction with the decision-making process; Figure 1) [10]. If caregivers of children with SCA feel more confident and knowledgeable about hydroxyurea and more involved in the decision-making process, then they may be more likely to initiate hydroxyurea and subsequently ensure that their child adheres to the medication. Thus, the primary aims of the ENGAGE HU study are as follows:

Figure 1.

Figure 1

Engaging parents of children with sickle cell disease and their providers in shared decision making for hydroxyurea (ENGAGE HU) conceptual model. H-SDM: hydroxyurea shared decision making; SDM: shared decision making.

  • Hypothesis 1: The H-SDM toolkit dissemination method will result in greater perceptions of SDM and less uncertainty among caregivers of children with SCA than the ASH clinician pocket guide (ie, usual care).

  • Hypothesis 2: The H-SDM toolkit dissemination method will result in greater improvements in caregiver knowledge about hydroxyurea, more children being offered and receiving hydroxyurea, and better health outcomes than the ASH clinician pocket guide (usual care).

Overview of Study Design

ENGAGE HU is an adapted stepped-wedge, stratified, multicenter RCT [14] with the H-SDM toolkit as the intervention and the ASH clinician pocket guide as the active comparator. We selected sites in the United States with sickle cell clinics that work with patient populations from urban, suburban, and rural communities. Each clinic begins to enroll patients using the ASH clinician pocket guide as the dissemination method. Each site then crosses over to using the H-SDM toolkit (Figure 2). Clinician training for the H-SDM toolkit begins during the last month of each usual care period. A stepped-wedge design with sequential assignment was chosen to ensure that all sites received the intervention and could step in at different timepoints. All sites will complete the usual care condition first, as clinicians would not be able to unlearn skills gained from the H-SDM toolkit. Each site enrolls approximately 4-5 participants per period. Enrollment ends 44 months after the study initiation (Figure 2).

Figure 2.

Figure 2

Study timeline. H-SDM: hydroxyurea shared decision making; IRB: institutional review board.

Randomization

We chose an adapted stepped-wedge randomized trial (clinic is the unit of randomization) with sites not previously exposed to the H-SDM toolkit. This design maximizes our confidence that differences in outcomes between the groups occur due to the dissemination method and not baseline discrepancies among participant groups, confounding, or chance. We randomize at the site level to reduce the risk of contamination and because the NHLBI guidelines require clinics to make system-level changes to deliver high-quality care. The order in which the sites crossover is random (Figure 2). The randomization minimizes differences among large (>501 patients), medium (270-500 patients), and small (<270 patients) sites.

Patient Involvement

Patients with SCA and their caregivers provided input at several stages of the trial, including development, design, feasibility, and trial conduct. They also assisted with the toolkit components, choice of outcome measures, and recruitment methods. They helped us carefully assess the trial burden on caregivers of patients with SCA. Stakeholders will be coauthors of peer-reviewed publications, and the study results in a format suitable for a nonspecialist audience will be sent to the patients and caregivers.

Eligibility and Consent

Eligibility criteria for the caregiver participants in the ENGAGE HU study include the following: their child has a diagnosis of SCA and receives care at the recruitment site; their child is aged 0-5 years; their child is eligible for hydroxyurea according to NHLBI guidelines (HbSS and HbS/β0 thalassemia); they can participate in both study visits; and they can read, understand, and speak English fluently. Exclusion criteria include their child has an active hydroxyurea prescription filled in the past 3 months; they have previously made a decision about whether to initiate hydroxyurea (after November 2019, we changed this criterion to include whether the research team had approached the caregiver reinitiation of hydroxyurea within the past 3 months); any diagnoses or conditions that, in the opinion of the site investigator or hematologist, would prevent the patient from being a suitable candidate for the study; and their child is a sibling of a participant actively or previously enrolled in the study.

The Cincinnati Children’s Hospital Medical Center (CCHMC) is the co-ordinating center (CC) for this multisite trial (Multimedia Appendix 1 [14-39]). The CCHMC oversees the study conduct, regulatory and institutional review board (IRB) administration, and compliance. The protocol for ENGAGE HU includes an IRB-approved waiver of the documentation of consent for clinicians participating in the trial. The trial also has an IRB-approved waiver of consent that permits clinical sites to generate a list of eligible patients. Caregivers participate in the informed consent process and are required to provide written or electronic consent.

Recruitment and Retention

The ENGAGE HU trial consecutively enrolls caregivers of patients with SCA across the United States. Caregivers are identified as potentially eligible for hydroxyurea by provider referral or electronic health record review. A member of the site research team approaches the child’s hematology provider to obtain approval before contacting the potential caregiver participant. Caregivers of patients deemed eligible will receive an invitation via regular mail or phone or may be approached during a clinic visit, with research coordinators at each site screening participants and completing the informed consent process.

Evidence-based strategies for optimizing participation and retention include scheduling visits at times convenient for the family, reminder phone calls, allowing participants to complete questionnaires on the internet, scheduling phone or video problem-solving sessions at a convenient time, and check-in calls during the COVID-19 pandemic. In addition, the importance of the follow-up visit is reviewed with each family at baseline to engage them as partners in the research process. We also seek to aid sites in developing solutions to reach nonresponders during weekly study meetings. To improve retention, we collect multiple forms of contact information from multiple contacts (eg, family members and friends) to stay in close contact with families. In addition, we use a graduated incentive system for visits to reduce attrition. A Stakeholder Advisory Council, whose members include the caregivers of patients with SCA, reviews and provides ongoing feedback on the recruitment and retention plan.

Hydroxyurea Dissemination Methods

H-SDM Toolkit

Guided by the social cognitive theory, and considering preidentified barriers [40], the team designed the H-SDM toolkit to increase the likelihood that caregivers and health care providers would engage with one another to make a joint decision about hydroxyurea. The social cognitive theory posits that behavior change occurs when an individual is motivated, feels confident in his or her ability to perform the new behavior (self-efficacy), and observes that the behavior is successfully performed and reinforced by others (observational learning and reinforcement). The development of the H-SDM toolkit is described in detail elsewhere [11]. Briefly, our research team collaborated with clinicians, educators, community-based organizations, and patients with SCA and their caregivers to identify barriers related to decision making regarding hydroxyurea. We designed the H-SDM toolkit with core and optional components tailored to individuals’ needs while also being broadly applicable (Table 1).

Table 1.

Hydroxyurea shared decision-making toolkit components.

Materials Component Process Core Optional
Virtual reality simulation Guided practice Clinicians receive virtual reality training to increase their self-efficacy in describing hydroxyurea risks, benefits, and other treatments; eliciting caregiver preferences; assessing decision readiness; and moving caregivers toward a decision a N/Ab
Previsit brochure Decision aid To increase caregiver motivation to make a decision by providing information about hydroxyurea as a treatment option N/A
In-visit issue card Decision aid To increase caregiver self-efficacy by providing them with the information needed to evaluate the benefits and risks of hydroxyurea and other treatment options N/A
After-visit booklet Decision aid Includes links to reputable resources; caregivers can take notes and take this resource home to share with other caregivers involved in decision making N/A
Parent video narratives Decision aid Four videos (3 mothers and 1 father)—caregivers telling their story about how they made a decision about hydroxyurea N/A
Previsit planning template Identifying eligible patients Secure SharePoint site with electronic health record templates (eg, EPIC builds) N/A
Care gap report template Identifying eligible patients Secure SharePoint site with tools to identify eligible patients who were missed or not approached N/A
Checklist template Identifying eligible patients Secure SharePoint site with a SCAc data collection form for tracking whether hydroxyurea was offered and prescribed N/A
Process map template Implementation Sites are provided with quality improvement tools that help integrate guidelines into their care delivery system. Process maps visually describe the flow of work or ideas N/A
Failure mode effect analysis template Implementation Failure mode effect analysis templates assist teams in determining how their clinic process needs to change to incorporate the NHLBId guidelines into routine care N/A
Plan-do-study-act template Implementation Plan-do-study-act templates assist teams in determining how their clinic process needs to change to incorporate the NHLBI guidelines into routine care N/A
Key driver diagram template Implementation Site teams complete key driver diagrams, which are a visual display of a team’s theory of what “drives” or contributes to the study aims N/A
Implementation planning tool Implementation Teams are invited to weekly calls and booster sessions to review best practices in the implementation, particularly for the clinical decision support N/A
Run chart template 1 Monitoring For use in shared decision making N/A
Run chart template 2 Monitoring To track eligible patients who have been offered hydroxyurea N/A
Run chart template 3 Monitoring To track hydroxyurea prescriptions N/A
Hydroxyurea navigator monitoring tool (dose, labs, and adherence) Monitoring Table of dates and laboratory values with a way for clinicians to indicate if a value is in range or moving in the right direction N/A

aCheck marks indicate whether a component of the toolkit is core or optional.

bN/A: not applicable.

cSCA: sickle cell anemia.

dNHLBI: The National Heart, Lung, and Blood Institute.

Clinicians participate in guided practice using the visit decision aids in an immersive virtual reality environment [41] (Figure 3). The virtual reality simulation was adapted from a general pediatric practice protocol to train clinicians to discuss the influenza vaccine with racial and ethnic minority families [42].

Figure 3.

Figure 3

The clinical environment viewed through the virtual reality headset.

Usual Care

The ASH clinician pocket guide contains information that may motivate clinicians to use an SDM approach (eg, the NHLBI guidelines). The guide also includes information that may increase clinician confidence in describing hydroxyurea risks, benefits, and other treatments to caregivers. All sites receive printed copies of the guide, a link to download copies, and a link to the app to distribute to their clinicians. Site clinicians also view a live or recorded didactic presentation that reviews the NHLBI guidelines for hydroxyurea. Sites then develop or update their site-specific care guidelines for hydroxyurea and create a plan for implementation.

Procedures

Once the research team obtains consent from interested caregivers, they can complete baseline assessments at that time or a more convenient date. If caregivers prefer or cannot complete measures in person, then they can complete them on internet using Research Electronic Data Capture (REDCap) [43]. If a caregiver does not complete baseline assessments within 30 days of consent, then the caregiver may be rescreened, reconsented, and asked to complete baseline assessments one more time. At baseline, caregiver participants discuss initiating hydroxyurea with providers, and measures may be completed over 1-2 visits with 3 baseline visit types: (1) Full baseline: caregiver completes all baseline measures during one visit, (2) Baseline part 1: caregiver participants complete baseline measures not dependent upon the hydroxyurea discussion, and (3) Baseline part 2: caregiver participants complete baseline measures relevant to hydroxyurea discussion (Table 1).

The follow-up visit occurs between 3 and 7 months after baseline, and caregiver participants can complete measures during a clinic visit or on the internet. After both the baseline and follow-up visits, clinicians or research staff document whether they offered or prescribed hydroxyurea, whether they used Usual Care or H-SDM toolkit, patient’s health care utilization, and hematology lab values (Figure 4). Study sites complete a follow-up survey to assess whether and how their site is continuing to implement guidelines and whether they are offering hydroxyurea 3 months after recruitment ends. Caregiver participants are compensated US $40 for completion of baseline measures, US $20 for partial completion, US $20 for hydroxyurea discussion, and US $40 for completing all follow-up measures. We also compensate caregiver participants US $5 each time they refilled hydroxyurea between baseline and follow-up time points, verified by electronic medical record review.

Figure 4.

Figure 4

Study flowchart. H-SDM: hydroxyurea shared decision making; SCD: Sickle Cell Disease.

Primary Outcomes

The decisional conflict scale (DCS) is a 16-item measure that assesses decisional uncertainty [15]. Items are rated on a 4-point Likert scale of 0=strongly agree to 4=strongly disagree. To calculate the total score, the 16 items are summed, divided by 16, and multiplied by 25. The scores range from 0 to 100. The dyadic OPTION (observing patient involvement) scale is a measure of the caregiver perception of clinician behaviors involved in SDM [16]. Parents respond to the following item: “My doctor and I made the decision together.” The scores range from 0 to 100 (Table 2).

Table 2.

Primary and secondary outcome measures and covariates and fidelity assessments completed at baseline and follow-up visits in the engaging caregivers and providers of children with sickle cell anemia in shared decision making for hydroxyurea trial.

Construct Measure Brief description Baseline Follow-up
Primary outcomes

Caregiver-reported decisional uncertainty Decisional conflict scale [15]–effectiveness Measures uncertainty experienced when feeling uninformed about options, unclear about personal values, or unsupported in making a choice a N/Ab

Caregiver-reported perception of shared decision making Dyadic OPTION [16]–effectiveness Describes clinician behaviors to involve a patient or caregiver in decision making N/A
Secondary outcomes

Caregiver-reported satisfaction with decision making 6-item survey [17,44]–effectiveness Three items adapted from the empirical research related to procedural justice and 3 items assessing the influence of faith on decision making

Caregiver-reported hydroxyurea knowledge 8-item survey–effectiveness Hydroxyurea knowledge survey (8 items): developed based on the existing literature, the Ottawa Knowledge User Manual, and it was used by caregiver and clinician stakeholders in our pilot work

Caregiver report of SCDc-specific quality of life and pain PedsQLd SCD module [18]–effectiveness Measures several domains of health-related quality of life including pain impact, fatigue, pain management, emotions, communication, and treatment adherence

Caregiver report of neurocognitive functioning Ages and stages questionnaire [45]–effectiveness Reliable, accurate developmental and social emotional screener for children aged between 2 and 60 months

Caregiver report of hydroxyurea adherence Medical adherence measure subscale [46]–effectiveness A 9-item survey that measures adherence problems and the extent of nonadherence in pediatric populations N/A

Caregiver report of continued use of decision aids H-SDMe follow-up survey For the H-SDM condition, caregiver report of continued use of decision aids: previsit brochure, postvisit booklet, and narrative videos, including sharing information with others N/A

Hydroxyurea uptake Active hydroxyurea prescription–effectiveness One item reported by the research coordinator. They report whether patients enrolled in the study have an active prescription for hydroxyurea using the EMRf (prescription in the last 6 months)

Hydroxyurea adherence Lab values and pharmacy refill records–effectiveness Labs reported by the research coordinator based on the EMR (past 12 months): HbFg level, which increases when taking hydroxyurea as prescribed, ANCh, which decreases when taking hydroxyurea as prescribed, and MCVi, which increases when taking hydroxyurea as prescribed

Hydroxyurea offered 1 item reported by research coordinator–reach 1 of 3 responses completed by the research coordinator based on a review of EMR data: hydroxyurea was not offered, offered, or previously prescribed. If not offered, coordinators choose a reason why (ie, not eligible because the patient is on transfusions)

Health care utilization Hospitalizations, emergency room visits, and ill visits–effectiveness EMR data on the number of hospitalizations, ill visits, and emergency room visits in the 6 months before enrollment (if possible, some participants may be 9 months of age) and the 6 months after enrollment
Covariates

Demographics Demographics survey 10-item survey assessing family demographics including patient and caregiver age, gender, race and ethnicity, socioeconomic status, insurance (public vs private), and caregiver highest level of education completed N/A

Health literacy Newest vital sign [19] Newest vital sign (3 min): tests literacy skills for both numbers and words N/A

Caregiver report of the effects of COVID-19 CEFISj [47] The CEFIS was designed to be used in ongoing and new studies where COVID-19 may impact study outcomes. It conceptualizes the exposure to potentially traumatic aspects of COVID-19 and assesses the pandemic's impact on the family

Caregiver report of telemedicine use COVID-19 and telemedicine use survey [48] Items from the telemedicine usability questionnaire assess the impact of telemedicine on care
Fidelity

Caregiver-reported fidelity H-SDM toolkit parent checklist Checklist to assess the toolkit components that were used during the hydroxyurea discussion with the clinician N/A

Research coordinator observation of decision making Observer OPTION scale [20]–implementation Observer quantifies clinician behaviors to involve a caregiver in decision making. A total score is calculated, ranging from 0 (no involvement) to 100 (exemplary involvement) N/A

Intervention fidelity Intervention fidelity checklist–implementation Checklist to assess if the clinician used the intervention materials N/A

Study site report of continued use of intervention Follow-up survey–maintenance Survey to assess the continued implementation of the sites' guidelines and clinical characteristics to understand barriers and facilitators to maintain implementation N/A 1-3 months after enrollment ends

aThe check mark indicates that participants completed the measure either at baseline, follow-up, or both.

bN/A: not applicable.

cSCD: sickle cell disease.

dPedsQL: Pediatric Quality of Life.

eH-SDM: hydroxyurea shared decision making.

fEMR: emergency medical record.

gHbF: fetal hemoglobin.

hANC: absolute neutrophil count.

iMCV: mean corpuscular volume.

jCEFIS: COVID-19 Exposure and Family Impact Survey.

Secondary Outcomes

A 6-item survey assesses satisfaction with decision making [17,44], and an 8-item survey assesses hydroxyurea knowledge. If the Cronbach alpha for items on these scales is acceptable (≥.70), then we will sum the ratings to obtain a total score; otherwise, we will analyze items separately. The medical adherence measure assesses problems associated with hydroxyurea adherence [46]. Nonadherence and late adherence are calculated as a continuous variable (0%-100%). The Pediatric Quality of Life Inventory Sickle Cell Module [18] is a 43-item scale with 9 dimensions that assesses health-related quality of life in patients with SCA. Caregivers rated how much of a problem an issue had been for a child on a 5-point scale of Never to Almost Always. Responses are reverse scored and linearly transformed to a 0-100 scale. Total scores are the sum of the items divided by the number of items answered. The Ages and Stages Questionnaire [45] is a set of questionnaires in which caregivers’ complete questions appropriate for their child’s developmental stage. Each developmental area is scored on a 3-point scale of 0=not yet, 5=sometimes, and 10=yes and then totaled and compared with area cut-off scores. The H-SDM toolkit follow-up survey measures caregivers’ continued use of decision aids (Table 2).

Covariates

Covariate analyses will include data from the caregiver participant completed Demographics Survey and the Newest Vital Sign Survey [19]. The Newest Vital Sign Survey contains 10 items that assess health literacy skills using a mix of free response, yes or no, and Likert scale questions such as “how confident are you filling out medical forms by yourself?” The research team reviews the electronic health records to collect data on hydroxyurea (ie, if offered, if there is active prescription, adherence) based on lab values in the past 12 months, pharmacy refill records, and health care utilization.

To understand how the COVID-19 pandemic may impact trial study outcomes (eg, differential levels of distress), we added 2 additional measures in May 2020. The caregiver participants complete the COVID-19 Exposure and Family Impact Survey (CEFIS) [47]. The CEFIS contains following subscales: part 1 (exposure) comprises 25 items (yes or no responses) and part 2 (impact) comprises 12 items with 10 items using a 4-point scale rating impact on caregiver participant’s and family’s life and 2 items that use a 10-point distress scale. Part 3 is an open-ended question, so that participants could expand upon their experiences. Higher scores denote a more negative impact or exposure. The caregiver participants also complete the COVID-19 and telemedicine use survey [48], which contains 24 items rated on a 7-point Likert scale of 1=completely disagree to 7=completely agree, with statements such as “telehealth improves my access to health care services.”

Fidelity Assessments

The site study coordinator completes the intervention fidelity checklist and assesses whether the clinician used the treatment materials outlined in the protocol. The number of fidelity assessments that sites complete is determined based on site-specific expectations for enrollment. We developed the parent checklist specifically for this study to assess the H-SDM toolkit components used during the hydroxyurea discussion with the clinician. To ensure reliability, 2 research coordinators from the CC site independently code the recorded visits using the Observer OPTION scale [20]. Clinicians must obtain a score of 80 or higher. If a score of less than 80 is received, then it indicates that the clinician or site needs additional training (1-hour video conference call). Encounters will continue to be reviewed for fidelity to ensure that the clinician or site is implementing 80% of the required toolkit components. Finally, a follow-up survey 1-3 months after enrollment ends assesses whether sites have continued implementing the H-SDM toolkit guidelines.

Data Analyses

Data quality will be maintained through double data entry from site research team members and data quality checks from the coordinating site coordinator that assesses the conformance, completeness, and plausibility of electronic REDCap data. The coordinating site manager will also monitor data quality through random inspections. Any reliability issues were addressed with additional training. Discrepancies will be resolved by checking source data and, if necessary, by returning to patient charts to correct any inaccuracies.

All analyses will be conducted using Stata version 16 [49]. Before conducting analyses, the primary and secondary outcome measures’ psychometric properties will be assessed (eg, the measures’ dimensionality). The characteristics of the sites (eg, number of clinicians) and participants (eg, health literacy) will be summarized using descriptive statistics. Additional health care utilization variables will be analyzed as count variables and examined in the exploratory analyses.

Primary Outcomes Analyses

To examine differences between usual care and H-SDM toolkit groups on the DCS scale assessed at a single time point during the intervention session, a linear mixed-effects regression model with a robust variance estimator and maximum likelihood estimation will be used, with observations clustered within site and alpha set to .05. To examine differences between the usual care and H-SDM toolkit groups on the OPTION scale, we will conduct a logistic mixed-effects regression model with a robust variance estimator, maximum likelihood estimation, and observations clustered within site with alpha set to .05.

Secondary Outcomes Analyses

Parental knowledge and child health outcomes will be analyzed using linear mixed-effect regression models, with observations clustered within the site. To account for possible type I error inflation due to a large number of secondary outcomes, we will use the Benjamini-Hochberg procedure [50] to decrease the false discovery rate, with the overall alpha set to .05. For health care utilization outcomes, generalized mixed-effect regression models will be employed, with binary outcomes estimated using logistic models and count outcomes analyzed with negative binomial models. The interaction between these demographic variables and treatment conditions will be included in the regression models. We will examine the impact of the COVID-19 pandemic on our trial outcomes by assessing the interaction between our treatment groups and scores on the CEFIS in regression models. Observations will be coded as occurring prepandemic or during pandemic, regardless of treatment condition assignment.

Subgroup Analyses

We will compare the characteristics of the following subgroups on outcome variables: (1) caregiver participants who enroll versus those who decline, (2) dropouts versus completers, (3) clinicians who adopt the H-SDM toolkit versus those who do not, (4) sites who adopt the full H-SDM toolkit versus those that adopt only the core components, (5) sites that continue to implement guidelines versus those who do not, and (6) observations collected prepandemic versus during the pandemic.

Process Improvement Analyses

During the H-SDM toolkit period, data are tracked on monthly run charts, which will be converted into p-charts or control charts to determine if the process of offering hydroxyurea is under control (ie, minimal variation in the data) and if there are any notable changes (ie, factors that change the process). The upper and lower control limits will be calculated as 3 sigma from the mean (ie, standard Shewhart chart method) [21]. We will consider any data point outside the control limit variation from a special cause.

Fidelity Analyses

We will examine the differences between sites that continue to implement the intervention components and those who discontinue the toolkit use.

Statistical Power

We based sample size calculations on the smallest effect sizes (Cohen d) reported in previous studies using the DCS (effect sizes range from d=0.4 to 1.2) [22], our primary outcome, and a stepped-wedge design (eg, Hussey and Hughes approach) [14,23]. We calculated power analyses using the optimal design [51] power analysis software. With our planned sample size of n=87 per group (total sample size N=174) and up to 10%-15% missing data on our primary outcome, we will have at least 80% power to detect a standardized effect size difference of d=0.40 between our treatment groups on our primary outcome.

Data and Safety Monitoring

The study oversight will be under the direction of a Data and Safety Monitoring Board (DSMB) comprising members having expertise in SDM, hematology, psychology, biostatistics as well as a parent of a young child with SCA and an adult patient living with SCA. The DSMB will assess safety and efficacy data (if applicable), along with study’s progress and data integrity. These experts will review and evaluate the accumulated data for participant safety, adverse events, and study’s conduct and progress every 6 months. The DSMB will make recommendations to the appropriate regulatory agencies (IRB and Patient-Centered Outcomes Research Institute [PCORI]) concerning the continuation, modification, or termination of the study. Given the study is low risk, there are 2 conference calls scheduled each year.

Although no adverse events are anticipated, we will ensure that each site has procedures to refer any parents who become upset to appropriate resources for follow-up. The principal investigator (PI), a clinical psychologist with experience in managing parental distress, will provide study staff and clinician training. The PI and site PI will be notified if any individual needs psychological follow-up due to study participation. The IRB at CCHMC will be notified as soon as the immediate needs of the participant are addressed. For any severe adverse events (ie, life-threatening), the study staff will inform the PI within 1 working day. All serious adverse events will be reported to the IRB within 48 hours of the event.

Results

The ENGAGE HU trial was funded in August 2017, and the Ethics Committee of CCHMC approved the study (Approval No. 2017-6612) in November 2017. Patient recruitment started in July 2018 and will end in November 2021. The study will be completed in February 2022. As of February 2021, we have enrolled 120 caregiver participants. We expect to disseminate the findings of the trial through peer-reviewed journals in the summer of 2022.

Discussion

Principal Findings

The ENGAGE HU trial compares the existing ASH clinician pocket guide with the H-SDM toolkit, which is a caregiver-centered, technology-enhanced decision support toolkit to help clinicians implement SDM for hydroxyurea [11]. We designed the H-SDM toolkit components to increase the likelihood that caregivers and health care providers would make a change in their behaviors (ie, engage with one another to make a decision about hydroxyurea). The H-SDM toolkit targets the worries, fears, and uncertainty of caregivers regarding hydroxyurea initiation. Improving hydroxyurea uptake is an important issue, as it is efficacious for patients with SCA. Given the broad stakeholder input and our preliminary studies, we believe that the H-SDM toolkit dissemination method has the potential to promote SDM and enhance the quality of care provided to children with SCA [52].

Strengths and Limitations

Several aspects of this trial will enable the rapid adoption of findings into practice. First, we developed the H-SDM toolkit with substantial clinician and caregiver input; thus, it contains components these stakeholders felt were feasible, acceptable, and essential for improving clinical care. Second, we designed the H-SDM toolkit with core and optional components so that it can be tailored to the needs of individual families and be broadly applicable across many clinical settings. Third, virtual reality simulation provides guided practice in facilitating an SDM process. It is also a low-cost clinician training intervention that will be made accessible on national SCA-focused websites shared across SCA networks. Virtual reality training can occur in person or using web-based video conferencing tools (eg, Zoom or Microsoft Teams) [41], which is especially useful in the context of the ongoing COVID-19 pandemic. Finally, sites included in this trial were selected because their patient populations mirror the larger US SCA population with respect to economics, geography, and racial and ethnic diversity. This diversity increases the applicability of our findings to nonstudy settings and increases the available study pool.

There are some limitations to this study that should be acknowledged. A critical consideration for the ENGAGE HU trial is that SCA primarily affects individuals of African and Hispanic or Latino descent. Although the ENGAGE HU trial design includes best-practice strategies for recruiting people of color in research, we may experience recruitment difficulties because potential participants are mistrustful or have child care and transportation issues [53]. Furthermore, a successful and timely completion of clinical trials in the SCA population is compounded, as it is a rare disease with a smaller pool of available participants [54]. A potential barrier to intervention fidelity is the intrinsic difficulty in changing behavior. Given our goals to alter caregiver-clinician interactions, we address this barrier through guided practice in the virtual reality environment and audio recordings of a percentage of caregiver-clinician hydroxyurea interactions. These interventions should foster fidelity. Our pilot work indicates that clinicians currently using the toolkit decision aids find them beneficial and recommend them to others [11]. Ultimately, we hope that our study findings will have a substantial impact on improving health outcomes and decreasing health care costs in pediatric SCA and other chronic conditions.

Acknowledgments

The statements presented in this study are solely the responsibility of the authors and do not necessarily represent the views of the PCORI, its Board of Governors, or the Methodology Committee. The authors would like to thank Emmanuel J Volanakis, MD, for his assistance with study recruitment.

The research reported in this work was funded by the PCORI Award (CDR-1609-36055). AH was supported in part by a grant from the NHLBI, National Institutes of Health (1F32HL143915).

LN was affiliated with the Department of Hematology/Oncology at the Children's Hospital Oakland at the time of research and is currently the Medical Director for AbbVie, and a voluntary faculty at the University of California San Francisco.

Abbreviations

ASH

American Society of Hematology

CC

co-ordinating center

CCHMC

Cincinnati Children’s Hospital Medical Center

CEFIS

COVID-19 Exposure and Family Impact Survey

DCS

Decisional Conflict Scale

DSMB

Data and Safety Monitoring Board

H-SDM

hydroxyurea shared decision making

IRB

institutional review board

NHLBI

The National Heart, Lung, and Blood Institute

PCORI

Patient-Centered Outcomes Research Institute

PI

principal investigator

RCT

randomized controlled trial

RE-AIM

Reach, Effectiveness, Adoption, Implementation, and Maintenance

REDCap

Research Electronic Data Capture

SCA

sickle cell anemia

SDM

shared decision making

Appendix

Multimedia Appendix 1

Peer-review report.

Footnotes

Authors' Contributions: LC, LS, WB, FR, MK, MB, KS, MT, CQ, and RW designed this study; JP, CM, and LC designed the statistical analysis plan; LC and CN obtained permission from the ethics committees; AH, HS, CN, YL, SB, AT, JR, AY, KW, AK, CC, SC, CP, AH, SR, LN, EM, AS, and SR carried out this trial; AH and LC drafted this manuscript; and all authors read, carefully reviewed, and approved the final manuscript.

Conflicts of Interest: Author REW receives hydroxyurea donations for investigator-initiated research studies from Bristol Myers-Squibb Foundation and Addmedica, Inc. LN received research funding (2018-2020) from Patient-Centered Outcomes Research Institute, National Heart, Lung, and Blood Institute, Seattle Children's Research Grants, Doris Duke Foundation, Health Resources and Services Administration, Terumo Corporation, Bluebird Bio, Sancillo and Company, Celgene Corporation, Imara Corporation, Sangamo Therapeutics, Silarus Therapeutics, Pfizer, Global Blood Therapeutics, La Jolla Pharmaceuticals, Mast Therapeutics, and Selexys Pharmaceuticals. She was also a consultant for Apopharma, Bayer-Global, Novartis, Pfizer, Emmaus Medical, and CTD Holdings. None of the research funding or consultancy were related to the research conducted. The other authors have no conflicts to declare.

References

  • 1.Hassell KL. Population estimates of sickle cell disease in the U.S. Am J Prev Med. 2010 Apr;38(4 Suppl):512–21. doi: 10.1016/j.amepre.2009.12.022. [DOI] [PubMed] [Google Scholar]
  • 2.Therrell BL, Lloyd-Puryear MA, Eckman JR, Mann MY. Newborn screening for sickle cell diseases in the United States: a review of data spanning 2 decades. Semin Perinatol. 2015 Apr;39(3):238–51. doi: 10.1053/j.semperi.2015.03.008. [DOI] [PubMed] [Google Scholar]
  • 3.Lanzkron S, Carroll CP, Haywood C. Mortality rates and age at death from Sickle Cell Disease: U.S., 1979–2005. Public Health Rep. 2013 Mar;128(2):110–6. doi: 10.1177/003335491312800206. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4.Nevitt SJ, Jones AP, Howard J. Hydroxyurea (hydroxycarbamide) for sickle cell disease. Cochrane Database Syst Rev. 2017 Apr 20;4 doi: 10.1002/14651858.CD002202.pub2. http://europepmc.org/abstract/MED/28426137. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5.Wang WC, Ware RE, Miller ST, Iyer RV, Casella JF, Minniti CP, Rana S, Thornburg CD, Rogers ZR, Kalpatthi RV, Barredo JC, Brown RC, Sarnaik SA, Howard TH, Wynn LW, Kutlar A, Armstrong FD, Files BA, Goldsmith JC, Waclawiw MA, Huang X, Thompson BW, BABY HUG investigators Hydroxycarbamide in very young children with sickle-cell anaemia: a multicentre, randomised, controlled trial (BABY HUG) Lancet. 2011 May 14;377(9778):1663–72. doi: 10.1016/S0140-6736(11)60355-3. http://europepmc.org/abstract/MED/21571150. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6.Charache S, Terrin ML, Moore RD, Dover GJ, Barton FB, Eckert SV, McMahon RP, Bonds DR. Effect of hydroxyurea on the frequency of painful crises in sickle cell anemia. N Engl J Med. 1995 May 18;332(20):1317–22. doi: 10.1056/nejm199505183322001. [DOI] [PubMed] [Google Scholar]
  • 7.Yawn BP, Buchanan GR, Afenyi-Annan AN, Ballas SK, Hassell KL, James AH, Jordan L, Lanzkron SM, Lottenberg R, Savage WJ, Tanabe PJ, Ware RE, Murad MH, Goldsmith JC, Ortiz E, Fulwood R, Horton A, John-Sowah J. Management of sickle cell disease. J Am Med Assoc. 2014 Sep 10;312(10):1033. doi: 10.1001/jama.2014.10517. [DOI] [PubMed] [Google Scholar]
  • 8.Smith AW, Bodas P, Sidebotham L, Weilnau J, Wildman B. Improving uptake of hydroxyurea in patients with sickle cell disease: a retrospective study of a clinic-based change in consenting practices. J Natl Med Assoc. 2019 Apr;111(2):169–75. doi: 10.1016/j.jnma.2018.09.004. [DOI] [PubMed] [Google Scholar]
  • 9.Oyeku SO, Driscoll MC, Cohen HW, Trachtman R, Pashankar F, Mullen C, Giardina PJ, Velazco N, Racine AD, Green NS. Parental and other factors associated with hydroxyurea use for pediatric sickle cell disease. Pediatr Blood Cancer. 2012 Nov 05;60(4):653–8. doi: 10.1002/pbc.24381. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10.Crosby LE, Shook LM, Ware RE, Brinkman WB. Shared decision making for hydroxyurea treatment initiation in children with sickle cell anemia. Pediatr Blood Cancer. 2014 Oct 12;62(2):184–5. doi: 10.1002/pbc.25124. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11.Crosby LE, Walton A, Shook LM, Ware RE, Treadwell M, Saving KL, Britto M, Peugh J, McTate E, Oyeku S, Nwankwo C, Brinkman WB. Development of a hydroxyurea decision aid for parents of children with sickle cell anemia. J Pediatr Hematol Oncol. 2019 Jan;41(1):56–63. doi: 10.1097/MPH.0000000000001257. http://europepmc.org/abstract/MED/30044352. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12.Gaglio B, Shoup JA, Glasgow RE. The RE-AIM Framework: a systematic review of use over time. Am J Public Health. 2013 Jun;103(6):e38–e46. doi: 10.2105/ajph.2013.301299. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13.Glasgow RE, Vogt TM, Boles SM. Evaluating the public health impact of health promotion interventions: the RE-AIM framework. Am J Public Health. 1999 Sep;89(9):1322–7. doi: 10.2105/ajph.89.9.1322. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.Hussey MA, Hughes JP. Design and analysis of stepped wedge cluster randomized trials. Contemp Clin Trials. 2007 Feb;28(2):182–91. doi: 10.1016/j.cct.2006.05.007. [DOI] [PubMed] [Google Scholar]
  • 15.O'Connor AM. Validation of a decisional conflict scale. Med Decis Making. 2016 Jul 02;15(1):25–30. doi: 10.1177/0272989x9501500105. [DOI] [PubMed] [Google Scholar]
  • 16.Melbourne E, Sinclair K, Durand M, Légaré F, Elwyn G. Developing a dyadic OPTION scale to measure perceptions of shared decision making. Patient Educ Couns. 2010 Feb;78(2):177–83. doi: 10.1016/j.pec.2009.07.009. [DOI] [PubMed] [Google Scholar]
  • 17.Cascardi M, Poythress NG, Hall A. Procedural justice in the context of civil commitment: an analogue study. Behav Sci Law. 2001 Dec;18(6):731–40. doi: 10.1002/bsl.421. [DOI] [PubMed] [Google Scholar]
  • 18.Panepinto JA, Torres S, Bendo CB, McCavit TL, Dinu B, Sherman-Bien S, Bemrich-Stolz C, Varni JW. PedsQL™ sickle cell disease module: feasibility, reliability, and validity. Pediatr Blood Cancer. 2013 Aug;60(8):1338–44. doi: 10.1002/pbc.24491. http://europepmc.org/abstract/MED/23441057. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19.Weiss BD. Quick assessment of literacy in primary care: the newest vital sign. Ann Fam Med. 2005 Nov 01;3(6):514–22. doi: 10.1370/afm.405. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20.Elwyn G, Hutchings H, Edwards A, Rapport F, Wensing M, Cheung WY, Grol R. The OPTION scale: measuring the extent that clinicians involve patients in decision-making tasks. Health Expect. 2005 Mar;8(1):34–42. doi: 10.1111/j.1369-7625.2004.00311.x. http://europepmc.org/abstract/MED/15713169. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21.Langley G, Moen R, Nolan K, Nolan T, Norman C, Provost L. The improvement guide: a practical approach to enhancing organizational performance 2nd edition. San Francisco: Jossey-Bass; 2009. Apr 21, pp. 1–512. [Google Scholar]
  • 22.O'Connor A. User manual decisional conflict scale. Patient Decision Aids. 1993. [2021-03-10]. https://decisionaid.ohri.ca/eval_dcs.html.
  • 23.Hemming K, Haines TP, Chilton PJ, Girling AJ, Lilford RJ. The stepped wedge cluster randomised trial: rationale, design, analysis, and reporting. Br Med J. 2015 Feb 06;350(feb06 1):391. doi: 10.1136/bmj.h391. [DOI] [PubMed] [Google Scholar]
  • 24.Melbourne E, Roberts S, Durand MA, Newcombe R, Légaré F, Elwyn G. Dyadic OPTION: measuring perceptions of shared decision-making in practice. Patient Educ Couns. 2011 Apr;83(1):55–7. doi: 10.1016/j.pec.2010.04.019. [DOI] [PubMed] [Google Scholar]
  • 25.Légaré F, Ratté S, Stacey D, Kryworuchko J, Gravel K, Graham ID, Turcotte S. Interventions for improving the adoption of shared decision making by healthcare professionals. Cochrane Database Syst Rev. 2010 May 12;(5) doi: 10.1002/14651858.CD006732.pub2. [DOI] [PubMed] [Google Scholar]
  • 26.Walton A, Shook LM, Treadwell M. Shared decision making for hydroxyurea with families of patients with sickle cell anemia. Proceedings of the 10th Annual Sickle Cell Disease Research and Educational Symposium and 39th National Sickle Cell Disease Scientific Meeting; 10th Annual Sickle Cell Disease Research and Educational Symposium and 39th National Sickle Cell Disease Scientific Meeting; April 2016; Hollywood, Florida. 2016. [Google Scholar]
  • 27.Osborn CY, Weiss BD, Davis TC, Skripkauskas S, Rodrigue C, Bass PF, Wolf MS. Measuring adult literacy in health care: performance of the newest vital sign. Am J Health Behav. 2007;31 Suppl 1:S36–46. doi: 10.5555/ajhb.2007.31.supp.S36. [DOI] [PubMed] [Google Scholar]
  • 28.Brinkman WB, Majcher JH, Poling LM, Shi G, Zender M, Sucharew H, Britto MT, Epstein JN. Shared decision-making to improve attention-deficit hyperactivity disorder care. Patient Educ Couns. 2013 Oct;93(1):95–101. doi: 10.1016/j.pec.2013.04.009. http://europepmc.org/abstract/MED/23669153. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 29.Real FJ, DeBlasio D, Beck AF, Ollberding NJ, Davis D, Cruse B, Samaan Z, McLinden D, Klein MD. A virtual reality curriculum for pediatric residents decreases rates of influenza vaccine refusal. Acad Pediatr. 2017;17(4):431–5. doi: 10.1016/j.acap.2017.01.010. [DOI] [PubMed] [Google Scholar]
  • 30.Lopreiato JO, Sawyer T. Simulation-based medical education in pediatrics. Acad Pediatr. 2015;15(2):134–42. doi: 10.1016/j.acap.2014.10.010. [DOI] [PubMed] [Google Scholar]
  • 31.Consorti F, Mancuso R, Nocioni M, Piccolo A. Efficacy of virtual patients in medical education: a meta-analysis of randomized studies. Comput Educ. 2012 Nov;59(3):1001–8. doi: 10.1016/j.compedu.2012.04.017. [DOI] [Google Scholar]
  • 32.Optimal design plus empirical evidence: documentation for the “Optimal Design” software [computer program] Optimal Design. 2011. [2021-03-17]. http://www.hlmsoft.net/od/od-manual-20111016-v300.pdf.
  • 33.Flores G, Portillo A, Lin H, Walker C, Fierro M, Henry M, Massey K. A successful approach to minimizing attrition in racial/ethnic minority, low-income populations. Contemp Clin Trials Commun. 2017 Mar;5:168–74. doi: 10.1016/j.conctc.2017.01.009. http://europepmc.org/abstract/MED/28378019. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 34.Campbell MK, Piaggio G, Elbourne DR, Altman DG, CONSORT Group Consort 2010 statement: extension to cluster randomised trials. Br Med J. 2012 Sep 04;345 doi: 10.1136/bmj.e5661. [DOI] [PubMed] [Google Scholar]
  • 35.Enders CK, Tofighi D. Centering predictor variables in cross-sectional multilevel models: a new look at an old issue. Psychol Methods. 2007 Jun;12(2):121–38. doi: 10.1037/1082-989X.12.2.121. [DOI] [PubMed] [Google Scholar]
  • 36.Graham JW, Olchowski AE, Gilreath TD. How many imputations are really needed? Some practical clarifications of multiple imputation theory. Prev Sci. 2007 Sep;8(3):206–13. doi: 10.1007/s11121-007-0070-9. [DOI] [PubMed] [Google Scholar]
  • 37.Enders CK, Gottschall AC. Multiple imputation strategies for multiple group structural equation models. Struct Equ Model: A Multidisciplinary Journal. 2011 Jan 13;18(1):35–54. doi: 10.1080/10705511.2011.532695. [DOI] [Google Scholar]
  • 38.O'Connor A, Cranney A. User Manual - Knowledge. Ottawa: Ottawa Hospital Research Institute; 2002. [2021-03-17]. https://decisionaid.ohri.ca/docs/develop/User_Manuals/UM_Knowledge.pdf. [Google Scholar]
  • 39.Cohen J. Statistical power analysis for the behavioral sciences. Hillsdale, N.J: L. Erlbaum Associates; 1988. [Google Scholar]
  • 40.Godin G, Bélanger-Gravel A, Eccles M, Grimshaw J. Healthcare professionals' intentions and behaviours: a systematic review of studies based on social cognitive theories. Implementation Sci. 2008 Jul 16;3(1) doi: 10.1186/1748-5908-3-36. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 41.Crosby L, Real F, Cruse B, Davis D, Klein M, McTate E, Hood A, Brinkman W, Hackworth R, Quinn C. An immersive virtual reality curriculum for pediatric providers on shared decision making for hydroxyurea. Blood. 2019 Nov 13;Supplement_1(134):3402. doi: 10.1182/blood-2019-128661. https://ashpublications.org/blood/article/134/Supplement_1/3402/423950/An-Immersive-Virtual-Reality-Curriculum-for. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 42.Committee on infectious diseases Recommendations for prevention and control of influenza in children, 2017 – 2018. Pediatrics. 2017 Sep 04;140(4) doi: 10.1542/peds.2017-2550. [DOI] [PubMed] [Google Scholar]
  • 43.Harris PA, Taylor R, Thielke R, Payne J, Gonzalez N, Conde JG. Research electronic data capture (REDCap)—a metadata-driven methodology and workflow process for providing translational research informatics support. J Biomed Inform. 2009 Apr;42(2):377–81. doi: 10.1016/j.jbi.2008.08.010. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 44.Allen D, Marshall ES. Spirituality as a coping resource for African American parents of chronically ill children. MCN Am J Matern Child Nurs. 2010;35(4):232–7. doi: 10.1097/NMC.0b013e3181de3f76. [DOI] [PubMed] [Google Scholar]
  • 45.Squires J, Bricker D, Potter L. Revision of a parent-completed developmental screening tool: ages and stages questionnaires. J Pediatr Psychol. 1997;22(3):313–28. doi: 10.1093/jpepsy/22.3.313. [DOI] [PubMed] [Google Scholar]
  • 46.Zelikovsky N, Schast AP, Palmer J, Meyers KEC. Perceived barriers to adherence among adolescent renal transplant candidates. Pediatr Transplant. 2008 May;12(3):300–8. doi: 10.1111/j.1399-3046.2007.00886.x. [DOI] [PubMed] [Google Scholar]
  • 47.Kazak A, Canter K, Phan-Vo TL, McDonnell G, Hildenbrand A, Alderfer M, Schultz C, Barakat L, Kassam- Adams N, Pai A, Deatrick J. COVID-19 Exposure and Family Impact Survey (CEFIS) [2020-07-30]. www.nlm.nih.gov/dr2/CEFIS_COVID_question- naire_English_42220_final.pdf.
  • 48.Parmanto B, Lewis, Jr. AN, Graham KM, Bertolet MH. Development of the Telehealth Usability Questionnaire (TUQ) Int J Telerehab. 2016 Jul 01;8(1):3–10. doi: 10.5195/ijt.2016.6196. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 49.StataCorp . Stata Statistical Software: Release 16. College Station, Texas: StataCorp LLC; 2019. [2020-06-23]. https://www.stata.com. [Google Scholar]
  • 50.Benjamini Y, Hochberg Y. Controlling the false discovery rate: a practical and powerful approach to multiple testing. J R Stat Soc: Series B (Methodological) 2018 Dec 05;57(1):289–300. doi: 10.1111/j.2517-6161.1995.tb02031.x. [DOI] [Google Scholar]
  • 51.Raudenbush S, Spybrook J, Congdon R, Liu X, Martinez F, Bloom H, Hill C. Optimal design for longitudinal and multilevel research: documentation for the optimal design software version 3.0. Ann Arbor Univ Michigan: 2011. [2021-03-10]. https://sites.google.com/site/optimaldesignsoftware/home. [Google Scholar]
  • 52.Thornburg CD, Calatroni A, Panepinto JA. Differences in health-related quality of life in children with sickle cell disease receiving hydroxyurea. J Pediatr Hematol Oncol. 2011 May;33(4):251–4. doi: 10.1097/MPH.0b013e3182114c54. http://europepmc.org/abstract/MED/21516020. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 53.Paskett ED, Reeves KW, McLaughlin JM, Katz ML, McAlearney AS, Ruffin MT, Halbert CH, Merete C, Davis F, Gehlert S. Recruitment of minority and underserved populations in the United States: the centers for population health and health disparities experience. Contemp Clin Trials. 2008 Nov;29(6):847–61. doi: 10.1016/j.cct.2008.07.006. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 54.Stevens EM, Patterson CA, Li YB, Smith-Whitley K, Barakat LP. Mistrust of pediatric sickle cell disease clinical trials research. Am J Prev Med. 2016 Jul;51(1):78–86. doi: 10.1016/j.amepre.2016.01.024. [DOI] [PMC free article] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

Multimedia Appendix 1

Peer-review report.


Articles from JMIR Research Protocols are provided here courtesy of JMIR Publications Inc.

RESOURCES