Table 4.

The reach, effectiveness, adoption, implementation, and maintenance evaluation measures of Hydroxyurea Toolbox implementation.

Domains	Measures	Data sources
Adoption—clinic	Proportion and representativeness of clinics that agree to support the HUa Toolbox	Institutional data to describe clinics (eg, size, case mix, years in service, regional sociodemographics of SCDb patients) Clinic data collection form Qualitative interviews
Adoption—provider	Characteristics of providers at each site (eg, specialty, years in practice, sociodemographics, level of expertise) Proportion and representativeness of eligible providers approached in the study (numerator) among all providers (denominator) Proportion and representativeness of enrolled providers in the study (numerator) among all eligible providers (denominator) at each site	Provider survey Clinic data collection form
Effectiveness	Number and proportion of providers demonstrating improved knowledge and self-efficacy in hydroxyurea administration Percentage of patients who were prescribed hydroxyurea per provider	Provider survey Medical chart abstraction Qualitative interviews
Implementation	Consistency with which sites are able to implement the use of the Toolbox app as planned Engagement with the app: Percentage, number, and representativeness of providers that appropriately used HU Toolbox app (low or high use; in the entire practice) Percentage of providers who reported satisfaction with HU Toolbox app (MARSc scale) Percentage of patients whose provider used the Toolbox at each site App usage statistics	App usage statistics Provider survey Qualitative interviews
Maintenance/sustainability	Extent to which program leaders express a desire or intent to offer or encourage the use of the Toolbox app by their clinical providers at the conclusion of the research Percentage of providers who continue to use the provider app beyond the study period, and representativeness Percentage of providers who continue to prescribe hydroxyurea to their patients	App usage statistics Clinic data collection form Qualitative interviews

^aHU: Hydroxyurea.

^bMARS: mobile app rating scale.

^bSCD: sickle cell disease.