Table 1.
Overview of the Supportive Text vs Email Messaging (STEM) outcome measures.
| RE-AIMa domain and outcomes | Measures | Data source | Timeline (months) | ||||||||||||||
|
|
|
|
|
1-3 | 4-6 | 7-9 | 10-12 | 13-15 | 16-18 | ||||||||
| Reach |
|
|
|
|
|
|
|
|
|||||||||
|
|
Dose delivered | The frequency of emails and text messages sent to the subscribers (including delivery failures) | STEM metadata | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ||||||||
|
|
Dose received | The average number of times participants read the emails or text messages | Survey questionnaire |
|
|
✓ | ✓ | ✓ | ✓ | ||||||||
| Effectiveness |
|
|
|
|
|
|
|
|
|||||||||
|
|
Depression symptom score | Patient Health Questionnaire-9 (PHQ-9) | Clinical questionnaire |
|
|
✓ | ✓ | ✓ | ✓ | ||||||||
|
|
Patients’ quality of life | 5-item World Health Organization Well-Being Index (WHO-5) | Clinical questionnaire |
|
|
✓ | ✓ | ✓ | ✓ | ||||||||
|
|
Anxiety symptom scores | Generalized Anxiety Disorder-7 (GAD-7) | Clinical questionnaire |
|
|
✓ | ✓ | ✓ | ✓ | ||||||||
| Adoption |
|
|
|
|
|
|
|
|
|||||||||
|
|
Acceptability/uptake | The number of subscriptions to the text and email services | STEM metadata |
|
|
|
|
|
✓ | ||||||||
|
|
Acceptability/uptake | Barriers and facilitators | Qualitative focus group discussions guided by the CFIRb |
|
|
|
|
|
✓ | ||||||||
| Implementation |
|
|
|
|
|
|
|
|
|||||||||
|
|
Feasibility | Implementation drivers (barriers and facilitators) | Qualitative focus group discussions guided by the CFIR |
|
|
|
|
|
✓ | ||||||||
|
|
Fidelity | The proportion of participants who read the messages at least once a day | Survey questionnaire |
|
|
✓ | ✓ | ✓ | ✓ | ||||||||
|
|
Cost | Comparative cost of developing and maintaining both strategies | STEM metadata | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ||||||||
| Maintenance |
|
|
|
|
|
|
|
|
|||||||||
|
|
Sustainability | Dropout rates; barriers and facilitators | Subscription data; qualitative focus group discussions guided by the CFIR |
|
|
|
|
|
✓ | ||||||||
aRE-AIM: Reach, Effectiveness, Adoption, Implementation, and Maintenance.
bCFIR: Consolidated Framework for Implementation Research.