Table 4.
Evaluation matrix
| Evaluation question | Data source |
|---|---|
| RQ1: What is the level of program implementation of PLH-Teens at scale in Tanzania in terms of quality of delivery and implementation fidelity? |
1) Parenting for Lifelong Health-Facilitator Assessment Tool (PLH-FAT)—measures facilitator competence and adherence 2) Direct observation of group sessions using the structured observation guide 3) Semi-structured interviews held with facilitators, coordinators, coaches, and LIP staff 4) Focus group discussions (FGDs) held with adolescents, parents/caregivers, facilitators, and coaches |
| RQ2: What factors are associated with the quality of delivery and implementation fidelity of PLH-Teens? |
1) PLH-FAT 2) Interviews 3) FGDs 4) Community of practice reflective meetings among LIPs, Pact, CWBSA and researchers 5) Facilitator Profile Form examining facilitator demographics including education level, experience, and professional background 6) Coach Profile Form examining coach demographics including education, experience, and professional background 7) LIP Organizational Characteristics Form 8) Direct observation of group sessions using the structured observation guide |
| RQ3: How are implementation quality and fidelity associated with intervention outcomes? |
1) PLH-FAT 2) Interviews 3) FGDs 4) Community of practice reflective meetings 5) Facilitator Profile Form 6) Coach Profile Form 7) LIP Organizational Characteristics Form 8) Parent/caregiver- and adolescent-report on pre-post questionnaires 9) Parent/caregiver and adolescent program attendance data 10) Direct observation of group sessions using the structured observation guide |
| RQ4: What are participant and implementing staff perspectives on the acceptability, appropriateness, feasibility, benefits, and challenges of delivering PLH-Teens in their schools and communities? |
1) Interviews with school principals, facilitators, coordinators, coaches, and LIP staff 2) FGDs with adolescents, parents/caregivers, facilitators, and coaches 3) Direct observation of group sessions using the structured observation guide |
| RQ5: What is the impact of PLH-Teens on VAC and participant well-being? |
1) Parent/caregiver- and adolescent-report on pre-post questionnaires 2) Individual interviews with school principals, facilitators, coordinators, coaches, and LIP staff 3) FGDs with adolescents, parents/caregivers, facilitators, and coaches |
| RQ6: How much does it cost to deliver PLH-Teens at scale? |
1) Facilitator cost surveys 2) Facilitator profile surveys 3) Coach cost surveys 4) LIP cost surveys |