Table 2. Measures within the process evaluation and economic analyses.
The process evaluation will utilize a range of qualitative and quantitative measures to assess programme fidelity and implementation, recruitment of sites and families, participant engagement and experiences, and the feasibility of implementing the programme within child and family services in Ireland not involved in the RCT. Several measures will also be applied in order to conduct a costs analyses of ChARM.
| Measure | Participant | Objective |
|---|---|---|
| Process evaluation | ||
| Session checklists | Practitioners | Fidelity of program content |
| Work Alliance Inventory | Practitioners &
Parents |
Practitioner-parent relationships |
| IY Agency Implementation
Effectiveness Questionnaire |
Practitioners &
managers |
Site and practitioner capacity to implement the
program with integrity |
| In-depth semi-structured
interviews |
Practitioner &
managers |
Assess experiences of developing, coordinating and
implementing program |
| Records of meetings | Research team | Assess experiences of recruiting sites, developing
and implementing program |
| Attendance records | Practitioners | Records of parental attendance to program |
| PLSP feedback form | Parent | Parental feedback on Positive Life Skills Program |
| Home visits feedback form | Parent | Parental feedback on home visits |
| IY parent satisfaction
questionnaire |
Parent | Parental feedback on Incredible Years parenting
program |
| Working Alliance Inventory | Parent | Parent-practitioner relationship |
| Semi-structured interview for
parents (including attritors) |
Parent | Assess experiences of participating in the program |
| Draw and Tell interview | Child 7–11 years | Experiences of child wellbeing and family |
| Cantril’s ladder | Child 7–11 years | Life satisfaction on 1–10 scale of ladder |
| My family and me | Child 7–11 years | Emotional closeness of family relationships |
| Semi structured interview/focus
group |
Child and
Family services |
Assess feasibility of implementing the ChARM
program within current systems of care in Ireland |
| Economic analyses | ||
| Costs diaries for program inputs | Practitioners
& managers |
Estimate the cost per family of delivering the
program |
| Service Utilisation Questionnaire | Parent | Document health, educational and social services
used by families in previous six months |