Skip to main content
. 2021 Dec 30;10(12):e24792. doi: 10.2196/24792

Table 1.

Harmonised evaluation data sources guided by the Reach, Effectiveness, Adoption, Implementation, and Maintenance framework.

Implementation Quantitative data sources Qualitative data sources
Engage with schools to adopt the Harmonised app
  • Number of schools agreeing to participate, number of schools invited, and proportion of invited schools agreeing to participate

Drivers of and barriers to school participation:
  • School engagement log

  • School engagement notes

  • Preimplementation school information forms

  • Preimplementation focus groups

The app is implemented in schools
  • Number of schools implementing in accordance with random assignment

  • Costs of implementation (time and money)

Understanding implementation:
  • School implementation plans

  • Implementation run sheets

  • Postimplementation stakeholder focus groups

  • Postimplementation taitamariki focus groups

The app reaches the target population
  • Number and proportion of students in participating schools and others that download and use the app:

  • App download data (Firebase reports)

  • App use assessed in taitamariki survey postimplementation

Drivers of and barriers to app access and use:
  • Open-ended query in survey reason for not downloading

  • Postimplementation focus groups with taitamariki

  • Postimplementation focus groups with stakeholders

  • Whānau interviews

The app is effective at improving relationship and well-being outcomes
  • Primary and secondary outcomes assessed in web-based survey completed by taitamariki at 5 school terms over 18 months

Impacts of the app:
  • Postimplementation focus groups with taitamariki

Maintenance of the Harmonised app beyond the implementation period
  • App use data posttrial (Firebase)

Understanding long-term impacts and app retention:
  • Postimplementation hui (meeting)