Skip to main content
. 2019 Feb 5;9(2):e025591. doi: 10.1136/bmjopen-2018-025591

Table 1.

Process evaluation framework for analysis (V.3.0, 27 June 2018)

Evaluation area Questions
Fidelity
(the degree to which the intervention was delivered as intended)
  • What is the intervention?

  • Was the intervention (safety plan (SP) and follow-up telephone calls) delivered as intended?

  • Was there consistency in terms of how the intervention was delivered?

  • What, if any, adaptations were needed to the planned intervention? And were they needed?

  • What barriers, if any, were there to delivering the intervention in a consistent way? (SP and follow-up telephone calls)?

Exposure
(the extent to which participants received and understood the different elements of the intervention and whether they implemented these as intended. Their satisfaction with the intervention and barriers to receipt and implementation were also considered)
  • To what extent did participants take up all potential elements of the full programme of intervention (SP and five follow-up telephone calls)?

  • To what degree did participants receive the minimum dose (SP and one follow-up phone call)?

  • To what extent was the SP completed as intended by the participant? If it was not what were the reasons for that?

  • How did participants use the safety plan they had developed? (eg, frequency of use, practicality— where did they keep it, did they share with others)

  • To what extent did participants alter or amend their safety plans throughout the course of the intervention?

  • What elements of the intervention did participants find helpful/unhelpful and why? What elements of the intervention would participants change and why?

  • What changes, if any, did participants feel that they implemented as a result of taking part in the intervention?

  • What factors were involved in ongoing engagement with the intervention?

  • What do participants report were barriers and facilitators to developing the SP, engaging with telephone support and using the SP in practice?

  • What feedback do participants have regarding feasibility and acceptability of the SP and follow-up telephone calls?

Reach
(the extent to which the target audience is reached by the intervention, as well as any ‘spill over’ effects on people not recruited)
  • How well does the study sample represent the population of interest?

  • Did participants report sharing their SP with family or friends?

  • To what extent did the intervention reach and influence people other than recruited participants?

Context
(includes information relating to aspects of the context in which the intervention was delivered, as well as broader context that both practitioner and client were operating within that may influence intervention effectiveness)
  • What participant-centred contextual factors influenced engagement with the intervention (safety planning and follow-up calls) and use of the SP in practice?

  • What contextual factors within participants’ day-to-day environment influenced engagement with the intervention (safety planning and follow-up calls) and use of the SP in practice?

  • How did the context in which the intervention was delivered influence engagement with the intervention and use of the SP in practice?

  • Was the SP useful in certain circumstances and not in others?

  • How does the intervention fit in with what is delivered in hospital (how easy was is it to deliver in this setting and does it conflict with anything)?

  • What were the particular context-related difficulties/issues that arose during the study in delivering the intervention?

Recruitment and retention
  • How did participants feel about being approached/recruited in hospital setting?

  • How acceptable were study and intervention procedures to participants?

  • What motivated study participants to agree to take part? (And what kept them engaged?)

  • Were there any difficulties in recruitment?

  • What is the attrition rate overall and by subgroup? That is, intervention groups and control

  • What were the reasons for withdrawal?

Contamination
  • What are the characteristics of other groups or services people are attending or resources they are using—do these provide any elements of the intervention?

  • Have participants used an SP or similar in the past?

  • Did participants in the treatment as usual (TAU) arm investigate ‘SP’ strategy on their own?

  • Have any of the TAU arm participants seen intervention content from other participants?

  • How did randomisation to the TAU arm affect participants?