Table 2.
Dimensions of the PatientTIME process evaluation.
| Dimensions | Purpose | Research questions (data source) |
| Delivery | ||
| Uptake | Insight into the procedures used to reach users, and information on who was reached | Were the publicity actions conducted as planned? (Logbook) Who showed interest in participating? (Questionnaire Qr) What were the reasons for not participating? (Logbook) |
| “Dose” delivered | Insight into the exposure to the intervention | To whom was the intervention delivered, and how does this compare to the population of interested patients? (Questionnaire Qr) |
| Participation rate | Insight into the characteristics of participantsa and their reasons for participating | Who participated in the evaluation, compared with the total group who were invited to participate in the intervention? (Questionnaire Qr, Q0) |
| Fidelity | Insight into the extent to which the intervention was provided as planned | Which adaptions made to the intervention for the benefit of the effect evaluation may have influenced use and outcomes? (Logbook) What was the time between registration and the consultation date? (Questionnaire Qr) To what extent were reminders necessary for the benefit of the effect evaluation? (Logbook) |
| User-program interaction | ||
| Dose received (attrition) |
Insight into the actual exposure to the intervention and the use of its different components |
How many video fragments were watched per patient? (Log files) How many patients used the question prompt sheet? (Log files) How many patients audio-recorded their consultation? (Log files) |
| Usability | Insight into the usability of the intervention | How was the satisfaction with the intervention rated? (Questionnaire Q1)b |
| Contextual factors | ||
| Patient’s context | Insight into the contextual factors at the micro level | What influence does the patients’ context have and how could the context have influenced the outcome evaluation? (Logbook) |
a A patient was defined as a “participant” if he or she registered the first consultation date and completed the previsit questionnaire Q0.
b The usability was evaluated with the System Usability Scale, a 10-item questionnaire that gives an overview of satisfaction with the program, resulting in a sum score (range 0-100) [33]. Usability tests had already been conducted with patients on a small scale during the development phase. However, as usability is strongly associated with use, attrition, and dropout, we decided to measure it on a larger scale as well.