Table 2.
Descriptive information on ESM-based feedback of ongoing ESM-based feedback studies in the Belgian-Dutch Network for ESM research.
| # | Study/project name | Form | Feedback/ESM Software | Face-to-face meeting | Length of feedback | Frequency | Timing | Content | Included parties | Training | Effectiveness1 | Impact/Burden |
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 1 | CSP-DNA | Digital movie and poster | RoQua/ESMvis visual feedback using R | Yes | Circa 60 min. | 1 | After 3 or 4 weeks of ESM monitoring | Text and descriptive graphs + ESMvis poster + ESMvis descriptive movie | Patient, HCP and researcher | Pilot, training will be developed | Qualitative interviews with patients | Qualitative interviews with patients |
| 2 | DAILY | Digital report via e-mail | m-Path/m-path | Yes | 50 min. | 1 | After 4 weeks of ESM monitoring | Descriptive graphs | Patient and HCP | For HCPs, an online training (optional) | Self-injurious thoughts, urges, and behaviors | Qualitative interviews with patients and HCPs and evaluation questionnaires filled in by patients and HCPs |
| 3 | ESM BD | Digital report via e-mail | RoQua/RoQua | Yes | 40–60 min. | 1 | After 4 months of ESM monitoring | Descriptive graphs | Patient, HCP and researcher | For HCPs, a training on how to interpret the graphs and how to structure the discussion with the patient | Qualitative interviews with patients and HCPs | Qualitative interviews with patients and HCPs |
| 4 | ESM-MSD | Digital feedback interface | PsyMate™/PsyMate™ | Yes | 15 min (and open) | 3 | At the end of 3 ESM waves of the study | Descriptive graphs | Patient and researcher | NA | NA | NA |
| 5 | ESM PSY | Digital report via e-mail | RoQua/RoQua | Yes | Flexible (integrated in diagnostic advice meeting) | 1 | At the end of the diagnostic phase | Descriptive graphs, dependent on relevant clinical questions | Patient and HCP (psychiatrist and psychiatrist in training, psychiatric nurse) | For HCPs, a training on how to interpret graphs as diagnostical instruments | Qualitative interviews with HCPs | Qualitative interviews with HCPs |
| 6 | iCASE | Paper report | In-house SPSS and R script/RoQua | Yes | 1–2 h | 1 | After the study ends | Descriptive(s) graphs and temporal associations with VAR analysis | Patient, HCP, researcher | NA | Depressive symptoms | Evaluation questionnaires filled by patients |
| 7 | IMPACT | Online dashboard | m-Path/m-Path | Yes | Flexible (determined by the HCP, 8 ACT therapy session) | Circa 8 times (depends on total number of ACT therapy sessions provided) | Depends on time between therapy sessions; every 1–2 weeks (after each ACT session in combination with ESM monitoring) | Descriptive graphs, word cloud (topic of value description within ACT therapy) | Patient and ACT-DL HCP | For HCP, an online training on how to work with the dashboard and a manual wherein the therapy ACT-DL protocol is described | Insight and self-reflection; ACT coping skills; client empowerment and disease management; symptoms, distress, wellbeing and quality of life Qualitative interviews with patients and HCP |
Adapted version of the MAUQ (including usability and acceptability of the intervention) – therapist and client version Qualitative interviews with patients and HCP |
| 8 | IMPROVE | Online dashboard | m-Path/m-Path | Yes | 50 min. | 1 | After 1 week of ESM monitoring | Descriptive graphs | Patient and HCP | For HCP, an online training and manual (optional) | Compliance, Self-reflection and insight, self-management, self-efficacy, therapeutic self-care, patient activation, service engagement, work alliance, shared-decision making, depression, anxiety and stress Qualitative interviews with patients and HCP |
Adapted version of the MAUQ (including usability) Qualitative interviews with patients and HCP |
| 9 | LIME | Digital feedback interface | PsyMate™/PsyMate™ | Yes | Circa 35 min. | Flexible (determined by the psychological assistant to the GP, in dialogue with the patient) | Flexible (determined by the psychological assistant to the GP, in dialogue with the patient) | Descriptive graphs and diagrams | Patient, psychological assistant to the GP, and sometimes researcher | For assistants to the GP, a training and work instruction about the use of ESM technology to support detailed functional analyses within their work processes. For patients, an instruction about the download, login procedure, and use of the tool |
NA | Qualitative interviews with patients and the psychological assistants to the GP |
| 10 | Moe-i-teloos | Digital feedback-interface | PsyMate™/PsyMate™ | Yes | 45–60 min. | 6 | After each week of ESM monitoring | Descriptive graphs | Patient and HCP | For HCP, a workshop on how to use the graphical PsyMate interface to provide feedback on ESM data | Fatigue, cognitive and emotional symptoms, personal goals, societal participation, cost-effectiveness | Evaluation questionnaire filled in by patients |
| 11 | N1AP | Digital report including most relevant graphs and written evaluations of the feedback session | PsyMate™/PsyMate™ | Yes | 45 min | After each ESM week or twice weekly, ESM monitoring takes place circa 16 weeks plus 6 monthly FUs plus 3 yearly FUs | After each week of ESM monitoring or twice weekly | Descriptive graphs | Patient and HCP/researcher | For HCPs or researchers on how to use the feedback module and on how to provide feedback | Momentary psychotic experiences, subjective well-being, social functioning, cognition, sleep, dopamine super-sensitivity, negative symptoms | Evaluation questionnaire filled in by patients |
| 12 | PETRA | Digital feedback interface and digital report | RoQua/RoQua | Yes | 45–60 min | Flexible (determined by the HCP and patient) | Flexible (determined by the HCP and patient) | Descriptive and interactive graphs | Patient and HCP | For HCPs, a workshop on how to use the PETRA interface | Qualitative interviews and usability sessions with patients, and evaluation questionnaires filled in by patients | Qualitative interviews and usability sessions with patients, and evaluation questionnaires filled in by patients |
| 13 | SELFIE | Digital report | NA/PsyMate™ | Yes | 45–60 min | 3 face-to-face 3 emails |
Face-to-face: week 1, 3, 5 Email: week 2, 4, 6 |
Feedback on their use of the exercises in the app | Participant and HCP | For HCPs, a training and guideline with detailed instructions on how to provide the intervention | NA | Evaluation questionnaires filled in by participants |
| 14 | Therap-i | Digital feedback interface and digital report, including discussed graphs and notes, sent via email | In-house R script/RoQua | Yes | 45–60 min | 3 | Week 2, 4 and 8 | Descriptive and network graphs on cognitions, emotions, behavior, body and context | Patient, HCP and researcher | For HCPs, a workshop is offered on how to use the Therap-i module in their treatment. Participation is not necessary to undergo the ESM module. | Depressive symptoms, psychological functioning, illness perception, therapeutic alliance, self-management | Evaluation questionnaires filled in by patients and HCPs, and a qualitative interview with a subset of patients |
| 15 | ZELF-i | Digital report via e-mail | In-house R script/RoQua | Yes | 45–60 min | 4 reports, 1 meeting | Week 1, 2, 3, and 4 | Text and descriptive graphs and (after week 4) temporal associations with VAR analysis between sets of variables (i.e., affect and activities or thinking patterns) | Patient and researcher | For research assistants a training on how to support patients in interpreting the graphs | Depressive symptoms, psychosocial functioning and feelings of empowerment | Evaluation questionnaires filled in by patients and a qualitative interview with a subset of patients |
ACT: Acceptance and Commitment Therapy. ACT-DL: Acceptance and Commitment Therapy in Daily Life. ESM: Experience sampling method. FU: follow-up. GP: general practitioner. HCP: healthcare professional. MAUQ: mHealth App Usability Questionnaire. NA: not applicable. PETRA: PErsonalized Treatment by Real-time Assessment; VAR: vector autoregression. 1Note: Effectiveness may refer to the effects of the feedback alone or as part of a more elaborate intervention (e.g., Therap-i module includes resilience interview, ESM monitoring, and ESM-based feedback). This overview was last updated October 2022.