Abstract
Background
Intensive longitudinal methods offer a powerful tool for capturing daily experiences of individuals. However, its feasibility, effectiveness, and optimal methodological approaches for studying or monitoring experiences of oncology patients remain uncertain.
Objective
This scoping review aims to describe to what extent intensive longitudinal methods with daily electronic assessments have been used among patients with breast or lung cancer and with which methodologies, associated outcomes, and influencing factors.
Methods
We searched the electronic databases (PubMed, Embase, and PsycINFO) up to January 2024 and included studies reporting on the use of these methods among adults with breast or lung cancer. Data were extracted on population characteristics, intensive monitoring methodologies used, study findings, and factors influencing the implementation of these methods in research and clinical practice.
Results
We identified 1311 articles and included 52 articles reporting on 41 studies. Study aims and intensive monitoring methodologies varied widely, but most studies focused on measuring physical and psychological symptom constructs, such as pain, anxiety, or depression. Compliance and attrition rates seemed acceptable for most studies, although complete methodological reporting was often lacking. Few studies specifically examined these methods among patients with advanced cancer. Factors influencing implementation were linked to both patient (eg, confidence with intensive monitoring system) and methodology (eg, option to use personal devices).
Conclusions
Intensive longitudinal methods with daily electronic assessments hold promise to provide unique insights into the daily lives of patients with cancer. Intensive longitudinal methods may be feasible among people with breast or lung cancer. Our findings encourage further research to determine optimal conditions for intensive monitoring, specifically in more advanced disease stages.
Keywords: diary, ecological momentary assessment, neoplasms, quality of life, self-report, telemedicine, scoping review, longitudinal methods, breast cancer, lung cancer, patients with cancer, cancer, intensive monitoring, advanced disease stages, mobile phone
Introduction
Background
People diagnosed with cancer, among which breast and lung cancer are the most prevalent diagnoses globally [1], often experience various problems and concerns that affect their quality of life and well-being across physical, psychological, social, and spiritual domains [2-6]. Understanding the fluctuations, interactions, and contextual variations of the multidimensional problems and concerns in patients’ daily lives is crucial to gain a comprehensive view of these patients’ quality of life and to optimize patient-centered care. Such insights could lead to, among others, improvements in drug schedules and personalized treatment decision-making [7] and the identification of novel care intervention targets by identifying contexts or states that aggravate or buffer against certain problems and concerns [8].
An effective way to gather insights into the daily and within-day variability of patients’ quality of life and well-being is the use of intensive longitudinal methods. Bolger and Laurenceau [9] defined intensive longitudinal methods as “an umbrella term to encompass data collection methods that employ enough repeated measurements to model a change process for each subject.” The authors specify a minimum number of 5 sequential assessments, as it enables the estimation of linear models within each participant [9]. Examples of such methods are daily diaries and ecological momentary assessments (EMAs), also known as experience sampling methods (ESM). While predominantly developed in psychological research, these methods recently gained more attention in other fields and clinical practice, including oncology, due to advancements in handheld computer technologies that enable easier implementation than traditional pencil-and-paper approaches [9-13]. Despite easier implementation of these methods, researchers and clinicians in the field of oncology still lack a clear understanding of available options for intensive longitudinal monitoring, their opportunities, pitfalls, and feasibility in populations experiencing high symptom burden. This underscores the need for a structured overview of the use and capabilities of these methods.
Currently, no systematically conducted literature review exists on the use of intensive longitudinal methods in monitoring people with cancer. One systematic review [14] provided the most recent overview of the use of EMA in people with cancer across 42 studies (23 and 8 studies included people with breast and lung cancer, respectively) and found considerable heterogeneity in the methodologies used. However, due to its inclusion criteria focusing solely on EMAs, a large group of studies monitoring patients on a once-daily basis was left out [14]. Furthermore, the review did not report on the barriers and facilitators that were encountered during the implementation of ESM, which is crucial information for optimal use in practice [14].
Objective
We aimed to describe to what extent intensive longitudinal methods with daily electronic assessments have been used among patients with breast or lung cancer, along with the methodologies used, associated outcomes, and influencing factors. We limited the scope of this review to these patient groups with the most prevalent cancer diagnoses for feasibility reasons to provide a more nuanced picture for these methods among these groups and to inform our own ongoing ESM project among these patient groups [15]. More specifically, we described (1) the characteristics of the populations with breast or lung cancer among whom intensive longitudinal methods with daily electronic assessments have been used; (2) the objectives, design, and methods used; (3) the results obtained (including study findings and response-related results); and (4) the identified barriers and facilitators for implementing these methods in clinical and research practice.
Methods
Overview
We conducted a scoping review using a systematic search strategy to gain insight into the extent, range, and nature of current evidence on the use of intensive longitudinal methods with daily electronic assessments in people with breast or lung cancer, rather than providing evidence for a specific research question as in systematic reviews [16,17]. This manuscript adheres to the PRISMA-ScR (Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for Scoping Reviews) [18].
Eligibility Criteria
We included articles that met the following criteria: articles that (1) performed in people diagnosed with breast or lung cancer through self-report or proxy responding; (2) included people aged ≥18 years; (3) used active intensive longitudinal methods, meaning the conscious reporting of experiences rather than passive data collection through wearables without conscious participant involvement [12]; (4) collected self-reports using electronic devices or allowed participants to choose between electronic and pen-and-paper self-reports, resulting in a partial sample that opted for electronic assessments; (5) applied a measurement period of >24 hours, with ≥5 planned assessments, including at least 1 assessment per day; and (6) included original full-text articles in English, Dutch, or French.
Articles were excluded if they met one or both of the following criteria: articles that (1) were conducted in people in complete cancer remission and (2) concerned reviews, meta-analyses, notes, letters to editors, conference abstracts, or study protocols.
Search Strategy
The initial literature search was conducted on April 7, 2022, and updated on January 19, 2024, both without restrictions for its time coverage. We searched 3 databases: PubMed, Embase, and PsycINFO. We consulted a librarian of the Vrije Universiteit Brussel for the development of the search strategy. Keywords included terms related to the population (eg, cancer) and methodology (eg, ecological momentary assessment and daily diary). The search strategy was validated in PubMed and translated to other databases. The full search strategy is provided in Multimedia Appendix 1.
Study Selection
Figure 1 provides an overview of the selection procedure. Most duplicates were automatically detected and removed using EndNote (version 20; Clarivate) [19]. Screening followed a 2-step process. First, 2 researchers (JG and KdN) independently screened titles and abstracts and labeled them as relevant, irrelevant, or potentially relevant for inclusion. Additional duplicates not detected by EndNote were removed during this step. Second, both reviewers screened the full texts of relevant and potentially relevant studies for final inclusion. JG and KdN resolved discrepancies in both steps through discussion and consensus and consulted a third and fourth reviewer (LP and LVdB), if necessary. JG screened articles found during the updated search. We used Rayyan (Qatar Computing Research Institute) [20] for reference management and manual removal of duplicates.
Figure 1.
PRISMA-ScR (Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for Scoping Reviews) flow diagram. ILM: intensive longitudinal method.
Data Extraction and Synthesis
JG extracted data into a precreated MS Excel (version 16; Microsoft Corp) spreadsheet. To ensure consistency and accuracy of the initial search, KdN independently completed the data extraction form for a random 10% sample of included articles. JG and KdN discussed and resolved discrepancies. JG extracted updated search results. The data extraction form was revised throughout the review process. It included study characteristics (ie, authors, year, country, and overarching study); sample characteristics (ie, sample size, site of primary tumor, stage of disease, mean age, proportion of female participants, and comparison group characteristics); study aims and design; system characteristics (ie, device, application, and operation system); daily questionnaire characteristics (ie, number of items, constructs measured daily, existing measurement instruments, or sources used); sampling schedule characteristics (ie, number of monitoring periods, duration of the monitoring periods, type of sampling scheme [ie, fixed or random signal-contingent, event-contingent, or interval-contingent] [9], daily prompt frequency, and approximate time interval between prompts); supportive features for participants; response-related results (ie, participation rate, attrition rate, proportion of completed prompts, and monetary incentives); and main study findings. We listed the barriers and facilitators for the implementation of the used method in research and clinical practice per study.
We have presented the study and sample characteristics, system and sampling schedule characteristics, and response-related results in the Results section, grouping articles reporting on the same study. We conducted content analysis on the extracted barriers and facilitators, inductively categorizing the content in themes and subthemes.
Results
Of the 1311 identified articles, we screened 253 (19.3%) full-text articles for eligibility. We included 52 articles, describing 41 unique studies (Figure 1).
Population Characteristics
All the 41 studies were conducted in high-income countries, except for 1 (2%) study in Türkiye [21] (all study and sample characteristics are listed in Multimedia Appendix 2) [21-72]. We included 21 (51%) studies [22-44] reporting on samples of people with mixed primary tumor sites (including breast and lung cancer), 16 (39%) studies [21,45-66] on samples of people with breast cancer only, and 4 (10%) studies [67-72] on a sample of lung cancer only (Table 1). A total of 7 (17%) studies included patients’ partners [25,38,39,43,45-50,63]. While 26 (63%) studies were conducted in people at differing stages of disease, of which 11 (42%) included up to stage III [21,48-51,54-59,61,63,73] and 15 (58%) included up to stage IV [23,25,26,31,32,34,36-39,41-44,53,64,69,70], 6 (15%) studies [24,30,33,35,45-47,52] specifically focused on people with stage IV cancer. Sample sizes ranged from 4 [29] to 344 [42] participants, with a mean of 54.3 (SD 56.4). The mean ages were 51 (SD 4.7) years for patients with breast cancer, 65 (SD 2.8) years for patients with lung cancer, and 58 (SD 5.7) years for patients with mixed primary tumor sites. None of the studies used proxy responding.
Table 1.
Study and sample characteristics of the included studies (n=41).
Characteristics | Frequency of studies, n (%) | Reference, year | |||
Primary tumor sites | |||||
|
Breast | 16 (39) |
|
||
|
Lung | 4 (10) | |||
|
Mixed | 21 (51) |
|
||
Included patients and partners | 7 (17) | ||||
Disease stage | |||||
|
I to II | 1 (2) | |||
|
III to IV | 9 (22) | |||
|
Mixed | 20 (49) |
|
||
|
Not fully mentioned | 11 (27) | |||
Sample size | |||||
|
4-20 | 9 (22) | |||
|
21-50 | 14 (34) |
|
||
|
51-100 | 13 (32) |
|
||
|
100-344 | 5 (12) | |||
Mean age (years) | |||||
|
40-50 | 10 (24) |
|
||
|
51-60 | 19 (46) |
|
||
|
61-70 | 9 (22) | |||
|
Not mentioned | 3 (7) | |||
Study design as reported by study authors | |||||
|
Observational | 30 (73) |
|
||
|
Interventional | 11 (27) | |||
Study objectives | |||||
|
Feasibility, usability, or validity | 19 (46) |
|
||
|
Trajectory or relationship of variables | 17 (41) |
|
||
|
Effectiveness of methods as intervention | 4 (10) | |||
|
Effectiveness of other interventions | 3 (7) | |||
|
Introduce statistical approach | 1 (2) |
|
Study Design and Objectives
Of the 41 studies, 30 (73%) [22-25,27,28,30,37-50,53-61,63,65-67,69-72] used intensive methods in observational study designs, whereas 11 (27%) [21,26,29,31-34,36,51,52,62,64] used them in interventional studies. While 38% (20/52) of the articles [23,24,27-30,33,34,36-38,40-43,51,56,59-61] focused on the intensive method’s feasibility, usability, or validity, other articles investigated the prevalence or trajectory of measured variables or relationships between those variables [22,25,39,44-50,53-55,57,58,63,65-67,69,70,72], the effectiveness of the intensive methods as an intervention [21,26,31,32,71], or the effectiveness of other interventions [52,62,64] or introduced a novel statistical approach [68].
Data Collection Methods
Daily Measured Constructs
Of the 41 studies, 30 (73%) [23-25,27-34,36,37,40-42,44-50,52-59,62,63,65-72] used items adapted from previous studies or scales (study details are listed in Multimedia Appendix 3) [21-72]. Some of the most frequently recurring questionnaires were the Common Toxicity Criteria Adverse Events grading system [29,31-33,37,41,74], EORTC Core Quality of Life Questionnaire (EORTC-QLQ-C30) [24,42,69,70,75], and the Positive and Negative Affect Schedule-Expanded scale [48-50,53,69,70,76]. Measured constructs covered physical, psychological, and social domains; behaviors and intentions; daily events; sleep quality; and general quality of life. The physical domain was the most assessed domain, with the most frequently measured constructs being pain [22,23,26,27,30,34,35,38-41,45-47,52,54,56,57,59,65-68,70] and fatigue [23,26-32,35,40,41,44,54-57,59,65,66,70]. Anxiety [22,26,35,41,51,54,56,57,59-61,65,66,72] and depression [26,35,51,56,57,59,61,65,66] were the most frequently measured constructs in the psychological domain, and social support [25,45,48,50,62] and communication [25,38,39,46,49,50,63] were the most frequently measured constructs in the social domain. Frequently measured behavioral constructs included medication use [22,36,38-40,47,61,64] and physical activity [38,39,56,57,65,66].
Sampling Schedule Characteristics
Of the 41 studies, 23 (56%) [21-24,26-28,30,37-41,43,48,50-53,59,61,62,69,70,72] required patients to fill in the questionnaire once per day, while 6 (15%) studies [25,29,31-34,67,68] required 2 completions daily, and 7 (17%) studies [35,44-47,54-58,63,65,66] required 3-6 completions daily (Table 2). Moreover, 5 (12%) studies [36,42,60,64,71] did not report the specific amount.
Table 2.
Data collection methods used in the included studies (n=41).
Data collection methods | Frequency of studies, n (%) | Reference, year | |||
Sampling schedule | |||||
|
Once daily | 23 (56) |
|
||
|
Twice daily | 6 (15) | |||
|
3-6 times daily | 7 (17) |
|
||
|
Not mentioned | 6 (15) | |||
Sampling typea | |||||
|
Fixed signal-contingent | 15 (37) | |||
|
Random signal-contingent | 7 (17) |
|
||
|
Interval-contingent | 6 (15) | |||
|
Event-contingent | 6 (15) | |||
|
Not clearly mentioned | 15 (37) |
|
||
Data collection period length (days) | |||||
|
5 | 1 (2) |
|
||
|
7 | 8 (20) | |||
|
8-13 | 3 (7) | |||
|
14 | 7 (17) | |||
|
>14 | 12 (29) | |||
|
Variable per person | 10 (24) | |||
Data collection devices for self-report assessments | |||||
|
Smartphone | 11 (27) |
|
||
|
Smartwatch | 2 (5) | |||
|
Handheld computer | 8 (20) | |||
|
Mobile device with telephone or SMS functionality | 9 (22) | |||
|
Device with internet functionality | 5 (12) | |||
|
Specifically developed device | 2 (5) | |||
|
Not mentioned | 5 (12) | |||
Device ownership | |||||
|
Patient-owned | 19 (46) |
|
||
|
Provided by researcher | 12 (29) | |||
|
Option to choose between patient-owned and research device | 2 (5) | |||
|
Not mentioned | 10 (24) | |||
Data collection softwarea | |||||
|
Smartphone apps | 9 (22) | |||
|
Browser-based surveys (sent via chat, mail, or SMS) | 6 (15) | |||
|
SMS | 3 (7) | |||
|
Interactive voice responding systems | 4 (10) | |||
|
Other specifically developed software | 12 (29) | |||
|
Not mentioned | 8 (20) | |||
Used conditional questionnaire items | 7 (17) | ||||
Used different questionnaire lengths depending on prompt timing | 5 (12) | ||||
The number of questionnaire items | |||||
|
1-20 | 20 (49) |
|
||
|
21-40 | 6 (15) | |||
|
41-84 | 2 (5) | |||
|
Not clearly mentioned | 13 (32) | |||
Supportive features | |||||
|
Automated self-care advice | 9 (22) | |||
|
Clinician alerts | 9 (22) | |||
|
Clinician could view summary of responses | 5 (12) | |||
|
Informational modules | 2 (5) | |||
|
Module allowing communication with clinicians | 1 (2) |
|
||
|
Patients received response summaries | 2 (5) | |||
|
Relaxation reminders | 1 (2) |
|
||
|
None mentioned | 23 (56) |
|
aMultiple options possible per study.
Out of the 41 studies, 22 (54%) studies [25,34-40,43-51,54-58,61,63,65-70,72] applied signal-contingent sampling (ie, prompting respondents to complete the questionnaire) and 6 (15%) studies [21,30,33,53,59,62] applied interval-contingent sampling (ie, instructing respondents to complete the questionnaire at certain intervals), while 15 (37%) studies [22-24,26-29,31,32,36,41,52,60,64,71] did not specify the sampling method. Furthermore, 6 (15%) studies used event-contingent sampling on top of the other sampling methods; of these, 4 (67%) studies [29-32,38,39] instructed patients to complete the assessment when experiencing adverse events, 1 (17%) study [35] required the patients to assess when rescue medication was taken, and 1 (17%) study [43] prompted patients when a physiologically measured stress threshold was reached. Out of 22 signal-contingent sampling studies, 13 (59%) [25,34-37,43,48-51,61,63,69,70,72] prompted patients at fixed times, with times between prompts ranging from 3 to 24 hours. Moreover, 36% (8/22) of the studies [35,42,44-47,54-58,65-68] prompted patients at random times, of which 5 (62%) [35,44-47,55,67,68] randomly prompted within a fixed time block (eg, between 9 AM and midnight). Minimum time intervals between randomly timed prompts ranged from 30 minutes to 3 hours [45-47,54-58].
Of the 41 studies, 7 (17%) [31-33,52,54-58,65,66,71] had multiple data collection periods for each patient. While the most common data collection period lengths were 7 days [28,35,48-54,71,72] and 14 days [22,25,29,31,32,45-47,62,67,68], ranging from 1 to 336 days [42,77], 10 (24%) studies [23,24,26,36,38-40,42,44,55,60] mentioned differing study lengths for each patient (eg, based on patients’ next chemotherapy visit) [55].
System Characteristics
Data collection devices and software varied substantively in the included studies (n=41), with 11 (27%) studies [21,25,27,40,43,44,51,54,56-58,61,63,65,66] using smartphones, 1 (2%) study using smartwatches [38,39], and 8 (20%) studies [22,24,28,30,35,45-47,55,67,68] using handheld computers for self-report assessments. Other studies used basic telephone and SMS text messaging functionality [26,34,37,41,51,52], internet functionality [48-50,53,56-59,65,66,69,70,72], and used a specifically developed device [23,38,39]. A total of 19 (46%) studies [21,26,27,34,37,40,41,43,44,48-54,56-59,61,63] used patients’ devices, whereas 12 (29%) studies [22-24,28,30,33,35,38,39,42,45-47,55,67,68] provided devices to patients.
Different types of software were used, including smartphone apps [21,25,27,36,40,43,44,54,60,61,63,64], browser-based surveys [48-50,53,56-59,63,65,66,69,70,72], SMS text messaging [34,37,51], interactive voice responding systems [26,34,41,52], and other specifically developed software applications [22,23,28,29,31-33,38,39,42,55,71].
Questionnaire Length
Some studies (7/41, 17%) [25,26,38-40,43,45-50,65-68] used conditional items that were presented when a certain response was given to previous items and different questionnaires depending on the timing of the prompt (eg, the use of morning prompts to assess sleep quality [55,56]). Most studies (20/41, 49%) [21-25,27-29,31-35,37-40,42-47,51,52,55-61,63,65-68] had questionnaire lengths ranging between 1 and 20 items, with the longest being 84 items (including conditional items) [48-50]. Several studies (13/41, 32%) [21,23,28-33,36,40,51,63,64,71] did not provide complete information on the number of items.
Supportive Features
Of 41 studies, 17 (41%) [21,23,24,26,28-34,36,37,40,42,61,63,71] provided supportive features; 9 (22%) studies [23,28-33,37,40,71] offered automated self-care advice to patients based on their responses directly after response submission, for instance, offering advice for managing reported symptoms, with severe symptoms triggering advice to contact a health care professional [73]. Also, 9 (22%) studies [26,28,29,31-34,37,40,71] automatically contacted health care professionals based on symptom severity (ie, clinician alerts). Some studies (2/41, 5%) [31,32,71] differentiated between different severities to indicate varying levels of need for immediate intervention (eg, amber and red alerts). A total of 6 (15%) studies [28,29,31-33,37,71] combined automated self-care advice and clinician alerts. One study [26] alerted clinicians based on responses given on domains other than physical symptoms, namely psychological variables (ie, depressive mood and anxiety) and distress caused by symptoms. Other supportive features included providing the opportunity to clinicians to view a summary or visualization of responses given by the patient [24,28,40,42,61] and providing patients with informational modules [21,36], modules allowing communication with clinicians [21,36], response summaries [30,63], and relaxation reminders [21].
Study-Reported Findings
Findings Concerning Methodological Evaluations
Intensive longitudinal methods that sampled once daily [23,26-28,30,37,40,42] or multiple times per day [33-35,38,43,56] were deemed feasible and acceptable for patients. These findings applied to various system characteristics, such as interactive voice response and SMS text messaging systems [26,34,37] and smartphone apps [27,40,43]. Compliance decreased over time in a 90-day study [61], with higher compliance among unemployed women. Patients believed in the method’s ability to improve symptoms [29], symptom management [28,71], and communication with clinicians [71]. Moreover, patients had positive views on the usability of the methods [26,30,34,35,56,71] and felt reassured by using them [29,33].
Health care professionals had a positive view of the methods [71] and found them reassuring for patients, especially during out of hours [33], and clinically useful [26,30,37]. In addition, health care professionals thought that the methods could be helpful aids in timely interventions [29] and for assessing [28] and managing symptoms [28,29]. However, one study [24] reported that quality of life data was not used for making treatment decisions, and other studies [26,42,64] reported that clinicians rarely contacted the patients after receiving clinical alerts or monitored their responses. In one study [71], health care professionals mentioned that reduced complexity of the system was needed to promote its utility.
Some studies (5/41, 12%) [34,36,41,51,59] compared intensive longitudinal methods with other scales and found agreement between the methods, such as depression ratings and Patient Health Questionnaire-9 [60,78]. One study [27] found a lack of agreement between the intensive methods and the Short Form Health Survey [79], but this concordance improved with higher compliance rates.
Findings Concerning Prevalence and Covariability of Constructs
Several studies (16/41, 39%) examined the prevalence and covariability of constructs ranging across multiple topics. For instance, 7 studies [25,45,46,48-50,63] reported findings related to the social dynamics between patients and their partners. One study [45] found greater reports of relationship interference when patients experienced more pain and lower arousal mood. Moreover, partners were more likely to provide support when patients experienced more tiredness and less active mood resulting from pain [45]. Another study on this topic [48] found that partners’ reports of support provision were positively associated with feelings of relationship intimacy reported by patients.
Overall, studies investigated various topics such as physical activity, affect, and physical symptoms. For instance, studies [54,65] showed associations between sedentary behavior, affective valence, and fatigue at different time points, analog to other studies [57,66] that found within-person associations between physical activity and same-day affect, fatigue, pain, and others.
Findings Concerning the Intensive Methods as an Intervention
Of the 41 studies, 7 (17%) [21,23,26,31,32,34,71] investigated the impact of intensive longitudinal methods as an intervention tool to improve symptoms, for instance, by providing automated self-care advice to patients or alerting clinicians when a certain symptom threshold was reached [71]. Patients in the intervention groups reported lower distress [21], lower fatigue, and higher levels of hand-foot syndrome [32] than those in the control groups. Patient-reported benefits included improved communication with health care professionals and symptom management and reassurance that symptoms were being monitored at home [31]. After the intervention, patients reported increased quality of life [21,23], lower anxiety and drowsiness, lower pain [34], and higher self-care efficacy [71] than at the baseline. One study using clinician alerts [26] found no improvements in symptom severity, explained by clinicians rarely contacting patients after alerts.
Response-Related Results
Of the 41 studies, 21 (51%) [22-26,33,34,37,40,43-50,52-54,56-58,63,65-67,69-71] reported participation rates ranging from 23.6% to 90.3% (mean 52.9, SD 3.4; Table 3; Multimedia Appendix 4) [21-72]. Overall, 17 (41%) studies [23,25,26,30,34,35,37-40,43,44,51,55,61,63,64,71] reported attrition rates, ranging from 0% to 56.9% (mean 19.7%, SD 17.7%). Furthermore, 19 (46%) studies [22,27,28,31-33,36,45-50,52-54,56-60,62,65-70,76] provided other attrition indicators, while 29 (71%) studies [22-27,33-35,40,42,43,45-47,50-67,69,70,72] reported compliance rates ranging from 44.2% to 98% (mean 74.9%, SD 16.4%).
Table 3.
Response-related results of the included studies (n=41).
Results and characteristics | Frequency of studies, n (%) | Reference, year | |
Participation rate | |||
|
23%-25% | 3 (7) | |
|
26%-50% | 8 (20) | |
|
51%-75% | 4 (10) | |
|
76%-90% | 6 (15) | |
|
Not mentioned | 19 (46) |
|
Attrition rate | |||
|
0%-25% | 12 (29) | |
|
26%-57% | 6 (15) | |
|
Other indicators mentioned | 18 (44) |
|
|
None mentioned | 5 (12) | |
Compliance rate | |||
|
44%-60% | 6 (15) | |
|
61%-80% | 10 (24) | |
|
81%-100% | 13 (32) |
|
|
Other indicators mentioned | 6 (15) | |
|
Not mentioned | 6 (15) | |
Monetary incentives | |||
|
Amount based on the number of completed assessments | 6 (15) |
|
|
Fixed amount | 5 (12) | |
|
None provided | 2 (5) | |
|
Not specified | 28 (68) |
|
Overall, 32% (13/41) of the studies provided monetary incentives, of which 8 (62%) studies [25,45-50,54,55,59,69,70] based attainable monetary amounts on the number of completed assessments, while 5 (38%) [38,39,51,52,56-58,65,66,72] provided patients with fixed amounts. Attainable monetary amounts ranged from US $40 to $200.
Barriers and Facilitators
Most studies reported the barriers and facilitators regarding the implementation of their methods in research or clinical practice (Table 4), either related to the person with cancer or the methods themselves. Some facilitating person-related factors included having confidence in using technology systems [31,56] and recognizing its clinical benefits [28,30,60]. Some person-related barriers were lack of smartphone ownership [40,61] and discomfort with technology [30,45-47,71]. However, inexperience with technology generally did not impact success with the study technologies [25,28,31,35]. However, smartphone users had higher compliance during an SMS protocol than basic phone users [37].
Table 4.
Barriers and facilitators for the implementation of the method in practice and for research purposes, as stated by the papers’ authors or extracted from the reported results.
Themes | Facilitators | Barriers |
Factors related to the person with breast or lung cancer |
|
|
Factors related to the method |
|
|
Other factors | —c |
aEMA: ecological momentary assessment.
bPROM: patient-reported outcome measure.
cNot applicable.
Some facilitating method-related factors included the ability to tailor sampling schedules to the population of interest [53,55,67] and the option to use reminders [21,31,36,54,57,58,61]. Some barriers included technical issues such as empty batteries leading to memory loss and missing data [38,45,46,51] and false-positive clinician alerts due to faulty responding and transmission problems [33,37]. All these factors were associated with improvements in participation and compliance rates, user-experience, patient burden, quality of responses, time requirements for researchers, and adoption in clinical settings [21,22,25-34,36-38,40,42-48,51,55-58,60,61,67,69,71].
Discussion
Principal Findings
Intensive longitudinal methods with daily electronic assessments have been used among people with breast or lung cancer at different disease stages. The methods involved 1-6 assessments per day to study a wide range of experiences in daily life, primarily physical and psychological symptoms. Some studies integrated supportive features within the longitudinal assessments. For most studies, compliance and attrition rates were acceptable, although many studies lacked complete methodological reporting. Few studies focused on patients in the advanced stage of disease. We identified the barriers and facilitators for using these methods, related to both the person with cancer and the method itself.
Our review highlights the promise of intensive longitudinal methods to provide unique insights into the daily lives of people living with cancer. Importantly, these methods generally seem feasible and acceptable among patients with breast or lung cancer, supported by positive patient and health care professional experiences, along with compliance and attrition rates indicating acceptable amounts of missing data. These findings were true for different methodological approaches, such as studies that assessed patients once or multiple times daily. Moreover, these methods demonstrate flexibility as they were used to address an array of objectives, such as exploring within-person symptom associations [55] or communication patterns in dyads [63].
Before widespread implementation of these intensive methods in oncology research and practice, several of our findings encourage further investigation into its feasibility and optimal study conditions. First of all, it is striking that response- and methodology-related reporting was often incomplete or reported in different ways (eg, compliance rates and amount of questionnaire items). Standardized reports of this information are critical to inform optimal methodological choices in future studies or clinical procedures, as poor choices can lead to additional patient burden and missing data. Due to the unstandardized reporting by many included studies, comparisons in response-related results between studies with different methodological features were not possible in this review. Yet, such comparisons are particularly important when using intensive sampling methods in populations who are already susceptible to increased disease-related burden. In addition, several identified factors need further exploration to enhance the implementation of intensive longitudinal methods with daily electronic assessments in research and practice, for example, participants’ feelings of inexperience and discomfort with technology leading to a lower likelihood to participate in the study [30,45-47,71]. Finally, low participation rates of the included studies indicate participant recruitment to be difficult, and sample sizes were often small. This is a major barrier for research, as it could lead to sampling bias, for instance, through self-selected sampling of people more confident or experienced in using electronic systems. Subsequently, this could limit the validity of study findings.
Our review identified understudied areas that prevent gaining a complete understanding of people with breast or lung cancer and their daily experiences. First, several populations of people with breast or lung cancer are currently underrepresented in intensive longitudinal method studies, which significantly limits the generalizability of findings for these populations, including findings on the feasibility of these methods. For instance, of the 41 studies, only 4 (10%) were conducted in people with lung cancer specifically, 6 (15%) studies were conducted in people with stage IV cancer specifically, 1 (2%) study was conducted in a low-income country, and only 1 (2%) study included 1 male participant with breast cancer. Second, although the study objectives varied widely, studies predominantly focused on the aspects of physical health, such as pain, or had rather clinical views on psychological constructs by focusing on depression and anxiety. Only one included study [62] covered experiences from spiritual or existential quality of life domains, which is remarkable because these experiences generally have increasing value at the end of life [5,6]. Furthermore, although ESMs offer the potential for linking patient experiences with concurrent contexts (eg, where the patient is and what they are doing) [12], these contextual aspects remain understudied among people with breast or lung cancer. A broader focus encompassing different domains and contexts is needed to gain a more comprehensive understanding of patients’ quality of life and well-being, ultimately enabling the improvement of patient-centered care.
Implications for Practice and Research
On the basis of our findings, we provide several recommendations for practice and research. First, applying existing reporting guidelines for EMAs, such as those synthesized by Liao et al [80], can improve transparency and consistency in reporting for intensive longitudinal studies in oncology. Their checklist serves as a starting point to fulfill recommended reporting criteria, such as reporting the use of prompts and complete questionnaire information [81]. This will allow future researchers to accurately explore the effects of study features on response-related results.
Second, addressing implementation factors highlighted in this review can be achieved through simple solutions, such as providing clear instructions, training on the use of the methods, and emphasizing the importance of the study to increase patient motivation and confidence [25,28-31,37,56,60]. Moreover, extensive pretesting such as conducting a pilot study is essential to uncover any technical issues that may arise.
Third, it is essential to determine optimal conditions for using intensive longitudinal methods with daily electronic assessments in people with cancer, such as ideal sampling schemes for the feasible measurement of specific constructs [82,83]. Studies should focus on populations at an increased risk for symptom burden, such as those with advanced stage cancer [84,85]. Furthermore, the use of supportive features such as automated feedback and clinician alerts needs more investigation to explore how it is optimally implemented in routine clinical practice for the best possible outcomes. Moreover, it is recommended to develop measures to examine the quality of responses provided by patients [86], as these could be influenced by cancer and its treatment (eg, through cognitive impairment).
Fourth, future studies among patients with breast and lung cancers could broaden their focus to encompass more nonclinical psychological or spiritual-existential topics and contextual factors. This approach could yield novel insights into the interplay between physical functioning and other aspects of well-being and how they vary in different contexts [8]. Researchers could look to other populations of people living with or beyond cancer to further inform on the possibilities of these methods. For example, studies involving survivors of cancer could have a less clinical focus due to living past the treatment stage. Future literature reviews of the use of daily methods among such populations would be greatly beneficial.
Finally, studies should further explore how multiple daily measurements compare with the same constructs as measured by the more commonly used patient-reported outcome measures in oncology, in which patients are expected to aggregate experiences over ≥1 weeks [87,88]. Such research could examine the ecological validity of these commonly used patient-reported outcome measures [59] and provide valuable insights for oncology research and practice regarding which experiences are more accurately measured on a more frequent basis.
Strengths and Limitations
This scoping review followed a broad systematic search strategy in multiple databases, incorporating studies that used self-report methods to assess patients daily or multiple times a day. Consequently, it offers a comprehensive overview of the methods used to gain insight into the daily experiences of people with breast and lung cancers at various stages across different countries.
Nevertheless, this review has limitations. First, it is plausible that we missed studies that used different terms for their daily electronic self-report questionnaire than those used in our search string. However, the broadness of our search string minimized this risk, and we detected articles that reported on methods that could be classified as ESMs but were not identified by the previous review in 2019 [12]. Second, only 10% of data extraction was checked by a second reviewer, and none were compared during the updated search, introducing a slight possibility of inaccuracies. We consider this a minor risk, as we found no disagreements in the 10% data that we had checked.
Conclusions
Intensive longitudinal methods using daily electronic assessments hold promise and can be feasible to provide unique insights into the daily lives of patients with breast or lung cancer. However, our findings encourage further research on the feasibility of determining optimal conditions for intensive monitoring, specifically in more advanced disease stages, and better adherence to standardized reporting guidelines. Moreover, considering a more multidimensional approach to the topics studied, especially beyond physical and psychopathological symptoms, will enhance the value of these methods, ultimately aiding in the improvement of patient-centered care in oncology.
Acknowledgments
The authors would like to thank Lise Rosquin for her valuable comments on the manuscript. This work is part of a wider study funded by the Research Foundation-Flanders (FWO), under grant agreement (G0C8120N). LP is a senior postdoctoral fellow of the Research Foundation-Flanders. LVdB holds the Collen-Francqui Research Professor Chair “Aging, dementia and palliative care” (2020-2023).
Abbreviations
- EMA
ecological momentary assessment
- EORTC-QLQ-C30
EORTC Core Quality of Life Questionnaire
- ESM
experience sampling methods
- PRISMA-ScR
Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for Scoping Reviews
Search terms.
Study and sample characteristics.
Content and design characteristics.
Response-related characteristics.
PRISMA Scoping Review Checklist.
Footnotes
Authors' Contributions: All authors contributed to the conception and design of the study. JG and KdN acquired and interpreted the data. JG drafted the manuscript. All authors reviewed the final draft and provided the final approval.
Conflicts of Interest: None declared.
References
- 1.Ferlay J, Colombet M, Soerjomataram I, Parkin DM, Piñeros M, Znaor A, Bray F. Cancer statistics for the year 2020: an overview. Int J Cancer. 2021 Apr 05; doi: 10.1002/ijc.33588. (forthcoming) https://onlinelibrary.wiley.com/doi/10.1002/ijc.33588. [DOI] [PubMed] [Google Scholar]
- 2.Lam S, William L, Poon P. Acute cancer pain syndromes in palliative care emergencies. In: MacLeod R, van den Block L, editors. Textbook of Palliative Care. Cham, Switzerland: Springer International Publishing; 2018. [Google Scholar]
- 3.Henson LA, Maddocks M, Evans C, Davidson M, Hicks S, Higginson IJ. Palliative care and the management of common distressing symptoms in advanced cancer: pain, breathlessness, nausea and vomiting, and fatigue. J Clin Oncol. 2020 Mar 20;38(9):905–14. doi: 10.1200/JCO.19.00470. doi: 10.1200/JCO.19.00470. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Caruso R, Nanni MG, Riba MB, Sabato S, Grassi L. The burden of psychosocial morbidity related to cancer: patient and family issues. Int Rev Psychiatry. 2017 Oct;29(5):389–402. doi: 10.1080/09540261.2017.1288090. doi: 10.1080/09540261.2017.1288090. [DOI] [PubMed] [Google Scholar]
- 5.Selman LE, Brighton LJ, Sinclair S, Karvinen I, Egan R, Speck P, Powell RA, Deskur-Smielecka E, Glajchen M, Adler S, Puchalski C, Hunter J, Gikaara N, Hope J. Patients' and caregivers' needs, experiences, preferences and research priorities in spiritual care: a focus group study across nine countries. Palliat Med. 2018 Jan 12;32(1):216–30. doi: 10.1177/0269216317734954. https://journals.sagepub.com/doi/abs/10.1177/0269216317734954?url_ver=Z39.88-2003&rfr_id=ori:rid:crossref.org&rfr_dat=cr_pub0pubmed . [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Cohen SR, Mount BM, Tomas JJ, Mount LF. Existential well-being is an important determinant of quality of life: evidence from the McGill quality of life questionnaire. Cancer. 1996 Feb 1;77(3):576–86. doi: 10.1002/(SICI)1097-0142(19960201)77:3<576::AID-CNCR22>3.0.CO;2-0. doi: 10.1002/(SICI)1097-0142(19960201)77:3<576::AID-CNCR22>3.0.CO;2-0. [DOI] [PubMed] [Google Scholar]
- 7.Bos FM, Schoevers RA, aan het Rot M. Experience sampling and ecological momentary assessment studies in psychopharmacology: a systematic review. Eur Neuropsychopharmacol. 2015 Nov;25(11):1853–64. doi: 10.1016/j.euroneuro.2015.08.008. doi: 10.1016/j.euroneuro.2015.08.008.S0924-977X(15)00261-8 [DOI] [PubMed] [Google Scholar]
- 8.van Knippenberg RJ, de Vugt ME, Ponds RW, Myin-Germeys I, van Twillert B, Verhey FR. Dealing with daily challenges in dementia (deal-id study): an experience sampling study to assess caregiver functioning in the flow of daily life. Int J Geriatr Psychiatry. 2017 Sep;32(9):949–58. doi: 10.1002/gps.4552. doi: 10.1002/gps.4552. [DOI] [PubMed] [Google Scholar]
- 9.Bolger N, Laurenceau JP. Intensive Longitudinal Methods: An Introduction to Diary and Experience Sampling Research. New York, NY: Guilford Press; 2013. [Google Scholar]
- 10.Aiello EJ, Taplin S, Reid R, Hobbs M, Seger D, Kamel H, Tufano J, Ballard-Barbash R. In a randomized controlled trial, patients preferred electronic data collection of breast cancer risk-factor information in a mammography setting. J Clin Epidemiol. 2006 Jan;59(1):77–81. doi: 10.1016/j.jclinepi.2005.07.007. doi: 10.1016/j.jclinepi.2005.07.007.S0895-4356(05)00248-9 [DOI] [PubMed] [Google Scholar]
- 11.Stone AA, Shiffman S, Schwartz JE, Broderick JE, Hufford MR. Patient compliance with paper and electronic diaries. Control Clin Trial. 2003 Apr;24(2):182–99. doi: 10.1016/S0197-2456(02)00320-3. doi: 10.1016/S0197-2456(02)00320-3. [DOI] [PubMed] [Google Scholar]
- 12.Kampshoff CS, Verdonck-de Leeuw IM, van Oijen MG, Sprangers MA, Buffart LM. Ecological momentary assessments among patients with cancer: a scoping review. Eur J Cancer Care (Engl) 2019 May 14;28(3):e13095. doi: 10.1111/ecc.13095. https://europepmc.org/abstract/MED/31090160 . [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Jim HS, Hoogland AI, Brownstein NC, Barata A, Dicker AP, Knoop H, Gonzalez BD, Perkins R, Rollison D, Gilbert SM, Nanda R, Berglund A, Mitchell R, Johnstone PA. Innovations in research and clinical care using patient-generated health data. CA Cancer J Clin. 2020 May;70(3):182–99. doi: 10.3322/caac.21608. https://europepmc.org/abstract/MED/32311776 . [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Paterson C, Armitage L, Turner M. Current landscape of ecological momentary assessment (real-time data) methodology in cancer research: a systematic review. Semin Oncol Nurs. 2023 Dec;39(6):151514. doi: 10.1016/j.soncn.2023.151514. https://linkinghub.elsevier.com/retrieve/pii/S0749-2081(23)00163-8 .S0749-2081(23)00163-8 [DOI] [PubMed] [Google Scholar]
- 15.Geeraerts J, Pivodic L, De Nooijer K, Naert E, Crombez G, De Ridder M, Van den Block L. Investigating experiences of people with advanced breast or lung cancer in their natural context: protocol for an experience sampling study. BMJ Open. 2024 Feb 14;14(2):e075752. doi: 10.1136/bmjopen-2023-075752. https://bmjopen.bmj.com/lookup/pmidlookup?view=long&pmid=38355197 .bmjopen-2023-075752 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Munn Z, Peters MD, Stern C, Tufanaru C, McArthur A, Aromataris E. Systematic review or scoping review? Guidance for authors when choosing between a systematic or scoping review approach. BMC Med Res Methodol. 2018 Nov 19;18(1):143. doi: 10.1186/s12874-018-0611-x. https://bmcmedresmethodol.biomedcentral.com/articles/10.1186/s12874-018-0611-x .10.1186/s12874-018-0611-x [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Arksey H, O'Malley L. Scoping studies: towards a methodological framework. Int J Soc Res Methodol. 2005 Feb;8(1):19–32. doi: 10.1080/1364557032000119616. doi: 10.1080/1364557032000119616. [DOI] [Google Scholar]
- 18.Tricco AC, Lillie E, Zarin W, O'Brien KK, Colquhoun H, Levac D, Moher D, Peters MD, Horsley T, Weeks L, Hempel S, Akl EA, Chang C, McGowan J, Stewart L, Hartling L, Aldcroft A, Wilson MG, Garritty C, Lewin S, Godfrey CM, Macdonald MT, Langlois EV, Soares-Weiser K, Moriarty J, Clifford T, Tunçalp Ö, Straus SE. PRISMA extension for scoping reviews (PRISMA-ScR): checklist and explanation. Ann Intern Med. 2018 Oct 02;169(7):467–73. doi: 10.7326/M18-0850. https://www.acpjournals.org/doi/abs/10.7326/M18-0850?url_ver=Z39.88-2003&rfr_id=ori:rid:crossref.org&rfr_dat=cr_pub0pubmed .2700389 [DOI] [PubMed] [Google Scholar]
- 19.EndNote: Office 2013 compatibility. Clarivate. 2022. Jun 15, [2024-05-24]. https://support.clarivate.com/Endnote/s/article/EndNote-Office-20132016-Compatibility?language=en_US .
- 20.Ouzzani M, Hammady H, Fedorowicz Z, Elmagarmid A. Rayyan-a web and mobile app for systematic reviews. Syst Rev. 2016 Dec 05;5(1):210. doi: 10.1186/s13643-016-0384-4. https://systematicreviewsjournal.biomedcentral.com/articles/10.1186/s13643-016-0384-4 .10.1186/s13643-016-0384-4 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Çınar D, Karadakovan A, Erdoğan AP. Effect of mobile phone app-based training on the quality of life for women with breast cancer. Eur J Oncol Nurs. 2021 Jun;52:101960. doi: 10.1016/j.ejon.2021.101960. doi: 10.1016/j.ejon.2021.101960.S1462-3889(21)00066-1 [DOI] [PubMed] [Google Scholar]
- 22.Aigner CJ, Cinciripini PM, Anderson KO, Baum GP, Gritz ER, Lam CY. The association of pain with smoking and quit attempts in an electronic diary study of cancer patients trying to quit. Nicotine Tob Res. 2016 Jun;18(6):1449–55. doi: 10.1093/ntr/ntv118. https://europepmc.org/abstract/MED/26038362 .ntv118 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Chumbler NR, Mkanta WN, Richardson LC, Harris L, Darkins A, Kobb R, Ryan P. Remote patient-provider communication and quality of life: empirical test of a dialogic model of cancer care. J Telemed Telecare. 2007;13(1):20–5. doi: 10.1258/135763307779701112. doi: 10.1258/135763307779701112. [DOI] [PubMed] [Google Scholar]
- 24.Harper FW, Heath EI, Gleason ME, Penner L, Lorusso P, Wang D, Albrecht TL. Physicians' use of patients' daily reports of quality of life to evaluate treatment response in phase I cancer trials. J Cancer Ther. 2012 Oct;3(5):582–8. doi: 10.4236/jct.2012.35074. https://europepmc.org/abstract/MED/24058742 . [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.Langer SL, Romano JM, Todd M, Strauman TJ, Keefe FJ, Syrjala KL, Bricker JB, Ghosh N, Burns JW, Bolger N, Puleo BK, Gralow JR, Shankaran V, Westbrook K, Zafar SY, Porter LS. Links between communication and relationship satisfaction among patients with cancer and their spouses: results of a fourteen-day smartphone-based ecological momentary assessment study. Front Psychol. 2018;9:1843. doi: 10.3389/fpsyg.2018.01843. https://europepmc.org/abstract/MED/30364167 . [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Mooney KH, Beck SL, Friedman RH, Farzanfar R, Wong B. Automated monitoring of symptoms during ambulatory chemotherapy and oncology providers' use of the information: a randomized controlled clinical trial. Support Care Cancer. 2014 Sep;22(9):2343–50. doi: 10.1007/s00520-014-2216-1. https://europepmc.org/abstract/MED/24687538 . [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27.van den Berg L, Brouwer P, Panda N, Hoogbergen M, Solsky I, Onnela JP, Haynes AB, Sidey-Gibbons CJ. Feasibility and performance of smartphone-based daily micro-surveys among patients recovering from cancer surgery. Qual Life Res. 2022 Feb;31(2):579–87. doi: 10.1007/s11136-021-02934-x. doi: 10.1007/s11136-021-02934-x.10.1007/s11136-021-02934-x [DOI] [PubMed] [Google Scholar]
- 28.Kearney N, Kidd L, Miller M, Sage M, Khorrami J, McGee M, Cassidy J, Niven K, Gray P. Utilising handheld computers to monitor and support patients receiving chemotherapy: results of a UK-based feasibility study. Support Care Cancer. 2006 Jul;14(7):742–52. doi: 10.1007/s00520-005-0002-9. doi: 10.1007/s00520-005-0002-9. [DOI] [PubMed] [Google Scholar]
- 29.Maguire R, Miller M, Sage M, Norrie J, McCann L, Taylor L, Kearney N. Results of a UK based pilot study of a mobile phone based advanced symptom management system (ASyMS) in the remote monitoring of chemotherapy related toxicity. Clin Eff Nurs. 2005 Sep;9(3-4):202–10. doi: 10.1016/j.cein.2006.08.013. doi: 10.1016/j.cein.2006.08.013. [DOI] [Google Scholar]
- 30.McCall K, Keen J, Farrer K, Maguire R, McCann L, Johnston B, McGill M, Sage M, Kearney N. Perceptions of the use of a remote monitoring system in patients receiving palliative care at home. Int J Palliat Nurs. 2008 Sep;14(9):426–31. doi: 10.12968/ijpn.2008.14.9.31121. doi: 10.12968/ijpn.2008.14.9.31121. [DOI] [PubMed] [Google Scholar]
- 31.McCann L, Maguire R, Miller M, Kearney N. Patients' perceptions and experiences of using a mobile phone-based advanced symptom management system (ASyMS) to monitor and manage chemotherapy related toxicity. Eur J Cancer Care (Engl) 2009 Mar;18(2):156–64. doi: 10.1111/j.1365-2354.2008.00938.x. doi: 10.1111/j.1365-2354.2008.00938.x.ECC938 [DOI] [PubMed] [Google Scholar]
- 32.Kearney N, McCann L, Norrie J, Taylor L, Gray P, McGee-Lennon M, Sage M, Miller M, Maguire R. Evaluation of a mobile phone-based, advanced symptom management system (ASyMS) in the management of chemotherapy-related toxicity. Support Care Cancer. 2009 Apr;17(4):437–44. doi: 10.1007/s00520-008-0515-0. https://strathprints.strath.ac.uk/69319/ [DOI] [PubMed] [Google Scholar]
- 33.Weaver A, Love SB, Larsen M, Shanyinde M, Waters R, Grainger L, Shearwood V, Brooks C, Gibson O, Young AM, Tarassenko L. A pilot study: dose adaptation of capecitabine using mobile phone toxicity monitoring - supporting patients in their homes. Support Care Cancer. 2014 Oct;22(10):2677–85. doi: 10.1007/s00520-014-2224-1. doi: 10.1007/s00520-014-2224-1. [DOI] [PubMed] [Google Scholar]
- 34.Besse KT, Faber-te Boveldt ND, Janssen GH, Vernooij-Dassen M, Vissers KC, Engels Y. Pain assessment with short message service and interactive voice response in outpatients with cancer and pain: a feasibility study. Pain Pract. 2016 Mar;16(3):320–6. doi: 10.1111/papr.12278. doi: 10.1111/papr.12278. [DOI] [PubMed] [Google Scholar]
- 35.Hachizuka M, Yoshiuchi K, Yamamoto Y, Iwase S, Nakagawa K, Kawagoe K, Akabayashi A. Development of a personal digital assistant (PDA) system to collect symptom information from home hospice patients. J Palliat Med. 2010 Jun;13(6):647–51. doi: 10.1089/jpm.2009.0350. doi: 10.1089/jpm.2009.0350. [DOI] [PubMed] [Google Scholar]
- 36.Passardi A, Foca F, Caffo O, Tondini CA, Zambelli A, Vespignani R, Bartolini G, Sullo FG, Andreis D, Dianti M, Eccher C, Piras EM, Forti S. A remote monitoring system to optimize the home management of oral anticancer therapies (ONCO-TreC): prospective training-validation trial. J Med Internet Res. 2022 Jan 26;24(1):e27349. doi: 10.2196/27349. https://www.jmir.org/2022/1/e27349/ v24i1e27349 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37.Yap KY, Low HX, Koh KS, Un M, Shih V, Chan A. Feasibility and acceptance of a pharmacist-run tele-oncology service for chemotherapy-induced nausea and vomiting in ambulatory cancer patients. Telemed J E Health. 2013 May;19(5):387–95. doi: 10.1089/tmj.2012.0136. doi: 10.1089/tmj.2012.0136. [DOI] [PubMed] [Google Scholar]
- 38.LeBaron V, Alam R, Bennett R, Blackhall L, Gordon K, Hayes J, Homdee N, Jones R, Lichti K, Martinez Y, Mohammadi S, Ogunjirin E, Patel N, Lach J. Deploying the behavioral and environmental sensing and intervention for cancer smart health system to support patients and family caregivers in managing pain: feasibility and acceptability study. JMIR Cancer. 2022 Aug 09;8(3):e36879. doi: 10.2196/36879. https://cancer.jmir.org/2022/3/e36879/ v8i3e36879 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 39.LeBaron V, Homdee N, Ogunjirin E, Patel N, Blackhall L, Lach J. Describing and visualizing the patient and caregiver experience of cancer pain in the home context using ecological momentary assessments. Digit Health. 2023;9:20552076231194936. doi: 10.1177/20552076231194936. https://journals.sagepub.com/doi/10.1177/20552076231194936?url_ver=Z39.88-2003&rfr_id=ori:rid:crossref.org&rfr_dat=cr_pub0pubmed .10.1177_20552076231194936 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 40.Coolbrandt A, Muylaert K, Vandeneede E, Dooms C, Wildiers H. Remote system for daily symptom monitoring during systemic anticancer treatment. Cancer Nurs. 2021 Aug 5;45(4):E758–65. doi: 10.1097/NCC.0000000000000999. doi: 10.1097/NCC.0000000000000999. [DOI] [PubMed] [Google Scholar]
- 41.Lee MK, Basch E, Mitchell SA, Minasian LM, Langlais BT, Thanarajasingam G, Ginos BF, Rogak LJ, Mendoza TR, Bennett AV, Schrag D, Mazza GL, Dueck AC. Reliability and validity of PRO-CTCAE® daily reporting with a 24-hour recall period. Qual Life Res. 2023 Jul;32(7):2047–58. doi: 10.1007/s11136-023-03374-5. https://europepmc.org/abstract/MED/36897529 .10.1007/s11136-023-03374-5 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 42.Nordhausen T, Lampe K, Vordermark D, Holzner B, Al-Ali HK, Meyer G, Schmidt H. An implementation study of electronic assessment of patient-reported outcomes in inpatient radiation oncology. J Patient Rep Outcomes. 2022 Jul 19;6(1):77. doi: 10.1186/s41687-022-00478-3. doi: 10.1186/s41687-022-00478-3.10.1186/s41687-022-00478-3 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 43.Schuler T, King C, Matsveru T, Back M, Clark K, Chin D, Lilian R, Gallego B, Coiera E, Currow DC. Wearable-triggered ecological momentary assessments are feasible in people with advanced cancer and their family caregivers: feasibility study from an outpatient palliative care clinic at a cancer center. J Palliat Med. 2023 Jul;26(7):980–5. doi: 10.1089/jpm.2022.0535. doi: 10.1089/jpm.2022.0535. [DOI] [PubMed] [Google Scholar]
- 44.van Roozendaal AS, Schellekens MP, van Woezik RA, van der Lee ML. Exploring the dynamic interconnectedness of protective and perpetuating factors of cancer-related fatigue. Psychooncology. 2023 Dec;32(12):1876–84. doi: 10.1002/pon.6235. doi: 10.1002/pon.6235. [DOI] [PubMed] [Google Scholar]
- 45.Badr H, Laurenceau JP, Schart L, Basen-Engquist K, Turk D. The daily impact of pain from metastatic breast cancer on spousal relationships: a dyadic electronic diary study. Pain. 2010 Dec;151(3):644–54. doi: 10.1016/j.pain.2010.08.022. doi: 10.1016/j.pain.2010.08.022.00006396-201012000-00016 [DOI] [PubMed] [Google Scholar]
- 46.Badr H, Pasipanodya EC, Laurenceau JP. An electronic diary study of the effects of patient avoidance and partner social constraints on patient momentary affect in metastatic breast cancer. Ann Behav Med. 2013 Apr;45(2):192–202. doi: 10.1007/s12160-012-9436-8. doi: 10.1007/s12160-012-9436-8. [DOI] [PubMed] [Google Scholar]
- 47.Stephenson E, DeLongis A, Bruel B, Badr H. Outpatient pain medication use: an electronic daily diary study in metastatic breast cancer. J Pain Symptom Manage. 2018 Apr;55(4):1131–7. doi: 10.1016/j.jpainsymman.2017.11.032. https://linkinghub.elsevier.com/retrieve/pii/S0885-3924(17)30697-8 .S0885-3924(17)30697-8 [DOI] [PubMed] [Google Scholar]
- 48.Belcher AJ, Laurenceau JP, Graber EC, Cohen LH, Dasch KB, Siegel SD. Daily support in couples coping with early stage breast cancer: maintaining intimacy during adversity. Health Psychol. 2011 Nov;30(6):665–73. doi: 10.1037/a0024705. doi: 10.1037/a0024705.2011-17047-001 [DOI] [PubMed] [Google Scholar]
- 49.Pasipanodya EC, Parrish BP, Laurenceau JP, Cohen LH, Siegel SD, Graber EC, Belcher AJ. Social constraints on disclosure predict daily well-being in couples coping with early-stage breast cancer. J Fam Psychol. 2012 Aug;26(4):661–7. doi: 10.1037/a0028655. doi: 10.1037/a0028655.2012-14969-001 [DOI] [PubMed] [Google Scholar]
- 50.Otto AK, Laurenceau JP, Siegel SD, Belcher AJ. Capitalizing on everyday positive events uniquely predicts daily intimacy and well-being in couples coping with breast cancer. J Fam Psychol. 2015 Feb;29(1):69–79. doi: 10.1037/fam0000042. https://europepmc.org/abstract/MED/25528074 .2014-56433-001 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 51.Cai L, Boukhechba M, Gerber MS, Barnes LE, Showalter SL, Cohn WF, Chow PiI. An integrated framework for using mobile sensing to understand response to mobile interventions among breast cancer patients. Smart Health. 2020 Mar;15:100086. doi: 10.1016/j.smhl.2019.100086. doi: 10.1016/j.smhl.2019.100086. [DOI] [Google Scholar]
- 52.Carson JW, Carson KM, Olsen M, Sanders L, Westbrook K, Keefe FJ, Porter LS. Yoga practice predicts improvements in day-to-day pain in women with metastatic breast cancer. J Pain Symptom Manage. 2021 Jun;61(6):1227–33. doi: 10.1016/j.jpainsymman.2020.10.009. https://europepmc.org/abstract/MED/33065208 .S0885-3924(20)30804-6 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 53.Dasch KB, Cohen LH, Belcher A, Laurenceau JP, Kendall J, Siegel S, Parrish B, Graber E. Affective differentiation in breast cancer patients. J Behav Med. 2010 Dec;33(6):441–53. doi: 10.1007/s10865-010-9274-8. doi: 10.1007/s10865-010-9274-8. [DOI] [PubMed] [Google Scholar]
- 54.Pinto BM, Kindred MD, Dunsiger SI, Williams DM. Sedentary behavior among breast cancer survivors: a longitudinal study using ecological momentary assessments. J Cancer Surviv. 2021 Aug;15(4):546–53. doi: 10.1007/s11764-020-00948-x. doi: 10.1007/s11764-020-00948-x.10.1007/s11764-020-00948-x [DOI] [PubMed] [Google Scholar]
- 55.Ratcliff CG, Lam CY, Arun B, Valero V, Cohen L. Ecological momentary assessment of sleep, symptoms, and mood during chemotherapy for breast cancer. Psychooncology. 2014 Nov;23(11):1220–8. doi: 10.1002/pon.3525. https://europepmc.org/abstract/MED/24706506 . [DOI] [PMC free article] [PubMed] [Google Scholar]
- 56.Solk P, Gavin K, Fanning J, Welch W, Lloyd G, Cottrell A, Nielsen A, Santa Maria CA, Gradishar W, Khan SA, Kulkarni S, Siddique J, Phillips SM. Feasibility and acceptability of intensive longitudinal data collection of activity and patient-reported outcomes during chemotherapy for breast cancer. Qual Life Res. 2019 Dec;28(12):3333–46. doi: 10.1007/s11136-019-02278-7. doi: 10.1007/s11136-019-02278-7.10.1007/s11136-019-02278-7 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 57.Phillips SM, Welch WA, Fanning J, Santa-Maria CA, Gavin KL, Auster-Gussman LA, Solk P, Lu M, Cullather E, Khan SA, Kulkarni SA, Gradishar W, Siddique J. Daily physical activity and symptom reporting in breast cancer patients undergoing chemotherapy: an intensive longitudinal examination. Cancer Epidemiol Biomarkers Prev. 2020 Dec;29(12):2608–16. doi: 10.1158/1055-9965.EPI-20-0659. https://europepmc.org/abstract/MED/32994340 .1055-9965.EPI-20-0659 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 58.Auster-Gussman LA, Gavin KL, Siddique J, Welch WA, Solk P, Whitaker M, Cullather E, Fanning J, Maria CS, Gradishar W, Khan S, Kulkarni S, Phillips SM. Social cognitive variables and physical activity during chemotherapy for breast cancer: an intensive longitudinal examination. Psychooncology. 2022 Mar;31(3):425–35. doi: 10.1002/pon.5820. doi: 10.1002/pon.5820. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 59.Stone AA, Broderick JE, Junghaenel DU, Schneider S, Schwartz JE. PROMIS fatigue, pain intensity, pain interference, pain behavior, physical function, depression, anxiety, and anger scales demonstrate ecological validity. J Clin Epidemiol. 2016 Jun;74:194–206. doi: 10.1016/j.jclinepi.2015.08.029. doi: 10.1016/j.jclinepi.2015.08.029.S0895-4356(15)00546-6 [DOI] [PubMed] [Google Scholar]
- 60.Kim J, Lim S, Min YH, Shin YW, Lee B, Sohn G, Jung KH, Lee JH, Son BH, Ahn SH, Shin SY, Lee JW. Depression screening using daily mental-health ratings from a smartphone application for breast cancer patients. J Med Internet Res. 2016 Aug 04;18(8):e216. doi: 10.2196/jmir.5598. https://www.jmir.org/2016/8/e216/ v18i8e216 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 61.Min YH, Lee JW, Shin YW, Jo MW, Sohn G, Lee JH, Lee G, Jung KH, Sung J, Ko BS, Yu JH, Kim HJ, Son BH, Ahn SH. Daily collection of self-reporting sleep disturbance data via a smartphone app in breast cancer patients receiving chemotherapy: a feasibility study. J Med Internet Res. 2014 May 23;16(5):e135. doi: 10.2196/jmir.3421. https://www.jmir.org/2014/5/e135/ v16i5e135 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 62.Sztachańska J, Krejtz I, Nezlek JB. Using a gratitude intervention to improve the lives of women with breast cancer: a daily diary study. Front Psychol. 2019;10:1365. doi: 10.3389/fpsyg.2019.01365. https://europepmc.org/abstract/MED/31249544 . [DOI] [PMC free article] [PubMed] [Google Scholar]
- 63.Xu W, Wang J, Schoebi D. The role of daily couple communication in the relationship between illness representation and fear of cancer recurrence in breast cancer survivors and their spouses. Psychooncology. 2019 Jun;28(6):1301–7. doi: 10.1002/pon.5082. doi: 10.1002/pon.5082. [DOI] [PubMed] [Google Scholar]
- 64.Lim E, Boyle F, Okera M, Loi S, Goksu SS, van Hal G, Chapman SC, Gable JC, Chen Y, Price GL, Hossain AM, Gainford MC, Ezquerra MB. An open label, randomized phase 2 trial assessing the impact of food on the tolerability of abemaciclib in patients with advanced breast cancer. Breast Cancer Res Treat. 2022 Oct;195(3):275–87. doi: 10.1007/s10549-022-06690-5. https://europepmc.org/abstract/MED/35915198 .10.1007/s10549-022-06690-5 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 65.Welch WA, Solk P, Auster-Gussman L, Whitaker M, Siddique J, Fanning J, Mishory A, Khan S, Santa-Maria C, Kulkarni S, Phillips SM. Longitudinal sedentary time and symptoms in breast cancer patients during chemotherapy using ecological momentary assessment. Med Sci Sports Exerc. 2023 May 01;55(5):966–74. doi: 10.1249/MSS.0000000000003115.00005768-202305000-00021 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 66.Whitaker M, Welch WA, Fanning J, Santa-Maria CA, Auster-Gussman LA, Solk P, Khan SA, Kulkarni SA, Gradishar W, Siddique J, Phillips SM. Using ecological momentary assessment to understand associations between daily physical activity and symptoms in breast cancer patients undergoing chemotherapy. Support Care Cancer. 2022 Aug;30(8):6613–22. doi: 10.1007/s00520-022-07071-w. doi: 10.1007/s00520-022-07071-w.10.1007/s00520-022-07071-w [DOI] [PMC free article] [PubMed] [Google Scholar]
- 67.Shiyko MP, Siembor B, Greene PB, Smyth J, Burkhalter JE. Intra-individual study of mindfulness: ecological momentary perspective in post-surgical lung cancer patients. J Behav Med. 2019 Feb;42(1):102–10. doi: 10.1007/s10865-018-9942-7. doi: 10.1007/s10865-018-9942-7.10.1007/s10865-018-9942-7 [DOI] [PubMed] [Google Scholar]
- 68.Shiyko MP, Burkhalter J, Li R, Park BJ. Modeling nonlinear time-dependent treatment effects: an application of the generalized time-varying effect model (TVEM) J Consult Clin Psychol. 2014 Oct;82(5):760–72. doi: 10.1037/a0035267. https://europepmc.org/abstract/MED/24364799 .2013-44749-001 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 69.Steffen LE, Vowles KE, Smith BW, Gan GN, Edelman MJ. Daily diary study of hope, stigma, and functioning in lung cancer patients. Health Psychol. 2018 Mar;37(3):218–27. doi: 10.1037/hea0000570. https://europepmc.org/abstract/MED/29172604 .2017-52847-001 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 70.Steffen LE, Cheavens JS, Vowles KE, Gabbard J, Nguyen H, Gan GN, Edelman MJ, Smith BW. Hope-related goal cognitions and daily experiences of fatigue, pain, and functional concern among lung cancer patients. Support Care Cancer. 2020 Feb;28(2):827–35. doi: 10.1007/s00520-019-04878-y. https://europepmc.org/abstract/MED/31152302 .10.1007/s00520-019-04878-y [DOI] [PMC free article] [PubMed] [Google Scholar]
- 71.Maguire R, Ream E, Richardson A, Connaghan J, Johnston B, Kotronoulas G, Pedersen V, McPhelim J, Pattison N, Smith A, Webster L, Taylor A, Kearney N. Development of a novel remote patient monitoring system: the advanced symptom management system for radiotherapy to improve the symptom experience of patients with lung cancer receiving radiotherapy. Cancer Nurs. 2015;38(2):E37–47. doi: 10.1097/NCC.0000000000000150. doi: 10.1097/NCC.0000000000000150. [DOI] [PubMed] [Google Scholar]
- 72.Dunsmore VJ, Neupert SD. Coping with 'scanxiety': within-person processes in lung cancer. Psychol Rep. 2023 Mar 25;:332941231164336. doi: 10.1177/00332941231164336. https://journals.sagepub.com/doi/abs/10.1177/00332941231164336?url_ver=Z39.88-2003&rfr_id=ori:rid:crossref.org&rfr_dat=cr_pub0pubmed . [DOI] [PMC free article] [PubMed] [Google Scholar]
- 73.Coolbrandt A, Muylaert K, Vandeneede E, Dooms C, Wildiers H. Real-time symptom management in the context of a remote symptom-monitoring system: prospective process evaluation and cross-sectional survey to explore clinical relevance. Support Care Cancer. 2021 Jun;29(6):3401–8. doi: 10.1007/s00520-021-06029-8. doi: 10.1007/s00520-021-06029-8.10.1007/s00520-021-06029-8 [DOI] [PubMed] [Google Scholar]
- 74.Trotti A, Byhardt R, Stetz J, Gwede C, Corn B, Fu K, Gunderson L, McCormick B, Morrisintegral M, Rich T, Shipley W, Curran W. Common toxicity criteria: version 2.0. an improved reference for grading the acute effects of cancer treatment: impact on radiotherapy. Int J Radiat Oncol Biol Phys. 2000 Apr 01;47(1):13–47. doi: 10.1016/S0360-3016(99)00559-3. doi: 10.1016/S0360-3016(99)00559-3.S0360301699005593 [DOI] [PubMed] [Google Scholar]
- 75.Fayers P, Bottomley A, EORTC Quality of Life Group. Quality of Life Unit Quality of life research within the EORTC-the EORTC QLQ-C30. European Organisation for Research and Treatment of Cancer. Eur J Cancer. 2002 Mar;38 Suppl 4:S125–33. doi: 10.1016/S0959-8049(01)00448-8. doi: 10.1016/S0959-8049(01)00448-8.S0959804901004488 [DOI] [PubMed] [Google Scholar]
- 76.Watson D, Clark LA. The PANAS-X: manual for the positive and negative affect schedule - expanded form. The University of Iowa. 1994. [2024-05-25]. https://iro.uiowa.edu/esploro/outputs/other/9983557488402771#file-0 .
- 77.Kim J, Marcusson-Clavertz D, Yoshiuchi K, Smyth JM. Potential benefits of integrating ecological momentary assessment data into mHealth care systems. Biopsychosoc Med. 2019;13:19. doi: 10.1186/s13030-019-0160-5. https://bpsmedicine.biomedcentral.com/articles/10.1186/s13030-019-0160-5 .160 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 78.Löwe B, Unützer J, Callahan CM, Perkins AJ, Kroenke K. Monitoring depression treatment outcomes with the Patient Health Questionnaire-9. Med Care. 2004 Dec;42(12):1194–201. doi: 10.1097/00005650-200412000-00006. doi: 10.1097/00005650-200412000-00006.00005650-200412000-00006 [DOI] [PubMed] [Google Scholar]
- 79.Ware JE, Sherbourne CD. The MOS 36-item short-form health survey (SF-36). I. Conceptual framework and item selection. Med Care. 1992 Jun;30(6):473–83. [PubMed] [Google Scholar]
- 80.Liao Y, Skelton K, Dunton G, Bruening M. A systematic review of methods and procedures used in ecological momentary assessments of diet and physical activity research in youth: an adapted STROBE Checklist for Reporting EMA Studies (CREMAS) J Med Internet Res. 2016 Jun 21;18(6):e151. doi: 10.2196/jmir.4954. https://www.jmir.org/2016/6/e151/ v18i6e151 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 81.Trull TJ, Ebner-Priemer UW. Ambulatory assessment in psychopathology research: a review of recommended reporting guidelines and current practices. J Abnorm Psychol. 2020 Jan;129(1):56–63. doi: 10.1037/abn0000473. doi: 10.1037/abn0000473.2019-79779-007 [DOI] [PubMed] [Google Scholar]
- 82.Eisele G, Vachon H, Lafit G, Kuppens P, Houben M, Myin-Germeys I, Viechtbauer W. The effects of sampling frequency and questionnaire length on perceived burden, compliance, and careless responding in experience sampling data in a student population. PsyArXiv Preprints. Preprint posted online February 20, 2020. doi: 10.31234/osf.io/zf4nm. https://osf.io/preprints/psyarxiv/zf4nm . [DOI] [PubMed] [Google Scholar]
- 83.Shiffman S, Stone AA, Hufford MR. Ecological momentary assessment. Annu Rev Clin Psychol. 2008;4:1–32. doi: 10.1146/annurev.clinpsy.3.022806.091415. doi: 10.1146/annurev.clinpsy.3.022806.091415. [DOI] [PubMed] [Google Scholar]
- 84.Giesinger JM, Wintner LM, Oberguggenberger AS, Gamper EM, Fiegl M, Denz H, Kemmler G, Zabernigg A, Holzner B. Quality of life trajectory in patients with advanced cancer during the last year of life. J Palliat Med. 2011 Aug;14(8):904–12. doi: 10.1089/jpm.2011.0086. doi: 10.1089/jpm.2011.0086. [DOI] [PubMed] [Google Scholar]
- 85.Hwang SS, Chang VT, Fairclough DL, Cogswell J, Kasimis B. Longitudinal quality of life in advanced cancer patients: pilot study results from a VA medical cancer center. J Pain Symptom Manage. 2003 Mar;25(3):225–35. doi: 10.1016/s0885-3924(02)00641-3. https://linkinghub.elsevier.com/retrieve/pii/S0885392402006413 .S0885392402006413 [DOI] [PubMed] [Google Scholar]
- 86.Geeraerts J, Kuppens P. Investigating careless responding detection techniques in experience sampling methods (ESM) OSF. [2024-05-25]. https://osf.io/8ymh5/download .
- 87.van Roij J, Fransen H, van de Poll-Franse L, Zijlstra M, Raijmakers N. Measuring health-related quality of life in patients with advanced cancer: a systematic review of self-administered measurement instruments. Qual Life Res. 2018 Aug;27(8):1937–55. doi: 10.1007/s11136-018-1809-4. doi: 10.1007/s11136-018-1809-4.10.1007/s11136-018-1809-4 [DOI] [PubMed] [Google Scholar]
- 88.Miranda R, Raemdonck E, Deliens L, Kaasa S, Zimmermann C, Rodin G, Robijn L, Lundeby T, Houbracken I, Beernaert K. Do cancer centres and palliative care wards routinely measure patients' quality of life? An international cross-sectional survey study. Support Care Cancer. 2023 Jul 31;31(8):499. doi: 10.21203/rs.3.rs-2761423/v1. doi: 10.21203/rs.3.rs-2761423/v1.10.1007/s00520-023-07964-4 [DOI] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
Search terms.
Study and sample characteristics.
Content and design characteristics.
Response-related characteristics.
PRISMA Scoping Review Checklist.