Abstract
Background
There is great potential for delivering cost-effective, quality health care for patients with chronic conditions through digital interventions. Managing chronic conditions often includes a substantial workload required for adhering to the treatment regimen and negative consequences on the patient’s function and well-being. This treatment burden affects adherence to treatment and disease outcomes. Digital interventions can potentially exacerbate the burden but also alleviate it.
Objective
The objective of this review is to identify, summarize, and synthesize the evidence of how digital interventions impact the treatment burden of people with chronic conditions.
Methods
The search, selection, and data synthesis processes were designed according to the PRISMA-P (Preferred Reporting Items for Systematic Review and Meta-Analysis Protocols) 2015. A systematic search was conducted on October 16, 2023, from databases PubMed, Scopus, Web of Science, ACM, PubMed Central, and CINAHL.
Results
Preliminary searches have been conducted, and screening has been started. The review is expected to be completed in October 2024.
Conclusions
As the number of patients with chronic conditions is increasing, it is essential to design new digital interventions for managing chronic conditions in a way that supports patients with their treatment burden. To the best of our knowledge, the proposed systematic review will be the first review that investigates the impact of digital interventions on the treatment burden of patients. The results of this review will contribute to the field of health informatics regarding knowledge of the treatment burden associated with digital interventions and practical implications for developing better digital health care for patients with chronic conditions.
Trial Registration
PROSPERO CRD42023477605; https://www.crd.york.ac.uk/prospero/display_record.php?RecordID=477605
International Registered Report Identifier (IRRID)
DERR1-10.2196/54833
Keywords: chronic illness, treatment burden, eHealth, mHealth, digital health, mobile health
Introduction
Background
Digital technologies are now commonly used in daily life, bringing many new possibilities for connecting people and providing services. The use of mobile- and web-based digital health care interventions has increased during the COVID-19 pandemic and has been found to have high efficacy, accessibility, and cost-effectiveness in the self-management of chronic diseases [1-3].
As the global population is growing, the prevalence of chronic diseases has increased significantly [4]. The World Health Organization [4] has estimated that if this trend continues, by 2050 chronic diseases will be the cause of 86% of the 90 million deaths each year. This means a 90% increase in absolute numbers since 2019. Therefore, there is a continuous need for new interventions for the management of chronic diseases.
Chronic diseases often require regular long-term management, which requires patients to not only cope with their symptoms but also navigate services, interact with health professionals, and adhere to treatments, creating a significant burden for many patients [5]. Treatment burden is defined as both the workload required for self-management of disease and the impact treatment regimens have on the patient’s function and well-being [5]. Treatment burden can affect many domains: burden of taking medications, traveling to appointments, financial burden, impact on social life and emotions, and burden of accessing health care services [6,7]. A high treatment burden has been associated with poor adherence and worse disease outcomes [6].
The variety of available digital interventions can be tailored to meet the diverse needs of patients. For example, telemedicine and remote visits can reduce the need for traveling to medical appointments [8]. Mobile health apps, wearable technologies, and remote monitoring systems can track patients’ health data and alert health care professionals (HCPs) if intervention is required [9,10]. Electronic health records offer a central repository for patients’ history to minimize the paperwork and speed up the adherence process [11], while electronic prescription management improves patient safety as well as the efficiency and costs of prescribing medications [12]. Furthermore, patients’ portals, web-based support groups, and forums provide emotional and social support for patients [13].
The World Health Organization Classification of Digital Interventions, Services and Applications in Health [14] highlights a variety of digital health technologies for different types of services. In this study, we will focus on the point of service category of digital interventions. The point of service category includes those digital interventions that facilitate and deliver health care services to the patients, making it easier to see the connection between the treatment burden of the patient and the digital intervention. This category includes communication systems, community-based information systems, decision support systems, diagnostics information systems, electronic medical record systems, laboratory information systems, personal health records, pharmacy information systems, and a variety of telehealth systems. These digital interventions can include many different components, such as monitoring tools, decision aids, behavior change support, communication with HCPs, and web-based peer support groups.
Digital interventions may affect the treatment burden in multiple ways. With limited resources, digital interventions may be used to reduce the burden on the health care system, and staff end up offloading the burden to patients [15-18]. Patients may also find digital systems inaccessible or difficult to use [19] and struggle with digital stress [20]. However, digital interventions can expedite and simplify health care processes in a way that patients may receive treatment more efficiently, reducing the treatment burden for patients. For example, they can reduce the need for medical appointments and travel to hospitals [8] and make self-management easier and more motivating for patients [21,22].
Many systematic reviews have been conducted to investigate the treatment burden on patients with chronic conditions [6,7,23-26]. These reviews have provided insights into the definition, prevention, and patient’s experience of treatment burden. In addition, recent systematic and umbrella reviews about digital interventions have found that most digital interventions in health care are mobile- or computer-based [27-29]. The findings of the recent research are mostly focused on effectiveness, and the largest targeted condition group is mental illnesses [27,29]. However, we have observed a gap in the literature regarding systematic reviews combining these 3 concepts: treatment burden, digital interventions, and chronic conditions.
Objective
The aim of this review is to identify gaps in the literature and summarize and synthesize currently available evidence of how digital interventions impact the treatment burden of people with chronic conditions. The impact can be a positive or negative effect on any domain of treatment burden. We aim to investigate if the results differ between chronic conditions with different levels of treatment burden or between interventions with different components.
Research Questions
We have two primary research questions: (1) How can digital interventions impact the treatment burden on people with chronic conditions? (2) What kind of support can digital interventions provide for people with chronic conditions with their treatment burden?
Methods
Ethical Considerations
We followed the University of Oulu ethics process as defined in the guidelines from the Ethics Committee of Human Sciences [30]. According to the guidelines, an ethics board review is not needed for this protocol.
Study Design
This protocol is reported according to the PRISMA-P (Preferred Reporting Items for Systematic Review and Meta-Analysis Protocols) 2015 [31]. We registered the protocol on the International Prospective Register of Systematic Reviews (PROSPERO CRD42023477605).
The systematic review will use a convergent design for systematic mixed studies reviews [32]. The mixed method approach was selected because qualitative results can help us to understand the phenomenon of treatment burden in the context of digital health care, and quantitative results can be used to generalize the qualitative findings by measuring their magnitude, trends, causes, and effects [33]. The convergent design was most suitable for this review since the research questions can be answered by both qualitative and quantitative findings.
Information Sources and Search Strategy
A systematic search for papers published between January 1, 2013, and October 16, 2023, was conducted from bibliographical databases PubMed, Scopus, Web of Science, ACM, PubMed Central, and CINAHL. The following search string was used: (“Chronic illness” OR “chronic disease” OR “chronic diseases” OR “chronic illnesses” OR “chronically ill” OR “diabetes” OR “asthma” OR “cancer” OR “cystic fibrosis” OR “epilepsy” OR “rheumatoid arthritis” OR “HIV” OR “patient”) AND (“Digital” OR “Remote” OR “Mobile” OR “smartphone” OR “smartwatch” OR “smart ring” OR “smart device” OR “smart devices” OR “app” OR “mHealth” OR “eHealth” OR “web-based”) AND (“Treatment burden” OR “Burden of treatment” OR “Treatment impact” OR “Treatment workload” OR “Treatment inconvenience” OR “Treatment acceptability” OR “Illness burden” OR “Burden of illness” OR “Medication burden”). To identify relevant papers, a search strategy was conducted in an iterative way. The creation of the search strings for treatment burden was informed by previous systematic reviews on the topic [23,24]. Scoping searches were conducted in several potential databases focusing on health and biomedicine, information technology, nursing, psychology, or multiple disciplines (PubMed, Scopus, Web of Science, ACM, PubMed Central, CINAHL, IEEE, and APA PsycINFO). Scoping searches were conducted on October 15, 2023, in CINAHL and on October 12, 2023, in other databases. Searches conducted on IEEE and APA PsycINFO databases revealed no relevant results, so databases were excluded from the search strategy. Including only certain chronic conditions, for example, epilepsy or neurological conditions, was considered, but there was a limited number of studies found during the initial scoping searches. For example, in the scoping search for epilepsy conducted on October 12, 2023, only 3 relevant papers were identified. Therefore, we decided to keep the scope wide and include all chronic conditions in the search string.
The MeSH term “chronic disease” and search terms “coronary heart disease,” “heart disease,” “MS,” and “multiple sclerosis” were tested during a scoping search in PubMed, but they brought no new results and therefore were removed from the search terms. A supplementary search will be conducted from the citations contained in systematic literature reviews and scoping reviews that were found during the literature searches.
Inclusion Criteria
We have included original publications written in English and accepted in peer-reviewed journals or conference proceedings. Qualitative, quantitative, and mixed method studies are included. The studies can be clinical trials, nonrandomized controlled trials, cross-sectional studies, longitudinal studies, observational studies, case studies, and other types of qualitative studies. Study design will be classified based on the tool from Grimes and Schulz [34]. Conference proceedings are included, but reviews, protocols, and book chapters are excluded.
We limited our search to publications after 2013 to include the last 10 years of research. Although digital health technology has developed quickly in recent years, the use of digital interventions in health care for chronic conditions goes farther than 10 years [35]. To the best of our knowledge, there are no previous systematic reviews relating to both digital health and treatment burden. However, studies before 2013 referred mostly to apps created only for research purposes, which were not available to the public at that time. Therefore, we decided to include papers published after 2013 to cover all relevant publications.
The study population in the included publications must consist of patients who have a chronic condition, their caregivers, or HCPs treating patients with chronic conditions. All ages and ethnicities are included. Only studies with outcomes regarding treatment burden for the patients are included. Studies that do not specifically mention the phrase “treatment burden” or “burden of treatment” but still discuss the impact of health care on the workload and burden for patients are also included. Only studies regarding a digital intervention that facilitates and delivers health care services to patients with chronic conditions are included.
Selection of Studies
After the searches, all titles and abstracts from search results were uploaded to a web-based Covidence screening tool (Veritas Health Innovation), where duplicate records will be removed. All titles and abstracts were screened and selected for inclusion independently by 2 authors (MP and PK or OK). Full-text papers from the selected papers will also be screened and selected for inclusion independently by 2 authors (MP and PK or OK). Disagreements will be resolved by discussion.
Data Extraction
Data on population characteristics, study design, aims, intervention characteristics, measures, and main results will be extracted using a predefined data extraction form in Covidence. Study design will be classified based on the tool from Grimes and Schulz [34]. Before proceeding with data extraction, MP will pilot the data extraction form with 5 papers to identify possible adjustment needs. Data extraction will be performed independently by 2 reviewers (MP and PK or OK). Disagreements will be resolved by discussion.
Risk of Bias
The quality of the included studies will be assessed using Joanna Briggs Institute Critical Appraisal tools. Two reviewers (MP and PK or OK) will assess the quality of each included study independently. Based on the design of the eligible studies, we will use Joanna Briggs Institute checklists designed for randomized controlled trials, quasi-experimental studies, analytical cross-sectional studies, case-control studies, case series, and qualitative studies.
Data Synthesis
A convergent integrated approach to synthesis and integration will be used [32]. This involves converting quantitative data into qualitative data followed by integration of the qualitative and quantitative evidence [36].
Results
Currently, we have performed searches in the 6 selected databases, and 241 studies have been identified. Screening based on title and abstract excluded 192 studies. Overall, 69 studies have been included in the second round of study selection, which is ongoing. The review is expected to be completed in 2024.
Discussion
This systematic review is performed to investigate the impact of digital health care on the treatment burden of patients with chronic conditions. This review is important because the world is currently facing increasing amounts of chronic diseases, and digital solutions are needed to improve the management of chronic diseases, which pose a significant burden on both health care systems and the patients themselves. However, it is essential to design the digital interventions in a way that helps patients to deal with their existing treatment burden and avoids further increasing the treatment burden. To the best of our knowledge, this will be the first review that covers the impact of digital health care on the treatment burden of patients with chronic conditions. The outcomes are expected to cover the positive and negative impacts of digital interventions on treatment burden and the different types of support digital interventions can provide to people with chronic conditions struggling with treatment burden. We aim to categorize different types of interventions and their components and find potential differences between interventions with different components and chronic conditions with different levels of treatment burden.
For the limitations of this review, the findings will depend on the number of eligible studies we will be able to identify and the quality of these studies. In addition, the studies identified for this review may be heterogeneous in terms of design, interventions, participant groups, and outcomes. Furthermore, our search will be restricted to peer-reviewed studies published in English.
Abbreviations
- HCP
health care professional
- PRISMA-P
Preferred Reporting Items for Systematic Review and Meta-Analysis Protocols
Footnotes
Authors' Contributions: MP developed the initial research questions; design of the review, search, and selection strategies; and drafted the paper. PK and OK contributed to the refining of the research questions; design of the review, search, and selection strategies; and writing and editing of the paper. WB and MI contributed to the editing and approved the final paper.
Conflicts of Interest: None declared.
References
- 1.Blandford A, Wesson J, Amalberti R, AlHazme R, Allwihan R. Opportunities and challenges for telehealth within, and beyond, a pandemic. Lancet Glob Health. 2020;8(11):e1364–e1365. doi: 10.1016/S2214-109X(20)30362-4. https://linkinghub.elsevier.com/retrieve/pii/S2214-109X(20)30362-4 .S2214-109X(20)30362-4 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Portnoy J, Waller M, Elliott T. Telemedicine in the era of COVID-19. J Allergy Clin Immunol Pract. 2020;8(5):1489–1491. doi: 10.1016/j.jaip.2020.03.008. https://europepmc.org/abstract/MED/32220575 .S2213-2198(20)30249-X [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.Sim I. Mobile devices and health. N Engl J Med. 2019;381(10):956–968. doi: 10.1056/NEJMra1806949. [DOI] [PubMed] [Google Scholar]
- 4.World health statistics 2023: monitoring health for the SDGs, sustainable development goals. World Health Organization. 2023. [2024-04-03]. https://www.who.int/publications/i/item/9789240074323 .
- 5.Eton DT, de Oliveira DR, Egginton JS, Ridgeway JL, Odell L, May CR, Montori VM. Building a measurement framework of burden of treatment in complex patients with chronic conditions: a qualitative study. Patient Relat Outcome Meas. 2012;3:39–49. doi: 10.2147/PROM.S34681. https://europepmc.org/abstract/MED/23185121 .prom-3-039 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Demain S, Gonçalves AC, Areia C, Oliveira R, Marcos AJ, Marques A, Parmar R, Hunt K. Living with, managing and minimising treatment burden in long term conditions: a systematic review of qualitative research. PLoS One. 2015;10(5):e0125457. doi: 10.1371/journal.pone.0125457. https://dx.plos.org/10.1371/journal.pone.0125457 .PONE-D-14-42028 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Sav A, King MA, Whitty JA, Kendall E, McMillan SS, Kelly F, Hunter B, Wheeler AJ. Burden of treatment for chronic illness: a concept analysis and review of the literature. Health Expect. 2015;18(3):312–324. doi: 10.1111/hex.12046. https://europepmc.org/abstract/MED/23363080 . [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Kelley LT, Phung M, Stamenova V, Fujioka J, Agarwal P, Onabajo N, Wong I, Nguyen M, Bhatia RS, Bhattacharyya O. Exploring how virtual primary care visits affect patient burden of treatment. Int J Med Inform. 2020;141:104228. doi: 10.1016/j.ijmedinf.2020.104228.S1386-5056(19)31064-0 [DOI] [PubMed] [Google Scholar]
- 9.Hamine S, Gerth-Guyette E, Faulx D, Green BB, Ginsburg AS. Impact of mHealth chronic disease management on treatment adherence and patient outcomes: a systematic review. J Med Internet Res. 2015;17(2):e52. doi: 10.2196/jmir.3951. https://www.jmir.org/2015/2/e52/ v17i2e52 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Mattison G, Canfell O, Forrester D, Dobbins C, Smith D, Töyräs J, Sullivan C. The influence of wearables on health care outcomes in chronic disease: systematic review. J Med Internet Res. 2022;24(7):e36690. doi: 10.2196/36690. https://www.jmir.org/2022/7/e36690/ v24i7e36690 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Tinetti ME, Naik AD, Dindo L, Costello DM, Esterson J, Geda M, Rosen J, Hernandez-Bigos K, Smith CD, Ouellet GM, Kang G, Lee Y, Blaum C. Association of patient priorities-aligned decision-making with patient outcomes and ambulatory health care burden among older adults with multiple chronic conditions: a nonrandomized clinical trial. JAMA Intern Med. 2019;179(12):1688–1697. doi: 10.1001/jamainternmed.2019.4235. https://europepmc.org/abstract/MED/31589281 .2752365 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Klepser D, Lanham A, Cochran G. Electronic prescriptions: opportunities and challenges for the patient and pharmacist. Adv Health Care Technol. 2016;2:1–11. doi: 10.2147/ahct.s64477. https://www.dovepress.com/electronic-prescriptions-opportunities-and-challenges-for-the-patient--peer-reviewed-fulltext-article-AHCT . [DOI] [Google Scholar]
- 13.Schwartz CE, Zhang J, Michael W, Eton DT, Rapkin BD. Reserve-building activities attenuate treatment burden in chronic illness: the mediating role of appraisal and social support. Health Psychol Open. 2018;5(1):2055102918773440. doi: 10.1177/2055102918773440. https://journals.sagepub.com/doi/abs/10.1177/2055102918773440?url_ver=Z39.88-2003&rfr_id=ori:rid:crossref.org&rfr_dat=cr_pub0pubmed .10.1177_2055102918773440 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Classification of digital interventions, services and applications in health: a shared language to describe the uses of digital technology for health, 2nd Edition. World Health Organization. 2023. [2024-04-03]. https://www.who.int/publications-detail-redirect/9789240081949#:~:text=The%20WHO%20Classification%20of%20digital,needs%20and%20advance%20health%20goals .
- 15.May CR, Eton DT, Boehmer K, Gallacher K, Hunt K, MacDonald S, Mair FS, May CM, Montori VM, Richardson A, Rogers AE, Shippee N. Rethinking the patient: using Burden of Treatment Theory to understand the changing dynamics of illness. BMC Health Serv Res. 2014;14:281. doi: 10.1186/1472-6963-14-281. https://bmchealthservres.biomedcentral.com/articles/10.1186/1472-6963-14-281 .1472-6963-14-281 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Eton DT, Ridgeway JL, Egginton JS, Tiedje K, Linzer M, Boehm DH, Poplau S, Ramalho de Oliveira D, Odell L, Montori VM, May CR, Anderson RT. Finalizing a measurement framework for the burden of treatment in complex patients with chronic conditions. Patient Relat Outcome Meas. 2015;6:117–26. doi: 10.2147/PROM.S78955. https://europepmc.org/abstract/MED/25848328 .prom-6-117 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Mair FS, Montori VM, May CR. Digital transformation could increase the burden of treatment on patients. BMJ. 2021;375:n2909. doi: 10.1136/bmj.n2909. https://www.bmj.com/lookup/doi/10.1136/bmj.n2909 . [DOI] [PubMed] [Google Scholar]
- 18.Hardman R, Begg S, Spelten E. Healthcare professionals' perspective on treatment burden and patient capacity in low-income rural populations: challenges and opportunities. BMC Fam Pract. 2021;22(1):50. doi: 10.1186/s12875-021-01387-y. https://bmcfampract.biomedcentral.com/articles/10.1186/s12875-021-01387-y .10.1186/s12875-021-01387-y [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Henni SH, Maurud S, Fuglerud KS, Moen A. The experiences, needs and barriers of people with impairments related to usability and accessibility of digital health solutions, levels of involvement in the design process and strategies for participatory and universal design: a scoping review. BMC Public Health. 2022;22(1):35. doi: 10.1186/s12889-021-12393-1. https://bmcpublichealth.biomedcentral.com/articles/10.1186/s12889-021-12393-1 .10.1186/s12889-021-12393-1 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Steele RG, Hall JA, Christofferson JL. Conceptualizing digital stress in adolescents and young adults: toward the development of an empirically based model. Clin Child Fam Psychol Rev. 2020;23(1):15–26. doi: 10.1007/s10567-019-00300-5.10.1007/s10567-019-00300-5 [DOI] [PubMed] [Google Scholar]
- 21.Allam A, Kostova Z, Nakamoto K, Schulz PJ. The effect of social support features and gamification on a web-based intervention for rheumatoid arthritis patients: randomized controlled trial. J Med Internet Res. 2015;17(1):e14. doi: 10.2196/jmir.3510. https://www.jmir.org/2015/1/e14/ v17i1e14 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Comello MLG, Qian X, Deal AM, Ribisl KM, Linnan LA, Tate DF. Impact of game-inspired infographics on user engagement and information processing in an eHealth program. J Med Internet Res. 2016;18(9):e237. doi: 10.2196/jmir.5976. https://www.jmir.org/2016/9/e237/ v18i9e237 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Alsadah A, van Merode T, Alshammari R, Kleijnen J. A systematic literature review looking for the definition of treatment burden. Heliyon. 2020;6(4):e03641. doi: 10.1016/j.heliyon.2020.e03641. https://linkinghub.elsevier.com/retrieve/pii/S2405-8440(20)30486-2 .S2405-8440(20)30486-2 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.Sheehan OC, Leff B, Ritchie CS, Garrigues SK, Li L, Saliba D, Fathi R, Boyd CM. A systematic literature review of the assessment of treatment burden experienced by patients and their caregivers. BMC Geriatr. 2019;19(1):262. doi: 10.1186/s12877-019-1222-z. https://bmcgeriatr.biomedcentral.com/articles/10.1186/s12877-019-1222-z .10.1186/s12877-019-1222-z [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.Gallacher K, Smyth R, May C, Mair F. A systematic review of the use of Burden of Treatment Theory: systematic review, meta-analysis, or scoping review. Ann Fam Med. 2023;21(Suppl 1):3641. doi: 10.1370/afm.21.s1.3641. https://www.annfammed.org/content/21/Supplement_1/3641 . [DOI] [Google Scholar]
- 26.Matthews KS, Rennoldson SC, Fraser SD. Influence of health-system change on treatment burden: a systematic review. Br J Gen Pract. 2022;73(726):e59–e66. doi: 10.3399/bjgp.2022.0066. https://bjgp.org/content/73/726/e59 . [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27.Taylor ML, Thomas EE, Vitangcol K, Marx W, Campbell KL, Caffery LJ, Haydon HM, Smith AC, Kelly JT. Digital health experiences reported in chronic disease management: an umbrella review of qualitative studies. J Telemed Telecare. 2022;28(10):705–717. doi: 10.1177/1357633X221119620. https://journals.sagepub.com/doi/10.1177/1357633X221119620 . [DOI] [PubMed] [Google Scholar]
- 28.Xiong S, Lu H, Peoples N, Duman EK, Najarro A, Ni Z, Gong E, Yin R, Ostbye T, Palileo-Villanueva LM, Doma R, Kafle S, Tian M, Yan LL. Digital health interventions for non-communicable disease management in primary health care in low-and middle-income countries. NPJ Digit Med. 2023;6(1):12. doi: 10.1038/s41746-023-00764-4. https://www.nature.com/articles/s41746-023-00764-4 .10.1038/s41746-023-00764-4 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.Ibrahim MS, Yusoff HM, Bakar YIA, Aung MMT, Abas MI, Ramli RA. Digital health for quality healthcare: a systematic mapping of review studies. Digit Health. 2022;8:20552076221085810. doi: 10.1177/20552076221085810. https://journals.sagepub.com/doi/abs/10.1177/20552076221085810?url_ver=Z39.88-2003&rfr_id=ori:rid:crossref.org&rfr_dat=cr_pub0pubmed .10.1177_20552076221085810 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30.Ethics Committee of Human Sciences. University of Oulu. [2024-01-09]. https://www.oulu.fi/en/university/faculties-and-units/eudaimonia-institute/ethics-committee-human-sciences .
- 31.Shamseer L, Moher D, Clarke M, Ghersi D, Liberati A, Petticrew M, Shekelle P, Stewart LA. Preferred Reporting Items for Systematic Review and Meta-Analysis Protocols (PRISMA-P) 2015: elaboration and explanation. BMJ. 2015;350:g7647. doi: 10.1136/bmj.g7647. http://www.bmj.com/lookup/pmidlookup?view=long&pmid=25555855 . [DOI] [PubMed] [Google Scholar]
- 32.Stern C, Lizarondo L, Carrier J, Godfrey C, Rieger K, Salmond S, Apostolo J, Kirkpatrick P, Loveday H. Methodological guidance for the conduct of mixed methods systematic reviews. JBI Evid Implement. 2021;19(2):120–129. doi: 10.1097/XEB.0000000000000282. doi: 10.1097/XEB.0000000000000282. [DOI] [PubMed] [Google Scholar]
- 33.Pluye P, Hong QN. Combining the power of stories and the power of numbers: mixed methods research and mixed studies reviews. Annu Rev Public Health. 2014;35:29–45. doi: 10.1146/annurev-publhealth-032013-182440. https://www.annualreviews.org/content/journals/10.1146/annurev-publhealth-032013-182440 . [DOI] [PubMed] [Google Scholar]
- 34.Grimes DA, Schulz KF. An overview of clinical research: the lay of the land. Lancet. 2002;359(9300):57–61. doi: 10.1016/s0140-6736(02)07283-5. [DOI] [PubMed] [Google Scholar]
- 35.Eland-de Kok P, van Os-Medendorp H, Vergouwe-Meijer A, Bruijnzeel-Koomen C, Ros W. A systematic review of the effects of e-health on chronically ill patients. J Clin Nurs. 2011;20(21-22):2997–3010. doi: 10.1111/j.1365-2702.2011.03743.x. [DOI] [PubMed] [Google Scholar]
- 36.Voils CI, Sandelowski M, Barroso J, Hasselblad V. Making sense of qualitative and quantitative findings in mixed research synthesis studies. Field Methods. 2008;20(1):3–25. doi: 10.1177/1525822X07307463. doi: 10.1177/1525822X07307463. [DOI] [PMC free article] [PubMed] [Google Scholar]