Abstract
Background
Childhood obesity is a serious global issue, leading to increased medical spending on obesity-related diseases such as cardiovascular diseases and diabetes. There is a need for health care services that link health behavior to risk factors, such as diet and physical activity, and that provide better advice and feedback to users, which Internet of Things–enabled technologies could facilitate.
Objective
The objective of the systematic review will be to identify available Internet of Things–enabled technologies for weight management of children and adolescents (users younger than 18 years). It will also aim to understand the use, effectiveness, and feasibility of these technologies.
Methods
We will search the Medline, PubMed, Web of Science, Scopus, ProQuest Central, and IEEE Xplore Digital Library databases for studies published after 2010, using a combination of keywords and subject headings related to health activity tracking, youth, and Internet of Things. In addition, a Google search to identify grey literature will be conducted. Two authors will independently screen the titles and abstracts identified from the search and accept or reject the studies according to the study inclusion criteria. Any discrepancies will then be discussed and resolved. The quality of the included studies will be assessed using the Critical Appraisal Skills Programme (CASP) checklists. Data from included studies will be extracted into a predesigned form to identify the types of devices or apps, Internet of Things applications, and health outcomes related to weight management.
Results
A preliminary search on Medline returned 484 results. The publication of the final systematic review is expected in mid-2020.
Conclusions
The effectiveness and feasibility of physical activity trackers and consumer wearables for different patient groups have been well reviewed, but there are currently no published reviews that look into these technologies in the wider Internet of Things context. This review aims to address this gap by examining Internet of Things–enabled technologies that are designed for youth weight management and thus inform further research and clinical studies to reduce childhood obesity.
International Registered Report Identifier (IRRID)
PRR1-10.2196/16930
Keywords: Internet of Things, IoT, childhood obesity, wearables, physical activity tracking
Introduction
Background
Childhood obesity and related costs are increasing worldwide [1-3]. It has been shown that the majority of children with obesity remained obese in adulthood, resulting in significant health care costs [4]. Promoting better diet and regular physical activities [5] can help prevent childhood obesity and thus reduce the occurrence of obesity-related metabolic and cardiovascular diseases [6], and in turn reduce health care costs.
Management of childhood obesity usually involves patient lifestyle counseling [7], but face-to-face counseling can be expensive and difficult for patients in rural areas [5]. There is a growing emphasis on patient-centered health care, where care extends beyond the hospital and is “respectful of and responsive to individual patient preferences, needs, values, and ensuring that patient values guide all clinical decisions”[8]. A promising solution for patient-centered care is the deployment of connected health technologies for remote diagnosis, monitoring, and treatment and patient self-care and support [9,10]. The tracking of physical activity has been studied extensively since the 2000s [11]. It is only in the previous 5 years that wearables, such as wristwatches with activity sensors, have become sophisticated enough to provide measures beyond steps, distance, calories, and sleep. For example, wearables can now measure activity minutes, heart rate, and goal and target-oriented designs [12]. These advances in wearables allow more accurate tracking of physical activities and provide greater insight into the type and form of physical activity undertaken by the user, such as exercise intensity and metabolic rate [13].
The use of these wearables can further be enhanced through integration with the Internet of Things (IoT) [14]. Since the advent of IoT in 1999 [15], IoT-enabled devices and networks have been applied to a range of applications including smart cities [16], virtual power plants [17], and health care [18,19]. In the health care setting, IoT-enabled devices—technologies that are connected to a network–can give accurate and real-time feedback that can generate health data to improve understanding of user behavior and personalize treatment regimes. Acampora et al [20] surveyed the applications of IoT in health care and identified six main applications in health care (Table 1).
Table 1.
Application | Goal |
Health monitoring, behavioral monitoring, emergency detection | Sensor networks for physiological measures (electrocardiogram, electroencephalogram, etc), health behaviors (such as physical activity) and hazard detection (such as falls) |
Assisted living | Smart environments are created to support patients and older adults in their daily lives |
Therapy and rehabilitation | Remote and autonomous rehabilitation service provision |
Persuasive well-being | Motivate users to adopt a healthier lifestyle |
Emotional well-being | Analyze emotions and improve mental well-being of users |
Smart hospitals | Improve communication among hospitals |
Technologies that track physical activity are widely used in health care applications. Previous studies have reviewed different applications of IoT and non-IoT physical activity trackers for various patient groups, including patients with rheumatic and musculoskeletal diseases [21], epilepsy, Parkinson, patients who have had a stroke [22], working-age women [23], people with serious mental illness [24], obese adults [25], and children [26,27]. These wearable activity trackers have generally shown significant effectiveness in increasing physical activity in the short-term [28], but there are still relatively few studies justifying their long term effectiveness [29]. Furthermore, long-term user adherence remains challenging [30].
Most systematic reviews on physical activity tracking and weight management in children were published several years ago. However, one recent review examined the feasibility and effectiveness of wearable activity trackers for young people (5-19 years old) [27]. Overall, they found that measures of effectiveness were mostly positive but nonsignificant. However, this review included any type of wearable activity tracker and did not focus on IoT.
With regard to user perspectives of mobile health interventions for weight management, it was found that user acceptance of trackers can vary greatly depending on their age group [31,32]. In addition, although the data from wearables can be a valuable source of data for diagnosis and patient monitoring, they are oftentimes not standardized or validated, which limits their clinical significance in supporting clinical decision making [22,33].
Objectives
There is a gap in the literature regarding children and adolescent’s use of digital weight management technologies that are connected to a wider network. Currently, no studies focusing on the wider context of IoT-enabled technologies for weight management in children and adolescents have been published. Previously published reviews have focused on elements of this (ie, weight management in children and adolescents, the use of IoT in weight management technologies), but none have examined the intersection. This review will aim to understand how IoT-enabled technologies designed for youth, such as physical activity trackers and weight management apps, fit in the wider IoT context, how data obtained through these devices can improve health care delivery, and whether these address privacy concerns by considering regulations. Specifically, the review aims to answer the following questions:
What IoT-enabled solutions are used for weight management and physical activity encouragement in children and adolescents (<18 years old)?
How are the data collected with IoT-enabled solutions analyzed, and how do the technologies connect and contribute to the wider IoT ecosystem?
What are the ethical and regulatory barriers in implementing these technologies, especially with regard to data sharing and privacy?
What are the effectiveness measures used and reported by researchers?
Methods
Protocol
This protocol is developed in accordance with the Preferred Reporting Items for Systematic Reviews and Meta-Analyses Protocols (PRISMA-P) statement [34] and the systematic review to be executed based on this protocol will also be conducted in accordance with PRISMA.
Search
We will search Medline, Pubmed, Web of Science, Scopus, ProQuest Central, Engineering Village Compendex, and the IEEE Xplore Digital Library for studies published after 2010 using a combination of keywords and subject headings related to health activity tracking, youth, and IoT (Table 2). The search string will be constructed in this format: (Health activity tracking) AND (Youth) AND (IoT). Additionally, a Google search will be used to identify gray literature. A sample search conducted in Medline can be found in Multimedia Appendix 1.
Table 2.
Theme | MeSHa termsb | Search terms |
Health activity–tracking device | Fitness Trackers | electronic track* OR (electronic activ* AND track*) OR (electronic activ* AND monitor*) OR electronic fitness track* OR fitness track* OR (wearable AND track*) OR wearable OR sens* |
Weight management | Weight Reduction, Body Mass Index | (Weight AND (manag* OR monitor* OR reduc* OR loss OR maint*)) OR (“body mass index” OR BMI) OR diet OR obes* |
Youth | Pediatrics, Child, Adolescent | Child* OR teen* OR youth OR paed* OR ped* OR adolescent* OR young* |
Internet of Things | N/Ac | IoT OR Internet of things OR connected health OR digital health OR mobile health OR mhealth OR Bluetooth OR wireless OR application processing interface OR API |
aMeSH: Medical Subject Headings.
bMeSH terms were included in the search terms and are only identified separately in this table to describe which search terms were MeSH terms.
cN/A: not applicable.
Eligibility Criteria
The study was defined as follows using the PICO (population, intervention, comparator, outcomes) model:
Population: Children and adolescents younger than 18 who have interacted with IoT-enabled technologies for weight management, physical activity tracking, and encouragement of a healthy lifestyle.
Intervention: Wearable IoT-enabled weight management and tracking technologies (eg, physical activity tracker, food tracker, sleep tracker) and other physical activity or dietary interventions designed to help young people lose or maintain weight.
Comparator: Studies with and without a comparator will be included.
Outcomes: This study will provide information on (1) the available weight management technologies and products for young people (designed for users below the age of 18), (2) the reported effectiveness of these technologies and the measures used to assess them, and (3) the benefits and limitations of each of these technologies reported by the studies.
The inclusion and exclusion criteria for the study can be found in Textbox 1.
Study inclusion and exclusion criteria.
Inclusion criteria
English publications
Studies published between 2010 (year of first published study identified by Ridgers et al for wearable activity trackers for youth [27]) and present
Studies that describe a wearable device or mobile app for health activity tracking connected to a wider network (including internet and other networks beyond the standalone device)
Health activity tracking and other weight management devices for young people that have data analysis functionalities connected to a network
Studies that describes the data analysis process and how data is connected to the wider network
Exclusion criteria
Studies that do not describe weight management intervention
Studies that describe devices or mobile apps that are not connected to a wider network/platform for data analysis
Health activity tracking devices that are not connected to a network beyond simple data storage
Studies that are not focused on children or adolescents (below 18 years of age)
Study Records
Data Management and Selection Process
All search results will be exported into a Mendeley library and duplicates will be removed. Two authors (CL and MM-I) will independently screen the titles and abstracts identified from the search and accept or reject the studies according to the study inclusion and exclusion criteria. Any discrepancies will then be discussed and resolved. The full texts will be downloaded for the selected studies and analyzed to determine eligibility. Where there is disagreement in either the screening or full-text analysis stages, a third reviewer will be consulted until consensus is reached.
Data Extraction
One reviewer will extract data from the included studies, which will be validated by a second reviewer. Data from eligible publications will be extracted into a predesigned form to identify the types of devices or apps, IoT architecture employed, effectiveness for youth weight management, and relevant ethics and regulations if mentioned (Textbox 2). The form was custom-built to reflect reported items identified in a preliminary search of the literature that were relevant to the stated research questions.
Data extraction by theme.
Background information of study
Year
Country
Target patient age group
Test sample size
Trial type
Length of study
Scientific theory
Sensing layer
Product
Type of device (eg, mobile app, wearable tracker)
Sensor type
Data collected (eg, activity, food intake, heart rate, sleep)
Networking layer
Data transfer method
Service/interface layer
What user needs does the product aim to satisfy
Stakeholders (if identified)
Data analysis methods
Effectiveness
Researcher-reported effectiveness measures and outcomes (if any)
Ethics and governance
Mention of ethics
Mention of regulation
Data Analysis
As the number of studies are expected to be limited, the analysis will be qualitative, focusing on how existing technologies interact with IoT and connect to the wider internet.
Quality Appraisal
Two reviewers will independently review the identified randomized controlled trials using the risk of bias tool developed by the Cochrane Collaboration [35]. The quality of other included studies and systematic reviews will be assessed using relevant Critical Appraisal Skills Programme (CASP) checklists (eg, CASP checklist for randomized controlled trials, CASP checklist for systematic review) [36]. As we do not expect a large number of studies to meet the inclusion criteria, risk of bias and quality will be reported, but no studies will be removed.
Results
This study aims to identify the types of IoT-enabled technologies used for weight management of children and adolescents and identify the benefits, effectiveness, and limitations of each of these technologies. A sample search conducted on PubMed returned 592 results (search string and results can be found in Appendix 1). The results will inform future development of weight management technologies for children and adolescents to reduce the cost burden of childhood obesity on health care systems. Full results will be published mid-2020.
Discussion
Although wearables and apps for health activity management have been well-reviewed, their integration with the wider IoT network represents a gap in the knowledge for improving patient-centered health care. This systematic review will allow the health care and app development community to better understand how current technologies interact with the internet and provide insights for future IoT–enabled technology development for children and adolescents. The results of this work will inform future development of weight management technologies for young people. A potential limitation of this review is that studies of IoT devices might overrepresent children and adolescents from high socio-economic status, if the devices were preowned and not provided for the study.
This systematic review protocol will be executed within the next 12 months and the review will be published in a peer-reviewed journal to inform future developments in IoT-enabled childhood obesity management technologies.
Acknowledgments
CL, MM-I, MH, and EM are supported by grants from EIT Health (grant #18654) and a Promoting the Internet of Things via Collaborations between HEIS and Industry (PITCH-IN) grant.
Abbreviations
- CASP
Critical Appraisal Skills Programme
- IoT
Internet of Things
- MeSH
Medical Subject Headings
- PICO
population, intervention, comparator, outcomes
- PRISMA-P
Preferred Reporting Items for Systematic Reviews and Meta-Analyses Protocols
Appendix
Initial search results.
Footnotes
Authors' Contributions: CL and EM conceptualized and designed the review protocol. CL drafted and finalized the protocol with suggested revisions from MM-I, EM and MH.
Conflicts of Interest: None declared.
References
- 1.Thorpe KE, Florence CS, Howard DH, Joski P. The impact of obesity on rising medical spending. Health Aff (Millwood) 2004;Suppl Web Exclusives:W4–480. doi: 10.1377/hlthaff.w4.480. [DOI] [PubMed] [Google Scholar]
- 2.Cawley J. The economics of childhood obesity. Health Aff (Millwood) 2010;29(3):364–71. doi: 10.1377/hlthaff.2009.0721. [DOI] [PubMed] [Google Scholar]
- 3.Ramachandran A, Snehalatha C. Rising burden of obesity in Asia. J Obes. 2010;2010 doi: 10.1155/2010/868573. doi: 10.1155/2010/868573. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Sonntag D, Ali S, De Bock F. Lifetime indirect cost of childhood overweight and obesity: A decision analytic model. Obesity (Silver Spring) 2016 Jan 06;24(1):200–6. doi: 10.1002/oby.21323. doi: 10.1002/oby.21323. [DOI] [PubMed] [Google Scholar]
- 5.Nelson JM, Vos MB, Walsh SM, O'Brien LA, Welsh JA. Weight management-related assessment and counseling by primary care providers in an area of high childhood obesity prevalence: current practices and areas of opportunity. Child Obes. 2015 Apr;11(2):194–201. doi: 10.1089/chi.2014.0052. http://europepmc.org/abstract/MED/25585234. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Rowland T. Physical activity and clustered cardiovascular risk in children: a cross-sectional study (The European Youth Heart Study) Yearbook of Sports Medicine. 2007 Jan;2007:109–110. doi: 10.1016/s0162-0908(08)70100-4. [DOI] [Google Scholar]
- 7.Retat L, Pimpin L, Webber L, Jaccard A, Lewis A, Tearne S, Hood K, Christian-Brown A, Adab P, Begh R, Jolly K, Daley A, Farley A, Lycett D, Nickless A, Yu L, Jebb S, Aveyard P. Screening and brief intervention for obesity in primary care: cost-effectiveness analysis in the BWeL trial. Int J Obes (Lond) 2019 Oct;43(10):2066–2075. doi: 10.1038/s41366-018-0295-7. http://europepmc.org/abstract/MED/30705390. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Baker A. Crossing the Quality Chasm: A New Health System for the 21st Century. London: BMJ; 2001. Nov 17, [PubMed] [Google Scholar]
- 9.Kvedar J, Coye MJ, Everett W. Connected health: a review of technologies and strategies to improve patient care with telemedicine and telehealth. Health Aff (Millwood) 2014 Feb;33(2):194–9. doi: 10.1377/hlthaff.2013.0992. [DOI] [PubMed] [Google Scholar]
- 10.Mulgrew KW, Shaikh U, Nettiksimmons J. Comparison of parent satisfaction with care for childhood obesity delivered face-to-face and by telemedicine. Telemed J E Health. 2011 Jun;17(5):383–7. doi: 10.1089/tmj.2010.0153. [DOI] [PubMed] [Google Scholar]
- 11.Telama R. Tracking of physical activity from childhood to adulthood: a review. Obes Facts. 2009;2(3):187–95. doi: 10.1159/000222244. https://www.karger.com?DOI=10.1159/000222244. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Evenson KR, Goto MM, Furberg RD. Systematic review of the validity and reliability of consumer-wearable activity trackers. Int J Behav Nutr Phys Act. 2015 Dec 18;12:159. doi: 10.1186/s12966-015-0314-1. https://ijbnpa.biomedcentral.com/articles/10.1186/s12966-015-0314-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Dooley EE, Golaszewski NM, Bartholomew JB. Estimating accuracy at exercise intensities: a comparative study of self-monitoring heart rate and physical activity wearable devices. JMIR Mhealth Uhealth. 2017 Mar 16;5(3):e34. doi: 10.2196/mhealth.7043. https://mhealth.jmir.org/2017/3/e34/ [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Hiremath S, Yang G, Mankodiya K. Wearable internet of things: concept, architectural components and promises for person-centered healthcare. MOBIHEALTH. 2014:304–307. doi: 10.4108/icst.mobihealth.2014.257440. [DOI] [Google Scholar]
- 15.Ashton K. RFID Journal. 2009. Jun 22, That "internet of things' thing: in the real world, things matter more than ideas http://www.rfidjournal.com/articles/view?4986.
- 16.Petrolo R, Loscrì V, Mitton N. Towards a smart city based on cloud of things, a survey on the smart city vision and paradigms. Trans. Emerging Tel. Tech. 2015 Mar 09;28(1):e2931. doi: 10.1002/ett.2931. https://onlinelibrary.wiley.com/doi/abs/10.1002/ett.2931?casa_token=lNFsCLth_H8AAAAA:Yi9mV-fNpNzoQtTOKY9FBh-efxzXN36CsW4HWY9tkgQlNJXEMLjW6dJh8HSIhpxiQlZQRRRiu1SroA. [DOI] [Google Scholar]
- 17.Othman M, Hegazy Y, Abdelaziz A. Optimal operation of virtual power plant in unbalanced distribution networks. Electric Power Components and Systems. 2016 Aug 15;44(14):1620–1630. doi: 10.1080/15325008.2016.1183728. https://www.researchgate.net/profile/Almoataz_Abdelaziz/publication/283329072_A_Review_of_Virtual_power_plant_Definitions_Components_Framework_and_Optimization/links/5633e68708aeb786b7013cc3.pdf. [DOI] [Google Scholar]
- 18.Ud Din I, Guizani M, Hassan S, Kim B, Khurram Khan M, Atiquzzaman M, Ahmed SH. The internet of things: a review of enabled technologies and future challenges. IEEE Access. 2019;7:7606–7640. doi: 10.1109/ACCESS.2018.2886601. [DOI] [Google Scholar]
- 19.Dimitrov DV. Medical internet of things and big data in healthcare. Healthc Inform Res. 2016 Jul;22(3):156–63. doi: 10.4258/hir.2016.22.3.156. https://www.e-hir.org/DOIx.php?id=10.4258/hir.2016.22.3.156. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Acampora G, Cook DJ, Rashidi P, Vasilakos AV. A survey on ambient intelligence in health care. Proc IEEE Inst Electr Electron Eng. 2013 Dec 01;101(12):2470–2494. doi: 10.1109/JPROC.2013.2262913. http://europepmc.org/abstract/MED/24431472. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Davergne T, Pallot A, Dechartres A, Fautrel B, Gossec L. Use of wearable activity trackers to improve physical activity behavior in patients with rheumatic and musculoskeletal diseases: a systematic review and meta-analysis. Arthritis Care Res (Hoboken) 2019 Jun;71(6):758–767. doi: 10.1002/acr.23752. [DOI] [PubMed] [Google Scholar]
- 22.Johansson D, Malmgren K, Alt Murphy M. Wearable sensors for clinical applications in epilepsy, Parkinson's disease, and stroke: a mixed-methods systematic review. J Neurol. 2018 Aug;265(8):1740–1752. doi: 10.1007/s00415-018-8786-y. http://europepmc.org/abstract/MED/29427026. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Reed J, Prince S, Elliott C, Mullen K, Tulloch H, Hiremath S, Cotie L, Pipe A, Reid R. Impact of workplace physical activity interventions on physical activity and cardiometabolic health among working-age women: a systematic review and meta-analysis. Circ Cardiovasc Qual Outcomes. 2017 Feb;10(2) doi: 10.1161/CIRCOUTCOMES.116.003516. [DOI] [PubMed] [Google Scholar]
- 24.Naslund JA, Aschbrenner KA, Bartels SJ. Wearable devices and smartphones for activity tracking among people with serious mental illness. Ment Health Phys Act. 2016 Mar;10:10–17. doi: 10.1016/j.mhpa.2016.02.001. http://europepmc.org/abstract/MED/27134654. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.Park S, Hwang J, Choi Y. Effect of mobile health on obese adults: a systematic review and meta-analysis. Healthc Inform Res. 2019 Jan;25(1):12–26. doi: 10.4258/hir.2019.25.1.12. https://www.e-hir.org/DOIx.php?id=10.4258/hir.2019.25.1.12. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Jones RA, Hinkley T, Okely AD, Salmon J. Tracking physical activity and sedentary behavior in childhood: a systematic review. Am J Prev Med. 2013 Jun;44(6):651–8. doi: 10.1016/j.amepre.2013.03.001. [DOI] [PubMed] [Google Scholar]
- 27.Ridgers ND, McNarry MA, Mackintosh KA. Feasibility and effectiveness of using wearable activity trackers in youth: a systematic review. JMIR Mhealth Uhealth. 2016 Nov 23;4(4):e129. doi: 10.2196/mhealth.6540. https://mhealth.jmir.org/2016/4/e129/ [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.Gal R, May AM, van Overmeeren EJ, Simons M, Monninkhof EM. The effect of physical activity interventions comprising wearables and smartphone applications on physical activity: a systematic review and meta-analysis. Sports Med Open. 2018 Sep 03;4(1):42. doi: 10.1186/s40798-018-0157-9. http://europepmc.org/abstract/MED/30178072. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.Fawcett E, Brindley D, Meinert E. Long-term weight management using wearable technology in overweight and obese adults: a systematic review. JMIR mHealth uHealth. 2019 Dec 16; doi: 10.2196/13461. https://preprints.jmir.org/preprint/13461. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30.Brickwood K, Watson G, O'Brien J, Williams AD. Consumer-based wearable activity trackers increase physical activity participation: systematic review and meta-analysis. JMIR Mhealth Uhealth. 2019 Apr 12;7(4) doi: 10.2196/11819. https://mhealth.jmir.org/2019/4/e11819/ [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.Hu R, van Velthoven MH, Meinert E. Perspectives of people who are overweight and obese on using wearable technology for weight management: systematic review. JMIR Mhealth Uhealth. 2020 Jan 13;8(1) doi: 10.2196/12651. https://mhealth.jmir.org/2020/1/e12651/ [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32.Puri A, Kim B, Nguyen O, Stolee P, Tung J, Lee J. User acceptance of wrist-worn activity trackers among community-dwelling older adults: mixed method study. JMIR Mhealth Uhealth. 2017 Nov 15;5(11):e173. doi: 10.2196/mhealth.8211. https://mhealth.jmir.org/2017/11/e173/ [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33.Piwek L, Ellis DA, Andrews S, Joinson A. The rise of consumer health wearables: promises and barriers. PLoS Med. 2016 Feb;13(2):e1001953. doi: 10.1371/journal.pmed.1001953. http://dx.plos.org/10.1371/journal.pmed.1001953. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34.Moher D, Shamseer L, Clarke M, Ghersi D, Liberati A, Petticrew M, Shekelle P, Stewart LA, PRISMA-P Group Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015 statement. Syst Rev. 2015 Jan 01;4:1. doi: 10.1186/2046-4053-4-1. https://systematicreviewsjournal.biomedcentral.com/articles/10.1186/2046-4053-4-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 35.Higgins J, Green S. Cochrane Handbook For Systematic Reviews Of Interventions. New Jersey: John Wiley & Sons; 2011. [Google Scholar]
- 36.Critical Appraisal Skills Program. 2018. CASP systematical review checklist https://casp-uk.net/wp-content/uploads/2018/01/CASP-Systematic-Review-Checklist_2018.pdf.
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
Initial search results.