Abstract
Background
Disasters are becoming more frequent due to the impact of extreme weather events attributed to climate change, causing loss of lives, property, and psychological trauma. Mental health response to disasters emphasizes prevention and mitigation, and mobile health (mHealth) apps have been used for mental health promotion and treatment. However, little is known about their use in the mental health components of disaster management.
Objective
This scoping review was conducted to explore the use of mobile phone apps for mental health responses to natural disasters and to identify gaps in the literature.
Methods
We identified relevant keywords and subject headings and conducted comprehensive searches in 6 electronic databases. Studies in which participants were exposed to a man-made disaster were included if the sample also included some participants exposed to a natural hazard. Only full-text studies published in English were included. The initial titles and abstracts of the unique papers were screened by 2 independent review authors. Full texts of the selected papers that met the inclusion criteria were reviewed by the 2 independent reviewers. Data were extracted from each selected full-text paper and synthesized using a narrative approach based on the outcome measures, duration, frequency of use of the mobile phone apps, and the outcomes. This scoping review was reported according to the PRISMA-ScR (Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for Scoping Reviews).
Results
Of the 1398 papers retrieved, 5 were included in this review. A total of 3 studies were conducted on participants exposed to psychological stress following a disaster while 2 were for disaster relief workers. The mobile phone apps for the interventions included Training for Life Skills, Sonoma Rises, Headspace, Psychological First Aid, and Substance Abuse and Mental Health Services Administration (SAMHSA) Behavioural Health Disaster Response Apps. The different studies assessed the effectiveness or efficacy of the mobile app, feasibility, acceptability, and characteristics of app use or predictors of use. Different measures were used to assess the effectiveness of the apps’ use as either the primary or secondary outcome.
Conclusions
A limited number of studies are exploring the use of mobile phone apps for mental health responses to disasters. The 5 studies included in this review showed promising results. Mobile apps have the potential to provide effective mental health support before, during, and after disasters. However, further research is needed to explore the potential of mobile phone apps in mental health responses to all hazards.
Keywords: mental health, disasters, mobile health, mHealth, application, applications, app, apps, smartphone, stress, psychological, traumatic, disaster, disasters, hazard, hazards, emergency, psychological trauma, mobile apps, trauma, scoping, review methods, review methodology, mobile phone
Introduction
Rising global average temperatures and associated changes in weather patterns result in extreme weather events that include hazards such as heatwaves, wildfires, hurricanes, floods, and droughts [1]. These extreme events linked to climate change are resulting in overlapping and so-called cascading disasters leading to record numbers of “billion dollar” disasters with significant losses of lives and property [2,3]. In 2021 alone, approximately 10,000 fatalities caused by disasters were reported globally, while the economic loss was estimated at approximately US $343 billion [4]. Disasters are predicted to become more recurring as a result of the impact of human activities such as burning fossil fuels and deforestation, which release greenhouse gases into the atmosphere that trap heat and cause global temperatures to rise [5].
These catastrophes can adversely affect physical health, mental health, and well-being in both the short and long term as a result of changes due to the political and socioeconomic content, evacuations, social disruption, damage to health care facilities, and financial losses [6-10]. It is estimated that about 33% of people directly exposed to natural disasters will experience mental health sequelae such as posttraumatic stress disorders (PTSDs), anxiety, and depression, among others [11,12].
There is growing recognition of the importance of incorporating mental health into medical and emergency aspects of disaster response [12,13]. However, in contrast to most medical response strategies that are largely curative, mental health response to disasters is predicated on the principles of preventive medicine, thus, emphasizing health promotion, disaster prevention, preparedness, and mitigation [14]. The strategies of mental health response span across primary prevention (mitigating the risk of ill health before it develops), secondary prevention (early detection and intervention), and tertiary prevention (managing established ailment and averting further complications) [15].
Mobile health (mHealth) technology has shown great promise in mental health and has been applied across the 3 levels of prevention [16-20]. For example, SMS text messaging and mobile apps have been developed to promote mental health awareness among young people and older adults (primary prevention) [21]. Additionally, during the COVID-19 pandemic, mHealth was deployed at the population level in Canada to screen for symptoms of anxiety and depression (secondary prevention) [22]. In addition, mHealth interventions were deployed to support first responders and essential workers during the pandemic [23,24]. Further, the technology has been deployed for therapeutic purposes in patients diagnosed with mental health conditions while simultaneously providing support against complications such as suicidal ideation (tertiary prevention) [25].
Although videoconferencing and phone calls can be used for mental health conditions, mobile apps provide more mobility and accessibility, are interactive, more adaptable to users’ routines, and can be used repeatedly [26,27]. While numerous academic studies have been conducted on the app of mHealth in the preventive and curative management of mental health conditions in clinical, community, and public health settings, including epidemic response and control, little is known about the use of mobile apps in the mental health components of natural disaster management. This scoping review aims to fill this gap in the literature by mapping where and how mobile apps have been used as part of natural disaster mental health response strategies.
Methods
Overview
This scoping review was reported according to the PRISMA-ScR (Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for Scoping Reviews) [28]. The PRISMA-ScR checklist is available in Multimedia Appendix 1. The protocol was not registered.
Search Strategy
A medical librarian (JYK) collaborated with the research team to identify relevant keywords and subject headings for the review, such as mHealth or m-health; mobile health or mobile applications; public health emergency, disaster, or catastrophe; and flood, earthquake, or hurricane. Equipped with this knowledge, the librarian developed and executed comprehensive searches in 6 electronic databases, including Ovid MEDLINE, Ovid Embase, APA PsycInfo, CINAHL, Scopus, and Web of Science Core Collection. The search was conducted on June 30, 2022, and was limited to the English language. The full search strategies are available in Multimedia Appendix 2.
Inclusion and Exclusion Criteria
We included papers that applied mobile apps for mental health responses to disasters. Papers were included if the study participants were persons affected by a natural disaster (setting), the intervention included using a mobile phone app, and the outcome included the assessment of a mental health problem. Studies in which participants were exposed to a man-made disaster were included if the sample also included some participants exposed to a natural disaster. The mental health conditions included were stress, anxiety, depression, and PTSD. Only full-text studies published in English were included. Studies that did not include any intervention with a mobile app for mental health, those focused on videoconferencing or phone calls, and papers on protocols, trial registration, or review were excluded.
Selection of Studies
The search identified papers that were retrieved from the databases. After removing duplicates, the initial titles and abstracts of the unique papers were screened by 2 independent review authors based on the inclusion criteria in a web-based tool called Covidence (Veritas Health Innovation Ltd) [29]. Full texts of the selected papers that met the inclusion criteria were reviewed by the 2 independent reviewers. The research team resolved disagreements through discussion. The bibliographies from the included studies were also reviewed to identify additional studies for inclusion.
Data Extraction and Synthesis
Data from each selected full-text paper were extracted into a data extraction form developed by the research team. The data included the author and year of publication, country of study, study design, number of participants, type of natural disaster, name of the mobile app, duration of use of the app, outcome measures, and the study’s findings. These data were synthesized using a narrative approach based on the outcome measures, the duration, frequency of use of the mobile apps, and the outcomes.
Results
Search Results
Of the 1532 papers retrieved from the searches, 976 unique papers had their titles and abstracts screened after deduplication. A total of 38 papers were moved to full-text screening, and data were extracted from 5 papers [30-34] (Figure 1). Table 1 shows the summary of the details of the papers.
Table 1.
References | Country of study | Type of natural disaster | Mental health conditions targeted | Target population | Name of app (if available) | Intervention (app content) | Conclusion |
Choi et al [32] | South Korea | Mixed: earthquakes—2 participants, fires—3 participants, hazardous chemical—4 participants, and traffic accidents—11 participants. | Post-traumatic stress, 1 year after a natural, social, or artificial disaster. | Disaster survivors | TLSa apps |
|
The TLS mobile app was effective for increasing positive and decreasing negative psychological factors according to app usage time and is expected to provide psychological stability and to provide the appropriate conditions to enable effective self-control and management for disaster survivors. |
Heinz et al [30] | United States | Wildfires | PTSD and postdisaster distress | Disaster survivors | Sonoma Rises |
|
Findings from this study suggest that adolescent disaster survivors are willing and able to use digital health tools and find them beneficial. |
Rung et al [31] | United States | Hurricanes in 2005 and Deepwater Horizon oil spill in 2010 | Stress prevention and management | Disaster survivors | The Headspace mobile mindfulness app |
|
The program was easy and cost-effective to implement and acceptable to those who participated, but few women elected to try it. Several short-term benefits of the program were identified, particularly for depression and sleep. |
Choi et al [33] | South Korea | Disaster simulation training for responders in flood, fire, or leakage of hazardous chemicals | Traumatic stress | Disaster relief workers | PFAd app |
|
The use of PFA mobile app during disaster simulation training can function as a new framework for providing disaster relief teaching and methodical mental health services to survivors at the disaster site by disaster health care staff. |
Seligman et al [34] | United States | Any disaster | Stress prevention and management | Disaster relief workers | SAMHSAe Behavioral Health Disaster Response App | The app provides access to trauma and disaster-related behavioral health resources available on the web or in hard copyright on a smartphone. | The SAMHSA disaster app assures that responders feel confident at having the best disaster behavior health resources. |
aTLS: Training for Life Skills.
bPTSD: posttraumatic stress disorder.
cMBSR: Mindfulness-Based Stress Reduction.
dPFA: Psychological First Aid.
eSAMHSA: Substance Abuse and Mental Health Services Administration.
Characteristics of Included Studies
Of the 5 studies included in this review, 3 (60%) were conducted in the United States [30,31,34], while 2 (40%) were conducted in South Korea [32,33]. All studies used different study designs. A total of 3 studies used a quasi-experimental design—the first, a single group postexperiment with 22 participants [32]; the second, a multiple-baseline single case experimental design with 7 participants [30], while the third study used a 1-group pre- and posttest design with 318 participants [31]. The Training for Life Skills (TLS) app study had only a posttest following the use of the app [32]; the other 2 had baseline and follow-up measurements with the Sonoma Rises app study having, in addition, preintervention and postintervention measurements. The Psychological First Aid (PFA) study was designed as a qualitative study, while the Substance Abuse and Mental Health Services Administration (SAMHSA) study used a mixed methods descriptive design.
Characteristics of the Population
The TLS, Sonoma, and Headspace apps were designed for disaster survivors, while the PFA and SAMHA apps were designed to support disaster relief workers. The TLS app study was administered to adults with a median age of 32 years. Participants of the Sonoma Rises app study had a mean age of 16 (SD 0.98) years, while participants of the Headspace app study had a mean age of 46.1 (SD 10) years. The TLS app study focused on all types of disasters; the Sonoma Rises study focused on adolescents exposed to wildfires, while the Headspace app focused on women who experienced hurricanes and deep-water oil spillage. The PFA study involved 19 disaster health care workers who first underwent disaster simulation training using the mobile app.
Characteristics of the Mobile App Interventions
The included studies revealed several mobile phone apps used as interventions. The first, the TLS app, was used as a psychological first aid program for disaster survivors with content on information, psychological healing, and mood change [32]. The second was the Sonoma Rises app, a Health Insurance Portability and Accountability Act (HIPAA)–compliant, cloud-based mobile app with daily push notifications as reminders designed to help survivors of wildfires or other disasters to find their new routines, build resilience, and increase well-being. The app included 6 self-paced content sections, psychoeducation, and direct connections to free and local mental health care services. The third was the Headspace app for a mindfulness-based stress reduction program that included a series consisting of 10 sessions designed to be used for about 10 minutes per day. The SAMHSA Disaster App equips behavioral health providers to respond to all kinds of traumatic incidents by enabling them to readily access disaster-specific information and other important materials directly on their mobile devices [34]. The PFA mobile app provided evidence-based information and tools for disaster workers to prepare for, execute, and recover from providing psychological first aid during disasters. Accessibility via smartphones and the inclusion of multimedia interventions and assessments tailored for disaster contexts were key features enabling its use integrated with the simulation training [33].
Frequency and Duration of App Use
The 3 survivor-based apps had variations in the duration of the intervention (app use), which were 8 weeks, at least 5 times a week, frequency of use per day not specified [32]; 4 weeks for 10 minutes per day [30]; and 6 weeks for 5-10 minutes per day [31]. Both the TLS app and the Sonoma Rises app studies had weekly follow-up assessments. The different interventions were applied at least a year following the disasters. Participants in the Sonoma Rises app study used the app on an average of 17 (SD 8.92) days and visited the app an average of 43.50 (SD 30.56) times, with an average session lasting 56.85 (SD 27.87) seconds. The mean time spent on the app was 35.77 (SD 30.03) minutes, while for the TLS app study, the median time spent on the app over the 8 weeks of use was 200-399 minutes. Participants used the Headspace app an average of 24 (SD 36) days and logged in an average of 36 (SD 80) times. There was no description of the frequency and duration of use for the relief worker apps.
Effectiveness Outcomes
Effectiveness outcomes refer to the effects or impact of an intervention or program on the intended outcomes or goals. Different measures were used to assess the effectiveness of the apps’ use as either the primary or secondary outcome. Emotional quotients (emotional stability), basic rhythm quotients (brain stability), alpha-blocking rates (increased positive mood), and brain quotients assessed using electroencephalogram (EEG)–measured brainwave activities adjusted for self-reported app use time were used in the TLS app study [32]. The Headspace app study assessed effectiveness using a combination of measures such as trait mindfulness using a 15-item Mindful Attention Awareness Scale (MAAS)—trait version; depressive symptoms using the Center for Epidemiologic Studies Depression Scale-10 (CESD-10); perceived stress with the Perceived Stress Scale, 4-item version (PSS-4); and sleep quality using the Pittsburgh Sleep Quality Index (PSQI) [31]. The Sonoma Rises app study measured efficacy using daily ratings of anxiety and fear, weekly measures of post-traumatic stress symptoms using the Child PTSD Symptom Scale (CPSS-5) for Diagnostic and Statistical Manual of Mental Disorders, Fifth Edition (DSM-5), internalizing and externalizing symptoms using the Behaviour and Feelings Survey (BFS), psychosocial functioning using the Ohio Scale for Youth—Functioning subscale (OSY), and measures of anxiety (Generalized Anxiety Disorder-7 [GAD-7]), depression (Patient Health Questionnaire-9 [PHQ-9]), well-being—Warwick-Edinburgh Mental Well-being Scale (WEMWBS), sleep (Insomnia—Severity Index [ISI]), academic engagement (Student Engagement Instrument [SEI]), and perceived social support (Wills’ Social Support Scale [WSSS]) [30].
All 3 survivor-based apps were found to have positive benefits in addressing mental health issues among persons exposed to natural disasters. The TLS mobile app was shown to be effective in increasing positive and decreasing negative psychological factors according to app use time. The TLS mobile apps’ use had a significant effect on the emotional quotients (β=.550; P<.008), explanatory power (EP) was 30%, had a significant positive effect on the basic rhythm quotient (left brain: β=.598; P<.003; EP 35; right brain: β=.451; P<.035; EP 20%). Additionally, it had a significant positive effect on the alpha-blocking rate (left brain: β=.510; P<.015; EP 26%; right brain: β=.463; P<.035, EP 21%); and a significant positive effect on the brain quotient (β=.451; P<.035; EP 20%) [16]. The Headspace app had a positive effect on depression (odds ratio [OR] 0.3, 95% CI 0.11-0.81), physical activity (OR 2.8, 95% CI 1.0-7.8), sleep latency (OR 0.3, 95% CI 0.11-0.81), sleep duration (OR 0.3, 95% CI 0.07-0.86), and sleep quality (OR 0.1, 95% CI 0.02-0.96); however, there was no change in mindfulness scores from baseline to follow-up. For the Sonoma Rises app, no significant effects were observed for the clinical and functional outcomes because the longitudinal part of the study was affected by limited statistical power as a result of small sample size and historical confounds that made the participants miss data submission. However, visual inspection of individual data following the intervention showed downward trends across the study phases for daily levels of anxiety, fearfulness, and individual posttraumatic stress symptom severity.
For the PFA app, the qualitative study explored disaster health workers’ experiences with simulation training using focus group discussions. A total of 19 participants engaged in disaster scenarios with standardized patients, using a PFA app for guidance. Workers valued the practical educational approach, felt increased self-efficacy to support survivors, and identified areas for enhancing simulations and app tools to optimize effectiveness.
Implementation Outcomes
Implementation outcomes refer to the effects of an intervention or program implementation on various aspects of the implementation process, such as the fidelity of implementation, acceptability, adoption, feasibility, and maintainability. In the papers reviewed, feasibility was assessed using enrollment, program participation, and retention. Acceptability was measured using how well participants liked the app using a rating scale, how much of the app program was completed, the biggest barriers, and whether the app would be recommended to others. Data on characteristics of app use (engagement) were measured using the total number of log ins, average log ins per program completer, platform used (iOS, Android, or web-based), day of week of use (weekday vs weekend), and time of day of use (in 4-hour blocks) [30,31].
The Headspace app was reported to be cost-effective to implement and easy to use [31]. For engagement, only 14% (43/318) of the enrolled women used the app. The level of engagement with the app was high, with 72% (31/43) of participants completing some or all the sessions. Retention was also high with 74% (32/43) of the participants completing the follow-up survey. Lack of time was cited as the main barrier to using the app for 37% (16/43) of users and 49% (94/193) of nonusers. The majority of the users (32/43, 74%) reported high levels of satisfaction with the app. Acceptability was also high, with most participants (32/43, 74%) reporting that they liked the app and 86% (37/43) reporting that they would recommend it to others. Characteristics of app use showed that of the 1530 log ins, most participants (n=1191, 78%) used the iOS platform, mainly on weekdays (n=1147, 75%) and at different times of day mostly from noon to 4 PM (n=375, 25%).
Sonoma Rises was found to be feasible in terms of engagement and satisfaction among teens with high levels of disaster-related posttraumatic stress symptoms [30]. The self-assessment and data visualization features of the Sonoma Rises app strongly appealed to all the participants, and they were willing to recommend the app to their friends. Self-satisfaction with the mobile app was rated as extremely high (mean 8.50, SD 0.58, on a scale of 0 to 10, with 10 as totally satisfied). The participants agreed or strongly agreed to recommend this intervention to a friend. The participants found the intervention helpful (mean 2, SD 0.82); had the content, functions, and capabilities they needed (mean 3, SD 1.12); and were satisfied with how easy it was to use the app (mean 2, SD 0), on a scale of 1 to 5 with 1 as strongly agree and 5 as strongly disagree. In the qualitative feedback, to make the use of the app better, the participants suggested more notifications to return to the app and the use of the app immediately after a disaster. Implementation outcome was not an objective of the TLS app, hence, none was reported.
Other Mobile Apps With Potential Use in Disasters
Some mobile apps not meeting the inclusion criteria showed promise for supporting mental health in disasters. PTSD Coach provides tools for managing PTSD symptoms [35]. Though not disaster-specific, its psychoeducation, symptom tracking, and coping strategies could aid survivors. Similarly, COVID Coach was designed to help manage pandemic-related stress and anxiety [36]. These apps are summarized in Table 2.
Table 2.
References | Country of study | Type of natural disaster | Mental health conditions targeted | Name of app (if available) | Intervention (app content) | Conclusion |
Kuhn et al [35] | Australia, Canada, Netherlands, Germany, Sweden, and Denmark | None. Designed for general use in PTSDa, but could have potential use in disaster response. | PTSD | PTSD Coach |
|
PTSD Coach was found to be acceptable and perceived to be helpful for managing PTSD symptoms by veterans and community samples. It also demonstrated improvements in depression symptoms and psychosocial functioning. |
Jaworski et al [36] | United States | None. Used in COVID-19 pandemic. | Stress and anxiety | COVID Coach |
|
The use of COVID Coach suggests that mobile apps might have the spread and accessibility needed to act as a useful medium for distributing mental health information and resources to persons enduring COVID-19 pandemic–related stress. |
aPTSD: posttraumatic stress disorder.
Discussion
Principal Findings
This review sought to identify and map the use of mobile apps for the mental health component of natural disaster management. We found only 5 studies meeting the inclusion criteria. The scarcity of published literature in this area suggests that mobile apps have not been extensively used in mental health responses to natural disasters. Academic studies on the public’s use of mobile technologies in disaster management are still nascent [37], but there has been increased interest in developing and deploying digital technology and mobile apps by governments and nonstate actors as part of disaster preparedness and response [38,39]. A recent systematic review found that there is a lack of mental health preparedness in most countries when it comes to disasters [40]. The 5 studies included in our scoping review confirmed this gap and further demonstrated that mobile apps can provide mental health support to disaster-affected individuals and communities. The studies found that the use of mobile apps was associated with improvements in mental health outcomes, such as decreased anxiety and depression symptoms and increased resilience. The reviewed studies also suggest that mobile apps can be effective in delivering psychoeducation and coping skills training to disaster-affected individuals. A 2017 scoping review found that mobile apps have been largely used for communication purposes in disaster management [37]. The scope of use was classified into 5 categories which are not mutually exclusive. These categories are (1) crowdsourcing (organize and collect disaster-related data from the crowd), (2) collaborating platforms (serve as a platform for collaboration during disasters), (3) alerting and information (disseminate authorized information before and during disasters), (4) collating (gather, filter, and analyze data to build situation awareness), and (5) notifying (for users to notify others during disasters) [37].
Some authors classify disaster response into 3 phases: preparedness, response, and mitigation [41]. The studies included in this review exclusively examined the use of mobile apps during the recovery phase of disaster management. However, none of the studies explored the potential of mobile apps during the preparedness or response phases of disaster management. By addressing this gap, future research could help to provide more comprehensive and effective strategies for the use of mobile apps throughout all phases of disaster management. Examples of potential opportunities are demonstrated in Figure 2.
Preparedness Phase
Mobile apps can play a critical role as primary prevention interventions by raising awareness and promoting mental health literacy in the community in preparation for natural disasters. These apps can provide information on common mental health problems that may arise during and after disasters and offer tips on staying mentally healthy. For example, apps can include psychoeducation modules on coping skills, stress reduction, and self-care techniques, as well as information on how to prepare for a disaster and what steps to take to protect one’s mental health during and after a disaster. The use and effectiveness of mobile apps in health literacy have been demonstrated in the literature [19], thus providing a foundation for adaptation in disaster management.
Response Phase
Mobile apps can be used to connect people in need of mental health support with mental health professionals or other resources. For example, apps can provide information on emergency hotlines, crisis intervention services, and support groups. This was demonstrated as effective during the COVID-19 pandemic [42]. Mobile apps can also provide coping strategies and techniques to manage stress and anxiety in response to other natural disasters [34]. In this scoping review, we found that 3 apps had positive benefits in addressing mental health issues among persons exposed to natural disasters.
Recovery Phase
As part of secondary and tertiary prevention strategies, mobile apps can provide valuable ongoing support to those affected by disasters. For secondary prevention, mobile apps can be designed to support early detection and intervention for mental health problems after a natural disaster. These apps can include screening tools to identify common mental health issues such as anxiety, depression, and PTSD and offer appropriate referral pathways [43]. Additionally, apps can provide symptom-tracking tools to help individuals monitor their mental health over time [43]. For tertiary prevention, mobile apps can support the ongoing management of established mental health problems after a natural disaster. For example, apps can provide evidence-based psychotherapy interventions, such as cognitive-behavioral therapy, to help individuals manage their symptoms [44]. They can also connect individuals with support groups and peer-to-peer networks to provide additional emotional support and help individuals connect with others who have experienced similar challenges. Furthermore, mobile apps can offer self-help tools, such as meditation exercises and mood tracking, to help people cope with the ongoing mental health effects of the disaster. They can also provide information on local mental health services and support groups, helping individuals access the resources they need to manage their mental health.
General Mental Health Apps Show Promise for Disaster Response
While not specifically designed for disaster contexts, some mobile apps demonstrate strategies to support mental health that could aid disaster survivors. PTSD Coach delivers PTSD psychoeducation, symptom tracking tools, coping skills training, and crisis resource access—elements that could help survivors experiencing common postdisaster issues like trauma or loss [35]. Though it was tailored for veterans and civilians with PTSD, 1 study found it improved users’ depression and functioning. Similarly, COVID Coach offered pandemic-related stress management through symptom tracking, healthy coping recommendations, and crisis line referrals [36]. By leveraging the scalability of mobile apps, COVID Coach reached many struggling during a global crisis. These examples illustrate that apps may provide accessible, far-reaching mediums for disseminating disaster mental health resources—even without disaster-specific tailoring. Research should further explore adapting evidence-based, general mental health apps for disaster contexts or incorporate elements of them into future disaster response tools. With mental health needs magnified during disasters, mobile apps with thoughtful design show promise in expanding access to psychosocial support.
There are several potential limitations when using mobile apps for mental health responses to disasters. One of the main concerns is the accessibility of these apps, as not all members of the affected communities may have access to smartphones or internet connectivity. Furthermore, language and cultural barriers may prevent effective use. Another potential limitation is the quality and accuracy of the information provided. Without proper oversight, some apps may provide misinformation or inaccurate advice, which could exacerbate mental health issues. In addition, privacy concerns around collecting and storing sensitive data must be addressed.
Barriers like lack of mobile devices and internet access can impede adoption, especially in marginalized areas. Apps not designed for low literacy users or that are only available in certain languages could also limit accessibility. Concerns around privacy and security may deter some individuals. However, smartphone ubiquity globally enables use by vulnerable groups. Government agencies and nongovernmental organizations (NGOs) can promote adoption by integrating vetted apps into disaster protocols and funding dissemination. Developing apps with stakeholders and prelaunch user testing also facilitate uptake. Monitoring user feedback allows for ongoing optimization and troubleshooting of barriers. Cultural tailoring to address stigma and use local beliefs further enables implementation success. Finally, limited evidence-based research into app effectiveness highlights the need for more rigorous evaluation and testing of mobile apps for disaster mental health response.
This scoping review has certain methodological limitations that should be considered while interpreting its results. First, the search was restricted to 6 electronic databases and only English-language papers were considered. We also searched MEDLINE and not PubMed, and these may have led to the omission of some relevant studies. Second, the study focused on mobile phone apps for mental health response to disasters, disregarding other types of technology that could also be used in disaster management such as telehealth, SMS text messaging, and emails. Moreover, since the study included only 5 papers, it may not offer a comprehensive overview of the use of mobile phone apps in disaster response strategies. There is the possibility of the existence of apps not yet published in academic literature. Fourth, the nonuse of a control group in the design of the studies makes it difficult to determine whether the observed effects were entirely due to the use of the apps or other characteristics of the participants that predisposed them to use the apps. Fifth, the small sample sizes for the studies mean they require caution with generalization. Despite these limitations, the review provides valuable insights into the use of mobile apps in disaster response and serves as a useful resource for developing contextually appropriate mobile apps for disaster management. Last, our study focused on natural disasters, further research should examine the role of apps in supporting mental health in conflict and complex emergencies such as wars, outbreaks of violence, and complex political conflict situations [45].
Conclusions
This scoping review found that mobile apps have not been extensively used in mental health responses to natural disasters, with only 5 studies meeting the inclusion criteria. However, the studies included in this review demonstrate that mobile apps can be useful in providing mental health support to disaster-affected individuals, as well as equip disaster responders. There is a critical gap identified in this study, as none of the studies investigated the use of mobile apps for potential victims in the preparedness or response phases of disaster management. We, therefore, recommend that mobile apps be integrated into the various phases of disaster management as part of mental health response. Additionally, it is important to ensure that these apps are accessible to all members of the community, taking into account cultural, linguistic, and other factors that may impact their effectiveness. Mobile apps have great potential to provide valuable ongoing support to those affected by disasters, and they can be a valuable resource in disaster management, helping people cope with the mental health effects of disasters and connecting with the necessary support services.
The findings from this scoping review have important implications for policy makers, disaster management professionals, and mental health practitioners. There is a clear need for policies and protocols that integrate evidence-based mobile apps into mental health disaster planning and response. Disaster agencies should invest in developing, evaluating, and widely disseminating mobile apps specifically designed to mitigate psychological trauma before, during, and after catastrophic events. Mental health professionals can incorporate vetted mobile apps into their standard of care for at-risk disaster survivors. Going forward, a collaborative approach across these groups will be essential to leverage mobile technology in building community resilience and addressing the rising mental health burdens in an era defined by climate change–fueled natural disasters.
Acknowledgments
This work was funded by the Department of Psychiatry, Dalhousie University, Halifax, Canada. The funder was not involved in the conceptualization or implementation of the study, nor the decision to publish the findings.
Abbreviations
- BFS
Behaviour and Feelings Survey
- CESD-10
Center for Epidemiologic Studies Depression Scale-10
- CPSS-5
Child PTSD Symptom Scale for Diagnostic and Statistical Manual of Mental Disorders, Fifth Edition
- DSM-5
Diagnostic and Statistical Manual of Mental Disorders, Fifth Edition
- EEG
electroencephalogram
- EP
explanatory power
- GAD-7
Generalized Anxiety Disorder-7
- HIPAA
Health Insurance Portability and Accountability Act
- ISI
Insomnia—Severity Index
- MAAS
Mindful Attention Awareness Scale
- mHealth
mobile health
- NGO
Non-Governmental Organization
- OR
odds ratio
- OSY
Ohio Scale for Youth—Functioning subscale
- PFA
Psychological First Aid
- PHQ-9
Patient Health Questionnaire-9
- PRISMA-ScR
Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for Scoping Reviews
- PSQI
Pittsburgh Sleep Quality Index
- PSS-4
Perceived Stress Scale, 4-item version
- PTSD
posttraumatic stress disorder
- SAMHSA
Substance Abuse and Mental Health Services Administration
- SEI
Student Engagement Instrument
- TLS
Training for Life Skills
- WEMWBS
Warwick-Edinburgh Mental Well-being Scale
- WSSS
Wills’ Social Support Scale
The PRISMA-SCR checklist. PRISMA-SCR: Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for Scoping Reviews.
Detailed search strategy.
Footnotes
Conflicts of Interest: None declared.
References
- 1.Birkmann J, Cardona OD, Carreño ML, Barbat AH, Pelling M, Schneiderbauer S, Kienberger S, Keiler M, Alexander AE, Zeil P, Welle T. Theoretical and conceptual framework for the assessment of vulnerability to natural hazards and climate change in Europe. In: Birkmann J, Kienberger S, Alexander DE, editors. Assessment of Vulnerability to Natural Hazards: A European Perspective. San Diego, California: Elsevier; 2014. pp. 1–19. [Google Scholar]
- 2.Bhola V, Hertelendy A, Hart A, Adnan SB, Ciottone G. Escalating costs of billion-dollar disasters in the US: climate change necessitates disaster risk reduction. J Clim Change Health. 2023;10:100201. doi: 10.1016/j.joclim.2022.100201. [DOI] [Google Scholar]
- 3.Leppold C, Gibbs L, Block K, Reifels L, Quinn P. Public health implications of multiple disaster exposures. Lancet Public Health. 2022;7(3):e274–e286. doi: 10.1016/S2468-2667(21)00255-3. https://linkinghub.elsevier.com/retrieve/pii/S2468-2667(21)00255-3 .S2468-2667(21)00255-3 [DOI] [PubMed] [Google Scholar]
- 4.Global SDG indicators data platform. United Nations. 2021. [2024-04-05]. https://unstats.un.org/sdgs/dataportal .
- 5.Sloggy MR, Suter JF, Rad MR, Manning DT, Goemans C. Changing climate, changing minds? The effects of natural disasters on public perceptions of climate change. Clim Change. 2021;168(3-4):25. doi: 10.1007/s10584-021-03242-6. https://europepmc.org/abstract/MED/34720263 .3242 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Chen X, Bakal J, Whitten T, Waldie B, Ho C, Wright P, Hassam S, Norris C. Assessing the impact of COVID-19 pandemic on the health of residents and the healthcare system in Alberta, Canada: an observational study-the Alberta post-COVID follow-up study. BMJ Open. 2023;13(2):e067449. doi: 10.1136/bmjopen-2022-067449. https://bmjopen.bmj.com/lookup/pmidlookup?view=long&pmid=36806075 .bmjopen-2022-067449 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Pazderka H, Shalaby R, Eboreime E, Mao W, Obuobi-Donkor G, Agyapong B, Oluwasina F, Adu MK, Owusu E, Sapara A, Agyapong VIO. Isolation, economic precarity, and previous mental health issues as predictors of PTSD status in females living in Fort McMurray during COVID-19. Front Psychiatry. 2022;13:837713. doi: 10.3389/fpsyt.2022.837713. https://europepmc.org/abstract/MED/35370820 . [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.To P, Eboreime E, Agyapong VIO. The impact of wildfires on mental health: a scoping review. Behav Sci (Basel) 2021;11(9):126. doi: 10.3390/bs11090126. https://www.mdpi.com/resolver?pii=bs11090126 .bs11090126 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Agyapong B, Shalaby R, Eboreime E, Obuobi-Donkor G, Owusu E, Adu MK, Mao W, Oluwasina F, Agyapong VIO. Cumulative trauma from multiple natural disasters increases mental health burden on residents of Fort McMurray. Eur J Psychotraumatol. 2022;13(1):2059999. doi: 10.1080/20008198.2022.2059999. https://www.tandfonline.com/doi/full/10.1080/20008198.2022.2059999 .2059999 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Guerra O, Eboreime E. The impact of economic recessions on depression, anxiety, and trauma-related disorders and illness outcomes-a scoping review. Behav Sci (Basel) 2021;11(9):119. doi: 10.3390/bs11090119. https://www.mdpi.com/resolver?pii=bs11090119 .bs11090119 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Norris FH, Friedman MJ, Watson PJ, Byrne CM, Diaz E, Kaniasty K. 60,000 disaster victims speak: part I. An empirical review of the empirical literature, 1981-2001. Psychiatry. 2002;65(3):207–239. doi: 10.1521/psyc.65.3.207.20173. [DOI] [PubMed] [Google Scholar]
- 12.North CS, Pfefferbaum B. Mental health response to community disasters: a systematic review. JAMA. 2013;310(5):507–518. doi: 10.1001/jama.2013.107799.1724280 [DOI] [PubMed] [Google Scholar]
- 13.Pfefferbaum B, Flynn BW, Schonfeld D, Brown LM, Jacobs GA, Dodgen D, Donato D, Kaul RE, Stone B, Norwood AE, Reissman DB, Herrmann J, Hobfoll SE, Jones RT, Ruzek JI, Ursano RJ, Taylor RJ, Lindley D. The integration of mental and behavioral health into disaster preparedness, response, and recovery. Disaster Med Public Health Prep. 2012;6(1):60–66. doi: 10.1001/dmp.2012.1.6/1/60 [DOI] [PubMed] [Google Scholar]
- 14.Math SB, Nirmala MC, Moirangthem S, Kumar NC. Disaster management: mental health perspective. Indian J Psychol Med. 2015;37(3):261–271. doi: 10.4103/0253-7176.162915. https://europepmc.org/abstract/MED/26664073 .IJPsyM-37-261 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Ali A, Katz DL. Disease prevention and health promotion: how integrative medicine fits. Am J Prev Med. 2015;49(5 Suppl 3):S230–s240. doi: 10.1016/j.amepre.2015.07.019. https://linkinghub.elsevier.com/retrieve/pii/S0749-3797(15)00408-0 .S0749-3797(15)00408-0 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Reddy MC, Paul SA, Abraham J, McNeese M, DeFlitch C, Yen J. Challenges to effective crisis management: using information and communication technologies to coordinate emergency medical services and emergency department teams. Int J Med Inform. 2009;78(4):259–269. doi: 10.1016/j.ijmedinf.2008.08.003.S1386-5056(08)00149-4 [DOI] [PubMed] [Google Scholar]
- 17.Cheng DR, Coote A, South M. A digital approach in the rapid response to COVID-19—experience of a paediatric institution. Int J Med Inform. 2021;149:104407. doi: 10.1016/j.ijmedinf.2021.104407. https://europepmc.org/abstract/MED/33588302 .S1386-5056(21)00033-2 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Souza F, Kushchu I. Mobile disaster management system applications—current overview and future potential. IOP Conference Series: Materials Science and Engineering; Proceedings EURO mGOV; 2005; NA. 2005. pp. 455–466. https://iopscience.iop.org/article/10.1088/1757-899X/1009/1/012049 . [Google Scholar]
- 19.Chandrashekar P. Do mental health mobile apps work: evidence and recommendations for designing high-efficacy mental health mobile apps. Mhealth. 2018;4:6. doi: 10.21037/mhealth.2018.03.02. https://europepmc.org/abstract/MED/29682510 .mh-04-2018.03.02 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Hyde AM, Watt M, Carbonneau M, Eboreime EA, Abraldes JG, Tandon P. Understanding preferences toward virtual care: a pre-COVID mixed methods study exploring the perspectives of patients with chronic liver disease. Telemed J E Health. 2022;28(3):407–414. doi: 10.1089/tmj.2021.0099. [DOI] [PubMed] [Google Scholar]
- 21.Eboreime E, Ohinmaa A, Rusak B, Cassidy KL, Morrison J, McGrath P, Uher R, Meier S, Fleury MJ, Iyer SN, Rej S, Batchelor F, Levinger P, Dang C, Hopwood M, Acquah FNL, Dzator J, Murphy GT, Warford J, Wozney L, Vedel I, Gahagan J, Theou O, Koto P, Sampalli T, Kirkland S, Watters N, Agyapong VIO. The Text4HealthyAging program: an evidence-based text messaging innovation to support healthy urban aging in Canada and Australia. Gerontol Geriatr Med. 2022;8:23337214221081378. doi: 10.1177/23337214221081378. https://journals.sagepub.com/doi/10.1177/23337214221081378?url_ver=Z39.88-2003&rfr_id=ori:rid:crossref.org&rfr_dat=cr_pub0pubmed .10.1177_23337214221081378 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Shalaby R, Adu MK, Andreychuk T, Eboreime E, Gusnowski A, Vuong W, Surood S, Greenshaw AJ, Agyapong VIO. Prevalence, demographic, and clinical correlates of likely PTSD in subscribers of Text4Hope during the COVID-19 pandemic. Int J Environ Res Public Health. 2021;18(12):6227. doi: 10.3390/ijerph18126227. https://www.mdpi.com/resolver?pii=ijerph18126227 .ijerph18126227 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Vilendrer S, Amano A, Johnson CGB, Favet M, Safaeinili N, Villasenor J, Shaw JG, Hertelendy AJ, Asch SM, Mahoney M. An app-based intervention to support first responders and essential workers during the COVID-19 pandemic: needs assessment and mixed methods implementation study. J Med Internet Res. 2021;23(5):e26573. doi: 10.2196/26573. https://www.jmir.org/2021/5/e26573/ v23i5e26573 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.Obuobi-Donkor G, Eboreime E, Bond J, Phung N, Eyben S, Hayward J, Zhang Y, MacMaster F, Clelland S, Greiner R, Jones C, Cao B, Brémault-Phillips S, Wells K, Li XM, Hilario C, Greenshaw AJ, Agyapong VIO. An E-mental health solution to prevent and manage posttraumatic stress injuries among first responders in Alberta: protocol for the implementation and evaluation of text messaging services (Text4PTSI and Text4Wellbeing) JMIR Res Protoc. 2022;11(4):e30680. doi: 10.2196/30680. https://www.researchprotocols.org/2022/4/e30680/ v11i4e30680 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.Eboreime E, Shalaby R, Mao W, Owusu E, Vuong W, Surood S, Bales K, MacMaster FP, McNeil D, Rittenbach K, Ohinmaa A, Bremault-Phillips S, Hilario C, Greiner R, Knox M, Chafe J, Coulombe J, Xin-Min L, McLean C, Rathwell R, Snaterse M, Spurvey P, Taylor VH, McLean S, Urichuk L, Tzeggai B, McCabe C, Grauwiler D, Jordan S, Brown E, Fors L, Savard T, Grunau M, Kelton F, Stauffer S, Cao B, Chue P, Abba-Aji A, Silverstone P, Nwachukwu I, Greenshaw A, Agyapong VIO. Reducing readmission rates for individuals discharged from acute psychiatric care in Alberta using peer and text message support: protocol for an innovative supportive program. BMC Health Serv Res. 2022;22(1):332. doi: 10.1186/s12913-022-07510-8. https://bmchealthservres.biomedcentral.com/articles/10.1186/s12913-022-07510-8 .10.1186/s12913-022-07510-8 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Andersson G, Cuijpers P. Internet-based and other computerized psychological treatments for adult depression: a meta-analysis. Cogn Behav Ther. 2009;38(4):196–205. doi: 10.1080/16506070903318960.917833314 [DOI] [PubMed] [Google Scholar]
- 27.Nicholas J, Ringland KE, Graham AK, Knapp AA, Lattie EG, Kwasny MJ, Mohr DC. Stepping up: predictors of 'stepping' within an iCBT stepped-care intervention for depression. Int J Environ Res Public Health. 2019;16(23):4689. doi: 10.3390/ijerph16234689. https://www.mdpi.com/resolver?pii=ijerph16234689 .ijerph16234689 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.Tricco AC, Lillie E, Zarin W, O'Brien KK, Colquhoun H, Levac D, Moher D, Peters MD, Horsley T, Weeks L, Hempel S, Akl EA, Chang C, McGowan J, Stewart L, Hartling L, Aldcroft A, Wilson MG, Garritty C, Lewin S, Godfrey CM, Macdonald MT, Langlois EV, Soares-Weiser K, Moriarty J, Clifford T, Tunçalp Ö, Straus SE. PRISMA extension for Scoping Reviews (PRISMA-ScR): checklist and explanation. Ann Intern Med. 2018;169(7):467–473. doi: 10.7326/M18-0850. https://www.acpjournals.org/doi/abs/10.7326/M18-0850?url_ver=Z39.88-2003&rfr_id=ori:rid:crossref.org&rfr_dat=cr_pub0pubmed .2700389 [DOI] [PubMed] [Google Scholar]
- 29.Veritas Health Innovation. Melbourne, Australia: 2022. [2024-04-05]. Covidence systematic review software. https://www.covidence.org/ [Google Scholar]
- 30.Heinz AJ, Wiltsey-Stirman S, Jaworski BK, Sharin T, Rhodes L, Steinmetz S, Taylor K, Gorman B, Mason D, Marikos S, McGovern M. Feasibility and preliminary efficacy of a public mobile app to reduce symptoms of postdisaster distress in adolescent wildfire survivors: Sonoma rises. Psychol Serv. 2021;19(2):67–79. doi: 10.1037/ser0000576.2022-03048-001 [DOI] [PubMed] [Google Scholar]
- 31.Rung AL, Oral E, Berghammer L, Peters ES. Feasibility and acceptability of a mobile mindfulness meditation intervention among women: intervention study. JMIR Mhealth Uhealth. 2020;8(6):e15943. doi: 10.2196/15943. https://mhealth.jmir.org/2020/6/e15943/ v8i6e15943 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32.Choi YJ, Ko EJ, Choi EJ, Um YJ. Managing traumatic stress using a mental health care mobile app: a pilot study. Int J Ment Health Promot. 2021;23(3):385–393. doi: 10.32604/IJMHP.2021.015018. https://scholarworks.bwise.kr/cau/handle/2019.sw.cau/50973 . [DOI] [Google Scholar]
- 33.Choi YJ, Jung HS, Choi EJ, Ko E. Disaster healthcare workers' experience of using the psychological first aid mobile app during disaster simulation training. Disaster Med Public Health Prep. 2021;17:e55. doi: 10.1017/dmp.2021.308.S1935789321003086 [DOI] [PubMed] [Google Scholar]
- 34.Seligman J, Felder SS, Robinson ME. Substance Abuse and Mental Health Services Administration (SAMHSA) behavioral health disaster response app. Disaster Med Public Health Prep. 2015;9(5):516–518. doi: 10.1017/dmp.2015.84.S1935789315000841 [DOI] [PubMed] [Google Scholar]
- 35.Kuhn E, van der Meer C, Owen JE, Hoffman JE, Cash R, Carrese P, Olff M, Bakker A, Schellong J, Lorenz P, Schopp M, Rau H, Weidner K, Arnberg FK, Cernvall M, Iversen T. PTSD coach around the world. Mhealth. 2018;4:15. doi: 10.21037/mhealth.2018.05.01. https://europepmc.org/abstract/MED/29963560 .mh-04-2018.05.01 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 36.Jaworski BK, Taylor K, Ramsey KM, Heinz A, Steinmetz S, Pagano I, Moraja G, Owen JE. Exploring usage of COVID coach, a public mental health app designed for the COVID-19 pandemic: evaluation of analytics data. J Med Internet Res. 2021;23(3):e26559. doi: 10.2196/26559. https://www.jmir.org/2021/3/e26559/ v23i3e26559 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37.Tan ML, Prasanna R, Stock K, Hudson-Doyle E, Leonard G, Johnston D. Mobile applications in crisis informatics literature: a systematic review. Int J Disaster Risk Reduct. 2017;24:297–311. doi: 10.1016/j.ijdrr.2017.06.009. [DOI] [Google Scholar]
- 38.Romano M, Onorati T, Aedo I, Diaz P. Designing mobile applications for emergency response: citizens acting as human sensors. Sensors (Basel) 2016;16(3):406. doi: 10.3390/s16030406. https://www.mdpi.com/resolver?pii=s16030406 .s16030406 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 39.Schoning J, Rohs M, Krüger A, Stasch C. Mobile Response 2008. Lecture Notes in Computer Science, vol 5424. Berlin, Heidelberg: Springer; 2009. Improving the communication of spatial information in crisis response by combining paper maps and mobile devices; pp. 57–65. [Google Scholar]
- 40.Roudini J, Khankeh HR, Witruk E. Disaster mental health preparedness in the community: a systematic review study. Health Psychol Open. 2017;4(1):2055102917711307. doi: 10.1177/2055102917711307. https://journals.sagepub.com/doi/10.1177/2055102917711307?url_ver=Z39.88-2003&rfr_id=ori:rid:crossref.org&rfr_dat=cr_pub0pubmed .10.1177_2055102917711307 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 41.Colajanni G, Daniele P, Nagurney A, Nagurney LS, Sciacca D. A three-stage stochastic optimization model integrating 5G technology and UAVs for disaster management. J Glob Optim. 2023;86:1–40. doi: 10.1007/s10898-023-01274-z. https://europepmc.org/abstract/MED/36855677 .1274 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 42.Singh HJL, Couch D, Yap K. Mobile health apps that help with COVID-19 management: scoping review. JMIR Nurs. 2020;3(1):e20596. doi: 10.2196/20596. https://nursing.jmir.org/2020/1/e20596/ v3i1e20596 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 43.Funnell EL, Spadaro B, Martin-Key N, Metcalfe T, Bahn S. mHealth solutions for mental health screening and diagnosis: a review of app user perspectives using sentiment and thematic analysis. Front Psychiatry. 2022;13:857304. doi: 10.3389/fpsyt.2022.857304. https://europepmc.org/abstract/MED/35573342 . [DOI] [PMC free article] [PubMed] [Google Scholar]
- 44.Murphy K, Coombes I, McMillan S, Wheeler AJ. Clozapine and shared care: the consumer experience. Aust J Prim Health. 2018;24(6):455–462. doi: 10.1071/PY18055.PY18055 [DOI] [PubMed] [Google Scholar]
- 45.Goniewicz K, Burkle FM, Hertelendy AJ, Khorram-Manesh A. The impact of war on emergency departments visits by Ukrainian refugees in Poland. Am J Emerg Med. 2023;67:189–190. doi: 10.1016/j.ajem.2023.02.040.S0735-6757(23)00118-3 [DOI] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
The PRISMA-SCR checklist. PRISMA-SCR: Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for Scoping Reviews.
Detailed search strategy.