Abstract
Background
Many children with mental health problems do not receive professional help. Despite the frequent use of digital health interventions (DHIs) such as websites or web-based service navigation platforms, their effects on parents’ mental health literacy, help seeking, or uptake of professional services are unclear.
Objective
This study aims to provide a systematic review and narrative synthesis to describe whether DHIs improve the aforementioned parental outcomes.
Methods
Databases, including CINAHL, Embase, MEDLINE OVID, PsycINFO, and PubMed (2000-2020), were accessed. Studies were included if they evaluated quantitative changes in mental health literacy, help seeking, or the uptake of services by parents of children with mental health problems. Theoretical frameworks, sample sizes, participant demographics, recruitment, interventions, DHI use, results, and health economic measures were used for data extraction.
Results
Of the 11,379 search results, 5 (0.04%) studies met the inclusion criteria. One randomized controlled trial found the reduced uptake of services after using a DHI coupled with a telephone coach for a child’s behavioral problem. Of 3 studies, 2 (66.7%) found statistically significant improvement in mental health literacy for attention-deficit/hyperactivity disorder but had no control group. One study found nonsignificant improvement in mental health literacy and help-seeking attitudes toward anxiety and depression compared with those in active controls. All studies were rated as having a high or serious risk of bias. Search results were affected because of a single reviewer screening articles, overall low-quality studies, and a lack of consistent nomenclature.
Conclusions
There is no high-quality evidence that DHIs can improve parents’ mental health literacy, help seeking, or uptake of services. More research is needed to evaluate DHIs by using rigorous study designs and consistent measures.
Trial Registration
PROSPERO International Prospective Register of Systematic Reviews CRD42020130074; https://www.crd.york.ac.uk/prospero/display_record.php?ID=CRD42020130074
Keywords: child, mental health, systematic review, caregiver, health literacy, digital health
Introduction
Background
Mental health problems are common among children [1,2]. They include internalizing problems, such as anxiety and lowered mood, and externalizing problems, such as hyperactivity, oppositional defiance, and aggression. Around half of these problems can progress to mental health disorders that are associated with adverse outcomes, including early school dropout, criminal justice system involvement, lower life satisfaction, poorer relationships, and lower earning potential [3-9]. Fortunately, there is a range of evidence-based treatments that have been shown to improve mental health problems in children, including the use of websites or web-based programs or other digital health interventions (DHIs) [10-13]. A DHI can be defined as the digital delivery of health information, such as through websites or apps, for health-related purposes [14]. Many of these treatments, including those delivered by DHIs and face-to-face interventions, focus on improving parenting—a key modifiable risk factor for these problems [15]. Despite treatments being available, many children with mental health problems do not receive professional help [2,16-18].
There are several recurrent barriers that prevent children receiving professional help. These barriers can be viewed along the help-seeking process, as parents need to recognize their child’s problem and acknowledge their need for additional support, be aware of treatment options, overcome stigma in accessing treatment, and ultimately access available services or treatments [2,19,20]. A lack of problem recognition and awareness of available treatments reflect inadequate mental health literacy, which has been defined as the “knowledge and beliefs about mental disorders which aid their recognition, management or prevention” [21]. Mental health literacy is important because it is linked to actions and mental health outcomes [22]. For children, especially young children, parents play a large role in recognizing the child’s problem and facilitating help seeking (Figure 1).
Ideally, we should be able to improve parents’ knowledge of mental health problems in children and where to find available and accessible services to help their children. This could be done by improving their mental health literacy, a known modifiable factor of help seeking [23]. However, previous research on interventions designed to improve mental health literacy and help seeking has been hampered by a lack of consistent measures of mental health literacy and a lack of focus on parents [22,24,25]. For parents, a US study with 165 children with mood disorders and other mental health comorbidities showed that face-to-face mental health literacy interventions can improve the quality of services accessed by families compared with waitlist control. The quality of services was measured by consensus among a group of blinded expert clinician researchers [26]. However, this intervention was intensive (8 group sessions lasting 90 minutes each) and may have been affected by attrition bias, as only 74% of participants completed the 18-month follow-up. In addition, several families dropped out of the waitlist control group after their child’s symptoms improved, underscoring the need for controlled trials to account for the natural history of some mental health problems improving over time.
Digital delivery of this educational material to parents, such as through a DHI, may prove to be an effective, accessible, scalable, and desirable way to improve parents’ mental health literacy and help seeking. Most parents search the web for health information and seek out the lived experience of other parents through forums, such as those on Facebook [27,28]. As parents seek out this information on the web, money and resources are devoted to building websites, apps, and platforms to help parents better understand their child’s mental health and where to receive help. Child mental health websites, such as childmind.org, can have enormous reach with a recent mental health campaign reaching 275 million people [29].
The World Health Organization states that DHIs have many perceived benefits, including enhanced reach, accessibility, scalability, desirability, reduced stigma, and perceived cost-effectiveness [14]. DHIs’ perception of cost-effectiveness comes from the potential for near-infinite scalability at low cost and targeted early intervention [14,30,31]. However, data on cost-effectiveness are rarely collected, despite recommendations to measure the economic impact as part of any DHI evaluation [32,33].
DHIs have been shown to improve mental health literacy in adults, based on the findings of 2 systematic reviews [34,35]. However, these reviews, which included a combined total of 28 studies, only included 1 study with parents.
The single-parent study was a randomized controlled trial that found that a convenience sample of parents recruited from a single workplace improved their mental health literacy from a DHI [36]. This lack of focus on parents in previous reviews is important because parents are the agents of change for their child’s mental health. Unlike adults seeking help for themselves, parents’ willingness to receive help for their child’s mental health problem is influenced by unique factors, such as whether the child participates in mental health treatment, or whether the treatment is framed in terms of child development [37,38]. With half of all adult mental health disorders originating in childhood, it is crucial to determine how DHIs can improve parents’ mental health literacy, help seeking, and uptake of mental health services for their children [9].
However, there have been no consistent positive effects on parental help-seeking attitudes, with some low-quality studies finding a positive effect of DHIs, but most found no effects [34,35]. Studies in these 2 reviews had some limitations, specifically the common use of convenience sampling, the predominant focus on young people, lack of consistent measures, and low-quality evidence.
Recently, a universal education program delivered via SMS text messaging improved mental health literacy in the parents of adolescents compared with care as usual control. However, this study did not include parents of younger children or parents who were identified as having an adolescent with a mental health problem, who may be more likely to benefit from an intervention that facilitates help seeking [39].
Little is known about the effects of a DHI on the mental health literacy of parents, especially parents of young children, and even less is known about the effects on help seeking and uptake of services and cost-effectiveness. This is despite the frequent use of DHIs by parents and low uptake of services among many children with a mental health problem.
Objectives
In this study, we aim to conduct a systematic review of the literature to understand (1) whether DHIs targeting parents of children aged 2 to 12 years with a mental health problem improve mental health literacy and (2) whether the use of DHIs is associated with changes in parental help seeking or uptake of mental health services for their child. We also aim to report the cost-effectiveness of such DHIs.
Methods
The systematic review was registered with PROSPERO (CRD42020130074). We conducted and reported a systematic review according to the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) guidelines [40].
Eligibility
We included studies that evaluated a DHI delivered directly to parents of children aged 2 to 12 years, with quantitative data reporting on outcomes of mental health literacy (specifically knowledge of treatment), help seeking (attitudes, intentions, and behaviors), or uptake of mental health services. Quantitative data were chosen to narratively synthesize the impact of DHIs on mental health literacy, help seeking and uptake of services.
For this review, we defined a DHI as a consumer-facing intervention using information communication technology targeting parents. The intervention could deliver information as a static webpage, a web-based parenting program, a web-based social network, a native mobile app, or other content delivered using digital means (other than telehealth). This definition was included in the PROSPERO registration.
We included DHIs targeting children with and without a mental health condition as long as the DHI was delivered as part of a program where some families were identified as having a mental health concern for their child. We included children aged 2 to 12 years. This age range was selected because of their likely dependence on parents to receive help for their mental health and the long-term impact of these early years on the well-being into adulthood [9]. We required a minimum of 1 outcome question on mental health literacy focusing on any of the following: knowledge of treatment, help seeking, or uptake of services.
Study designs included randomized controlled trials, quasi-randomized trials, and uncontrolled single-cohort studies. We restricted our analysis to articles published between January 2000 and December 2020 and written in English. We excluded conference proceedings and gray literature.
Data Sources and Search Strategy
We developed our search strategy after consultation with a research librarian at The Royal Children’s Hospital, Melbourne, Australia. A pilot search was performed in MEDLINE OVID, followed by a review of keywords and further development of the search strategy. We searched the electronic databases CINAHL, Embase, MEDLINE OVID, PsycINFO, and PubMed in late 2019 and repeated the search in January 2021 to identify any more recent publications.
We also reviewed the reference list of the included studies to identify additional studies for full-text review. All search results were compiled in Endnote and then exported to Covidence for screening. The search strategy used for all the databases is given in Multimedia Appendix 1.
Study Selection
One author (DP) screened the titles and abstracts of all articles produced from the search against the eligibility criteria. The full text of the remaining articles was obtained and screened again against the inclusion criteria. Any concerns about study eligibility were resolved in discussions with the supervising author (HH) during fortnightly supervision meetings. If there was insufficient evidence from the full-text study on whether it met the inclusion or exclusion criteria, DP attempted to contact the authors to obtain relevant information.
Data Collection Process
Two authors (DP and MG) independently extracted data from the included studies using a pre-existing data collection form for intervention reviews from Cochrane [41].
Data Items
Data extracted included study design; number of participants; type of comparison (where relevant); setting; recruitment; age and sex of participants and their children; the intervention, including the theoretical basis (a factor that may influence the success of a help-seeking intervention) [42] and measures of DHI use; outcome measures and whether they are validated measures; results; and economic outcomes. The data extracted were compared for accuracy, and the supervising author (HH) resolved any disagreements. Where possible, we calculated the effect sizes of the interventions and included these in Table 1.
Table 1.
Study | Design | Sample, n | Intervention | Timing of measures | Primary outcome | Measure | Outcome | P value | Validated measure |
Montoya et al [43] | Pre or post single cohort | 35 | DISCERN tool assessing popular Spanish websites about ADHDa treatment | Unspecified time points pre, post parents using the DISCERN tool | Mental health literacy: ADHD specific knowledge and motivation for treatment |
|
|
|
No |
Ossebaard et al [44] | Pre or post single cohort | 195 | Web-based decision aid on ADHD treatment | Pre, post intervention, though exact timing unclear | Mental health literacy: ADHD knowledge and treatment |
|
|
|
Unclear |
Ryan et al [45] | Pre or post single cohort | 172 | Information-based website on ADHD management | Baseline: 28 days postbaseline | Mental health literacy: ADHD knowledge |
|
|
|
No |
Sapru et al [46] | Nonrandomized controlled trials | 27 | 3× PowerPoint presentations emailed to participants | Pre and post intervention, though exact timing unclear | Mental health literacy and help-seeking attitudes for depression |
|
|
|
Not reported |
|
|
|
|
Pre, post intervention, though exact timing unclear | Mental health literacy and help-seeking attitudes for anxiety |
|
|
|
Not reported |
Sourander et al [47] | Randomized controlled trial | 464 | Strongest Families’ Smart website and 11× weekly 45-minute telephone coaching sessions | 6 months, 12 months, and 2 years after randomization | Uptake of services in the past 6 months |
|
|
|
No |
aADHD: attention-deficit/hyperactivity disorder.
Risk of Bias
The included studies were assessed for quality against 1 of 2 instruments. For nonrandomized studies, we assessed the risk of bias using the Risk of Bias in Nonrandomized Studies of Interventions tool [48]. For randomized studies, we assessed bias using the revised Cochrane tool for assessing risk of bias in randomized trials [49]. The quality assessment was conducted independently by DP and MG. They compared their assessments and resolved any disputes by discussion or through the input of the supervising author (HH).
Summary Measures
Whenever possible, we presented the outcome data of mental health literacy, help seeking, and uptake of services consistently, with parametric continuous data compared using means, nonparametric continuous data presented using medians, and categorical data presented as proportions. We also attempted to group the outcome data by validated and unvalidated measures.
Synthesis
Owing to the heterogeneity in outcome measures, we could not conduct a meta-analysis. Accordingly, we used a narrative synthesis to describe the effects of the DHIs.
Results
Search Results
Through the search strategy detailed in the previous section, a total of 11,379 potentially eligible articles were identified. Of the 11,379 articles, 5 (0.04%) met all inclusion and exclusion criteria (Figure 2). The primary author (DP) reviewed the reference list of these included studies, which revealed no additional studies meeting inclusion and exclusion criteria.
Description of Included Studies
Of the 5 included studies, 1 (20%) was a randomized controlled trial [47], 1 (20%) was a nonrandomized trial of 2 interventions [46], and 3 (60%) were uncontrolled before and after studies [43-45] (Table 2).
Table 2.
Study | Country | Design | Sample, n | Participants | Recruitment | Intervention | Comparator | Theoretical basis for the intervention | Digital health intervention use | Economic outcomes |
Montoya et al [43] | Spain | Single cohort pre or post study | 35 | Parents of children with a recent diagnosis of ADHDa | Parents selected by their child’s physician or from a local advocacy group | Use of the DISCERN tool to assess the quality of 10 popular Spanish websites about ADHD treatment | Nil | Not reported |
|
Not reported |
Ossebaard et al [44] | Netherlands | Single cohort pre or post study | 195 | Parents of children with a recent diagnosis of ADHD | The web-based decision aid invited visitors to the website to participate in the study | Web-based decision aid on ADHD treatment | Nil | Yes |
|
Not reported |
Ryan et al [45] | United Kingdom | Single cohort pre or post study | 172 | Parent or carer of a child with confirmed or suspected ADHD | Invited to attend if attending one of 3 pediatric outpatient clinics for suspected or confirmed ADHD | Information based website on ADHD management | Nil | Not reported |
|
Not reported |
Sapru et al [46] | Canada | Prospective nonrandomized controlled trial before and after study | 27 | Families referred to a tertiary hospital for management of a mood or anxiety disorder | Families on a waitlist for outpatient treatment of depression or anxiety were invited to attend | 3× PowerPoint presentations emailed to participants | 3 × 1-hour in-person group family psychoeducation sessions | Yes |
|
Not reported |
Sourander et al [47] | Finland | Prospective randomized controlled trial | 464 | Parents of children with high level disruptive behavior at a universal 4-year-old health check | Families attending a universal 4-year-old health check were screened and invited to attend | Strongest families smart website and 11× weekly 45-minute telephone coaching sessions | Brief website on positive parenting strategies and single 45-minute telephone coaching session and standard care | Not reported |
|
Not reported |
aADHD: attention-deficit/hyperactivity disorder.
All 5 studies were published between 2010 and 2018. There were 893 participants across the 5 studies, with the number of participants ranged from 27 to 464. The mean age of the children ranged from 4 to 10 years across the 5 studies. All studies were published in Europe or North America. Outcome measures included knowledge of attention-deficit/hyperactivity disorder (ADHD) treatment, knowledge and help seeking for anxiety and depression, and uptake of treatment for a child’s behavioral problem.
A total of 3 studies included participants with concerns about, or a recent diagnosis of, ADHD [43-45]. Another study included only participants who were parents of children with high-level disruptive behavior on the Strengths and Difficulties Questionnaire and who recognized that their child had a problem [47]. The final study included participants who were referred to a tertiary center for management of the child’s anxiety or depressive disorder, although the authors did not describe how the disorder had been diagnosed [46].
Participants were sampled using a variety of techniques. Of the 5 studies, 2 (40%) used consecutive sampling techniques to approach participants attending a scheduled universal health appointment [47] or a tertiary hospital mental health outpatient clinic [46]; 1 (20%) used a convenience sample of participants who had already attempted to access the intervention evaluated in the study [44]; and 1 (20%) used a convenience sample in which participants were selected by their child’s physician or from a local advocacy group [43].
Description of the Included Interventions
Of the 5 interventions, 4 (80%) were delivered on the web through a website [43-45,47] and 1 (20%) was delivered via a series of PowerPoint presentations [46]. These PowerPoint presentations were emailed to each family every week for 3 weeks. The topics of the three PowerPoint presentations were (1) introduction and treatment options, (2) interpersonal illness and communication skills, and (3) problem solving and personal reflection [46].
A total of 2 (40%) web-based interventions were delivered with a cointervention [43,47]. One (20%) of these cointerventions consisted of 11 consecutive weekly telephone coaching sessions, in addition to access to the Strongest Families Smart Website [47]. This website features 11 sessions containing tailored content, exercises, and instructional videos and requires parents to complete knowledge and experience-based questions. This content is designed to help parents develop skills to promote positive behavior and a positive relationship with their children [47]. Another study by Montoya et al [43] used a cointervention. In this study, parents evaluated popular ADHD websites against the DISCERN instrument [50] to assess the quality of written consumer health information available on ADHD treatment [43].
The remaining 2 (40%) interventions consisted of a website focused on ADHD [44,45]. A study by Ossebaard et al [44] trialed a web-based decision aid designed to help support parents and caregivers through the decision-making process of ADHD treatment. The average visitor, which included participants and nonparticipants, visited the website for an average of 6 minutes [44]. The final ADHD website contained information on the management of ADHD [45]. The website was funded by the pharmaceutical company Shire, which was disclosed to the participants. The participants could access the website for 1 month, and most of the participants accessed the website once or twice during that time [45]. For these 2 ADHD websites, postintervention outcomes were measured immediately following the intervention [44], 30 days after the intervention started [45], or 2 years after the intervention commenced [47].
Of the 5 studies, 2 (40%) did not specify precisely when they recorded postintervention outcomes [43,46].
Effect on Mental Health Literacy, Help Seeking, and Uptake of Services
Mental health literacy outcomes were the most common outcome assessed by the included studies, with 80% (4/5) of the studies measuring some form of mental health treatment knowledge (Table 1). The most common mental health problem assessed by the knowledge measures was ADHD [43-45], followed by depression and anxiety knowledge and help-seeking attitudes studied by Sapru et al [46]. Only 1 (20%) study measured the parent-reported uptake of mental health services [47].
ADHD Knowledge
Despite 60% (3/5) of the studies intending to measure ADHD knowledge and all through survey responses, each study used a different measure. None of these measures were validated. An adapted version of a validated measure was used by Ryan et al [45], but the authors did not provide a description of how it had been adapted and whether it was still valid. All of the ADHD knowledge studies were uncontrolled pre-post studies, and all showed an improvement in parent ADHD knowledge scores, 2 (40%) of which were statistically significant [42,49].
In addition, changes in knowledge among those who accessed the website and those who did not were assessed by Ryan et al [45]. Their study [45] showed that those who accessed the website at least once had a moderately significant improvement in knowledge compared with those who never accessed the ADHD and You website.
Of note, evaluation of a web-based decision aid by Ossebaard et al [44] was affected by a large number of missing data. From the 7500 unique views to the site, all of whom were invited to participate in the study, only 195 participants were enrolled, leading to potential selection bias. In addition, of these 195 participants, only 12 (6.2%) provided outcome data before and after the intervention, leading to potential attrition bias.
Depression and Anxiety Knowledge and Attitudes to Help Seeking
The only study that evaluated anxiety and depression-based mental health literacy and help-seeking attitudes was carried out by Sapru et al [46]. One measure was used for anxiety, and another for depression, with each measure assessing both knowledge and help-seeking attitudes within the same instrument. It was not reported whether these tools had been validated for this population.
Both the anxiety and depression measures showed an improvement in median scores of the intervention (web-based) compared with those of the control (in-person) group, although this difference was not significant in a small sample size.
Missing data and high attrition rates were again common, with outcome data provided for only 38% (5/13) of the intervention participants and 57% (8/14) of the control participants. The authors did not report why so many families failed to initiate or complete the programs and outcome measures. Two of the authors were contacted but did not provide further clarification on reasons for the missing data.
Uptake of Mental Health Services
Only 1 (20%) study measured the uptake of mental health services, which was also the largest study and had the longest follow-up of 2 years [47]. A study by Sourander et al [47] asked parents to self-report whether they had received any behavior treatment for their child in the previous 6 months. This measure was recorded at 6, 12, and 24 months after starting the 11-week intervention. The authors did not report whether this measure had been validated. Fewer parents in the intervention group, consisting of a website and 11 weekly telephone coaching sessions, reported that their child had accessed behavioral treatments (28/160, 17.5% participants) than did parents in the control group (46/164, 28% participants; odds ratio 1.8, 95% CI 1.1-3.1; P=.02). This reduction in the uptake of behavioral treatments occurred in the context of a small but significant improvement in the child’s behavior in the intervention group compared with the control group.
Cost-effectiveness
No studies reported on the cost-effectiveness or costs of the DHIs.
Assessment of Risk of Bias
One randomized controlled trial was rated as having a high risk of bias in 1 domain because of missing data, giving it an overall rating of high risk (Table 3) [47].
Table 3.
Study | Randomization process or selection bias | Deviations from intervention | Missing outcome or attrition bias | Measurement of outcome or detection bias | Selection of reported result or reporting bias | Overall |
Sourander et al [47] | Low | Low | High | Some concerns | Some concerns | High |
A total of 4 study designs were nonrandomized, with 3 (75%) of these studies [43,45,46] rated at serious risk of bias and 1 (25%) [44] rated at critical risk of bias (Table 4). The studies were rated at serious risk of bias because of a lack of identification of, or control for, potential confounders; potential for bias in selection of participants; and lack of objective outcome measures. The large number of missing participants also contributed to attrition bias and subsequent critical risk ratings.
Table 4.
Study | Confounding | Selection of participants | Classification of interventions | Deviations from intended interventions | Missing data | Measurement of outcomes | Selection of reported result | Overall |
Montoya et al [43] | Serious | Low | Low | Low | Low | Moderate | Moderate | Serious |
Ossebaard et al [44] | Serious | Critical | Low | Low | Critical | Serious | Moderate | Critical |
Ryan et al [45] | Serious | Low | Low | Low | Moderate | Serious | Moderate | Serious |
Sapru et al [46] | Serious | Serious | Low | Low | Moderate | Moderate | Moderate | Serious |
Discussion
Principal Findings
This study identified 5 studies of DHIs for parents of children with a mental health problem, measuring changes in mental health literacy, help seeking, or uptake of services.
Of those measuring mental health literacy, 80% (4/5) of the studies showed an improvement in parent knowledge. However, most of these studies focused on ADHD knowledge and were of low quality.
Of the 5 studies, 1 (20%), using a very small sample size of parents, measured both mental health literacy and help-seeking attitudes and used a nonrandomized control group, showing a nonsignificant trend to improved knowledge and help-seeking attitudes for child’s anxiety and depression. For this study, the mental health literacy and help-seeking attitudes outcomes were evaluated using the same measure and results were not presented separately, precluding conclusions about whether this improvement was predominantly because of changes in knowledge or attitudes.
The only large randomized controlled trial measured uptake of services and found the use of a website coupled with a telephone coach, reduced uptake of services for the child’s behavior, whilst simultaneously improving child behavior compared with a control group at 24 months follow up [47]. Despite the widespread use of websites and apps to help parents understand their child’s mental health or find services to help their child, only one study evaluated a universally accessible website [43]. Of the 5 studies, 2 (40%) had a comparison group, and neither of these studies compared the DHI to an existing and previously evaluated face-to-face, web-based, or school-based intervention. Thus, the comparative efficacy, feasibility, and cost-effectiveness of DHIs and face-to-face interventions remain unclear.
Of the 5 studies, 2 (40%) reported using theory to inform the design of the DHI. Although there is no evidence to definitively support the use of theory in designing a DHI, it is recommended to use a theory, or theories, to inform the design of health promotion interventions, and it may be beneficial for DHIs targeting help seeking [42,51].
None of the studies reported health economic outcomes of the interventions, such as development costs, implementation expenses, or potential financial benefits from the intervention on the family or health services. The overall quality of the papers was low, with only 20% (1/5) of the studies being a randomized controlled trial. All studies were rated as either high risk of bias on the revised Cochrane tool or serious or critical risk of bias on the Risk of Bias in Nonrandomized Studies of Interventions tool.
In addition, the lack of consistent and validated measures made a meta-analysis impossible and limited our ability to compare efficacy among the interventions. The lack of consistent measures has been described previously [24].
This is the only review showing the impact of DHIs on mental health literacy, help seeking, and referral uptake in parents of children with mental health problems. We searched a wide range of databases, hand searched references from included articles, and attempted to contact authors where data were missing. This study included all quantitative studies evaluating a DHI across multiple time points and thus presented a wider scope of included study designs than existing review articles on DHIs for mental health literacy or help seeking. Finally, this was the only study that extracted data on the theoretical basis of the intervention and economic outcomes.
Limitations
We included only studies with quantitative outcome measures. We recognize that we could have used categorical coding of qualitative data (eg, positive, neutral, or negative impact) to include qualitative research. This could be an area for future research. In addition, qualitative studies may provide more nuanced data into the effectiveness or otherwise of DHIs in this area, particularly on factors influencing help-seeking attitudes, intentions, and behaviors. In addition, a single reviewer (DP) evaluated all search results against the inclusion and exclusion criteria, which may have resulted in studies being missed at the screening stage. However, hand searching of references within these papers revealed no new studies, suggesting that it is unlikely that we missed any published studies. The studies included were of poor quality; therefore, the results must be interpreted with caution. This review only included peer-reviewed journals and did not include a search for gray literature. As such, there is potential for publication bias in the results. Finally, a lack of consistent nomenclature around help seeking and uptake of services may have resulted in the search strategy missing some studies that measured these outcomes.
Impact
There is no high-quality evidence that DHIs improve parent mental health literacy, help seeking, or uptake of services, even for the most studied area of ADHD. There is low-quality evidence that parents’ mental health literacy can be improved through the use of DHIs. There is also evidence that the use of a website and telephone coach may reduce the long-term uptake of mental health services for preschool children with disruptive behavior. The economic benefit of any DHI targeting parent mental health literacy, help seeking, or uptake of services remains unknown. This study cautiously supports the use of DHIs, especially ADHD websites, to improve parent mental health literacy. There is no evidence that any DHI can improve help seeking or uptake of services for children with a mental health problem.
Future Research
Despite the widespread availability, enthusiasm for, and use of DHIs among parents, there is little rigorous evidence regarding the effect of DHIs on parent mental health literacy, help seeking, and uptake of services for their children. There is an urgent need to develop, implement, and rigorously evaluate DHIs designed to improve these outcomes, including an economic evaluation of their effects. Websites targeting parent mental health literacy, especially for mental health problems other than ADHD, should be evaluated to establish whether they increase mental health literacy. Ideally, this evaluation would compare new and previously evaluated interventions using validated measures of parent mental health literacy.
Researchers should conduct randomized controlled trials of new and existing DHIs, including existing interventions that are already frequently accessed by parents. Comparison of face-to-face and school- or community-based interventions would also prove helpful in understanding the role of DHIs within the broader context of child mental health services [25]. Outcomes should include validated measures of parents’ knowledge of mental health problems in children and mental health actions, such as help seeking and uptake of services [25]. Consistent use of validated measures would allow a comparison of interventions and meta-analysis of their effects [52]. Research focusing on help seeking and uptake of services is especially important, given that so many children with mental health disorders are not receiving professional help. Until such research is conducted, we do not know whether a DHI can improve the uptake of mental health services among parents of children with mental health problems. A systematic review of qualitative studies may provide additional information on the influence of DHIs on parents’ help-seeking behaviors.
Conclusions
This review found low-quality evidence that DHIs may increase mental health literacy for ADHD and increase mental health literacy and help-seeking attitudes toward anxiety and depression. Overall, the heterogeneity of measures and high risk of bias across studies impacted our ability to confidently interpret these findings. We highlight the gap between parents’ frequent use of web-based sources of health information and the paucity of published evidence on the effect of these DHIs on help seeking, the uptake of services, and cost-effectiveness.
Acknowledgments
The authors would like to thank Ms Poh Chua, a research librarian at The Royal Children’s Hospital, Melbourne, Australia, for her help in developing the search strategy for this review. In addition, they would like to thank Associate Professor Emma Sciberras for her assistance in conceptualizing this paper. DP was funded by the National Health and Medical Research Council Postgraduate Scholarship (grant 1189935). HH was supported by the National Health and Medical Research Council Practitioner Fellowship Award 1136222. The Victorian Government’s Operational Infrastructure Support Program supported research at the Murdoch Children’s Research Institute.
Abbreviations
- ADHD
attention-deficit/hyperactivity disorder
- DHI
digital health intervention
- PRISMA
Preferred Reporting Items for Systematic Reviews and Meta-Analyses
Search strategy.
Footnotes
Authors' Contributions: DP conceptualized and designed the study, searched the literature, extracted data, conducted a quality appraisal, drafted the initial manuscript, and reviewed and revised the manuscript. MG extracted data, conducted a quality appraisal, and reviewed and revised the manuscript. HH conceptualized and designed the study, supervised the data extraction and quality appraisal, and reviewed and revised the manuscript. All authors approved the final manuscript as submitted and agreed to be accountable for all aspects of the work.
Conflicts of Interest: None declared.
References
- 1.Perou R, Bitsko RH, Blumberg SJ, Pastor P, Ghandour RM, Gfroerer JC, Hedden SL, Crosby AE, Visser SN, Schieve LA, Parks SE, Hall JE, Brody D, Simile CM, Thompson WW, Baio J, Avenevoli S, Kogan MD, Huang LN, Centers for Disease Control & Prevention (CDC) Mental health surveillance among children--United States, 2005-2011. MMWR Suppl. 2013 May 17;62(2):1–35.su6202a1 [PubMed] [Google Scholar]
- 2.Lawrence D, Johnson S, Hafekost J. The Mental Health of Children and Adolescents. Report on the Second Australian Child and Adolescent Survey of Mental Health and Wellbeing. Canberra: Department of Health; 2015. [Google Scholar]
- 3.Asendorpf JB, Denissen JJ, van Aken MA. Inhibited and aggressive preschool children at 23 years of age: personality and social transitions into adulthood. Dev Psychol. 2008 Jul;44(4):997–1011. doi: 10.1037/0012-1649.44.4.997.2008-08592-009 [DOI] [PubMed] [Google Scholar]
- 4.Duchesne S, Vitaro F, Larose S, Tremblay RE. Trajectories of anxiety during elementary-school years and the prediction of high school noncompletion. J Youth Adolescence. 2007 Sep 19;37(9):1134–46. doi: 10.1007/s10964-007-9224-0. [DOI] [Google Scholar]
- 5.Knapp M, McDaid D, Parsonage M. Mental Health Promotion and Mental Illness Prevention: the Economic Case. London, UK: Department of Health; 2011. [Google Scholar]
- 6.Patel V, Flisher AJ, Hetrick S, McGorry P. Mental health of young people: a global public-health challenge. The Lancet. 2007 Apr;369(9569):1302–13. doi: 10.1016/S0140-6736(07)60368-7. [DOI] [PubMed] [Google Scholar]
- 7.Powdthavee N, Vignoles A. Mental health of parents and life satisfaction of children: a within-family analysis of intergenerational transmission of well-being. Soc Indic Res. 2007 Nov 30;88(3):397–422. doi: 10.1007/s11205-007-9223-2. [DOI] [Google Scholar]
- 8.Stevenson J, Goodman R. Association between behaviour at age 3 years and adult criminality. Br J Psychiatry. 2001 Sep;179:197–202. doi: 10.1192/bjp.179.3.197.S0007125000266919 [DOI] [PubMed] [Google Scholar]
- 9.Kessler RC, Amminger GP, Aguilar-Gaxiola S, Alonso J, Lee S, Ustün TB. Age of onset of mental disorders: a review of recent literature. Curr Opin Psychiatry. 2007 Jul;20(4):359–64. doi: 10.1097/YCO.0b013e32816ebc8c. http://europepmc.org/abstract/MED/17551351 .00001504-200707000-00010 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Furlong M, McGilloway S, Bywater T, Hutchings J, Smith S, Donnelly M. Behavioural and cognitive-behavioural group-based parenting programmes for early-onset conduct problems in children aged 3 to 12 years. Cochrane Database Syst Rev. 2012 Feb 15;(2):CD008225. doi: 10.1002/14651858.CD008225.pub2. [DOI] [PubMed] [Google Scholar]
- 11.Tarver J, Daley D, Lockwood J, Sayal K. Are self-directed parenting interventions sufficient for externalising behaviour problems in childhood? A systematic review and meta-analysis. Eur Child Adolesc Psychiatry. 2014 Dec;23(12):1123–37. doi: 10.1007/s00787-014-0556-5. [DOI] [PubMed] [Google Scholar]
- 12.March S, Spence SH, Donovan CL. The efficacy of an internet-based cognitive-behavioral therapy intervention for child anxiety disorders. J Pediatr Psychol. 2009 Jun;34(5):474–87. doi: 10.1093/jpepsy/jsn099.jsn099 [DOI] [PubMed] [Google Scholar]
- 13.James AC, James G, Cowdrey FA, Soler A, Choke A. Cognitive behavioural therapy for anxiety disorders in children and adolescents. Cochrane Database Syst Rev. 2015 Feb 18;(2):CD004690. doi: 10.1002/14651858.CD004690.pub4. http://europepmc.org/abstract/MED/25692403 . [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.World Health Organization . WHO Guideline: Recommendations on Digital Interventions for Health System Strengthening. Geneva: World Health Organization; 2018. [PubMed] [Google Scholar]
- 15.Kiernan KE, Mensah FK. Poverty, family resources and children’s early educational attainment: the mediating role of parenting. British Educ Res J. 2011 Apr;37(2):317–36. doi: 10.1080/01411921003596911. [DOI] [Google Scholar]
- 16.Mental health of children and young people in England, 2017. NHS Digital. 2018. [2022-02-01]. https://digital.nhs.uk/data-and-information/publications/statistical/mental-health-of-children-and-young-people-in-england/2017/2017 .
- 17.Kataoka SH, Zhang L, Wells KB. Unmet need for mental health care among U.S. children: variation by ethnicity and insurance status. Am J Psychiatry. 2002 Sep;159(9):1548–55. doi: 10.1176/appi.ajp.159.9.1548. [DOI] [PubMed] [Google Scholar]
- 18.Mental health: A Report of the Surgeon General. Rockville, MD: Department of Health and Human Services, U.S. Public Health Service; 1999. [Google Scholar]
- 19.Radez J, Reardon T, Creswell C, Lawrence PJ, Evdoka-Burton G, Waite P. Why do children and adolescents (not) seek and access professional help for their mental health problems? A systematic review of quantitative and qualitative studies. Eur Child Adolesc Psychiatry. 2021 Feb;30(2):183–211. doi: 10.1007/s00787-019-01469-4. http://europepmc.org/abstract/MED/31965309 .10.1007/s00787-019-01469-4 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Rickwood D, Deane FP, Wilson CJ, Ciarrochi J. Young people’s help-seeking for mental health problems. Australian e J Advanc Mental Health. 2014 Dec 17;4(3):218–51. doi: 10.5172/jamh.4.3.218. [DOI] [Google Scholar]
- 21.Jorm AF, Korten AE, Jacomb PA, Christensen H, Rodgers B, Pollitt P. "Mental health literacy": a survey of the public's ability to recognise mental disorders and their beliefs about the effectiveness of treatment. Med J Aust. 1997 Feb 17;166(4):182–6. doi: 10.5694/j.1326-5377.1997.tb140071.x. [DOI] [PubMed] [Google Scholar]
- 22.Jorm A. We need to move from ‘mental health literacy’ to ‘mental health action’. Mental Health Prevent. 2020 Jun;18:200179. doi: 10.1016/j.mhp.2020.200179. [DOI] [Google Scholar]
- 23.Xu Z, Huang F, Kösters M, Staiger T, Becker T, Thornicroft G, Rüsch N. Effectiveness of interventions to promote help-seeking for mental health problems: systematic review and meta-analysis. Psychol Med. 2018 Dec;48(16):2658–67. doi: 10.1017/S0033291718001265.S0033291718001265 [DOI] [PubMed] [Google Scholar]
- 24.Hurley D, Swann C, Allen MS, Ferguson HL, Vella SA. A systematic review of parent and caregiver mental health literacy. Community Ment Health J. 2020 Jan;56(1):2–21. doi: 10.1007/s10597-019-00454-0.10.1007/s10597-019-00454-0 [DOI] [PubMed] [Google Scholar]
- 25.Tully LA, Hawes DJ, Doyle FL, Sawyer MG, Dadds MR. A national child mental health literacy initiative is needed to reduce childhood mental health disorders. Aust N Z J Psychiatry. 2019 Apr;53(4):286–90. doi: 10.1177/0004867418821440. [DOI] [PubMed] [Google Scholar]
- 26.Mendenhall AN, Fristad MA, Early TJ. Factors influencing service utilization and mood symptom severity in children with mood disorders: effects of multifamily psychoeducation groups (MFPGs) J Consult Clin Psychol. 2009 Jun;77(3):463–73. doi: 10.1037/a0014527.2009-08093-009 [DOI] [PubMed] [Google Scholar]
- 27.Park E, Kim H, Steinhoff A. Health-related internet use by informal caregivers of children and adolescents: an integrative literature review. J Med Internet Res. 2016 Mar 03;18(3):e57. doi: 10.2196/jmir.4124. https://www.jmir.org/2016/3/e57/ v18i3e57 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.Yardi S, Caldwell PH, Barnes EH, Scott KM. Determining parents' patterns of behaviour when searching for online information on their child's health. J Paediatr Child Health. 2018 Nov;54(11):1246–54. doi: 10.1111/jpc.14068. [DOI] [PubMed] [Google Scholar]
- 29.2020 Children’s Mental Health Report. Child Mind Institute. [2022-02-01]. https://childmind.org/awareness-campaigns/childrens-mental-health-report/2020-childrens-mental-health-report/
- 30.Christensen H, Reynolds J, Griffiths KM. The use of e-health applications for anxiety and depression in young people: challenges and solutions. Early Interv Psychiatry. 2011 Feb;5 Suppl 1:58–62. doi: 10.1111/j.1751-7893.2010.00242.x. [DOI] [PubMed] [Google Scholar]
- 31.Boydell KM, Hodgins M, Pignatiello A, Teshima J, Edwards H, Willis D. Using technology to deliver mental health services to children and youth: a scoping review. J Can Acad Child Adolesc Psychiatry. 2014 May;23(2):87–99. http://europepmc.org/abstract/MED/24872824 . [PMC free article] [PubMed] [Google Scholar]
- 32.Hilty DM, Yellowlees PM, Nesbitt TS. Evolution of telepsychiatry to rural sites: changes over time in types of referral and in primary care providers' knowledge, skills and satisfaction. Gen Hosp Psychiatry. 2006;28(5):367–73. doi: 10.1016/j.genhosppsych.2006.05.009.S0163-8343(06)00094-6 [DOI] [PubMed] [Google Scholar]
- 33.Eysenbach G, CONSORT-EHEALTH Group CONSORT-EHEALTH: improving and standardizing evaluation reports of web-based and mobile health interventions. J Med Internet Res. 2011 Dec 31;13(4):e126. doi: 10.2196/jmir.1923. https://www.jmir.org/2011/4/e126/ v13i4e126 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34.Tay JL, Tay YF, Klainin-Yobas P. Effectiveness of information and communication technologies interventions to increase mental health literacy: a systematic review. Early Interv Psychiatry. 2018 Dec 13;12(6):1024–37. doi: 10.1111/eip.12695. [DOI] [PubMed] [Google Scholar]
- 35.Brijnath B, Protheroe J, Mahtani KR, Antoniades J. Do web-based mental health literacy interventions improve the mental health literacy of adult consumers? Results from a systematic review. J Med Internet Res. 2016 Jun 20;18(6):e165. doi: 10.2196/jmir.5463. https://www.jmir.org/2016/6/e165/ v18i6e165 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 36.Deitz DK, Cook RF, Billings DW, Hendrickson A. A web-based mental health program: reaching parents at work. J Pediatr Psychol. 2009 Jun;34(5):488–94. doi: 10.1093/jpepsy/jsn108. http://europepmc.org/abstract/MED/18845585 .jsn108 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37.Perceptions of parenting: mapping the gaps between expert and public understandings of effective parenting in Australia. Frameworks Institute. [2022-02-01]. https://www.frameworksinstitute.org/wp-content/uploads/2020/06/PRC_MTG_Report_May_2016_final.pdf .
- 38.Cunningham CE, Chen Y, Deal K, Rimas H, McGrath P, Reid G, Lipman E, Corkum P. The interim service preferences of parents waiting for children's mental health treatment: a discrete choice conjoint experiment. J Abnorm Child Psychol. 2013 Aug;41(6):865–77. doi: 10.1007/s10802-013-9728-x. [DOI] [PubMed] [Google Scholar]
- 39.Chu JT, Wadham A, Jiang Y, Whittaker R, Stasiak K, Shepherd M, Bullen C. Effect of MyTeen SMS-based mobile intervention for parents of adolescents: a randomized clinical trial. JAMA Netw Open. 2019 Sep 04;2(9):e1911120. doi: 10.1001/jamanetworkopen.2019.11120. https://jamanetwork.com/journals/jamanetworkopen/fullarticle/10.1001/jamanetworkopen.2019.11120 .2749564 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 40.Moher D, Liberati A, Tetzlaff J, Altman DG, PRISMA Group Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. PLoS Med. 2009 Jul 21;6(7):e1000097. doi: 10.1371/journal.pmed.1000097. https://dx.plos.org/10.1371/journal.pmed.1000097 . [DOI] [PMC free article] [PubMed] [Google Scholar]
- 41.Data extraction forms. Cochrane. [2022-02-01]. https://dplp.cochrane.org/data-extraction-forms .
- 42.Gulliver A, Griffiths KM, Christensen H, Brewer JL. A systematic review of help-seeking interventions for depression, anxiety and general psychological distress. BMC Psychiatry. 2012 Jul 16;12:81. doi: 10.1186/1471-244X-12-81. https://bmcpsychiatry.biomedcentral.com/articles/10.1186/1471-244X-12-81 .1471-244X-12-81 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 43.Montoya A, Hernández S, Massana MP, Herreros O, Garcia-Giral M, Cardo E, Diez JA, Soutullo C, Fernández-Jaén A, Fuentes J. Evaluating Internet information on attention-deficit/hyperactivity disorder (ADHD) treatment: parent and expert perspectives. Educ Health (Abingdon) 2013;26(1):48–53. doi: 10.4103/1357-6283.112801. http://www.educationforhealth.net/article.asp?issn=1357-6283;year=2013;volume=26;issue=1;spage=48;epage=53;aulast=Montoya .EducHealth_2013_26_1_48_112801 [DOI] [PubMed] [Google Scholar]
- 44.Ossebaard HC, van Gemert-Pijnen JE, Sorbi MJ, Seydel ER. A study of a Dutch online decision aid for parents of children with ADHD. J Telemed Telecare. 2010 Jan 19;16(1):15–9. doi: 10.1258/jtt.2009.001006.16/1/15 [DOI] [PubMed] [Google Scholar]
- 45.Ryan GS, Haroon M, Melvin G. Evaluation of an educational website for parents of children with ADHD. Int J Med Inform. 2015 Nov;84(11):974–81. doi: 10.1016/j.ijmedinf.2015.07.008.S1386-5056(15)30024-1 [DOI] [PubMed] [Google Scholar]
- 46.Sapru I, Khalid-Khan S, Choi E, Alavi N, Patel A, Sutton C, Odejayi G, Calancie O. Effectiveness of online versus live multi-family psychoeducation group therapy for children and adolescents with mood or anxiety disorders: a pilot study. Int J Adolesc Med Health. 2016 Oct 14;30(4):/j/ijamh.2018.30.issue-4/ijamh-2016-0069/ijamh-2016-0069.xml. doi: 10.1515/ijamh-2016-0069./j/ijamh.ahead-of-print/ijamh-2016-0069/ijamh-2016-0069.xml [DOI] [PubMed] [Google Scholar]
- 47.Sourander A, McGrath PJ, Ristkari T, Cunningham C, Huttunen J, Hinkka-Yli-Salomäki S, Kurki M, Lingley-Pottie P. Two-year follow-up of internet and telephone assisted parent training for disruptive behavior at age 4. J Am Acad Child Adolesc Psychiatry. 2018 Sep;57(9):658–68.e1. doi: 10.1016/j.jaac.2018.07.001.S0890-8567(18)30329-0 [DOI] [PubMed] [Google Scholar]
- 48.Sterne JA, Hernán MA, Reeves BC, Savović J, Berkman ND, Viswanathan M, Henry D, Altman DG, Ansari MT, Boutron I, Carpenter JR, Chan A, Churchill R, Deeks JJ, Hróbjartsson A, Kirkham J, Jüni P, Loke YK, Pigott TD, Ramsay CR, Regidor D, Rothstein HR, Sandhu L, Santaguida PL, Schünemann HJ, Shea B, Shrier I, Tugwell P, Turner L, Valentine JC, Waddington H, Waters E, Wells GA, Whiting PF, Higgins JP. ROBINS-I: a tool for assessing risk of bias in non-randomised studies of interventions. BMJ. 2016 Oct 12;355:i4919. doi: 10.1136/bmj.i4919. http://www.bmj.com/lookup/pmidlookup?view=long&pmid=27733354 . [DOI] [PMC free article] [PubMed] [Google Scholar]
- 49.Higgins JP, Altman DG, Gøtzsche PC, Jüni P, Moher D, Oxman AD, Savovic J, Schulz KF, Weeks L, Sterne JA, Cochrane Bias Methods Group. Cochrane Statistical Methods Group The Cochrane Collaboration's tool for assessing risk of bias in randomised trials. BMJ. 2011 Oct 18;343:d5928. doi: 10.1136/bmj.d5928. http://europepmc.org/abstract/MED/22008217 . [DOI] [PMC free article] [PubMed] [Google Scholar]
- 50.Charnock D, Shepperd S, Needham G, Gann R. DISCERN: an instrument for judging the quality of written consumer health information on treatment choices. J Epidemiol Community Health. 1999 Feb;53(2):105–11. doi: 10.1136/jech.53.2.105. https://jech.bmj.com/lookup/pmidlookup?view=long&pmid=10396471 . [DOI] [PMC free article] [PubMed] [Google Scholar]
- 51.Planning Health Promotion Programs: An Intervention Mapping Approach. San Francisco: John Wiley & Sons; 2011. Chapter 1: overview of intervention mapping. [Google Scholar]
- 52.Wei Y, McGrath PJ, Hayden J, Kutcher S. Mental health literacy measures evaluating knowledge, attitudes and help-seeking: a scoping review. BMC Psychiatry. 2015 Nov 17;15:291. doi: 10.1186/s12888-015-0681-9. https://bmcpsychiatry.biomedcentral.com/articles/10.1186/s12888-015-0681-9 .10.1186/s12888-015-0681-9 [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
Search strategy.