Abstract
Background
Mental health disorders among children and youths are common and often have negative consequences for children, youths, and families if unrecognized and untreated. With the goal of early recognition, primary care physicians (PCPs) play a significant role in the detection and referral of mental disorders. However, PCPs report several barriers related to confidence, knowledge, and interdisciplinary collaboration. Therefore, initiatives have been taken to assist PCPs in their clinical decision-making through clinical decision support methods (CDSMs).
Objectives
This review aimed to identify CDSMs in the literature and describe their functionalities and quality.
Methods
In this review, a search strategy was performed to access all available studies in PubMed, PsychINFO, Embase, Web of Science, and COCHRANE using keywords. Studies that involved CDSMs for PCP clinical decision-making regarding psychosocial or psychiatric problems among children and youths (0–24 years old) were included. The search was conducted according to PRISMA-Protocols.
Results
Of 1,294 studies identified, 25 were eligible for inclusion and varied in quality. Eighteen CDSMs were described. Fourteen studies described computer-based methods with decision support, focusing on self-help, probable diagnosis, and treatment suggestions. Nine studies described telecommunication methods, which offered support through interdisciplinary (video) calls. Two studies described CDSMs with a combination of components related to the two CDSM categories.
Conclusion
Easy-to-use CDSMs of good quality are valuable for advising PCPs on the detection and referral of children and youths with mental health disorders. However, valid multicentre research on a combination of computer-based methods and telecommunication is still needed.
Keywords: access to care, adolescent, children and youths, family health, mental health, primary care
Key messages.
Mental health disorders in young people are common and have negative consequences.
Primary care providers (PCPs) play a crucial role in the detection and management.
Clinical decision support methods (CDSMs) can assist PCP decision-making.
Computer-based CDSMs focus on self-help, diagnosis, and treatment suggestions.
Telecommunication methods offer support using interdisciplinary (video) calls.
Future efforts should aim at a combination of both identified categories of CDSMs.
Background
Mental health disorders among children and youths are common, as an estimated 10–20% of them experience mental health difficulties.1,2 All too often, mental health disorders remain underdiagnosed and undertreated.3 A continued disparity exists between the increasing demands for paediatric mental health services and the limited supply of these services, particularly because of a shortage of child and adolescent psychologists and psychiatrists.4–7 To prevent negative long-term consequences for families and economic burdens for communities, accurate and timely detection of mental health disorders and appropriate referrals to youth mental health care are essential.8,9 One in four 7–12 year olds and four in ten 13–16 year olds who attend primary care have some sort of mental health problem.10 Therefore, primary care providers (PCPs) play an important role in the detection of mental health disorders and referrals to specialist services.10 In most Western countries, general practitioners (GPs) and paediatricians are examples of PCPs.11 Despite their crucial role, PCPs report a profound lack of communication skills with children and adolescents and a lack of confidence and knowledge about mental health difficulties, which negatively affect their clinical decision-making.8,9,12 Furthermore, collaborative care between PCPs and specialist child and youth mental health care providers is not satisfactory in terms of interdisciplinary communication and logistic procedures, for example, the quality of provided patient-specific information in referral letters.9
To improve the detection of mental health disorders and referral efficacy, various approaches have been developed to support PCPs in their clinical decision-making, including clinical decision support methods (CDSMs).8 Currently, no universal definition of CDSM exists. Therefore, this study uses the CDSM definition by Sim et al.: “methods that are designed to be a direct aid to clinical decision-making, in which the characteristics of an individual patient are matched to a (computerized) clinical knowledge base and patient-specific assessments or recommendations are then presented to the clinician or the patient for a decision”.13 Overall, CDSMs are aimed at the clinician analysing the current condition of the patient and providing support regarding treatment or referral, whereas decision aids are aimed at patients, offering choices regarding medical treatment. However, similar to decision aids, some CDSMs may encourage patients to participate actively in healthcare decisions.14
There are remarkable differences between non-computer-based and computer-based CDSMs, although previous research has mainly focused on computer-based CDSMs. One systematic review concluded that there is a need for readily available systems that promote evidence-based practices. These systems should consider regional variations in practice. They should leverage data reuse to generate predictions regarding treatment outcomes and address a broader cluster of clinical disorders. Furthermore, these systems should target primary care practices with limited knowledge and skills regarding child and adolescent psychiatry.8 Research on non-computer-based CDSMs, such as child psychiatry access programmes, recommended more investigations on the broad impact of these programmes on, for example, patients, families, or health systems instead of more descriptive evaluations focusing on programme usage and provider satisfaction.15
The present systematic review aimed to identify CDSMs for primary care that support clinical decision-making regarding children and youths with mental health disorders. To this end, a distinction was made between non-computer-based and computer-based CDSMs. The objective of this review was to describe the functionalities of CDSMs and their capability to provide diagnostic and referral support. Furthermore, we assessed the content of CDSMs and the quality of the underlying studies.
Methods
Search strategy
To identify all available studies, published between 2009 and 2021, that have described CDSMs for mental health disorders in children and youths in primary care, PubMed, PsychINFO, Embase, Web of Science, and COCHRANE were searched in August 2021. A combination of the following keywords was used in the search strategy: “efficacy”, “clinical decision-making”, “support”, “triage methods”, “general practitioner”, “psychiatry”, “mental health disorders”, “child”, “adolescent”, “primary care”, and “secondary care”. By consensus, LV, VR, and an information expert specifically selected each keyword and potential synonym. Questions related to keyword selection were discussed with MC. The detailed search strategy is described in the Supplementary Material.
Inclusion and exclusion criteria
Inclusion and exclusion criteria were determined prior to the keyword search. Peer-reviewed studies that described CDSMs for mental health disorders among children and youths (0–24 years) were included. By “CDSM”, the authors mean a method (a procedure, e.g., digital support) that assists PCPs in assessing children and youth with mental health symptoms and in deciding the need for referrals to specialized mental health care, preventive care, or primary care support. The search was limited to publications in English and Dutch. Studies were excluded if the recruited participants were all aged 25 years or older and if the methods used fully consisted of a dichotomous screening instrument.16
Selection procedure
Titles and abstracts from all identified studies were reviewed by LV and VR based on inclusion eligibility. Based on the inclusion and exclusion criteria described above, titles and abstracts were categorized into “to include”, “questionable”, and “to exclude”. Questions raised with regard to studies labelled as “questionable” were discussed with MC prior to being labelled as “to include” or “to exclude”. For example, there was a discussion about whether some studies fulfilled the criteria for CDSM; that is, the method was more focused on the assessment of mental health problems instead of supporting the decision regarding follow-up care. Full-text studies labelled as “to include” were read by LV and VR while extracting information as described below. Figure 1 describes a detailed flowchart concerning the inclusion and exclusion process. The systematic review was conducted in accordance with the Preferred Reporting Items for Systematic Reviews and Meta-Analyses Protocols (PRISMA-Protocols).17
Variables extracted
Based on the study methodology as mentioned in previous research, categories of information to be extracted were assembled by LV, VR, and MC by reaching a consensus.8 No efforts were made to synthesize outcomes because of the variability of the results presented by the studies reviewed. Extracted variables regarding the content of the CDSM were (abbreviated) method name, target population, targeted professionals, goal, content and organization of the method, and phase(s) of clinical decision-making that are supported by the CDSM: diagnosis, assessment of severity, and management.18 We also extracted variables regarding study design: objectives, methods, outcomes on provider (e.g., user satisfaction), patient level (e.g., referral efficacy), measurement moments and study duration, name of intervention, control group characteristics, target group characteristics, number of study participants, gender ratios, and mean ages of patients, as well as results at the provider and patient levels. The quality of the included studies was appraised by LV and VR using the Crowe Critical Appraisal Tool (CCAT), which helps in rating the studies included in a systematic review.19 CCAT helps readers with different levels and types of knowledge to reach similar conclusions about a research paper. The CCAT is one of the few instruments that has undergone both reliability and validity evaluations and is able to appraise different research study designs. The tool has been used broadly in previous research.19–22 The CCAT consists of a 22-item form divided into eight categories—preliminaries, introduction, design, sampling, data collection, ethical matters, results, and discussion of a study—which are scored by readers on a 6-point scale from 0 to 5. Each study is assigned a score on these categories, and the total score is obtained as a sum of all category scores (ranging from 0 to 40).23 LV scored all included studies before reaching agreement on scores with VR.
Results
After the removal of duplicates, the search strategy yielded 1,294 studies across different databases. Some studies were excluded based on the eligibility of titles and abstracts. Another set of studies was excluded because they met the exclusion criteria based on reading their full texts. Lastly, we added studies found in the reference lists of some of the included studies. In total, 25 studies describing 18 different CDSMs were included in the review (Fig. 1). All studies were written in English or Dutch.
Computer-based decision support methods
Of all identified CDSMs, more than half were computer-based decision support methods (CBDSMs) directed at patients aged 0–75 years old. CBDSMs provided electronic support on (clinical) reasoning for patients and providers.24–37 For patients, these methods provide tools for assessing (future) symptom severity34–37 and consecutive self-management of their mental health.33 The methods were also used to integrate service users’ and practitioners’ expertise about mental health to allow shared decision-making.24 Providers were given probability diagnoses following evidence-based algorithms based on routine data27 and surveys.28,29,31,34–37 Furthermore, some methods offered providers treatment suggestions,24,25 such as medication management26,32 and referral support.25,35,36 To achieve this output from the system, specific patient- and provider-related input was necessary. Patient-related input included vital signs and laboratory test results (e.g., body mass index, systolic and diastolic blood pressures, blood lipids, glucose metabolism), as well as questions on a variety of mental health areas (e.g., symptoms, side effects, treatment preferences, adherence, and response).24,32,34–37 Non-medical information, such as social life, finances, and school performance, was also retrieved in some methods.24,28–31 Provider-related input comprised information in the child’s electronic health record,34 health risk questions based on this information, and screening questions following a decision tree.27–31 Most computer-based methods focused on a variety of diagnoses.24,27–29,31,35–37 However, some focused on one specific disorder or symptom, such as autism spectrum disorder,25,30,34 attention-deficit/hyperactivity disorder (ADHD),26 and psychosis.33 More than half of the CBDSMs supported all phases of clinical decision-making, that is, support of diagnostics, assessment of severity, and management.25,26,28–31,34–37 Other methods supported two phases, that is diagnostics and assessment of severity24,33 or diagnostics and management27,32 (Supplementary Table 1).
Observational,24,25,27–29,37 comparative,26,29,32–36 or validation study designs30,31 were used to study the implementation (including clinical and cost-effectiveness) or the validation of the CBDSMs. The observational studies found that the CBDSMs were generally appreciated by both patients and care providers, for example, regarding a shared understanding of mental health risks, which facilitated implementation into primary practice.24,27,37 However, barriers related to workflow were also reported, such as challenging and confusing access to the method, hardware- and software-related difficulties, the need for duplication during the transition from paper to the electronic system, and issues regarding computer literacy.24,25,27 The comparative studies showed a reduction in psychological distress compared to usual care35,36 and an increase in the rate of diagnostic assessments compared to (community) control samples, which resulted in, for example, more prescriptions and visits.26,28,32,34 Furthermore, these studies showed a higher quality of care with respect to ADHD diagnosis.26 The studies reported fewer or no side effects35,36 and a reduced weight gain when patients used medication.32 In one study, the use of the CDSM led to an increased PCP understanding of patient mental health compared to an attention-comparison group, in which daily activities were monitored without monitoring mood and stress.33 All validation studies were directed at the Development and Well-Being Assessment (DAWBA). This method showed good test capabilities when compared between groups of low to high risk of autism spectrum disorder or eating disorders, with high sensitivity (88–100%), specificity (85–94%), positive predictive (82–88%), and negative predictive values (90–100%).30,31 (Supplementary Table 2). The average study quality of the CBDSMs was three stars (total score of 30.61), according to the CCAT.24–37 Lower total scores were attributed to poor description of design and sample of the study, whereas higher scores were attributed to a clear description of the data, as well as results and discussion sections24–37 (Table 1).
Table 1.
Total (max = 40) | Scorea | Prelim | Intro | Design | Sample | Data | Ethics | Results | Discussion | |
---|---|---|---|---|---|---|---|---|---|---|
Buckingham (2015) | ★★ | 24 | 4.75 | 5 | 2.75 | 3.33 | 0.83 | 2 | 2.25 | 3.17 |
Bauer (2015) | ★★★ | 28.67 | 5 | 5 | 3.5 | 3.17 | 2.5 | 2 | 3.5 | 4 |
Downs (2019) | ★★★★ | 33.38 | 5 | 5 | 3.25 | 5 | 3.97 | 3.5 | 4.5 | 3.16 |
Carrol (2013) | ★★★ | 30.40 | 5 | 5 | 3.75 | 2.83 | 3.83 | 2.5 | 3.5 | 4 |
Fortney (2010) | ★ | 20.49 | 4.5 | 5 | 2.5 | 1.17 | 2.17 | 1 | 1.32 | 2.83 |
Goodman (2000) | ★★★ | 29.83 | 5 | 2.5 | 4.25 | 4.67 | 4 | 3 | 3.25 | 3.17 |
Ford (2013) | ★★★★ | 35.17 | 5 | 5 | 4.75 | 3.83 | 4.67 | 3 | 4.25 | 4.67 |
McEwen (2016) | ★★★★ | 34.42 | 4.75 | 5 | 4.5 | 4.67 | 4 | 3 | 3.5 | 5 |
Moya (2005) | ★★★ | 32.33 | 3.75 | 5 | 4.5 | 5 | 3.33 | 2 | 3.75 | 5 |
Robinson (2018) | ★★★★ | 32.83 | 4.75 | 5 | 4.5 | 4 | 3.33 | 2.5 | 3.75 | 5 |
Reid (2013) | ★★★★ | 35.08 | 5 | 5 | 4.5 | 4.83 | 3.33 | 3.5 | 4.25 | 3.83 |
Fletcher (2019 and 2021)b | ★★★ | 32.23 | 5 | 5 | 2.69 | 4.91 | 3.89 | 3.75 | 3 | 3.99 |
Parker (2020) | ★★★ | 29.15 | 4.75 | 5 | 2.61 | 3.66 | 3.14 | 3.5 | 3 | 3.49 |
Kaye (2017) | ★ | 22.68 | 5 | 5 | 2.76 | 3.33 | 2.83 | 2 | 3.75 | 3.5 |
Gadomski (2014) | ★★ | 25.96 | 4 | 5 | 2.63 | 3 | 3.33 | 1 | 3.5 | 3.5 |
Kerker (2015) | ★ | 21.22 | 3.50 | 3 | 2.95 | 2.91 | 1.92 | 1.11 | 2.19 | 3.64 |
Yellowlees (2008) | ★★★ | 29.67 | 4.75 | 5 | 3.42 | 3.5 | 2.5 | 2.5 | 3 | 5 |
Epstein (2007) | ★★★ | 32 | 4.75 | 5 | 4.25 | 3.83 | 2.83 | 3 | 3.75 | 4.5 |
Williams (2006) | ★ | 21.33 | 4.75 | 5 | 2.58 | 2.5 | 1.17 | 1 | 2 | 3.33 |
Jacob (2012) | ★★ | 25.87 | 4.75 | 5 | 2.37 | 2.17 | 2.83 | 2.5 | 2.75 | 3.5 |
Walter (2019) | ★★★ | 29.23 | 4.75 | 5 | 2.85 | 4.15 | 2.98 | 3 | 2.5 | 4 |
Malas (2019) | ★★ | 27.8 | 4.75 | 5 | 3.09 | 3.49 | 2.81 | 2.5 | 2.5 | 3.66 |
Thompson (2019) | ★ | 22.3 | 3.75 | 5 | 2.5 | 2.32 | 2.15 | 1.5 | 2.25 | 2.83 |
Campbell (2021) | ★★ | 27.21 | 4.75 | 5 | 3.25 | 2.32 | 2.15 | 2.5 | 2.75 | 4.49 |
Max = maximum, Prelim = preliminaries; Intro = introduction.
One star: more than 1 SD below average; two stars: between 1 SD below average and average; three stars: between average and 1 SD above average; four stars: more than 1 SD above average.
Telecommunication methods
Less than half of the identified CDSMs were telecommunication methods targeted at 0–21 year olds. The telecommunication methods consisted of a practice in which PCPs are advised on mental health management through (video) conferences between psychiatrists and patients.38–46 These methods offered patients psychoeducation on medication,45 illness and diagnostic issues, exercise and lifestyle issues,43 and providers recommendations on referral.39,46 Some telecommunication methods also offered (peer) training for PCPs as part of the method,38–40,45,46 face-to-face assessments for patients if necessary,39,43 and strategies for practice transformation to integrate the telecommunication method.45 All but one method42 focused on multiple mental disorders at once.38–41,43–46 In one telecommunication method, there was no contact between psychiatrists and patients, but physicians received advice from psychiatrists on starting dosages of medication based on effect rating scales.42 Almost all telecommunication methods supported all phases of clinical decision-making38–41,43–46; one method supported two phases, that is, assessment of severity and management42 (Supplementary Table 1).
To investigate the telecommunication methods, almost all the studies used an observational design.38,39,43–46 One study used a comparative design.42 The studies showed behavioural improvement of the child compared with a sample of children not participating in the CDSM,42 provider’s and patient’s satisfaction with the method,44 PCPs’ knowledge and confidence regarding mental health disorders,38,39,43,46 and collaborative treatment between PCP and family39 after implementation of the method. Furthermore, the studies reported alleviation of the gap between youth needing quality behavioural health services and those receiving them,45 improved mental health in a convenience sample over time,41 more psychotropic medication prescriptions compared to a group of PCPs not receiving training for the CDSM,40 and increased psychotherapy, medical behavioural health visits, and guideline congruent medications prescriptions45 (Supplementary Table 2). The average CCAT score for the telecommunication methods was two stars (total score of 26.20), with lower scores mainly attributed to description of design and used data, and higher scores attributed to description of results and discussion38–46 (Table 1).
Combination of CDSMs
Two identified CDSMs were CDSMs consisting of a combination of computer-based decision support- and telecommunication method-related components. These CDSMs were directed at patients between 16 months of age and patients older than 75 years.47,48 One CDSM started with an algorithm in the patient’s electronic health record, which decided whether the patient health questionnaires were completed.47 If the questionnaires indicated that the patient needed to be referred based on depression symptoms, there was an option for the PCP to have contact with a child and youth mental health care provider on medication prescriptions.47 The other CDSM comprised a screening instrument via the patient’s electronic health record, with the possibility of referring the patient to a multidisciplinary team for autism evaluation as part of the method.48 Both CDSMs were directed at one specific disorder.47,48 The CDSM described by Thompson et al. supported all phases of clinical decision-making.47 The CDSM described by Campbell et al. supported two phases: diagnostics and management.48 Thompson et al.’s study used a comparative design with which the effectiveness of screening, referrals, and treatment uptake was measured via analysis of electronic health record data and screening of patients using the Patient Health Questionnaire-2 and -9.47 The study by Campbell et al. consisted of a comparative design that implemented process changes in intervention clinics.48 Comparisons were made between these intervention clinics and community clinics (which only received automatic reminders as part of the process changes), as well as between phases of change.48 Both studies showed an increase in screening and referral rates.47,48 The average quality of Thompson et al. and Campbell et al. was one and two stars (total score of 24.76), respectively, with lower scores attributed to poor descriptions of ethics and higher scores attributed to well-described introduction sections47,48 (Table 1).
Discussion
The present literature review aimed to provide a description of the functionalities of CDSMs and their capability to provide diagnostic support and support for management or referral by primary care practitioners (PCP). Furthermore, we examined the content of CDSMs and quality of underlying studies. This review yielded 25 studies describing 18 CDSMs used in primary care.
The majority of the CDSMs were CBDSMs, which provide electronic support for clinical reasoning following an algorithm. These CDSMs assist patients by offering tools for assessing the severity of (future) symptoms and consecutive self-management of their mental health. Moreover, they assist PCPs by offering probability diagnoses and suggestions for further management or referrals. Some functionalities of this category of CDSMs include monitoring tools,33,37 screening forms,25,26,34,37 a patient registry, a patient encounter scheduler, trial management,27 and (self-)assessment instruments24,27,35,36 with structured or open-ended questions.28–31 The CBDSMs are directed towards mental health disorders and provide PCPs with advice on diagnosis based on data collected before the consultation.
Less than half of the identified CDSMs were telecommunication methods. Through video conferences between psychiatrists and patients, these methods offer patients psychoeducation on multiple mental health topics. Additionally, these methods advise PCPs on mental health management or referrals. Contrary to CBDSMs, telecommunication methods are used to generate advice on diagnosis and referral based on concerns of the PCP during the consultation. Their functionalities comprise education for PCPs to improve detection of mental health disorders,38–40,42,45 referral support by phone, e-mail and/or video,41,42,44–46 and face-to-face evaluations with patients if necessary.38–40,43,46 We found two CDSMs that consisted of a combination of CBDSM- and telecommunication method-related components.47,48
There are several pros and cons of the identified CDSMs with regard to their usability in the primary care process as well as their relevance for clinical practice. CBDSMs provide the PCP with more information about possible mental health disorders based on electronic health records34 and, if applicable, a previous consultation, information that can be used to structure the next consultation with the child.32 For some CBDSMs, this notice is based on data from large studies.28 Moreover, children and their parents can have the opportunity to prepare for the consultation, because the CBDSMs stimulate them to think about relevant medical information that may also be discussed with their PCP.32 Another advantage is that no other care providers are involved in using the CDSM, except for the PCP.25 Therefore, the invested time and costs are limited. There are also disadvantages. First, CBDSMs should not be used in urgent situations because input from children and their parents may be quite time-consuming.30 Second, for some patients, computer-based decision support may be difficult to use due to their mental status.32 Third, a set of questions received beforehand may give too much direction to the consultation, which may impede children and their parents from talking about one set of problems more than others.35,36
An advantage of telecommunication methods over CBDSMs is their usability during consultation with the child. Therefore, information gathered during the conversation can be used directly for the telecommunication method.41 Furthermore, telecommunication methods provide room to take the context of the child and its problem into account while generating advice on diagnosis and referral, information that might be missed when using predetermined questions.44 A disadvantage of telecommunication methods is that their usage requires time investment from both PCPs and mental health care providers, which also makes them more costly compared to the one-off purchase of CBDSMs.39 CDSMs that consist of CBDSM- and telecommunication method-related components may have a combination of the abovementioned advantages and disadvantages.47,48
CBDSMs were directed at 0–75 year olds, telecommunication methods at 0–21 year olds, and a combination of these CDSMs at 16 months old, as well as patients older than 75 years. Since this is a broad age range, it should be noted that the applicability of individual CDSMs differs by age category. For example, younger children should be assisted by their parent and/or caregiver while providing information for a CDSM. By contrast, adolescents may be capable of providing information without any help, depending on their age and capability of self-determination.28–31 Therefore, PCPs should be aware of national care regulations with regard to the self-determination of young people.49
The quality of the underlying studies of CDSMs was variable. Compared to studies describing telecommunication methods, studies describing CBDSMs had a higher quality, that is, with regard to the description of the data. The aims of the studies describing CBDSMs were to describe the functional capabilities of the CDSM,27 to validate the CDSM,28,30,31 to describe PCP user satisfaction regarding the CDSM,24,33,37 to compare care with the CDSM and care without the CDSM with respect to screening rates34 and cost-effectiveness.35,36 Furthermore, these studies assessed the impact of the CDSM on the patient’s view of their own life and health24,32 and explored the effect of using a CDSM on PCP’s knowledge, beliefs, and self-reported practice regarding mental health disorders.25 The aims of studies on telecommunication methods included a description of the impact of CDSMs on care (e.g., medication prescriptions, treatment plans)33,40,42 and costs,45 effectiveness of detection of mental health disorders,39 PCP-reported satisfaction with the CDSM, and PCP’s knowledge and confidence regarding mental health disorders.38,39,44–46 It is notable that almost all the studies on telecommunication had an observational study design, implying a need for more comparative research designs.38,39,43–46 Studies describing CDSMs consisting of a combination of both CDSM types were of low average quality. These studies aimed to analyse the effectiveness of screening, referrals, and treatment uptake of the CDSM, as well as to assess quality improvement related to screening and referrals while implementing process changes.47,48
There were a few studies with outcomes specifically directed at ensuring accurate and timely detection of mental health disorders and appropriate referral, mentioned earlier as essential factors for preventing the long-term consequences of mental health disorders in children and youths.8,9 Two studies showed an increased rate of diagnostic assessments,26,47 while other studies reported more medication visits and prescriptions.32,40,42,45 These findings raise discussion about the possible overdiagnosis and overtreatment of mental health disorders due to the usage of CDSMs. Earlier research has confirmed overdiagnosis and overtreatment in children and youths with ADHD.50 However, improved detection of these mental disorders may counteract the underdiagnosis and undertreatment that also exists in this population.
Strengths and limitations
This study has several limitations. First, it was difficult to compare the different studies due to differences in quality, study designs, and outcome measures. Second, some identified CDSMs were directed at a broad age range, including those of 25 years and older, and had generic output (e.g., self-reported medication visits and vital signs). Therefore, it was not always clear how these CDSMs could be beneficial for children and youths specifically. Third, in some studies, it was unclear whether they included also children and youths. However, these studies were included because it was plausible studied CDSMs were directed at adults, children, and youths. Fourth, most studies originated from the United States of America (USA),25,26,32–34,38,40,41,43,45–48 the United Kingdom (UK),24,28–31 and Australia,35–37 which indicates that region-specific healthcare regulations must be taken into account while interpreting the review results. The health systems of the USA, the UK, and Australia are similar in many ways. In these countries, GPs or primary care paediatricians can be approached for first-contact medical care. However, there are also notable differences, such as the “gatekeeper” role for GPs in the UK and Australia.51–53 Furthermore, in the USA, access to mental health care can be inadequate, with more than 5,000 mental health professionals in shortage areas, mostly situated in rural areas.54 The aforementioned factors influence which CDSMs are suitable for a particular general practice setting. For example, computerized CDSMs might be more suitable if a GP is the only point of entry for care by a specialist, while telecommunication methods might be more appropriate in regions with a shortage of and longer travelling distance to mental health professionals.
This study also has strengths. First, to include relevant studies, the authors used a priori inclusion and exclusion criteria. Second, to minimize errors in the selection and reading process, there were two searchers and readers of studies. Third, this study provides an overview of different types of CDSMs, which may be useful for PCPs with tight schedules, such as GPs. To the best of our knowledge, no current scientific literature provides such an overview.
Conclusion
To assist PCPs in early detection and management of mental health disorders among children and youths, easy-to-use CDSMs of good quality are needed which can provide advice on management or referral.8,9,12 Based on the current review, methods consisting of a combination of CBDSMs and telecommunication methods are advised. While this advice applies to healthcare systems in which there are sufficient resources and care providers, it does not apply to healthcare systems in which there are shortages and where choices have to be made regarding care provision; that is, where CDSMs may be used as an aid for triage. In these systems, clinical assessments of experts in the context of telecommunication methods may be restricted to “severe” cases, as graded by an electronic system as part of a CBDSM. Electronic systems may be used by PCPs in “mild” and “moderate” cases without further clinical assessment by an expert in secondary mental health care. As for future research, we suggest more comparative multicentre studies (e.g., with a prospective cohort design) on a combination of CBDSMs with telecommunication methods in different health systems and different degrees of problem severity. These combined methods may consist of existing or newly researched CDSMs. Identified CDSMs that support multiple phases of clinical decision-making should have priority in future efforts.
Supplementary Material
Contributor Information
Lennard T van Venrooij, Department of Research and Education, Academic Center for Child and Youth Psychiatry, Curium-LUMC, Oegstgeest, the Netherlands; Department of Public Health and Primary Care, Leiden University Medical Center (LUMC), Leiden, the Netherlands.
Vlad Rusu, Department of Research and Education, Academic Center for Child and Youth Psychiatry, Curium-LUMC, Oegstgeest, the Netherlands.
Robert R J M Vermeiren, Department of Research and Education, Academic Center for Child and Youth Psychiatry, Curium-LUMC, Oegstgeest, the Netherlands; Youz, Parnassia Psychiatric Institute, the Hague, the Netherlands.
Roman A Koposov, Regional Centre for Child and Youth Mental Health and Child Welfare, Northern Norway, UiT, The Arctic University of Norway, Tromsø, Norway; Sechenov First Moscow State Medical University, Moscow, Russia.
Norbert Skokauskas, Regional Centre for Child and Youth Mental Health and Child Welfare, IPH, Faculty of Medicine and Health Sciences, NTNU, Trondheim, Norway.
Matty R Crone, Department of Public Health and Primary Care, Leiden University Medical Center (LUMC), Leiden, the Netherlands.
Funding
The study was funded by the departmental resources.
Ethical approval
The systematic review was conducted in accordance with the Declaration of Helsinki.
Conflict of interest
None.
Data availability
The data underlying this article are available in the article and its online supplementary material.
References
- 1. World Health Organization. Adolescent mental health 2020 [accessed 2020 Jan 19]. https://www.who.int/news-room/fact-sheets/detail/adolescent-mental-health.
- 2. United Nations. Youth 2019 [accessed 2019 Jan 16]. https://www.un.org/en/sections/issues-depth/youth-0/.
- 3. Martinez R, Reynolds S, Howe A.. Factors that influence the detection of psychological problems in adolescents attending general practices. Br J Gen Pract. 2006;56(529):594–599. [PMC free article] [PubMed] [Google Scholar]
- 4. Olfson M, Blanco C, Wang S, Laije G, Correll CU.. National trends in the mental health care of children, adolescents, and adults by office-based physicians. JAMA Psychiatry. 2014;71(1):81–90. [DOI] [PubMed] [Google Scholar]
- 5. Kolko DJ, Campo J, Kilbourne AM, Hart J, Sakolsky D, Wisniewski S.. Collaborative care outcomes for pediatric behavioral health problems: a cluster randomized trial. Pediatrics. 2014;133(4):e981–e992. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6. Whitney DG, Peterson MD.. US national and state-level prevalence of mental health disorders and disparities of mental health care use in children. JAMA Pediatr. 2019;173(4):389–391. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7. Pignatiello A, Stasiulis E, Solimine C, Ayad O, Boydell KM.. Lessons learned in a physician referral to pediatric telemental health services program. J Can Acad Child Adolesc Psychiatry. 2019;28(3):99–104. [PMC free article] [PubMed] [Google Scholar]
- 8. Koposov R, Fossum S, Frodl T, Nytrø Ø, Leventhal B, Sourander A, Quaglini S, Molteni M, De la Iglesia Vayá M, Prokosch H, et al. Clinical decision support systems in child and adolescent psychiatry: a systematic review. Eur Child Adolesc Psychiatry. 2017;26(11):1309–1317. [DOI] [PubMed] [Google Scholar]
- 9. Roberts J, Crosland A, Fulton J.. GPs’ responses to adolescents presenting with psychological difficulties: a conceptual model of fixers, future planners, and collaborators. Br J Gen Pract. 2014;64(622):e254–e261. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10. Kramer T, Garralda M.. Child and adolescent mental health problems in primary care. Adv Psychiatr Treat. 2000;6(4):287–294. [Google Scholar]
- 11. Rand CM, Goldstein NPN.. Patterns of primary care physician visits for US adolescents in 2014: implications for vaccination. Acad Pediatr. 2018;18(2S):S72–S78. [DOI] [PubMed] [Google Scholar]
- 12. Roberts J, Crosland A, Fulton J.. Patterns of engagement between GPs and adolescents presenting with psychological difficulties: a qualitative study. Br J Gen Pract. 2014;64(622):e246–e254. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13. Sim I, Gorman P, Greenes RA, Haynes RB, Kaplan B, Lehmann H, Tang PC.. Clinical decision support systems for the practice of evidence-based medicine. J Am Med Inform Assoc. 2001;8(6):527–534. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14. Drug and Therapeutics Bulletin. An introduction to patient decision aids. BMJ. 2013;347(1):f4147. [DOI] [PubMed] [Google Scholar]
- 15. Bettencourt AF, Plesko CM.. A systematic review of the methods used to evaluate child psychiatry access programs. Acad Pediatr. 2020;20(8):1071–1082. [DOI] [PubMed] [Google Scholar]
- 16. World Health Organization. Adolescent health in the South-East Asia region 2021 [accessed 2021 Apr 19]. https://www.who.int/southeastasia/health-topics/adolescent-health.
- 17. Shamseer L, Moher D, Clarke M, Ghersi D, Liberati A, Petticrew M, Shekelle P, Stewart LA, PRISMA-P group. Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015: elaboration and explanation. BMJ. 2015;349:g7647. [DOI] [PubMed] [Google Scholar]
- 18. Bajaj L, Hambidge S, Nyquist A, Kerby G.. Berman’s pediatric decision making. 5th ed. St. Louis (MO): Mosby; 2011. [Google Scholar]
- 19. Crowe M, Sheppard L, Campbell A.. Comparison of the effects of using the Crowe Critical Appraisal Tool versus informal appraisal in assessing health research: a randomised trial. Int J Evid Based Healthc. 2011;9(4):444–449. [DOI] [PubMed] [Google Scholar]
- 20. Kunkle R, Chaperon C, Berger AM.. Formal caregiver burden in nursing homes: an integrative review. West J Nurs Res. 2021;43(9):877–893. [DOI] [PubMed] [Google Scholar]
- 21. Columna L, Prieto L, Elias-Revolledo G, Haegele JA.. The perspectives of parents of youth with disabilities toward physical activity: a systematic review. Disabil Health J. 2020;13(2):100851. [DOI] [PubMed] [Google Scholar]
- 22. Prieto LA, Haegele JA, Columna L.. Dance programs for school-age individuals with disabilities: a systematic review. Adapt Phys Active Q. 2020;37(3):349–376. [DOI] [PubMed] [Google Scholar]
- 23. Naseralallah LM, Hussain AT, Jaam M, Pawluk SA.. Impact of pharmacist interventions on medication errors in hospitalised pediatric patients: a systematic review and meta-analysis. Int J Clin Pharm. 2020;42(4):979–994. [DOI] [PubMed] [Google Scholar]
- 24. Buckingham CD, Adams A, Vail L, Kumar A, Ahmed A, Whelan A, Karasouli E.. Integrating service user and practitioner expertise within a web-based system for collaborative mental-health risk and safety management. Patient Educ Couns. 2015;98(10):1189–1196. [DOI] [PubMed] [Google Scholar]
- 25. Bauer NS, Carroll AE, Saha C, Downs SM.. Computer decision support changes physician practice but not knowledge regarding autism spectrum disorders. Appl Clin Inform. 2015;6(3):454–465. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26. Carroll AE, Bauer NS, Dugan TM, Anand V, Saha C, Downs SM.. Use of a computerized decision aid for ADHD diagnosis: a randomized controlled trial. Pediatrics. 2013;132(3):e623–e629. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27. Fortney JC, Pyne JM, Steven CA, Williams JS, Hedrick RG, Lunsford AK, Raney WM, Ackerman BA, Ducker LO, Bonner LM.. A web-based clinical decision support system for depression care management. Am J Manag Care. 2010;16(11):849–854. [PMC free article] [PubMed] [Google Scholar]
- 28. Goodman R, Ford T, Richards H, Gatward R, Meltzer H.. The Development and Well-Being Assessment: description and initial validation of an integrated assessment of child and adolescent psychopathology. J Child Psychol Psychiatry. 2000;41(5):645–655. [PubMed] [Google Scholar]
- 29. Ford T, Last A, Henley W, Norman S, Guglani S, Kelesidi K, Martin A, Moran P, Latham-Cork H, Goodman R.. Can standardized diagnostic assessment be a useful adjunct to clinical assessment in child mental health services? A randomized controlled trial of disclosure of the Development and Well-Being Assessment to practitioners. Soc Psychiatry Psychiatr Epidemiol. 2013;48(4):583–593. [DOI] [PubMed] [Google Scholar]
- 30. McEwen FS, Stewart CS, Colvert E, Woodhouse E, Curran S, Gillan N, Hallett V, Lietz S, Garnett T, Ronald A, et al. Diagnosing autism spectrum disorder in community settings using the Development and Well-Being Assessment: validation in a UK population-based twin sample. J Child Psychol Psychiatry. 2016;57(2):161–170. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31. Moya T, Fletilich-Bilyk B, Goodman R, Chamelet Nogueira F, Souza Focchi P, Nicoletti M, Pinzon V, Athanássios Cordás T, Lotufo Neto F.. The eating disorders section of the Development and Well-Being Assessment (DAWBA): development and validation. Braz J Psychiatry. 2005;27(1):25–31. [DOI] [PubMed] [Google Scholar]
- 32. Robinson DG, Schooler NR, Correll CU, John M, Kurian BT, Marcy P, Miller AL, Pipes R, Trivedi MH, Kane JM.. Psychopharmacological treatment in the RAISE-ETP study: outcomes of a manual and computer decision support system based intervention. Am J Psychiatry. 2018;175(2):169–179. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33. Reid SC, Kauer SD, Hearps SJC, Crooke AHD, Khor A, Sanci LA, Patton GC.. A mobile phone application for the assessment and management of youth mental health problems in primary care: health service outcomes from a randomised controlled trial of mobiletype. BMC Fam Pract. 2013;14(1):84. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34. Downs SM, Bauer NS, Saha C, Ofner S, Carroll AE.. Effect of a computer-based decision support intervention on autism spectrum disorder screening in pediatric primary care clinics: a cluster randomized clinical trial. JAMA Netw Open. 2019;2(12):e1917676. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 35. Fletcher S, Chondros P, Palmer VJ, Chatterton ML, Spittal MJ, Mihalopoulos C, Wood A, Harris M, Burgess P, Bassilios B, et al. Link-me: protocol for a randomised controlled trial of a systematic approach to stepped mental health care in primary care. Contemp Clin Trials. 2019;78(1):63–75. [DOI] [PubMed] [Google Scholar]
- 36. Fletcher S, Spittal MJ, Chondros P, Palmer VJ, Chatterton ML, Densley K, Potiriadis M, Harris M, Bassilios B, Burgess P, et al. Clinical efficacy of a decision support tool (Link-me) to guide intensity of mental health care in primary practice: a pragmatic stratified randomised controlled trial. Lancet Psychiatry. 2021;8(3):202–214. [DOI] [PubMed] [Google Scholar]
- 37. Parker BL, Achilles MR, Subotic-Kerry M, O’Dea B.. Youth StepCare: a pilot study of an online screening and recommendations service for depression and anxiety among youth patients in general practice. BMC Fam Pract. 2020;21(1):2. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 38. Kaye DL, Fornari V, Scharf M, Fremont W, Zuckerbrot R, Foley C, Hargrave T, Smith BA, Wallace J, Blakeslee G, et al. Description of a multi-university education and collaborative care child psychiatry access program: New York State’s CAP PC. Gen Hosp Psychiatry. 2017;48(1):32–36. [DOI] [PubMed] [Google Scholar]
- 39. Gadomski AM, Wissow LS, Palinkas L, Hoagwood KE, Daly JM, Kaye D.. Encouraging and sustaining integration of child mental health into primary care: interviews with primary care providers participating in Project TEACH (CAPES and CAP PC) in NY. Gen Hosp Psychiatry. 2014;36(6):555–562. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 40. Kerker BD, Chor KHB, Hoagwood K, Radigan M, Perkins M, Setais J, Wang R, Olin SS, McCue Horwitz S.. Detection and treatment of mental health issues by pediatric PCPs in New York State: an evaluation of Project TEACH. Psychiatr Serv. 2015;66(4):430–433. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 41. Yellowlees PM, Hilty DM, Marks SL, Neufeld J, Bourgeois JA.. A retrospective analysis of a child and adolescent e-mental health program. J Am Acad Child Adolesc Psychiatry. 2008;47(1):103–107. [DOI] [PubMed] [Google Scholar]
- 42. Epstein JN, Rabiner D, Johnson DE, Fitzgerald DP, Chrisman A, Erkanli A, Sullivan KK, March JS, Margolis P, Norton EC, et al. Improving attention-deficit/hyperactivity disorder treatment outcomes through use of a collaborative consultation treatment service by community-based pediatricians: a cluster randomized trial. Arch Pediatr Adolesc Med. 2007;161(9):835–840. [DOI] [PubMed] [Google Scholar]
- 43. Williams AS, Dodding J, Wilson I, Fuller J, Wade V.. Consultation-liaison to general practitioners coming of age: the South Australian psychiatrists’ experience. Australas Psychiatry. 2006;14(2):206–211. [DOI] [PubMed] [Google Scholar]
- 44. Jacob MK, Larson JC, Craighead WE.. Establishing a telepsychiatry consultation practice in rural Georgia for primary care physicians: a feasibility report. Clin Pediatr. 2012;51(11):1041–1047. [DOI] [PubMed] [Google Scholar]
- 45. Walter HJ, Vernacchio L, Trudell EK, Bromberg J, Goodman E, Barton J, Young GJ, DeMaso DR, Focht G.. Five-year outcomes of behavioral health integration in pediatric primary care. Pediatrics. 2019;144(1):e20183243. [DOI] [PubMed] [Google Scholar]
- 46. Malas N, Klein E, Tengelitsch E, Kramer A, Marcus S, Quigley J.. Exploring the telepsychiatry experience: primary care provider perception of the Michigan Child Collaborative Care (MC3) program. Psychosomatics. 2019;60(2):179–189. [DOI] [PubMed] [Google Scholar]
- 47. Thompson H, Faig W, Gupta N, Lahey R, Golden R, Pollack M, Karnik N.. Collaborative care for depression of adults and adolescents: measuring the effectiveness of screening and treatment uptake. Psychiatr Serv. 2019;70(7):604–607. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 48. Campbell K, Carbone PS, Liu D, Stipelman CH.. Improving autism screening and referrals with electronic support and evaluations in primary care. Pediatrics. 2021;147(3):e20201609. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 49. Buitelaar JC. Child’s best interest and informational self-determination: what the GDPR can learn from children’s rights. Int Data Priv Law. 2018;8(4):293–308. [Google Scholar]
- 50. Kazda L, Bell K, Thomas R, McGeechan K, Sims R, Barratt A.. Overdiagnosis of attention-deficit/hyperactivity disorder in children and adolescents: a systematic scoping review. JAMA Netw Open. 2021;4(4):e215335. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 51. Onion DK, Berrington RM.. Comparisons of UK general practice and US family practice. J Am Board Fam Pract. 1999;12(2):162–172. [DOI] [PubMed] [Google Scholar]
- 52. Royal Medical Benevolent Fund. How general practice in the UK compares internationally 2021 [accessed 2021 Sep 25]. https://rmbf.org/get-help/help-for-doctors/doctor-advice-hub/how-general-practice-in-the-uk-compares-internationally/.
- 53. Clarke SE. Gatekeeping and general practice in the Australian health system [PhD thesis]. Sydney (Australia): The University of Sydney; 2021. [Google Scholar]
- 54. Myers CR. Using telehealth to remediate rural mental health and healthcare disparities. Issues Ment Health Nurs. 2019;40(3):233–239. [DOI] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
Data Availability Statement
The data underlying this article are available in the article and its online supplementary material.