Skip to main content
NIHPA Author Manuscripts logoLink to NIHPA Author Manuscripts
. Author manuscript; available in PMC: 2023 Jan 1.
Published in final edited form as: J Am Acad Child Adolesc Psychiatry. 2021 May 4;61(1):93–102. doi: 10.1016/j.jaac.2021.04.010

Development of a Symptom-Focused Model to Guide the Prescribing of Antipsychotics in Children and Adolescents: Results of the First Phase of the Safer and Targeted Use of Antipsychotics (SUAY) Clinical Trial

Robert B Penfold 1, Ella E Thompson 1, Robert J Hilt 1, Nadine Schwartz 1, Adelaide S Robb 1, Christoph U Correll 1, Douglas Newton 1, Kelly Rogalski 1, Marian F Earls 1, Robert A Kowatch 1, Arne Beck 1, Bobbi Jo H Yarborough 1, Stephen Crystal 1, Benedetto Vitiello 1, Kelly J Kelleher 1, Gregory E Simon 1
PMCID: PMC8566327  NIHMSID: NIHMS1698629  PMID: 34256967

Abstract

OBJECTIVE

To develop a new approach to prescribing guidelines as part of a pragmatic trial, Targeted and Safer Use of Antipsychotics in Youth (SUAY - ClinicalTrials.gov Identifier: NCT03448575) that supports prescribers in delivering high-quality mental health care to youth.

METHOD

A nominal group technique was used to identify first to nth line treatments for target symptoms and potential diagnoses. The panel included US pediatricians, child and adolescent psychiatrists and psychopharmacology experts. Meeting materials included information about Medicaid review programs, systematic reviews, prescribing guidelines, and a description of the pragmatic trial. Afterwards, a series of four webinar discussions were held to achieve consensus on recommendations.

RESULTS

The panel unanimously agreed that the guideline should focus on target symptoms rather than diagnoses. Guidance included recommendations for 1st- to nth-line treatment of target mental health symptoms, environmental factors to be addressed, possible underlying diagnoses that should first be considered and ruled out, and general considerations for pharmacological and therapeutic treatments.

CONCLUSION

Prescribing guidelines are often ignored because they do not incorporate the real-world availability of first-line psychosocial treatments, comorbid conditions and clinical complexity. Our approach addresses some of these concerns. If the approach proves successful in our ongoing pragmatic trial, Targeted and Safer Use of Antipsychotics in Youth (SUAY), it may serve as a model to state Medicaid programs and health systems to support clinicians in delivering high-quality mental health care to youth.

Keywords: antipsychotic, guidelines, consulting, accessibility

INTRODUCTION

Beginning in the mid 1990s, rates of prescribing antipsychotic medications to children and adolescents grew tremendously17 and remain high in some Medicaid and commercially insured populations.6,810 Significant decreases have been reported in populations with targeted programs to reduce use.1113 The vast majority of antipsychotic use in youth aged 4-17 years is not for psychotic disorders, mania, irritability associated with autism, or tic disorders, which are the regulatory indications for antipsychotic use. Rather, antipsychotics are prescribed the most for youth diagnosed with attention-deficit/hyperactivity disorder (ADHD), conduct disorder (CD) or oppositional defiant disorder (ODD) and/or impulsive aggression.8,1417 In one study, 66.9% of boys aged 6-11 years who were prescribed an antipsychotic had a diagnosis of ADHD and 43.1% had a diagnosis of CD or ODD.8 Given these data, there is widespread concern that antipsychotics are over-prescribed.18

One of the strongest concerns about antipsychotic use is the significant weight gain patients experience, which is associated with incident diabetes mellitus in youth and cardiovascular disease and premature mortality in adults.1926 Individual SGAs carry different risks, with clozapine and olanzapine considered most strongly associated with weight gain, and lurasidone, aripiprazole, brexpiprazole, cariprazine and ziprasidone considered to have lower weight gain, although several studies have shown that all second-generation antipsychotics are associated with weight gain to varying degrees.22,2732 There is concern that youth may be even more vulnerable to the metabolic side effects of these medications than adults and that, with continued treatment, these negative side effects propagate through the lifespan – potentially leading to higher risk of cardiovascular disease and increased premature mortality.1,17,3335 Medication side effects such as extrapyramidal symptoms and sedation may also impair functioning in youth more than in adults36,37.

In this paper, we report on the results of a consensus panel tasked with recommending appropriate prescribing of antipsychotics to youth in the context of large health systems and supportive services. These recommendations are part of a multi-component approach to minimizing inappropriate antipsychotic prescribing. We argue that our approach addresses many of the reasons why antipsychotics appear to be over-prescribed: lack of access to empirically-supported psychosocial treatments; guidelines that are inflexible, silent on the psychological and physical comorbidities youth experience, and fail to acknowledge the availability of first-line psychosocial treatments; difficulty parents/guardians face in navigating access to primary care and specialty mental health services; and geographic and logistical barriers to accessing mental health services regularly. This approach was developed as part of a pragmatic clinical trial funded by the National Institute of Mental Health called Targeted and Safer Use of Antipsychotics in Youth (SUAY)38. The approach is intended to be most useful to pediatricians and primary care physicians since they may treat lower volumes of patients with severe emotional disturbance; however, they are also relevant to child and adolescent psychiatrists in their own clinical practices and in the consultative roles that they often are called upon to play.

Safer Use of Antipsychotics in Youth (SUAY)

SUAY is a pragmatic clinical trial designed to test an approach to improving the targeted use of antipsychotics in youth aged 4-17 years38. The approach was motivated by the Second Opinion program implemented in Washington State for youth insured by Medicaid, which produced a 51% relative decrease in antipsychotic use.13 The core elements of the intervention are: (1) prescribing recommendations developed by our expert consensus panel; (2) clinical decision support (EHR-based best practice alert) integrated into the practice flow; (3) review of antipsychotic prescription orders and feedback to the prescribing clinician by a child and adolescent psychiatrist within 10 days of the order (according to the treatment algorithm); (4) behavioral health navigation for psychosocial treatment alternatives; and (5) improved access to psychosocial therapies via use of video conferencing. A full description of the study protocol is available elsewhere39. The methods and results presented in the current manuscript focus on the first of the 5 core elements (prescribing recommendations developed by expert consensus panel) described and do not directly address the others.

Rationale for a New Approach to Antipsychotic Prescribing Guidelines

In its Choosing Wisely® recommendations, the American Psychiatric Association lists as its 5th recommendation: Don’t; routinely prescribe an antipsychotic medication to treat behavioral and emotional symptoms of childhood mental disorders in the absence of approved or evidence supported indications40. This carefully worded recommendation acknowledges that not all antipsychotic prescribing for emotional and behavioral disturbances is inappropriate. Importantly, there are a number of reasonable algorithms for antipsychotic prescribing to youth 4146; however, there are two fundamental gaps that we address in our current recommendations to implement such guidelines: (1) how to support clinicians in most effectively utilizing the algorithms, and (2) how to increase access to psychosocial and pharmacological treatments that existing guidelines recommend and that are supported by empirical evidence as part of first-line treatment. Below we address the fundamental issues of implementing the guidelines.4754

Existing algorithms/guidelines for the use of antipsychotic medications include the Texas Medication Algorithm Project (TMAP)43, Treatment Recommendations for the use of Antipsychotics for Aggressive Youth (TRAAY)41, the Practice Parameter for the Use of Atypical Antipsychotic Medications in Children and Adolescents46 from the American Academy of Child and Adolescent Psychiatry (AACAP), and the Treatment of Maladaptive Aggression in Youth (T-MAY) guidelines developed through a systematic evidence review and consensus panel.55,56 Each of these guidelines provides thoughtful, reasonable and practical guidance to clinicians on how to prescribe antipsychotic medications. However, uptake of these guidelines and recommendations is thought to be lower than desirable as shown by several observational studies and meta analyses8,10,16,57 of antipsychotic prescribing frequencies.

There are several reasons for this gap. First, most clinicians regard guidelines as “cookbook” medicine that is not tailored to individual patient needs. Guidelines can be difficult to adapt to patient needs because a guideline cannot account for every possible clinical scenario or patient context, preferences, and values. The effective use of treatment algorithms is also complicated by these guidelines failing to account for psychiatric comorbidities, which are more the rule than exception for patients58. Treatment guidelines generally remain silent on the question of their application to patients with multiple health conditions50. An ideal algorithm would provide flexibility and “step outs” to be patient/family-centered.

A second reason for discordance between guidelines and care delivery is a lack of access to recommended first-line treatments. For example, the TRAAY guideline recommendation #3 is to begin with psychosocial and educational interventions.41 Similarly, in the TMAY guidelines, recommendation 7 is to “Provide psychoeducation for patients and families (Grade of Evidence: B; Strength of Recommendation: Very Strong)”55, recommendation 10 is to “Provide or assist the family in obtaining evidence-based parent and child skills training during all phases of care (Grade of Evidence: A; Strength of Recommendation: Very Strong)”, and recommendation 11 is to “Engage the child and family in taking an active role in implementing psychosocial strategies and help them to maintain consistency (Grade of Evidence: B; Strength of Recommendation: Very Strong)”56 However, access to clinicians providing these services may be limited in terms of geography or capacity.59,60 Children and adolescents living outside of major metropolitan and surrounding areas are particularly under-served in access to such services.6163 These disparities in access to and quality of care have been noted most prominently for child and adolescent psychiatrists59,64,65, but are relevant to other child and adolescent mental health specialists as well.6668 Further, a lack of local providers may cause parents/guardians to delay seeking and accessing care until behavioral issues become so severe that an antipsychotic is prescribed when an earlier psychosocial intervention or different medication would have prevented the more severe behavior and associated dysfunction.

Thus, while many pediatricians and primary care physicians would prefer their patients to use psychosocial therapies, they may resort to prescribing antipsychotics in order to provide the patient/family with any effective and fast/easily accessible treatment as an alternative to no treatment. New approaches to meeting this demand are needed to increase the use of recommended psychosocial interventions.69 With appropriate psychotherapies, engaging the family in constructive management of problematic behaviors, the use of antipsychotics may be avoided or minimized, and families gain the opportunity to learn new skills in managing their children’s symptoms and needs.70

Finally, existing guidelines tend to begin with a single condition or diagnosis, such as ADHD, CD or ODD, and recommend a series of treatment steps for that individual diagnosis. The majority of pediatric patients presenting with a psychiatric disorder have other “comorbid” disorders that are difficult to address with simple guidelines.71 Guidelines are lacking that could help a provider assess whether a specific treatment, such as an antipsychotic, is likely to be the most appropriate choice for a clinical circumstance more complex than a single diagnosis. The broad range of behavioral and mood disturbances for which antipsychotics are used suggests that an algorithmic approach to minimizing the use of antipsychotics in youth should include expert child and adolescent psychiatrist support as an integral component. Primary care physicians and pediatricians frequently report a desire for more support in managing behavioral health conditions.72 However, a key difficulty in providing such support is how to make it accessible and timely.

METHOD

Consensus Panel of Child Psychiatrists, Pediatricians, and Health Services Researchers

A full-day, face-to-face summit of clinical experts was held at the Kaiser Permanente Center for Total Health in Washington D.C. on July 28, 2016. Experts serving as panelists included pediatricians, child and adolescent psychiatrists, and psychopharmacology experts from across the United States. See Supplement 1, available online, for more detailed biographical information about panelists.

Panelists were provided with a series of materials in advance of the summit to help them prepare. Advance materials included the SUAY study scientific approach; information about the Second Opinion program that inspired the SUAY approach 13; previous literature (see Supplement 2, available online) and systematic reviews7375; and recommendations by AHRQ76, the American Psychiatric Association77, The American Academy of Child and Adolescent Psychiatry78 and the American Academy of Pediatrics79. We also conducted an independent systematic review of clinical trials involving children and adolescents that was distributed to panelists along with hyperlinks to the manuscripts included in our final review.

Systematic Review of Evidence

The systematic review was conducted according to version 5.1 of the Cochrane criteria80. We searched Embase and PubMed/Medline to identify all randomized trials, open label trials and meta analyses reporting results for all first generation and second generation antipsychotic medications available in the United States on or before May 23, 2016 and conducted with participants aged less than 18 years. Unpublished (non-peer-reviewed) studies were excluded so as to focus on the highest quality evidence. The search terms involved a combination of generic medication name, symptom, and child or adolescent participants. An example search would be: “cariprazine AND aggression AND (child OR adolescent). This search was repeated for the combination of 19 generic medication names and 16 conditions/symptoms (anxiety, depression, post-traumatic stress, aggression, disruptive, eating, sleep, insomnia, mood lability, dysregulated, mania, obsession, compulsion, psychosis, suicidal ideation, and tics) for a total of 304 searches. The generalized search strategy syntax was:

(aripiprazole OR asenapine OR brexpiprazole OR cariprazine OR clozapine OR fluphenazine OR haloperidol OR iloperidone OR loxapine OR lurasidone OR olanzapine OR paliperidone OR perphenazine OR pimozide OR quetiapine OR risperidone OR thiothixene OR trifluoperazine OR ziprasidone)

AND (anxiety OR depression OR flashbacks OR nightmares OR trauma OR disruptive OR aggressive OR impulsive OR dysregulated OR eating OR anorexia OR bulimia OR sleep OR insomnia OR mania OR hypomania OR “mood lability” OR irritability OR “mood swings” OR obsessive OR compulsive OR psychosis OR bipolar OR substance OR suicidal OR tics OR Tourette’s OR autism OR pervasive)

AND (child* OR adolescent)

The principal investigator and 3 research assistants divided this work and compiled the results. After deduplication the initial list of studies included 275 manuscripts.

In the next phase we eliminated all studies that were not randomized trials, open label trials, or meta analyses (n = 146 ) leaving 129 manuscripts to review for eligibility. Of these, 71 were eliminated leaving 58 studies to formally evaluate using the Cochrane criteria80. Each study was evaluated according to risk of: selection bias, performance bias, detection bias, attribution bias, reporting bias, and other bias. Version 1 of the Cochrane risk of bias tool was used81. Risk of bias was rated as low, high, or unclear. A spreadsheet template was completed by each reviewer with their rating on each dimension and a snippet of text copied from the manuscript supporting their rating. After review, 36 studies were judged to be of sufficient quality to include in the information packet for consensus panel members. Excluded studies had at least one domain on the risk of bias tool rated as “high”. Panelists were provided with a spreadsheet file summarizing the review on each Cochrane criterion as well as a hyperlink to a portable document file (*.pdf) copy of the original manuscript. Manuscripts were grouped by symptom/diagnosis to facilitate in-person discussion. A supplementary list of references provided to panelists is available in Supplement 2, available online.

Summit Organization and Approach

The summit began with introductions, an overview of the pragmatic trial, a brief review of the materials distributed prior to the meeting, an introduction to the nominal group technique 82,83 for reaching consensus, and the goals of the meeting.

The nominal group technique involves 4 stages: idea generation, recording ideas, discussing ideas, and voting on ideas. Panelists were provided with “voting worksheets” that listed diagnostic categories for each row and a column for idea generation and idea ranking. The principal investigator (RP) and facilitator (ET) initially presented the panelists with a list of diagnostic categories for which antipsychotic medications had been prescribed according to any clinical trial or observational study (including case reports) identified while conducting the systematic review of evidence. That list included the 16 conditions/symptoms used to conduct the systematic review. After an initial round of idea generation and discussion it was suggested that “violent ideation” be added to the list and the vote on this addition was unanimous.

Panelists were then asked to generate up to 5 ideas for antipsychotic prescribing scenarios (e.g., not responding to current antidepressant) they would endorse most strongly for each condition/symptom category and then prioritize/rank these for discussion. We then recorded all unique ideas for clinical scenarios and held a group discussion. Each of the 16 symptom domains was discussed separately with the goal of identifying: environmental factors to address related to the symptom; any underlying diagnoses with preferred treatments before considering prescribing an antipsychotic; underlying diagnoses to consider first; and general antipsychotic medication considerations related to the symptom or potential diagnosis.

Following the in-person summit, a series of four 1-hour weekly webinar discussions between panelists were held to refine the resulting recommendations. Panelists reviewed and provided input on draft guidance materials outside of the webinars via email. These efforts culminated in the development of a series of expert opinions regarding the 1st- to nth-line treatment of pediatric conditions treated with antipsychotics. At the final webinar meeting, panelists were asked to vote on their omnibus approval of the prescribing guidance.

RESULTS

Much of the discussion involved panelists considering how best to identify and structure consultations and reviews by child and adolescent psychiatrists. The principal investigator and Dr. Robert Hilt described the mandatory review process in Washington State for Medicaid youth and identified the strengths and weaknesses of that program (as well as similar programs across the US). The ensuing discussion among panelists revolved around: difficulties arriving at a correct diagnosis for youth, shortcomings of the American mental health system, and the inflexibility of existing guidelines for prescribing antipsychotic medications. A panelist suggested that reviews should focus on the primary symptom the prescriber is trying to treat – especially in the absence of actually seeing the patient and in the absence of standardized instrument scores or formal diagnostic interviews. The panel voted unanimously that the guidance should be organized around target symptoms (i.e., principal complaint) rather than diagnoses. There were three primary reasons for focusing on symptoms. First, arriving at the correct diagnosis can be difficult, and requiring revisions over time for developing children. Second, the anticipated target audience for their recommendations, primary care providers and pediatricians, are often less confident in making a mental health diagnosis. Third, there was some concern about prescribers adjusting diagnoses in order to avoid the hassle of triggering a review (e.g., entering a diagnosis of bipolar disorder to justify the prescribing of an antipsychotic for moderate mood lability).

Consensus panel efforts culminated in a series of guidance for 1st- to nth-line treatment of target mental health presentations. Table 1 summarizes the organizational construct developed for identifying the target symptom and possible underlying diagnoses within each of these categories. Full consensus panel guidance includes identifying and addressing environmental factors, possible underlying diagnoses that should first be considered and ruled out, and general considerations for pharmacological and therapeutic treatments for each target symptom or principal complaint. For instance, the consensus panel recommended never prescribing antipsychotics for certain cases including: anxiety alone, insomnia, mood swings or lability or irritability without mania, substance misuse, or suicidal ideation in the absence of psychosis or severe treatment resistant depression. This particularly strong language concerning “never prescribe” for certain clinical scenarios was again unanimously endorsed by the panelists with the rationale that the risk/benefit ratio for antipsychotics was unfavorable in the cases indicated. Supplement 3, available online, outlines the treatment steps recommended by the panel for each symptom.

Table 1:

Organization of Clinical Guidance Tablesa

TARGET SYMPTOM EXAMPLES OF POSSIBLE RELATED DIAGNOSES
Anxiety GAD, SAD, panic disorders
Depression MDD, persistent depression
Dissociation flashbacks, nightmares PTSD
Disruptive, aggressive, impulsive, dysregulated behaviors ODD, CD, ADHD
Eating Disorders AN, BN
Insomnia Various mental health disorders
Mania Bipolar disorder I/II
Mood lability, irritability, mood swings (without mania) DMDD, ODD, CD
Obsession and compulsion OCD
Psychosis Schizophrenia, schizoaffective disorders,
Substance misuse Substance Use Disorder
Suicidal ideation Depression
Tics Simple tics, TS
Violent Ideation Bipolar disorder I/II, Schizophrenia, Substance Use Disorder

Note: ADHD = attention-deficit/hyperactivity disorder; AN = anorexia nervosa; BN = bulimia nervosa; CD = conduct disorder; DMDD = disruptive mood dysregulation disorder; GAD = generalized anxiety disorder; MDD = major depressive disorder; OCD = obsessive-compulsive disorder; ODD = oppositional defiant disorder; PTSD = posttraumatic stress disorder; SAD = social anxiety disorder; TS = Tourette syndrome.

a

See Supplement 3, available online, for detailed tables.

The consensus panel also assisted in developing a case review form for consultations to be used in the pragmatic trial. Dose optimization of alternative pharmacotherapies and a history of current and prior medications (including the use of lower risk medications) and psychotherapeutic interventions were recommended to be reviewed and discussed during consultations, as needed. Finally, the panel discussed the use of navigation and best practice alerts as part of the effective implementation of the system.

To summarize, the consensus panel identified several key components for a best practice approach to safer and targeted use of antipsychotics via consultation:

  • Identify the target symptom(s)/behavior(s) that chiefly concern the patient/parent(s)/guardian(s);

  • Identify and address potential triggers

  • Identify and specifically address potential diagnoses (e.g., rule out psychosis);

  • Take a history of the type of, and response and tolerability to current and prior medications and psychosocial therapies used;

  • Consider the potential for dose optimization of the patien’s current medications and/or use of alternative or additional/adjunctive medications not in the antipsychotic class (e.g., stimulants, antidepressants, alpha-adrenergic agonists);

  • Consider use of lower risk medications (e.g., stimulants, antidepressants, alpha-adrenergic agonists);

  • Consider the potential for increased use of or changes to psychosocial therapy. This may be achieved through: use of mental health navigators, use of televideo therapy, and reminder/review protocols.

DISCUSSION

A number of Medicaid programs across the country (e.g., South Florida, Washington, Massachusetts) have implemented or are considering pharmacy management programs that include consultation with a child and adolescent psychiatrist as a core component.13,8486 Integrated health systems, such as Kaiser Permanente, also offer telepsychiatry consultations to pediatricians and primary care physicians. The recommendations developed by the expert panel in this study – especially the focus on target symptoms - can be used to guide the discussion between the prescribing and consulting physicians most effectively.

A second benefit of the targeted symptoms approach in this guideline is that the recommendations are flexible and mindful of comorbid psychiatric and physical conditions. In this way, the guideline is more useful to clinicians facing complicated prescribing choices.

A third benefit of this guideline approach (supported by best practice alerts, care navigation and expedited access to psychotherapy) is that it can be scaled to larger populations of patients and larger (more distant) geographic populations of youth because child and adolescent psychiatrist time, despite being a limited resource, can be efficiently and effectively deployed to improve treatment by supporting consultation with record reviews or telephone consultations for just those cases in which prescribing falls outside of guideline care.

Finally, clinicians might be concerned that a targeted symptom approach could delay the diagnosis of a disorder or that a potential unintended consequence of a focus on each targeted symptom could be an increase in multiclass polypharmacy. However, the guidance in every symptom class involves the following process: (1) Identify the target symptoms, (2) rule out potential diagnoses, (3) review current and past treatments (e.g., medications and psychotherapies), and (4) consider treatment alternatives (e.g., dose or medication changes, lower risk medications, psychotherapy). As such, the guidance developed here provides a framework for consulting child and adolescent psychiatrists to work with prescribers in arriving at an effective treatment plan for the principal complaint. The process begins by homing-in on what the clinician is trying to achieve with the antipsychotic medication (target symptom) and works through whether a different diagnosis might fit better and whether current medication doses might be increased or a return to previously successful medications might be considered. The program that inspired the approach developed here reported decreases in polypharmacy after it began13.

Clinicians may also be concerned that the proposed guidance unnecessarily impinges on the professional autonomy of practitioners. We originally proposed a “hard stop” (similar to Medicaid programs) where clinicians would not be able to order the medication without a second opinion consult from a child and adolescent psychiatrist (regardless of whether the ordering clinician was themself a psychiatrist). We interviewed physicians in 2 health systems about how best to implement the program and concluded that a “soft stop” would be preferable so as to engender a culture of collegiality87.

We would advocate for health system administrators and department chiefs to make local decisions on how strongly to push the guidance. We assembled a multi-disciplinary team of experts and report on their recommendations. The suite of SUAY intervention is designed to “make the right thing easy to do” but is also designed to change prescribing behavior.

This study focused on an approach to supporting the targeted prescribing of antipsychotics. The specific recommendations for that class of medication do not necessarily generalize broadly to other medication classes. However, the approach – identify target symptoms, step through lower risk medications, facilitate psychosocial interventions, and make expert advice available - can be generalized to other medication classes and therapies. Also, the consultation and guideline focused on the use of a certain medication class, in this case antipsychotics, but did not address the level of outcomes per se (e.g., on standardized instruments of symptom severity and/or functioning). Thus, measurement-based care should increasingly be used, in that both symptomatic, but also patient-reported and family-centered measurements and self-reports are incorporated in the assessment of the adequacy, effectiveness, tolerability and overall acceptability of specific treatment approaches. We acknowledge that the systematic review of evidence is now somewhat dated; however, the published evidence for prescribing antipsychotics to children and adolescents for conditions other than psychotic disorders, bipolar disorder, autism spectrum disorder, and developmental disability remains limited. Also, we did not attempt to qualify the strength of evidence for panelists prior to the in-person meeting. The stepped treatment recommendations for the multiple disorders covered in the guidance tables are based on expert consensus in addition to review by the panel of the treatment literature and guidelines for each disorder.

While development of this approach to reviewing antipsychotic prescriptions included a broad representation of pediatricians, child and adolescent psychiatrists and experts in psychopharmacology in the US, other stakeholders were not part of the guideline development. In particular, we did not directly incorporate the input of parents, guardians and youth. However, we did conduct a series of focus groups and telephone interviews with families at each of the four health systems participating in the trial to inform development of the overall SUAY program. Qualitative information reported by children, adolescents and parents/guardians regarding their experience accessing mental health care, being prescribed an antipsychotic, medication side effects, and changes in behavior and functioning (both positive and negative) was incorporated into the study protocol for offering supportive services – including help finding psychosocial services close to home and accessing therapy via televideo. Should the SUAY trial yield beneficial outcomes in terms of more targeted antipsychotic prescribing, the ultimate and refined guideline (and supporting approach) will be informed and vetted by multiple additional stakeholders, including patients, families, and payers.

Antipsychotic prescribing that focuses on target symptoms rather than diagnoses was unanimously endorsed by a panel of experts and may have significant promise as a strategy for improving safe and judicious antipsychotic prescribing. Such an approach may be especially promising when implemented as part of a multi-component intervention that deploys organizational influence processes to integrate prescribing recommendations, clinical decision support, timely specialty review of prescription orders with collegial feedback; behavioral health navigation; and improved access to psychosocial therapies, including use of telemedicine. This multi-component approach is currently being tested in the SUAY trial with the primary outcome being duration of antipsychotic use among youth initiating treatment. The study will also measure negative unintended consequences including hospital admissions, emergency department visits and suicide attempts. If the approach proves successful at increasing or intensifying the use of psychosocial interventions before antipsychotic medication use and minimizing the duration of antipsychotic treatment once started, it may serve as a model to state Medicaid programs and health systems as a way to support pediatricians and primary care physicians in delivering high-quality mental health care to youth.

Supplementary Material

1
2
3

Acknowledgments

This project is supported by the National Institute of Mental Health (NIMH) of the National Institutes of Health (NIH) under contract number HHSN271201600002C (Penfold) “A Targeted Approach to a Safer Use of Antipsychotics in Youth” (total award $9,658,552; no project costs were financed by nongovernmental sources). This information or content and conclusions are those of the author and should not be construed as the official position or policy of, nor should any endorsements be inferred by NIMH or NIH. Dr. Crystal’s work is supported by the Agency for Healthcare Research and Quality 1R01HS026001 and R18HS03258, the Patient-Centered Outcomes Research Institute HSA2902010000101, and the National Center for Advancing Translational Sciences (NCATS) UL1TR003017.

The research was performed with permission from Kaiser Permanente Washington Health Research Institute’s Institutional Review Board.

The authors wish to thank Adam Haim, PhD, of NIMH, for his critical input to the design and conduct of the study. They also thank Galia Siegal, PhD, of the Clinical Trials Operations Branch at NIMH, for her invaluable assistance in coordinating the clinical trial and liaising with the DSMB.

Funding acquisition:

Penfold, Vitiello, Kelleher, Simon

Investigation: Hilt, Robb, Correll, Newton, Rogalski, Earls, Kowatch, Crystal, Simon

Methodology: Beck

Project administration: Thompson

Resources: Thompson

Writing – original draft: Penfold, Thompson

Writing – review and editing: Hilt, Schwartz, Robb, Correll, Newton, Rogalski, Earls, Kowatch, Beck, Yarborough, Crystal, Vitiello, Kelleher, Simon

Disclosure:

Dr. Schwartz has been a consultant for the law firm Drinker, Biddle and Reath, now known as Faegre, Drinker, Biddle and Reath, in the past two years. She holds no stocks of pharmaceutical companies. Dr. Robb has been a consultant and/or advisor to or has received honoraria from the American Academy of Child and Adolescent Psychiatry, the American Academy of Pediatrics, I-ACT, Lundbeck/Takeda, the Neuroscience Education Institute, the Eunice Kennedy Shriver National Institute of Child Health and Human Development, and Supernus. She has served on a Data Safety Monitoring Board for NIMH and Otsuka. She has received grant support from NCATS, NIMH, Actavis/Forest/Allergan, Lundbeck/Takeda, and Supernus. She has IRA stock in Eli Lilly and Co., GlaxoSmithKline, Johnson and Johnson, and Pfizer. Dr. Correll has been a consultant and/or advisor to or has received honoraria from Acadia, Alkermes, Allergan, Angelini, Axsome, Gedeon Richter, IntraCellular Therapies, Janssen/JandJ, Karuna, LB Pharma, Lundbeck, MedAvante-ProPhase, MedInCell, Medscape, Merck, Mitsubishi Tanabe Pharma, Mylan, Neurocrine, Noven, Otsuka, Pfizer, Recordati, Rovi, Servier, Sumitomo Dainippon, Sunovion, Supernus, Takeda, and Teva. He has provided expert testimony for Janssen and Otsuka. He has served on a Data Safety Monitoring Board for Lundbeck, Rovi, Supernus, and Teva. He has received grant support from Janssen and Takeda. He is a stock option holder of LB Pharma. Dr. Vitiello has been a consultant for Medice, Lundbeck, Angelini, and Alkermes Pharmaceuticals, and for law firms Goodwin and Procter and Haynes and Boone, in the past two years. He holds no stocks of pharmaceutical companies. Drs. Penfold, Hilt, Newton, Rogalski, Earls, Kowatch, Beck, Yarborough, Crystal, Kelleher, Simon, and Ms. Thompson have reported no biomedical financial interests or potential conflicts of interest.

Footnotes

Publisher's Disclaimer: This is a PDF file of an unedited manuscript that has been accepted for publication. As a service to our customers we are providing this early version of the manuscript. The manuscript will undergo copyediting, typesetting, and review of the resulting proof before it is published in its final form. Please note that during the production process errors may be discovered which could affect the content, and all legal disclaimers that apply to the journal pertain.

Clinical trial registration information: Targeted and Safer Use of Antipsychotics in Youth; ClinicalTrials.gov; NCT03448575

REFERENCES

  • 1.Olfson M, Marcus SC, Weissman MM, Jensen PS. National trends in the use of psychotropic medications by children. J Am Acad Child Adolesc Psychiatry. 2002;41(5):514–521. 10.1097/00004583-200205000-00008 [DOI] [PubMed] [Google Scholar]
  • 2.Zito JM, Safer DJ, dosReis S, Gardner JF, Boles M, Lynch F. Trends in the prescribing of psychotropic medications to preschoolers. JAMA. 2000;283(8):1025–1030. 10.1001/jama.283.8.1025 [DOI] [PubMed] [Google Scholar]
  • 3.Zito JM, Safer DJ, DosReis S, et al. Psychotropic practice patterns for youth: a 10-year perspective. Arch Pediatr Adolesc Med. 2003;157(1):17–25. 10.1001/archpedi.157.1.17 [DOI] [PubMed] [Google Scholar]
  • 4.Zito JM, Safer DJ, Sai D, et al. Psychotropic Medication Patterns Among Youth in Foster Care. Pediatrics. 2008;121(1):e157–e163. 10.1542/peds.2007-0212 [DOI] [PubMed] [Google Scholar]
  • 5.Crystal S, Olfson M, Huang C, Pincus H, Gerhard T. Broadened Use Of Atypical Antipsychotics: Safety, Effectiveness, And Policy Challenges. Health Affairs. 2009;28(5):w770–w781. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6.Olfson M, Crystal S, Huang C, Gerhard T. Trends in antipsychotic drug use by very young, privately insured children. J Am Acad Child Adolesc Psychiatry. 2010;49(1):13–23. 10.1097/00004583-201001000-00005 [DOI] [PubMed] [Google Scholar]
  • 7.Sohn M, Moga DC, Blumenschein K, Talbert J. National trends in off-label use of atypical antipsychotics in children and adolescents in the United States. Medicine (Baltimore). 2016;95(23):e3784. 10.1097/MD.0000000000003784 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8.Penfold RB, Hunkeler EM, Madden JM, et al. Use of antipsychotic medications in pediatric populations: what do the data say? Curr Psychiatry Rep. 2013;15(12):426–436. 10.1007/s11920-013-0426-8 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9.Olfson M, Blanco C, Liu SM, Wang S, Correll CU. National Trends in the Office-Based Treatment of Children, Adolescents, and Adults With Antipsychotics. Arch Gen Psychiatry. 2012:1–10. 10.1001/archgenpsychiatry.2012.647 [DOI] [PubMed] [Google Scholar]
  • 10.Merikangas KR, He JP, Rapoport J, Vitiello B, Olfson M. Medication use in US youth with mental disorders. JAMA Pediatr. 2013;167(2):141–148. 10.1001/jamapediatrics.2013.431 [DOI] [PubMed] [Google Scholar]
  • 11.Edelsohn GA, Karpov I, Parthasarathy M, et al. Trends in Antipsychotic Prescribing in Medicaid-Eligible Youth. J Am Acad Child Adolesc Psychiatry. 2017;56(1):59–66. 10.1016/j.jaac.2016.10.005 [DOI] [PubMed] [Google Scholar]
  • 12.Melvin KE, Hart JC, Sorvig RD. Second-Generation Antipsychotic Prescribing Patterns for Pediatric Patients Enrolled in West Virginia Medicaid. Psychiatr Serv. 2017;68(10):1061–1067. 10.1176/appi.ps.201600489 [DOI] [PubMed] [Google Scholar]
  • 13.Barclay RP, Penfold RB, Sullivan D, Boydston L, Wignall J, Hilt RJ. Decrease in Statewide Antipsychotic Prescribing after Implementation of Child and Adolescent Psychiatry Consultation Services. Health Serv Res. 2017;52(2):561–578. 10.1111/1475-6773.12539 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.Loy JH, Merry SN, Hetrick SE, Stasiak K. Atypical antipsychotics for disruptive behaviour disorders in children and youths. Cochrane Database Syst Rev. 2012;9:CD008559. 10.1002/14651858.CD008559.pub2 [DOI] [PubMed] [Google Scholar]
  • 15.McKinney C, Renk K. Atypical antipsychotic medications in the management of disruptive behaviors in children: safety guidelines and recommendations. Clin Psychol Rev. 2011;31(3):465–471. 10.1016/j.cpr.2010.11.005 [DOI] [PubMed] [Google Scholar]
  • 16.Crystal S, Mackie T, Fenton MC, et al. Rapid Growth Of Antipsychotic Prescriptions For Children Who Are Publicly Insured Has Ceased, But Concerns Remain. Health Aff (Millwood). 2016;35(6):974–982. 10.1377/hlthaff.2016.0064 [DOI] [PubMed] [Google Scholar]
  • 17.Crystal S, Olfson M, Huang C, Pincus H, Gerhard T. Broadened use of atypical antipsychotics: safety, effectiveness, and policy challenges. Health Aff (Millwood). 2009;28(5):w770–781. 10.1377/hlthaff.28.5.w770 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18.Correll CU, Blader JC. Antipsychotic Use in Youth Without Psychosis: A Double-edged Sword. JAMA Psychiatry. 2015;72(9):859–860. 10.1001/jamapsychiatry.2015.0632 [DOI] [PubMed] [Google Scholar]
  • 19.Lopez OL, Becker JT, Chang YF, et al. The long-term effects of conventional and atypical antipsychotics in patients with probable Alzheimer’s disease. Am J Psychiatry. 2013;170(9):1051–1058. 10.1176/appi.ajp.2013.12081046 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20.Eapen V, John G. Weight gain and metabolic syndrome among young patients on antipsychotic medication: what do we know and where do we go? Australas Psychiatry. 2011;19(3):232–235. 10.3109/10398562.2010.539609 [DOI] [PubMed] [Google Scholar]
  • 21.Almandil NB, Wong IC. Review on the current use of antipsychotic drugs in children and adolescents. Arch Dis Child Educ Pract Ed. 2011;96(5):192–196. 10.1136/archdischild-2011-300054 [DOI] [PubMed] [Google Scholar]
  • 22.De Hert M, Detraux J, van Winkel R, Yu W, Correll CU. Metabolic and cardiovascular adverse effects associated with antipsychotic drugs. Nat Rev Endocrinol. 2012;8(2):114–126. 10.1038/nrendo.2011.156 [DOI] [PubMed] [Google Scholar]
  • 23.Andrade SE, Lo JC, Roblin D, et al. Antipsychotic medication use among children and risk of diabetes mellitus. Pediatrics. 2011;128(6):1135–1141. 10.1542/peds.2011-0855 [DOI] [PubMed] [Google Scholar]
  • 24.Jerrell JM, Tripathi A, Rizvi AA, McIntyre RS. The risk of developing type 2 diabetes mellitus associated with psychotropic drug use in children and adolescents: a retrospective cohort analysis. Prim Care Companion CNS Disord. 2012;14(1). 10.4088/PCC.11m01185 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 25.Sernyak MJ, Leslie DL, Alarcon RD, Losonczy MF, Rosenheck R. Association of diabetes mellitus with use of atypical neuroleptics in the treatment of schizophrenia. Am J Psychiatry. 2002;159(4):561–566. 10.1176/appi.ajp.159.4.561 [DOI] [PubMed] [Google Scholar]
  • 26.Galling B, Roldan A, Nielsen RE, et al. Type 2 Diabetes Mellitus in Youth Exposed to Antipsychotics: A Systematic Review and Meta-analysis. JAMA Psychiatry. 2016;73(3):247–259. 10.1001/jamapsychiatry.2015.2923 [DOI] [PubMed] [Google Scholar]
  • 27.Maayan L, Correll CU. Weight gain and metabolic risks associated with antipsychotic medications in children and adolescents. J Child Adolesc Psychopharmacol. 2011;21(6):517–535. 10.1089/cap.2011.0015 [DOI] [PubMed] [Google Scholar]
  • 28.Correll CU, Manu P, Olshanskiy V, Napolitano B, Kane JM, Malhotra AK. Cardiometabolic risk of second-generation antipsychotic medications during first-time use in children and adolescents. JAMA. 2009;302(16):1765–1773. 10.1001/jama.2009.1549 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 29.De Hert M, Yu W, Detraux J, Sweers K, van Winkel R, Correll CU. Body weight and metabolic adverse effects of asenapine, iloperidone, lurasidone and paliperidone in the treatment of schizophrenia and bipolar disorder: a systematic review and exploratory meta-analysis. CNS Drugs. 2012;26(9):733–759. 10.2165/11634500-000000000-00000 [DOI] [PubMed] [Google Scholar]
  • 30.DelBello MP, Goldman R, Phillips D, Deng L, Cucchiaro J, Loebel A. Efficacy and Safety of Lurasidone in Children and Adolescents With Bipolar I Depression: A Double-Blind, Placebo-Controlled Study. J Am Acad Child Adolesc Psychiatry. 2017;56(12):1015–1025. 10.1016/j.jaac.2017.10.006 [DOI] [PubMed] [Google Scholar]
  • 31.Goldman R, Loebel A, Cucchiaro J, Deng L, Findling RL. Efficacy and Safety of Lurasidone in Adolescents with Schizophrenia: A 6-Week, Randomized Placebo-Controlled Study. J Child Adolesc Psychopharmacol. 2017;27(6):516–525. 0.1089/cap.2016.0189 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 32.Huhn M, Nikolakopoulou A, Schneider-Thoma J, et al. Comparative efficacy and tolerability of 32 oral antipsychotics for the acute treatment of adults with multi-episode schizophrenia: a systematic review and network meta-analysis. Lancet. 2019;394(10202):939–951. 10.1016/S0140-6736(19)31135-3 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 33.Olfson M, He JP, Merikangas KR. Psychotropic medication treatment of adolescents: results from the national comorbidity survey-adolescent supplement. J Am Acad Child Adolesc Psychiatry. 2013;52(4):378–388. 10.1016/j.jaac.2012.12.006 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 34.Penfold RB, Kelleher KJ, Wang W, et al. Pediatric uptake of a newly available antipsychotic medication. Pediatrics. 2010;125(3):475–482. 10.1542/peds.2009-1288 [DOI] [PubMed] [Google Scholar]
  • 35.Correll CU, Sikich L, Reeves G, et al. Metformin add-on vs. antipsychotic switch vs. continued antipsychotic treatment plus healthy lifestyle education in overweight or obese youth with severe mental illness: results from the IMPACT trial. World Psychiatry. 2020;19(1):69–80. 10.1002/wps.20714 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 36.Dinnissen M, Dietrich A, van der Molen JH, et al. Guideline Adherence of Monitoring Antipsychotic Use for Nonpsychotic Indications in Children and Adolescents: A Patient Record Review. J Clin Psychopharmacol. 2021;41(1):13–18. 10.1097/JCP.0000000000001322 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 37.Walkerly A, King M. Evaluation of initial atypical antipsychotic monitoring parameters in children and adolescents. Ment Health Clin. 2020;10(6):354–357. 10.9740/mhc.2020.11.354 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 38.Penfold RB. Safer Use of Antipsychotics in Youth (SUAY), #NCT03448575. ClinicalTrials.gov, National Library of Medicine. https://clinicaltrials.gov/ct2/show/NCT03448575. Published 2018. Accessed. [Google Scholar]
  • 39.Penfold RB, Thompson EE, Hilt RJ, et al. Safer Use of Antipsychotics in Youth (SUAY) Pragmatic Trial Protocol. Contemp Clin Trials. 2020; 10.1016/j.cct.2020.106184 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 40.ABIM Foundation. American Psychiatric Association: Five Things Physicians and Patients Should Question. http://www.choosingwisely.org/doctor-patient-lists/american-psychiatric-association/. Published 2014. Accessed March 22, 2015.
  • 41.Pappadopulos E, Macintyre li JC, Crismon ML, et al. Treatment recommendations for the use of antipsychotics for aggressive youth (TRAAY). Part II. J Am Acad Child Adolesc Psychiatry. 2003;42(2):145–161. 10.1097/00004583-200302000-00008 [DOI] [PubMed] [Google Scholar]
  • 42.AACAP. Practice Parameter on the Use of Psychotropic Medication in Children and Adolescents. Journal of the American Academy of Child and Adolescent Psychiatry. 2009;48(9):961–973. 10.1097/CHI.0b013e3181ae0a08 [DOI] [PubMed] [Google Scholar]
  • 43.Pliszka SR, Crismon ML, Hughes CW, et al. The Texas Children’s Medication Algorithm Project: revision of the algorithm for pharmacotherapy of attention-deficit/hyperactivity disorder. J Am Acad Child Adolesc Psychiatry. 2006;45(6):642–657. 10.1097/01.chi.0000215326.51175.eb [DOI] [PubMed] [Google Scholar]
  • 44.Steiner H, Remsing L, Work Group on Quality I. Practice parameter for the assessment and treatment of children and adolescents with oppositional defiant disorder. J Am Acad Child Adolesc Psychiatry. 2007;46(1):126–141. 10.1097/01.chi.0000246060.62706.af [DOI] [PubMed] [Google Scholar]
  • 45.Pappadopulos E, Rosato NS, Correll CU, et al. Experts’ recommendations for treating maladaptive aggression in youth. J Child Adolesc Psychopharmacol. 2011;21(6):505–515. 10.1089/cap.2010.0128 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 46.Findling RL, Drury S, Jensen PS, Rapoport J. Practice Parameter for the Use of Atypical Antipsychotic Medications in Children and Adolescents. 2011:27. [Google Scholar]
  • 47.Grimshaw JM, Thomas RE, MacLennan G, et al. Effectiveness and efficiency of guideline dissemination and implementation strategies. Health technology assessment (Winchester, England) 2004;8(6):iii–iv, 1-72. 10.3310/hta8060 [DOI] [PubMed] [Google Scholar]
  • 48.Woolf SH, Grol R, Hutchinson A, Eccles M, Grimshaw J. Clinical guidelines: potential benefits, limitations, and harms of clinical guidelines. BMJ. 1999;318(7182):527–530. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 49.Eccles MP, Grimshaw JM, Shekelle P, Schunemann HJ, Woolf S. Developing clinical practice guidelines: target audiences, identifying topics for guidelines, guideline group composition and functioning and conflicts of interest. Implement Sci. 2012;7:60. 10.1186/1748-5908-7-60 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 50.Shekelle P, Woolf S, Grimshaw JM, Schunemann HJ, Eccles MP. Developing clinical practice guidelines: reviewing, reporting, and publishing guidelines; updating guidelines; and the emerging issues of enhancing guideline implementability and accounting for comorbid conditions in guideline development. Implement Sci. 2012;7:62. 10.1186/1748-5908-7-62 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 51.van Engen-Verheul MM, de Keizer NF, van der Veer SN, et al. Evaluating the effect of a web-based quality improvement system with feedback and outreach visits on guideline concordance in the field of cardiac rehabilitation: rationale and study protocol. Implement Sci. 2014;9(1):780. 10.1186/s13012-014-0131-y [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 52.Woolf S, Schunemann HJ, Eccles MP, Grimshaw JM, Shekelle P. Developing clinical practice guidelines: types of evidence and outcomes; values and economics, synthesis, grading, and presentation and deriving recommendations. Implement Sci. 2012;7:61. 10.1186/1748-5908-7-61 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 53.Goud R, van Engen-Verheul M, de Keizer NF, et al. The effect of computerized decision support on barriers to guideline implementation: a qualitative study in outpatient cardiac rehabilitation. Int J Med Inform. 2010;79(6):430–437. 10.1016/j.ijmedinf.2010.03.001 [DOI] [PubMed] [Google Scholar]
  • 54.Grimshaw J, Eccles M, Tetroe J. Implementing clinical guidelines: current evidence and future implications. J Contin Educ Health Prof. 2004;24 Suppl 1:S31–37. 10.1002/chp.1340240506 [DOI] [PubMed] [Google Scholar]
  • 55.Knapp P, Chait A, Pappadopulos E, Crystal S, Jensen PS. Treatment of maladaptive aggression in youth: CERT guidelines I. Engagement, assessment, and management. Pediatrics. 2012;129(6):e1562–1576. 10.1542/peds.2010-1360 [DOI] [PubMed] [Google Scholar]
  • 56.Scotto Rosato N, Correll CU, Pappadopulos E, et al. Treatment of maladaptive aggression in youth: CERT guidelines II. Treatments and ongoing management. Pediatrics. 2012;129(6):e1577–1586. 10.1542/peds.2010-1361 [DOI] [PubMed] [Google Scholar]
  • 57.Sultan RS, Correll CU, Schoenbaum M, King M, Walkup JT, Olfson M. National Patterns of Commonly Prescribed Psychotropic Medications to Young People. J Child Adolesc Psychopharmacol. 2018;28(3):158–165. 0.1089/cap.2017.0077 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 58.Plana-Ripoll O, Pedersen CB, Holtz Y, et al. Exploring Comorbidity Within Mental Disorders Among a Danish National Population. JAMA Psychiatry. 2019;76(3):259–270. 10.1001/jamapsychiatry.2018.3658 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 59.Thomas CR, Holzer CE 3rd. The continuing shortage of child and adolescent psychiatrists. J Am Acad Child Adolesc Psychiatry. 2006;45(9):1023–1031. 10.1097/01.chi.0000225353.16831.5d [DOI] [PubMed] [Google Scholar]
  • 60.Turner CM, Mataix-Cols D, Lovell K, et al. Telephone cognitive-behavioral therapy for adolescents with obsessive-compulsive disorder: a randomized controlled non-inferiority trial. J Am Acad Child Adolesc Psychiatry. 2014;53(12):1298–1307 e1292. 10.1016/j.jaac.2014.09.012 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 61.American Psychological Association, Center for Workforce Studies. Underserved populations: Practice setting matters. http://www.apa.org/workforce/snapshots/2011/underserved-population.pdf. Published 2011. Accessed April 1, 2013.
  • 62.Holzer CE, Goldsmith HF, Ciarlo JA. Effects of rural-urban county type on the availability of health and mental health care providers. Mental Health, United States. 1998:204–213. [Google Scholar]
  • 63.Muskie School of Public Service. Research and Policy Brief. Rural Children Don’t Receive the Mental Health Care they Need. Maine Rural Health Research Center. http://muskie.usm.maine.edu/Publications/rural/pb39/Rural-Children-Mental-Health-Services.pdf. Published 2009. Accessed December 29, 2014.
  • 64.American Association of Medical Colleges. Recent Studies and Reports on Physician Shortages in the U.S. https://www.aamc.org/download/100598/data/. Published 2015. Accessed February 11, 2015.
  • 65.Flaum M Telemental health as a solution to the widening gap between supply and demand for mental health services. In: Myers K, Turvey CL, eds. Telemental Health: Clinical, Technical, and Administrative Foundations for Evidence-based Practice. New York, NY: Elsevier; 2013. [Google Scholar]
  • 66.American Psychological Association, Michalski D, Mulvey T, Kohout J. 2008 APA Survey of Psychology Health Service Provders. Washington, DC: 2010. [Google Scholar]
  • 67.Kazdin AE, Blase SL. Rebooting psychotherapy research and practice to reduce the burden of mental illness. Perspect Psychol Sci 2011;6(l):21–37. 10.1177/1745691610393527 [DOI] [PubMed] [Google Scholar]
  • 68.Michalski DS, Kohout JL. The state of the psychology health service provider workforce. Am Psychol. 2011;66(9):825–834. 10.1037/a0026200 [DOI] [PubMed] [Google Scholar]
  • 69.Comer JS, Elkins RM, Chan PT, Jones DJ. New methods of service delivery for children’s mental health care. In: Alfano CA, Beidel D, eds. Comprehensive evidence-based interventions for school-aged children and adolescents. New York, NY: Wiley; 2014. [Google Scholar]
  • 70.Baumel A, Pawar A, Mathur N, Kane JM, Correll CU. Technology-Assisted Parent Training Programs for Children and Adolescents With Disruptive Behaviors: A Systematic Review. J Clin Psychiatry. 2017;78(8):e957–e969. 10.4088/JCP.16rll063 [DOI] [PubMed] [Google Scholar]
  • 71.Burgic-Radmanovic M, Burgic S. Comorbidity in children and adolescent psychiatry. Psychiatr Danub. 2010;22(2):298–300. [PubMed] [Google Scholar]
  • 72.NCQA-The Future of Patient-Centered Medical Homes: Foundation for a Better Health Care System. 2014. [Google Scholar]
  • 73.Agency for Healthcare Research and Quality. First and Second Generation Antipsychotics in Children and Young Adults - Comparative Effectiveness Review Update. https://effectivehealthcare.ahrq.gov/sites/default/files/pdf/antipsychotics-children-update_research-protocol.pdf. Published 2015. Accessed July 19, 2016.
  • 74.Pringsheim T, Panagiotopoulos C, Davidson J, Ho J, Canadian Alliance for Monitoring E, Safety of Antipsychotics in Children guideline g. Evidence-based recommendations for monitoring safety of second-generation antipsychotics in children and youth. Paediatr Child Health. 2011; 16(9):581–589. [PMC free article] [PubMed] [Google Scholar]
  • 75.Loy JH, Merry SN, Hetrick SE, Stasiak K. Atypical antipsychotics for disruptive behaviour disorders in children and youths. Cochrane Database Syst Rev. 2012(9):Cd008559. 10.1002/14651858.CD008559.pub2 [DOI] [PubMed] [Google Scholar]
  • 76.Kondo K, Winchell K, Kreyenbuhl JA, Sadowski C, Sultzer D. AHRQ Sytematic Surveillance Program. CER #43. Off-label Use of Antipsychotics: An Update. https://effectivehealthcare.ahrq.gov/sites/default/files/related_files/atypical-antipsychotics-off-label-update_surveillance.pdf. Accessed July 26, 2016. [Google Scholar]
  • 77.American Psychiatric Association. Choosing Wisely - Antipsychotics in Children or Adolescents. https://www.choosingwiselv.org/clinician-lists/american-psychiatric-association-antipsychotics-in-children-or-adolescents/. Published September 20, 2013; revised August 21, 2014. Accessed.
  • 78.American Academy of Child and Adolescent Psychiatry. Practice Parameter for the use of Atypical Antipsychotic Medications in Children and Adolescents 2011. [Google Scholar]
  • 79.Seida JC, Schouten JR, Boylan K, et al. Antipsychotics for children and young adults: a comparative effectiveness review. Pediatrics. 2012;129(3):e771–784. 10.1542/peds.2011-2158 [DOI] [PubMed] [Google Scholar]
  • 80.Higgins JPT, Green S. Cochrane Handbook for Systematic Reviews of Interventions Version 5.1.0 [updated March 2011], The Cochrane Collaboration, https://handbook-5-1.cochrane.org/. Published 2011. Accessed. [Google Scholar]
  • 81.Higgins JP, Altman DG, Gøtzsche PC, et al. The Cochrane Collaboration’s tool for assessing risk of bias in randomised trials. BMJ. 2011;343:d5928. 10.1136/bmj.d5928 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 82.Gill PJ, Hewitson P, Peile E, Harnden A. Prioritizing areas for quality marker development in children in UK general practice: extending the use of the nominal group technique. Fam Pract. 2012;29(5):567–575. 10.1093/fampra/cms006 [DOI] [PubMed] [Google Scholar]
  • 83.CDC. Gaining Consensus Among Stakeholdes Through the Nominal Group Technique. Evaluation Briefs No. 7 Web site. https://www.cdc.gov/healthyyouth/evaluation/pdf/brief7.pdf. Published 2018. Accessed March 26, 2019, 2019.
  • 84.Constantine RJ, McPherson MA, Jones ME, Tandon R, Becker ER. Improving psychotherapeutic medication prescribing in Florida: implementation of the Florida Medicaid Drug Therapy Management Program (MDTMP). Community Ment Health J. 2013;49(1):33–44. 10.1007/s10597-012-9497-y [DOI] [PubMed] [Google Scholar]
  • 85.Hilt RJ, Romaire MA, McDonell MG, et al. The Partnership Access Line: evaluating a child psychiatry consult program in Washington State. JAMA Pediatr. 2013;167(2):162–168. 10.1001/2013.jamapediatrics.47 [DOI] [PubMed] [Google Scholar]
  • 86.Chiara AN, Kashalikar N, Pomfret TC, et al. An Evaluation of a Multidisciplinary Pediatric Behavioral Health Medication Initiative Workgroup’s Interventions on Medication Prescribing in a Population of Medicaid Patients. J Manag Care Spec Pharm. 2018;24(8):746–751. 10.18553/jmcp.2018.24.8.746 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 87.Hartzler AL, Ralston JD, T AH, Kelleher KJ, Penfold RB. Designing Safer Use of Antipsychotics Among Youths: A Human-Centered Approach to an Algorithm-Based Solution. Psychiatr Serv. 2019;70(10):944–947. 10.1176/appi.ps.201800390 [DOI] [PMC free article] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

1
2
3

RESOURCES