Abstract
We conducted a review of empirically based prevention programs to identify prevalence and types of family support services within these programs. A total of 238 articles published between 1990 and 2011 that included a family support component were identified; 37 met criteria for inclusion. Following the Institute of Medicine’s typology, prevention programs were categorized as universal, selective, or indicated; programs containing more than one prevention level were characterized as multilevel. Family support types included those led by a mental health professional, led by a peer, or team-led. Among the 37 prevention programs reviewed, 27% (n = 10) were universal, 41% (n = 15) were selective, 16% (n = 6) were indicated, and 16% (n = 6) were multi-level. The predominant model of family support was professionally led (95%, n = 35). Two (n = 5%) provided team-led services. None were purely peer-led. In terms of content of family support services, all (100%, n = 37) provided instruction/skill build. Information and education was provided by 70% (n = 26), followed by emotional support (n = 11, 30%) and instrumental or concrete assistance (n = 11, 30%). Only 14% (n = 5) provided assistance with advocacy. The distribution of models and content of services in prevention studies differ from family support within treatment studies. As family support is likely to be an enduring component of the child and family mental health service continuum, comparative effectiveness studies are needed to inform future development.
Keywords: Prevention programs, Peer-to-peer support, Family support
Introduction
Mental health promotion via prevention or amelioration of risk factors has a robust research history in mental health (Barrera and Sandler 2006), particularly within the area of children’s mental health (Rishel 2007). Meta-analytic reviews have examined the impact of these programs across symptoms (e.g., depression, disruptive behaviors), settings (e.g., school-based programs), and risk factors (e.g., parental divorce; e.g., Beelmann 2006; Durlak and Wells 1997; Gillham et al. 2006; Horowitz and Garber 2006; Wilson et al. 2003). These reviews are notable for identifying a sizable number of empirically based prevention programs. The comprehensive Durlak and Wells (1997) review included 177 primary prevention programs (defined as health promotion and risk reduction interventions) and concluded that recipients of the interventions fared significantly better than youth in the control groups. Outcomes included symptom reduction and functioning with average effect sizes of 0.24–0.93. Furthermore, program benefits were maintained over time. A subsequent review (Durlak and Wells 1998) identified 130 indicated programs and found that behavioral and cognitive behavioral programs were effective at decreasing behavioral problems and improving functioning among youth; only seven programs had a negative effect (effect sizes ranged from −0.28 to 2.05).
Despite substantial research support for their efficacy, engaging families in these programs is challenging (Redmond et al. 2002; Spoth et al. 2007). Low recruitment and retention rates are reported in interventions that include parent involvement (see Spoth and Redmond 2000). To improve engagement, a growing number of prevention models are enlisting members of the target group’s community in recruitment efforts and delivery of the intervention (Prinz et al. 2001; Spoth et al. 2002, 2007). The use of lay community members within the field of prevention mirrors a movement in children’s mental health to train and employ parent peer support specialists (known by numerous names) to deliver family support services to parents or caregivers. The family support movement in children’s mental health has evolved since the late 1980s, with the newest models of service delivery involving direct peer-to-peer support provided by parents or caregivers of children who are raising or have raised a child with identified mental health needs to parents or caregivers (Hoagwood et al. 2010; Robbins et al. 2008). Because of their personal experience, parent peer support specialists often have a unique credibility with other parents and thus are able to engender trust and assist parents in becoming more actively engaged in their child’s services (Gyamfi et al. 2010; Hoagwood 2005; Koroloff et al. 1994; Osher et al. 2008; Robbins et al. 2008).
Family support as a service modality has been included in state mental health systems as one component of the overall service continuum since 1987, when the Child and Adolescent Service System Program (CASSP) was initiated (Katz-Levy 2011). The more recent addition to this model involves services provided by peer parents to parents/caregivers where the intent is to directly address parent/caregiver needs including clarifying and helping the parent to find their “voice”; reducing their sense of isolation, stress, or self-blame; providing education; teaching specific skills; and empowering and activating them, so that they can more effectively access and use mental health services.
In a review of family support services in children’s mental health treatments, Hoagwood et al. (2010) identified five types or content of services typically included in this service model: (a) instruction/skill development, including parenting strategies, anger management and stress reduction techniques, (b) information and education about mental health conditions; (c) emotional and affirmational support; (d) instrumental services (e.g., transportation, respite, childcare); and (e) advocacy, including provision of information about parental rights and resources, as well as skill building to help the parent advocate for their child’s services. See Table 1 for a fuller description of the five family support components.
Table 1.
Definitions of family support components
|
This prior review also identified three primary models of family support: Those led by peers (i.e., parent peer support) accounted for 22% of the total sample (n = 11), while those delivered by mental health professionals were the largest category (n = 33, 67%). Those led by teams of peers and mental health professionals were the smallest category (n = 6, 12%). Similar content was found across types, but the emphasis varied. Overall, 86% (n = 41) of programs included instructional support/skill building, 74% (n = 37) included informational support, 46% (n = 23) advocacy, 44% (n = 22) emotional support, and 12% (n = 6) instrumental support.
Three key points emerged from this review. First, the peer-led model, unlike the professionally led or team-led models, included more content related to advocacy. This is not surprising, as this has been a core component of peer-led family services since CASSP. Second, programs led by mental health professionals were more likely to focus on skill building related to managing the child’s issues, while peer-led emphasized parent cognitions about their experiences and parent’s own needs. Third, we found that professionally led and team-led programs were more likely to have used experimental designs, most often with random assignment. Peer-led programs had a much thinner research base and lower-quality research methods.
Because of the rich research history on preventive interventions, we were unable to include these programs in our original review. Therefore, this paper provides a complementary review of family support within prevention programs. The purpose of this review is to identify prevalence and types of family support services within prevention programs, to compare the distribution to family support within treatment studies, and to examine the extent and content of peer support models in particular, as these represent an innovative and emerging model.
We address the following questions:
What is the range and distribution of family support components within prevention programs for youth?
How does the range and distribution in prevention compare to family support in treatment studies?
How does the model of peer support (a subcategory of family support) in prevention compare to the peer support model in treatment studies?
Methods
We conducted a comprehensive search of prevention programs for children and adolescents that included family support for their parents/caregivers (hereafter called parents):
A computer search of the PsycINFO database from 1990 to present, using the stems prevent* and mental*. This search yielded 1,610 abstracts.
Website and Google searches.
Programs from the following widely recognized published reviews and compendiums: (1) The Journal of Clinical Child and Adolescent Psychology’s special issue review of Evidence-Based Psychosocial Treatments for Children and Adolescents (2008); (2) Blueprints: Center for the Study and Prevention of Violence Model and Promising Program (2011); (3) The Prevention Research Center for the Promotion of Human Development’s Prevention Research Center Ten-Year Report (1998–2008); (4) The Substance Abuse Mental Health Services Administration’s (SAMHSA); Guide for selecting evidence-based practices for children and adolescents with disruptive behavior disorders (2008); (5) SAMHSA’s National Registry of Evidence-based Programs and Practices, NREPP (2011); (6) Durlak and Wells’s (1998) Evaluation of Indicated Prevention Intervention (Secondary Prevention) Mental Health Programs for Children and Adolescents; (7) Kutash et al. (2006) School-Based Mental Health: An Empirical Guide for Decision-Makers; (8) Meta-Analytic Review of Depression Prevention Programs for Children and Adolescents (Stice et al. 2009); (9) the 2008 Guide for Selecting and Adopting Evidence-based Practices for Children and Adolescents with Disruptive Behavior Disorders (Burns et al.); (10) Domintrovich and Greenberg’s (2000) study of implementation: Current findings from effective programs that prevent mental disorders in school-based children; and (11) Horowitz and Garber’s (2006) study: The prevention of depressive symptoms in children and adolescents: A meta-analytic review.
The National Research Council and Institute of Medicine’s (2009) book, titled Preventing Mental, Emotional, and Behavioral Disorders among Young People: Progress and Possibilities.
Discussions with national experts from major national family advocacy organizations (e.g., NAMI, CHADD, National Federation).
To characterize programs, we followed the Institute of Medicine’s typology; (1) universal prevention programs, meaning prevention programs that target a total population; (2) selective, which are for specific groups based upon an identified risk factor, such as poverty or a traumatic event (e.g., the loss of a parent); or (3) indicated programs, which are designed for symptomatic youth before they have an established disorder (Cuijpers 2003; Kutash 2007; Mrazek and Haggerty 1994). Programs that had multiple types of prevention were characterized as multi-level.
Consistent with our earlier review (Hoagwood et al. 2010), we categorized family support as the provision of instruction (skills training), information (education), emotional support, concrete or instrumental support, and advocacy provided directly to parents within prevention programs. We also categorized programs as provided by professionals (e.g., school personnel, clinicians), those delivered by family members (peer-led), and those delivered by a family peer/professional team.
Inclusion and Exclusion Criteria
Prevention programs or interventions were included if they:
provided instructional (skill building), educational, emotional, instrumental (concrete), or advocacy support for parents of children/adolescents who were targeted through universal prevention programs or were at risk for the onset of a psychiatric disorder (e.g., prevention of conduct disorder among youth with disruptive behavior problems) with the explicit goal of helping the parent.
were published (as journal articles, chapters, or dissertations) between 1990 and September 2010 or are available via personal communication.
had a formal curriculum or structure.
Prevention programs or interventions were excluded if they:
provided treatments (i.e., targeted a specific syndrome or disorder).
targeted youth with diagnosed mental disorders.
primarily focused on preventing substance abuse, child abuse, school failure, or other non-mental health outcome.
only provided information in the form of a flier or pamphlet. Programs required an active parent component to meet inclusion criteria.
did not directly focus on social, emotional, or behavioral issues.
A word of clarification: Because of commonalities of psychosocial risk factors associated with various behavioral health outcomes, many programs exist that target a variety of risk factors that may also influence mental health outcomes. For example, programs with strong parent support components (e.g., National Head Start Association 2010; Strengthening Families Program 2010; Visiting Nurse Association of America 2010) focus their prevention on the promotion or prevention of outcomes such as education, school readiness, child abuse, or substance abuse. While these programs often demonstrate secondary positive behavioral health outcomes, the content does not specifically focus on emotional or behavioral issues. Home visiting programs, for example, typically provide one or more types of parental support, including parenting skills, linkages to resources and education about child development, and social support, although their main objectives are to prevent child abuse and neglect, encourage maternal self-sufficiency, reduce subsequent pregnancies, and promote academic readiness (Council on Community Pediatrics 2009). However, consistent with our stated exclusionary criteria, we limit our review to programs that have an explicit focus on reducing risk for the development of child mental health disorders and include an explicit focus on supporting the parent or caregiver.
Coding and Analysis
At least two of three authors (Cavaleri, Olin, and Kim) reviewed each of 238 published prevention programs that contained a parent/caregiver support component to determine their eligibility based upon the inclusion and exclusion criteria listed above. Thirty-seven programs were found to be eligible after this review. Next, the three authors systematically reviewed the prevention programs that met criteria in weekly meetings over a year. Programs were categorized as universal, selective, indicated, or multi-level as described by the Institute of Medicine’s typology (Durlak and Wells 1997). One author (MC) initially coded each of the programs and used the coding scheme as a basis for coding the programs based on the descriptions provided in the published articles and/or relevant sources. A second author (SO) reviewed each program to ensure inter-rater reliability. Any discrepancies were discussed among all of the authors until consensus was reached. The coding system was refined until no additional codes were needed.
Results
A total of 238 programs had an identified parent component, and of these, 37 (16%) met inclusion criteria (see Table 2 for a list of the included programs). The remaining 201 programs were excluded mainly for two reasons: (1) their primary focus was not on reducing the risk of mental health problems but rather other conditions (e.g., primary focus on child abuse, substance abuse, and academic readiness) or (2) they did not include parent/caregiver support beyond information in the form of a pamphlet or flier.
Table 2.
List of family support interventions meeting inclusion criteria
Intervention or program name | Source |
---|---|
Universal | |
1. Center for Improvement of Child Caring Effective Black Parenting (EBPP) | Myers et al. (1992) |
2. COPEing with Toddler Behavior (CWTB) | Niccols (2004), Niccols (2009) |
3. DARE to be YOU (DTBY) | Miller-Heyl et al. (1998) |
4. Early Home-Based Intervention | Cheng et al. (2007) |
5. Family School Partnership (FSP) | Bradshaw et al. (2009), Ialongo et al. (2001) |
6. FRIENDS | Barrett et al. (2004), Lowry-Webster et al. (2001) |
7. Home-Based Intervention | Aronen and Arajarvi (2000), Aronen and Kurkela (1996) |
8. Linking the Interests of Families and Teachers (LIFT) | Eddy et al. (2000), Reid et al. (1999) |
9. Resourceful Adolescent Program-Parent (RAP-P) | Harnett and Dadds (2004), Shochet et al. (2001) |
10. Universal Parenting Program | Hiscock et al. (2008) |
Selective | |
1. Child Anxiety Prevention Study (CAPS) | Ginsburg (2004, 2009) |
2. Children in the Middle (CIM) | Brandon (2006), Gillard and Seymour (2005) |
3. Children of Divorce Intervention Program (CODIP) | Wolchik et al. (1993) |
4. Dads for Life (DFL) | Cookston et al. (2006) |
5. Empowerment Zone (EZ) | Nabors et al. (2001), Nabors et al. (2004) |
6. Family Bereavement Program (FBP) | Lochman et al. (2009), Sandler et al. (2003), Sandler et al. (2010) |
7. Keeping Families Strong (KFS) | Riley et al. (2008) |
8. Metropolitan Area Child Study Research Group (MACS) | MACS Group (2002, 2007), Tolan and McKay (1996) |
9. Montreal Longitudinal Experimental Study | Pagani et al. (1999), Tremblay et al. (1991) |
10. New Beginnings Program (NBP) | Wolchik et al. (2002), Wolchik et al. (2009) |
11. Parent Management Training-Oregon Model (PMTO) | DeGarmo et al. (2009), Patterson et al. (2004) |
12. Parenting Training | Garvey et al. (2006) |
13. Preventive Intervention Project (Clinician Based Cognitive Psychoeducational Intervention for Families) | Beardslee et al. (2002, 2003, 2007) |
14. Protecting Families Program | Boyd et al. (2006); personal communication with R. Boyd 9/14 |
15. SAFE Children | Gorman-Smith et al. (2002), Tolan et al. (2004) |
Indicated | |
1. Cognitive Behavioral Interventions for Trauma in Schools (CBITS) | Morsette et al. (2009), Ngo et al. (2008); Stein et al. (2003) |
2. Coping Power (CPP) | Lochman and Wells (2002, 2003, 2004) |
3. Early Risers “Skills for Success” | August et al. (2006), Klimes-Dougan et al. (2009), Lee et al. (2008) |
4. Parenting through Change (PTC) | DeGarmo and Forgatch (2005), Forgatch and DeGarmo (1999) |
5. Penn Resiliency Program (PRP) | Roberts et al. (2004), Gillham et al. (2006, 2007) |
6. Queensland Early Intervention and Prevention Anxiety Project (QEIPAP) | Dadds et al. (1997, 1999) |
Multi-level | |
1. Adolescent Transitions Program (ATP) | Dishion and Kavanagh (2000), Stormshak et al. (2005) |
2. Early Alliance | Dumas et al. (1999, 2001), Prinz et al. (2000), Smith et al. (2001) |
3. Fast Track | Conduct Problems Prevention Research Group (2007), Orrell-Valente et al. (1999) |
4. Incredible Years Basic Training | http://www.incredibleyears.com/program/Incredible-Years_factsheet.pdf, Webster-Stratton et al. (2004) |
5. Raising Healthy Children (RHC) | Catalano et al. (2003), Haggerty et al. (2006) |
6. Triple P (Positive Parenting Program) | Sanders et al. (2000, 2007), Prinz et al. (2009a, b) |
Program Characteristics
Of the 37 programs that met eligibility for inclusion, 10 (27%) were categorized as universal, 15 (41%) were selective, six (16%) were indicated, and six (16%) were multi-level. There were variations across program levels with respect to how youth was selected for inclusion. In line with population-based prevention efforts, universal prevention programs did not identify children by risk, but by setting (e.g., school, primary care, or daycare settings) and/or age-group (Center for Improvement of Child Caring Effective Black Parenting Program, Myers et al. 1992; Dare To Be You, Miller-Heyl et al. 1998; Family Based Partnership, Bradshaw et al. 2009; Universal Parenting Program, Hiscock et al. 2008). For example, the Early Home-Based Intervention, which aimed to reduce future behavior problems, recruited mothers who gave birth during three time periods at a healthcare setting and delivered the intervention when their infants were between 5 and 9 months of age (Cheng et al. 2007).
In contrast, the selective programs identified youth at risk for mental health difficulties based on parental/familial factors, including divorce, death, and psychiatric difficulties (n = 8, 53%), or aspects associated with economic disadvantage, such as low socioeconomic status, living in disadvantaged communities, and homelessness (n = 7, 47%). The Preventive Intervention Project (Clinician Based Cognitive Psychoeducational Intervention for Families, Beardslee et al. 2003), for instance, selected children between 8 and 15 years of age who were at risk based upon having one or more parents who were experiencing depression, while the Empowerment Zone program targeted children of families who were of low socioeconomic status or were living in homeless shelters (Nabors et al. 2001).
Most of the indicated programs (n = 4, 67%) targeted youth who was already exhibiting internalizing or externalizing problems (e.g., Coping Power Program, Lochman and Wells 2002; Early Risers, August et al. 2001): The remaining two programs selected youth based upon psychosocial stressors such as experiencing a trauma (Cognitive Behavioral intervention for Trauma in Schools, Morsette et al. 2009), or who were raised by a single parent (Parenting Through Change (DeGarmo and Forgatch 2005).
Not surprisingly, the criteria for entry into the multilevel prevention programs varied by prevention level. For example, Triple P (Sanders et al. 2000) contained a universal component consisting of information about parenting resources, which was available to the entire population of youth and families through various media (e.g., television and radio); a selective component (parenting advice and information) for children evidencing mild behavioral problems; and an indicated component, consisting of parenting strategies and, if needed, additional supports (i.e., coping skills) for parents who are experiencing stressors, such as their own emotional health issues.
Family Support Components
Across prevention levels, programs offered a similar number of supportive components to parents: Multi-level programs offered three family support components on average, followed by universal (2.5), indicated (2.3), and selective programs (2.2). Programs were also relatively similar across prevention levels with respect to the type of support delivered. All of the programs (n = 37, 100%) provided instructional skill development, and primarily parenting strategies (e.g., setting appropriate consequences for behaviors, monitoring, listening, and discipline), to prevent or decrease emotional and behavioral problems (e.g., Coping with Toddler Behavior, Niccols 2004; Coping Power Program, Lochman and Wells 2002). Twenty-six programs (70%) also provided information, both verbally and in the form of videotapes, booklets, and handouts, about child development and identified risks to the child’s mental health, including divorce, low socioeconomic status, and parental mental health problems (Children in the Middle, Brandon 2006; Dare to Be You, Miller-Heyl et al. 1998; Linking the Interests of Families and Teachers, Eddy et al. 2000).
Eleven programs (30%) provided instrumental support, such as food, transportation, and childcare, to reduce barriers to participation, build support, and encourage interaction among family members (e.g., Early Risers, August et al. 2001; Parenting Through Change, DeGarmo and Forgatch 2005). Although most programs, and particularly those which offered groups, were arguably conducive to shared exchanges of difficulties and affirmation from other parents, only 11 programs (30%) specified offering emotional support as a key component, either through discussions with program facilitators about personal issues or troubles or by building a supportive network with other parents (e.g., Early Alliance, Dumas et al. 1999; Protecting Families Program, Boyd et al. 2006). The fifth and least-represented form of parent support was advocacy, which was provided by five programs (14%), and was primarily in reference to advocating within the educational system (e.g., Gorman-Smith et al. 2002).
As a whole, the number and type of family support offered to parents were similar irrespective of whether the child was identified as being at risk due to child difficulties (e.g., based on teacher or parent report about behavior, such as in the Adolescent Transition Program, Dishion and Kavanagh 2000), or parental factors (e.g., divorce, parental mental health, e.g., Keeping Families Strong, Riley et al. 2008; New Beginnings Program, Wolchik et al. 2009). Programs that focused on externalizing difficulties (e.g., Fast Track, Nix et al. 2005; Triple P Positive Parenting Program, Sanders et al. 2000) did not offer unique or more support components than programs that targeted internalizing symptoms (e.g., Child Anxiety Prevention Study, Ginsburg 2009) or externalizing and internalizing difficulties (e.g., Home-Based Intervention, Aronen and Kurkela 1996).
Although programs across prevention levels were mainly concordant, three differences were apparent. First, none of the universal prevention programs provided advocacy as a form of support; of the five programs that did offer this type of family support, two were selective (Metropolitan Area Child Study Research Group, Tolan and McKay 1996; SAFE Children, Tolan et al. 2004), one program was indicated (Early Risers, August et al. 2001), and the remaining two were multi-level (Early Alliance, Dumas et al. 1999; Fast Track, Conduct Problems Prevention Research Group 2007).
Second, among the indicated programs, emotional support was offered most frequently after instructional support (n = 3, 50%), while the other prevention levels provided informational support most frequently after instructional support (n = 9, 90% among the universal programs; n = 10, 67% among the selective programs; and n = 5, 83% among the multi-level programs). Third, the multilevel programs typically provided information support for the universal component, while the other supportive components were provided in the selective/indicated programs (e.g., Raising Healthy Children, Catalano et al. 2003; Triple P, Sanders et al. 2000). For example, Triple P’s universal component offered information about parenting resources, the selective component offered instructional support in the form of parenting skills, and the indicated part offered both parenting skills and additional instructional support, including teaching parents coping skills (relaxation techniques, self-statements) and communication and listing skills to enhance parents’ relationship with each other (Sanders et al.). See Table 3 for a comparison of the types and number of family support components by prevention level.
Table 3.
Comparison by program type
Type of support | Universal (n = 10) |
Selective (n = 15) |
Indicated (n = 6) |
Multi-level (n = 6) |
Total programs (N = 37) |
---|---|---|---|---|---|
Instructional skills development | n = 10, 100% | n = 15, 100% | n = 6, 100% | n = 6, 100% | n = 37, 100% |
Informational/educational | n = 9, 90% | n = 10, 67% | n = 2, 33% | n = 5, 83% | n = 26, 70% |
Emotional | n = 2, 20% | n = 4, 27% | n = 3, 50% | n = 2, 33% | n = 11, 30% |
Instrumental | n = 4, 40% | n = 2, 13% | n = 2, 33% | n = 3, 50% | n = 11, 30% |
Advocacy | 0 | n = 2, 13% | n = 1, 17% | n = 2, 33% | n = 5, 14% |
Outcomes and Impact
Another similarity across prevention levels was a primary focus on reducing child symptoms, although there was some variability with respect to symptom type. The universal and multi-level programs mostly focused on reductions in externalizing behaviors (n = 7, 70% of universal programs; n = 4, 80% of the five multi-level programs that studied child outcomes). Among the 13 selective programs that studied child outcomes, six focused on reducing externalizing behaviors (Children in the Middle, Brandon 2006; Empowerment Zone, Nabors et al. 2001; Metropolitan Area Child Study Research Group [MACS], Tolan and McKay 1996; Parent Management Training-Oregon [PMT-O], Patterson et al. 1982; Parent Training, Garvey et al. 2006; SAFEChildren, Gorman-Smith et al. 2002), and seven focused on internalizing behaviors either alone (Child Anxiety Prevention Study, Ginsburg 2004; Keeping Families Strong, Riley et al. 2008) or in conjunction with externalizing behaviors (e.g., Children of Divorce Intervention Program, Wolchik et al. 1993; Family Bereavement Program, Lochman et al. 2009; Montreal Longitudinal Study/Preventive Treatment Program, Pagani et al. 1999; New Beginnings Program, Hipke et al. 2002; Preventive Intervention Project [Clinician Based Cognitive Psychoeducational Intervention for Families], Beardslee et al. 2002). An equal number of indicated programs focused on externalizing behaviors (e.g., Coping Power, Lochman and Wells 2002; Early Risers, August et al. 2001; Parenting Through Change, DeGarmo and Forgatch 2005) and reducing internalizing difficulties, such as depression and PTSD (e.g., Cognitive Behavioral Interventions for Trauma in Schools [CBITS], Morsette et al. 2009; Penn Resiliency Program, Roberts et al. 2004; Queensland Early Intervention and Prevention Anxiety Project [QEIPEP], Dadds et al. 1997).
The impact of programs was mixed, particularly among the universal and selective interventions: For instance, 6 of the 10 universal programs (60%) showed favorable results in comparison with control and comparison groups at posttest and over time. For the four remaining programs, the intervention did not appear to be more beneficial than control or had no impact. Among the selective programs, several studies showed significant improvements in behavioral problems at posttest and/or follow-up comparative to another intervention condition (e.g., a self-study group in Family Bereavement Program, Sandler et al. 2003, or control group, e.g., Beardslee et al. 2003). Several studies, however, either did not find significant differences between groups or found a positive impact upon only some outcomes (e.g., SAFE Children was associated with improvements in academic performance in comparison with the control group, but not child behavior, Tolan et al. 2004).
Studies of the indicated and multi-level programs were more consistently positive. For all but one indicated program, child outcomes were favorable at posttest and/or follow-up. Findings of the remaining program (Penn Resiliency Program, Gillham et al. 2006; Roberts et al. 2004) were mixed. In one study, youth evidenced improvements in depression at the 2-year follow-up point in comparison with the control group, yet not at 3-year follow-up (Roberts et al. 2004). In a second study, children in two schools who received PRP evidenced significant reductions in depressive symptoms over a comparison treatment and a control group, but not in a third school (Gillham et al. 2007).
Parent outcomes beyond program satisfaction were studied secondarily across prevention levels, and results were generally favorable. Among the universal programs, six of the seven programs that focused on parent outcomes beyond treatment satisfaction examined parenting practices (e.g., use of positive parenting strategies, appropriate discipline; e.g., DTBY, Miller-Heyl et al. 1998; EBPP, Myers et al. 1992; FSP, Ialongo et al. 2001; Bradshaw et al. 2009; LIFT, Reid et al. 1999; UPP, Hiscock et al. 2008) or aspects of the parent/child relationship (e.g., parental rejection, EBPP; dysfunctional interactions, CWTB, Niccols 2004). Five of the six programs (83%) were associated with improvements in one or both of these areas, while results of the sixth program, FSP, were mixed: The intervention did not appear to significantly impact parental monitoring or discipline, but was associated with a greater number of reinforcing activities and decreased rejection toward their child (Bradshaw et al. 2009; Ialongo et al. 2001).
Almost half (n = 3, 43%) of universal programs that focused on parenting outcomes also examined the parent’s emotional health, including self-esteem, parenting self-efficacy, depression, anxiety, and stress. Results were varied; parents who participated in DTBY (Miller-Heyl et al. 1998), for example, evidenced greater increases in self-esteem and parenting self-efficacy in comparison with the control group, and these gains were maintained at 2-year follow-up. Likewise, parents who participated in RAP-F (Shochet et al. 2001) reported improvements in self-efficacy. However, mothers who received the Universal Prevention Program (Hiscock et al. 2008) did not evidence any difference in depression, anxiety, or stress in comparison with the control group either at 18 or 24 months following baseline (Hiscock et al. 2008).
Eleven selective programs (73%) investigated parent outcomes beyond satisfaction with services. Most found a beneficial impact of the prevention intervention on improved parenting and knowledge about parenting strategies (n = 6, 55%; CODIP, Wolchik et al. 1993; Dads for Life, Cookston et al. 2006; Empowerment Zone, Nabors et al. 2001; Family Bereavement Program, Sandler et al. 2003; Keeping Families Strong, Riley et al. 2008; New Beginnings Program, Wolchik et al. 2002; PMT-O, Patterson et al. 1982), the relationship between parent and child (n = 2, 18%; CODIP, Wolchik et al. 1993), decreased interpersonal conflict (n = 1, 6%; Dads for Life, Cookston et al. 2006), and increased knowledge and communication about their mental illness to their child (n = 1, 6%; Preventive Intervention Project [Clinician Based Cognitive Psychoeducational Intervention for Families], Beardslee et al. 2002).
Three of the eleven studies that focused on parent outcomes found mixed results, however (e.g., Children in the Middle, Kramer et al. 1998; SAMHSA 2006; Keeping Families Strong, Riley et al. 2008; SAFE Children, Gorman-Smith et al. 2002). CIM, for example, was associated with improved communication skills, but neither CIM nor the control group was associated with reduced parent conflict regarding child issues (Kramer et al. 1998). In a second study (Brandon 2006), CIM was associated with increased partner conflict, although parents in the intervention group also evidenced reductions in putting their child in between parents’ conflict. The third study (Gillard and Seymour 2005) found increased knowledge about how separation impacts children and decreased conflict among parents at 4-month follow-up.
Four selective programs identified the child as at risk based upon parental mental health (CAPS, Riley et al. 2008; Keeping Families Strong, Riley et al. 2008; Preventive Intervention Project, Beardslee et al. 2002, 2003, 2007; Protecting Families Program, Boyd et al. 2006), but only one studied the parent’s emotional health as a direct outcome (Keeping Families Strong, Riley et al. 2008). The other three programs that examined parent’s emotional health targeted children whose caregiver or parent died within the past 2½ years (Family Bereavement Program, Sandler et al. 2003, 2010), or youth who was exhibiting problem behaviors (Parent Management Training-Oregon, DeGarmo et al. 2009; Parent Training, Garvey et al. 2006). Overall, results suggested that these programs were effective at reducing depression, anxiety, and/or stress. Mothers who participated in the PMT-O group, for example, evidenced significant decreases in depressive symptoms in comparison with the control group, and these effects continued over time (Patterson et al. 2004). Further, engagement in Parent Training (Garvey et al. 2006) was associated with decreased depressive symptoms.
Fewer indicated (n = 3, 50%) and multi-level (n = 2, 33%) programs studied parent outcomes than the universal and selective categories. Results were generally positive among these programs, with results suggesting increases in positive parenting and appropriate disciplinary methods (Coping Power Program, Lochman and Wells 2002; Parenting Through Change, Forgatch and DeGarmo 1999; Triple P Positive Parenting Program, Sanders et al. 2000) and decreased feeling of distress (Incredible Years, Webster-Stratton et al. 2004).
Beyond the child and parent, several programs, and particularly the universal and selective programs, studied family-level factors including family relationships (EBPP) and family functioning (RAP-F). Here too, results were mixed; results of EBPP (Myers et al. 1992) showed significant improvement in family relationships from pre- to posttest, although findings of RAP-F did not find an impact of the intervention upon family functioning, based upon adolescent report. Result from studies of selective programs that explored domestic violence (CIM, Kramer et al. 1998; SAMHSA 2006) and family functioning (Beardslee et al. 2007) showed improvements in outcomes, but no discernible benefit of the intervention group over control. Alternately, families who received KFS (Riley et al. 2008; Wilhelm 2006) evidenced increased family involvement around mealtime and chores in comparison with the control group.
Parent Peer Support
Parent peer support models were rare. Ninety-five percent (n = 35) of the programs in our review were delivered by mental health professionals, including social workers, psychologists, counselors, master’s level students-in-training (e.g., Parent Management Training, Oregon, DeGarmo and Forgatch 2005; RAP-F, Shochet et al. 2001), teachers (e.g., FRIENDS (Lowry-Webster et al. 2001), and nurses (Home-Based Intervention, Aronen and Kurkela 1996). Only two programs (5%) included a parent peer in delivering the service: Early Risers (August et al. 2001, 2003, 2006) and Fast Track (Bierman et al. 2006; Conduct Problems Prevention Research Group 2007). In both Early Risers and Fast Track, the parent peer co-led the support with a mental health professional. Parent peers led none of the programs alone.
The roles of peers in the two co-led programs varied: Peers who co-led the Early Risers program (August et al. 2001), an indicated prevention program for children with behavioral problems, worked with school advocates and were primarily responsible for recruitment, referral, and instrumental support. The model was derived from The Incredible Years (e.g., Webster-Stratton et al. 2004). Peers in the Fast Track program, a multi-level program also for youth exhibiting behavioral problems, worked directly with the youth by providing social skills support to them, while teachers and former teachers (educational coordinators) delivered a classroom component, and professional mental health providers (e.g., social workers, counselors) delivered the parent group (Nix et al. 2005).
There were two notable variations between co-led and professionally led programs. First, both co-led programs offered advocacy support, a relative rarity among the professionally led programs (only three or 9% of the 35 professionally led programs offered advocacy comparatively). And second, the co-led programs were the only prevention programs that offered all five family support components. For instance, Fast Track provided parenting, communication, and problem-solving skills; emotional support for high-risk parents during home visits; transportation, food, and childcare for siblings; assisted parents in advocating for their child; and information about the child’s program components (a universal classroom component, and tutoring, a social skills group and a mentoring program for high-risk youth; Nix et al. 2005). The remaining 35 prevention programs offered between one and four family support components.
Discussion
Because family support services are a growing component of the continuum of mental health services, and because anticipated continuation of workforce shortages (Annapolis Coalition, 2007) is likely to lead to expansion of this service, understanding its typologies, core components, and its distribution within empirically based prevention programs can assist policy-makers, service providers, and researchers in refining conceptualization of this service model.
Comparisons between this review and our earlier study of family support in treatment programs for children with recognized mental health problems must be done cautiously given differences in inclusion criteria. Further, while program outcomes are important, our main aim was to describe family support components in prevention efforts; to do so, we reviewed programs with family support components, regardless of their impact. Additional limitations of the current review, such as exclusion of programs that were secondarily focused on behavioral health outcomes, a shortage of prevention models led by parent peers, and a lack of specificity regarding effect sizes, dosage, and intensity of family support, warrant mention when interpreting the results of this undertaking and any comparisons with our earlier review.
However, as described below, some tentative conclusions can be drawn.
Key Findings: Types of Family Support
Consistent with our earlier review of treatment programs, instruction/skill building was the most commonly provided supportive component among prevention programs. The primary form of instructional support was parenting skills, irrespective of prevention category or risk factor. To a lesser degree, programs offered strategies to manage the parent’s distress or symptoms. The rationale for addressing the parent’s emotional health was similar to what we found among the professionally led treatment programs to increase the parents’ capacity to support the child (e.g., helping the parent manage their own coping so that they can model and support the child’s intervention). Prominent components of peer-led treatment interventions, including self-care, assisting the parent in coping with stress, and skill training targeted at the parent, not at behavior management (e.g., NAMI Basics; Visions for Tomorrow 2007), were notably absent from the prevention programs in this review.
Family support focused on providing information, and education was the second most common type of content. Prevention programs provided information about normal child and adolescent development (e.g., Universal Parenting Program, Hiscock et al. 2008; Resourceful Adolescent Program-Family, Harnett and Dadds 2004) and risks to the child’s mental health, such as parental conflict (Children in the Middle, Brandon 2006) and substance use (Center for the Improvement of Child Caring Effective Black Parenting Program, Myers et al. 1992). Not surprisingly, a focus of information provision in the treatment interventions emphasized information about mental disorders, their symptoms, course, and treatments (e.g., Cognitive Behavioral Family Therapy, Barrett et al. 2004; Cognitive Behavioral Therapy + Parent Anxiety Management, Cobham et al. 1998; Trauma Focused-Cognitive Behavioral Therapy, Cohen et al. 2004).
Few prevention programs provided advocacy support (n = 5, 14%). Its limited representativeness here is not surprising, however, especially among the universal programs, in which an identified service need may not exist. In contrast, in treatment programs targeting children with identified mental health needs, their families are at increased likelihood of interacting with other service systems, such as schools and the legal system. Consequently, support services for these families are likely to include a focus on advocacy.
Key Findings: Parent Peer Support Models
This is an underdeveloped area. It comprised 22% in the treatment literature; pure parent-led models were absent in the prevention literature, and only 5% of programs included team-led models. There are several explanations for this. Historically, paraprofessionals have aided in recruitment and outreach within community-based prevention programs, not service delivery (Kegeles et al. 1996; Woods et al. 1998). Thus, to a certain extent, the paradigm of prevention programs already includes community members as core partners. And in fact, some of these community partners may in fact have been parent peers, but not necessarily identified as such.
Secondly, family run organizations such as the National Alliance on Mental Illness (NAMI) and the National Federation of Families for Children’s Mental Health, which are the major forces behind advancing peer-delivered models, have traditionally concentrated their efforts on providing support to families of children with serious mental disorders, rather than children at risk. Thus, national advocacy for family support has not traditionally focused on prevention. However, workforce shortages (SAMHSA 2007) in systems where prevention programs exist (schools, pediatric settings) coupled with an emerging literature showing how peers bring unique strengths to their work with families (e.g., credibility, trustworthiness; Hoagwood et al. 2010), suggests that there may be an increased demand for peer-delivered services in the future.
Implications and Future Research
As noted above, comparative studies of the relative effectiveness of different models of family support are needed. There are likely to be advantages and disadvantages to each of the models. Although employing parent peers runs the same risk as employing community members to deliver interventions and may raise the risk of ethical and boundary issues (e.g., threats to confidentiality, overstepping their boundaries, and over-identification with participants; Jain 2010), there may be advantages that future research can examine. These include greater ease in building rapport (Prinz et al. 2001), utilizing recruitment strategies that are contextually appropriate, and increasing the likelihood that preventive efforts will be sustained by tapping into the natural resources of the community (Spoth et al. 2007).
The concerns about risks involved in peer-delivered services are being addressed via the development of specific competency-based trainings for parent peers (e.g., Olin et al. 2009; University of Connecticut’s Family Development Credential Program 2010). National certification standards are currently being developed (Federation of Families for Children’s Mental Health 2010), and some states are also doing so (e.g., New York, Illinois). Increasingly, the role of parent peers as an emerging workforce to deliver family support services is becoming recognized through billable services in several states (e.g., New York, Maryland, South Carolina). Data on the unique impact of family support in general, and specific models, such as team-led and peer-led services, on family and child outcomes are still limited. Both efficacy and effectiveness studies are greatly needed. Given the unfunded mandate of many prevention efforts, use of indigenous resources— such as parent peers—is likely to be an important factor in sustaining prevention programs and reducing the burden of mental health costs.
Supplementary Material
Acknowledgments
Supported by Grants No. This R21MH90146-01 and P20 MH 078178-0, both from the National Institute for Mental Health (NIMH). We wish to thank Maura Crowe for her contribution to this manuscript.
Footnotes
Electronic supplementary material The online version of this article (doi:10.1007/s10567-011-0100-9) contains supplementary material, which is available to authorized users.
Contributor Information
Mary A. Cavaleri, Email: cavaleri@nyspi.columbia.edu, Mental Health Services and Policy Research, New York State Psychiatric Institute, Columbia University, 100 Haven Ave, Suite 31D, New York, NY 10032, USA
S. Serene Olin, Mental Health Services and Policy Research, New York State Psychiatric Institute, Columbia University, 100 Haven Ave, Suite 31D, New York, NY 10032, USA.
Annie Kim, Columbia University, New York, NY, USA.
Kimberly E. Hoagwood, Mental Health Services and Policy Research, New York State Psychiatric Institute, Columbia University, 100 Haven Ave, Suite 31D, New York, NY 10032, USA
Barbara J. Burns, Department of Psychiatry and Behavioral Sciences, Duke University School of Medicine, Durham, NC, USA
References
- Annapolis Coalition on Behavioral Health Workforce. Action plan on behavioral health workforce development. Washington, DC: Substance Abuse and Mental Health Services Administration; 2007. Publication 280-02-0302. [Google Scholar]
- Aronen ET, Arajarvi T. Effects of early intervention on psychiatric symptoms of youth adults in low-risk and high-risk families. American Journal of Orthopsychiatry. 2000;70(2):223–232. doi: 10.1037/h0087764. [DOI] [PubMed] [Google Scholar]
- Aronen ET, Kurkela SA. Long-term effects of an early home-based intervention. Journal of the American Academy of Child and Adolescent Psychiatry. 1996;35(12):1665–1672. doi: 10.1097/00004583-199612000-00019. [DOI] [PubMed] [Google Scholar]
- August GJ, Bloomquist ML, Lee SS, Realmuto GM, Hektner JM. Can evidence-based prevention programs be sustained in community practice settings? The Early Risers’ advanced-stage effectiveness trial. Prevention Science. 2006;7(2):151–165. doi: 10.1007/s11121-005-0024-z. [DOI] [PubMed] [Google Scholar]
- August GJ, Egan EA, Realmuto GM, Hektner JM. Four years of the Early Risers early-age-targeted preventive intervention: Effects on aggressive children’s peer relations. Behavioral Therapy. 2003;34:453–470. [Google Scholar]
- August GJ, Realmuto GM, Hektner JM, Bloomquist ML. An integrated components preventive intervention for aggressive elementary school children: The Early Risers Program. Journal of Consulting and Clinical Psychology. 2001;69(4):614–626. [PubMed] [Google Scholar]
- Barrera M, Sandler IN. Prevention: A report of progress and momentum into the future. Clinical Psychology: Science and Practice. 2006;13(3):221–226. [Google Scholar]
- Barrett PM, Healy-Farrell LJ, March JS. Cognitive behavioural family based treatment for childhood OCD: A randomised controlled trial. Journal of American Academy of Child and Adolescent Psychiatry. 2004;43(1):46–63. doi: 10.1097/00004583-200401000-00014. [DOI] [PubMed] [Google Scholar]
- Beardslee WR, Gladstone TRG, Wright EJ, Cooper AB. A family-based approach to the prevention of depressive symptoms in children at risk: Evidence of parental and child change. Pediatrics. 2003;112:119–131. doi: 10.1542/peds.112.2.e119. [DOI] [PubMed] [Google Scholar]
- Beardslee WR, Hoke L, Wheelock I, Rothberg PC, van de Velde P, Swatling S. Initial findings on preventive intervention for families with parental affective disorders. American Journal of Psychiatry. 2002;149:1335–1340. doi: 10.1176/ajp.149.10.1335. [DOI] [PubMed] [Google Scholar]
- Beardslee WR, Wright EJ, Gladstone TRG, Forbes P. Long-term effects from a randomized trial of two public health preventive interventions for parental depression. Journal of Family Psychology. 2007;21(4):703–713. doi: 10.1037/0893-3200.21.4.703. [DOI] [PubMed] [Google Scholar]
- Beelmann A. Review of systematic reviews in the social sciences: Apractical guide. European Psychologist. 2006;11(3):244–245. [Google Scholar]
- Bierman KL, Nix RL, Maples JJ, Murphy SA, the Conduct Problems Prevention Research Group Examining clinical judgment in an adaptive intervention design: The Fast Track Program. Journal of Consulting and Clinical Psychology. 2006;74(3):468–481. doi: 10.1037/0022-006X.74.3.468. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Blueprints: Center for the Study and Prevention of Violence Model and Promising Program. 2011 Downloaded August 1, 2011 from www.colorado.edu/cspv/blueprints/
- Boyd RC, Diamond GS, Bourjolly JN. Developing a family-based depression prevention program in urban community mental health clinics: A qualitative investigation. Family Process. 2006;45:187–203. doi: 10.1111/j.1545-5300.2006.00090.x. [DOI] [PubMed] [Google Scholar]
- Bradshaw CP, Zmuda JH, Kellam SG, Ialongo NS. Longitudinal impact of two universal preventive interventions in first grade on educational outcomes in high school. Journal of Educational Psychology. 2009;101(4):926–937. doi: 10.1037/a0016586. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Brandon DJ. Can four hours make a difference? Journal of Divorce and Remarriage. 2006;45(1–2):171–185. [Google Scholar]
- Catalano RF, Mazza JJ, Harachi TW, Abbott RD, Haggerty KP, Fleming CB. Raising healthy children through enhancing social development in elementary school: Results after 1.5 Years. Journal of School Psychology. 2003;41:143–164. [Google Scholar]
- Cheng S, Kondo N, Aoki Y, Kitamura Y, Takeda Y, Yamagata Z. The effectiveness of early intervention and the factors related to child behavioral problems at age 2: A randomized controlled trial. Early Human Development. 2007;83:683–691. doi: 10.1016/j.earlhumdev.2007.01.008. [DOI] [PubMed] [Google Scholar]
- Cobham VE, Dadds MR, Spence SH. The role of parental anxiety in the treatment of childhood anxiety. Journal of Consulting Clinical Psychology. 1998;66:893–905. doi: 10.1037//0022-006x.66.6.893. [DOI] [PubMed] [Google Scholar]
- Cohen JA, Deblinger E, Mannarino AP, Steer R. A multisite randomized controlled trial for sexually abused children with PTSD symptoms. Journal of the American Academy of Child and Adolescent Psychiatry. 2004;43:393–402. doi: 10.1097/00004583-200404000-00005. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Conduct Problems Prevention Research Group. Fast Track randomized controlled trial to prevent externalizing psychiatric disorders: Findings from grades 3 to 9. Journal of the American Academy of Child and Adolescent Psychiatry. 2007;46(10):1250–1262. doi: 10.1097/chi.0b013e31813e5d39. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Cookston JT, Braver SL, Sandler I, Genalo MT. Prospects for expanded parent education services for divorcing families with children. Family Court Review. 2006;40(2):189–202. [Google Scholar]
- Council on Community Pediatrics. The role of preschool home-visiting programs in improving children’s developmental and health outcomes. Pediatrics. 2009;123:598–603. doi: 10.1542/peds.2008-3607. [DOI] [PubMed] [Google Scholar]
- Cuijpers P. Examining the effects of prevention programs on the incidence of new cases of mental disorders: The lack of statistical power. American Journal of Psychiatry. 2003;160:1385–1391. doi: 10.1176/appi.ajp.160.8.1385. [DOI] [PubMed] [Google Scholar]
- Dadds MR, Holland DE, Laurens KR, Mullins M, Barrett PM, Spence SH. Early intervention and prevention of anxiety disorders in children: Results at 2-year follow-up. Journal of Consulting and Clinical Psychology. 1999;67(1):145–150. doi: 10.1037//0022-006x.67.1.145. [DOI] [PubMed] [Google Scholar]
- Dadds MR, Spence SH, Holland D, Barrett PM, Laurens K. Early intervention and prevention of anxiety disorders: A controlled trial. Journal of Consulting and Clinical Psychology. 1997;65:627–635. doi: 10.1037//0022-006x.65.4.627. [DOI] [PubMed] [Google Scholar]
- DeGarmo DS, Eddy JM, Reid JB, Feetrow RA. Evaluating mediators of the impact of the Linking the Interests of Families and Teachers (LIFT) multimodal preventive intervention on substance use initiation and growth across adolescence. Prevention Science. 2009;10:208–220. doi: 10.1007/s11121-009-0126-0. [DOI] [PMC free article] [PubMed] [Google Scholar]
- DeGarmo DS, Forgatch MS. Early development of delinquency within divorced families: Evaluating a randomized preventive intervention trial. Developmental Science. 2005;8(3):229–239. doi: 10.1111/j.1467-7687.2005.00412.x. [DOI] [PubMed] [Google Scholar]
- Dishion TJ, Kavanagh K. A multilevel approach to family-centered prevention in schools: Process and outcome. Addictive Behaviors. 2000;25(6):899–911. doi: 10.1016/s0306-4603(00)00126-x. [DOI] [PubMed] [Google Scholar]
- Domintrovich CE, Greenberg MT. The study of implementation: Current findings from effective programs that prevent mental disorders in school-aged children. Journal of Educational and Psychological Consultation. 2000;11(2):193–221. [Google Scholar]
- Dumas JE, Lynch AM, Laughlin JE, Smith EP, Prinz RJ. Promoting intervention fidelity: Conceptual issues, methods, and preliminary results form the Early Alliance prevention trial. American Journal of Preventive Medicine. 2001;20:38–47. doi: 10.1016/s0749-3797(00)00272-5. [DOI] [PubMed] [Google Scholar]
- Dumas JE, Prinz RJ, Smith EP, Laughlin J. The Early Alliance prevention trial: An integrated set of interventions to promote competence and reduce risk for conduct disorder, substance abuse, and school failure. Clinical Child and Family Psychology Review. 1999;2(1):37–53. doi: 10.1023/a:1021815408272. [DOI] [PubMed] [Google Scholar]
- Durlak JA, Wells AM. Primary prevention mental health programs for children and adolescents: A meta-analytic review. American Journal of Community Psychology. 1997;25:115–152. doi: 10.1023/a:1024654026646. [DOI] [PubMed] [Google Scholar]
- Durlak JA, Wells AM. Evaluation of indicated preventive intervention (secondary prevention) mental health programs for children and adolescents. American Journal of Community Psychology. 1998;26(5):775–802. doi: 10.1023/a:1022162015815. [DOI] [PubMed] [Google Scholar]
- Eddy JM, Reid JB, Fetrow RA. An elementary school-based prevention program targeting modifiable antecedents of youth delinquency and violence: Linking the interests of families and teachers (LIFT) Journal of Emotional and Behavioral Disorders. 2000;8(3):165–176. [Google Scholar]
- Federation of Families for Children’s Mental Health. Certification. 2010 Accessed November 11, 2010 from http://www.ffcmh.org/what-we-do/certification-2/overview/
- Forgatch MS, DeGarmo DS. Parenting through change: An effective prevention program for single mothers. Journal of Consulting and Clinical Psychology. 1999;67(5):711–724. doi: 10.1037//0022-006x.67.5.711. [DOI] [PubMed] [Google Scholar]
- Garvey C, Julion W, Fogg L, Kratovil A, Gross D. Measuring participation in a prevention trial with parents of young children. Research in Nursing and Health. 2006;29:212–222. doi: 10.1002/nur.20127. [DOI] [PubMed] [Google Scholar]
- Gillard L, Seymour F. Children in the middle: A parent education programme for separated parents. Auckland, Australia: Department of Psychology, University of Auckland; 2005. [Google Scholar]
- Gillham JE, Hamilton J, Freres DR, Patton K, Gallop R. Preventing depression among early adolescents in the primary care setting: A randomized controlled study of the Penn Resiliency Program. Journal of Abnormal Child Psychology. 2006;34(2):203–219. doi: 10.1007/s10802-005-9014-7. [DOI] [PubMed] [Google Scholar]
- Gillham JE, Reivich KJ, Freres DR, Chaplin TM, Shatte AJ, Samuels B, et al. School-based prevention of depressive symptoms: A randomized controlled study of the effectiveness and specificity of the Penn Resiliency Program. Journal of Consulting and Clinical Psychology. 2007;75(1):9–19. doi: 10.1037/0022-006X.75.1.9. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Ginsburg GS. Anxiety prevention programs for youth: Practical and theoretical considerations. Clinical Psychology: Science and Practice. 2004;11(4):430. [Google Scholar]
- Ginsburg GS. The Child Anxiety Prevention Study: Intervention model and primary outcomes. Journal of Consulting and Clinical Psychology. 2009;77(3):580–587. doi: 10.1037/a0014486. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Gorman-Smith D, Tolan PH, Henry DB, Leventhal A, Schoeny M, Lutovsky K, et al. Predictors of participation in a family-focused preventive intervention for substance use. Psychology of Addictive Behaviors. 2002;16(4S):S55–S64. doi: 10.1037/0893-164x.16.4s.s55. [DOI] [PubMed] [Google Scholar]
- Gyamfi P, Walrath C, Burns BJ, Stephens RL, Geng Y, Stambaugh L. Family education and support services in systems of care. Journal of Emotional and Behavioral Disorders. 2010;18(1):14–26. [Google Scholar]
- Haggerty KP, Fleming CB, Catalano RF, Harachi TW, Abbott RD. Raising Healthy Children: Examining the impact of promoting healthy driving behavior within a social development intervention. Prevention Science. 2006;7:257–267. doi: 10.1007/s11121-006-0033-6. [DOI] [PubMed] [Google Scholar]
- Harnett PH, Dadds MR. Training school personnel to implement a universal school-based prevention of depression program under real-world conditions. Journal of School Psychology. 2004;42:343–357. [Google Scholar]
- Hipke KN, Wolchik SA, Sandler IN, Braver SL. Predictors of children’s intervention-induced resilience in a parenting program for divorced mothers. Family Relations. 2002;51(2):121–129. [Google Scholar]
- Hiscock H, Bayer JK, Price A, Ukoumunne OC, Rogers S, Wake M. Universal parenting programme to prevent early childhood behavioural problems: Cluster randomised trial. British Medical Journal. 2008;336(7639):318–321. doi: 10.1136/bmj.39451.609676.AE. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Hoagwood KE. Family-based services in children’s mental health: A research review and synthesis. Journal of Child Psychology and Psychiatry. 2005;46(7):670–713. doi: 10.1111/j.1469-7610.2005.01451.x. [DOI] [PubMed] [Google Scholar]
- Hoagwood KE, Cavaleri M, Olin SS, Burns BJ, Gruttadaro JD, Hughes R. Family support in children’s mental health: A review and synthesis. Clinical Child and Family Psychology Review. 2010;13:1–45. doi: 10.1007/s10567-009-0060-5. [DOI] [PubMed] [Google Scholar]
- Horowitz JL, Garber J. The prevention of depressive symptoms in children and adolescents: A meta-analytic review. Journal of Consulting and Clinical Psychology. 2006;74(3):401–415. doi: 10.1037/0022-006X.74.3.401. [DOI] [PubMed] [Google Scholar]
- Ialongo N, Poduska J, Werthamer L, Kellam S. The distal impact of two first-grade preventive interventions on conduct problems and disorder in early adolescence. Journal of Emotional and Behavioral Disorders. 2001;9(3):146–160. [Google Scholar]
- Jain S. The role of paraprofessionals in providing treatment for posttraumatic stress disorder in low-resource communities. Journal of the American Medical Association. 2010;304(5):571–572. doi: 10.1001/jama.2010.1096. [DOI] [PubMed] [Google Scholar]
- Katz-Levy J. New roles for families in building systems of care: A CASSP perspective. 2011 Downloaded August 1, 2011 from http://www.familyreunion.org/FR_07/katzleavy/roles.html.
- Kegeles SM, Hays RB, Coates TJ. The Mpowerment Project: A community-level HIV prevention intervention for young gay men. American Journal of Public Health. 1996;86(8):1129–1136. doi: 10.2105/ajph.86.8_pt_1.1129. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Klimes-Dougan B, August GJ, Lee CYS, Realmuto GM, Bloomquist ML, Horowitz JJ, et al. Practitioner and site characteristics that relate to fidelity of implementation: The Early Risers prevention program in a going-to-scale intervention trial. Professional Psychology: Research and Practice. 2009;40(5):467–475. [Google Scholar]
- Koroloff NM, Elliott DJ, Koren PE, Friesen BJ. Connecting low-income families to mental health services: The role of the family associate. Journal of Emotional and Behavioral Disorders. 1994;2(4):240–246. [Google Scholar]
- Kramer KM, Arbuthnot J, Gordon DA, Roussis N, Hoza J. Effects of skill-based vs. information-based divorce education programs on domestic violence and parental communication. Family and Conciliation Courts Review. 1998;36(1):9–31. [Google Scholar]
- Kutash K. Understanding school-based mental health services for students who are disruptive and aggressive: What works for whom? Proceedings of persistently safe schools: The 2007 national conference on safe schools and community. 2007 Retrieved March 12, 2009, from: http://www.hamfish.org/
- Kutash K, Duchnowski AJ, Lynn N. School-based mental health: An empirical guide for decision-makers. Tampa: University of South Florida, Louis de la Parte Florida Mental Health Institute Dept. of Child and Family Studies, Research and Training Center for Children’s Mental Health; 2006. [Google Scholar]
- Lee CYS, August GJ, Realmuto GM, Horowitz JL, Bloomquist ML, Klimes-Dougan B. Fidelity at a distance: Assessing implementation fidelity of the Early Risers prevention program in a going-to-scale intervention trial. Prevention Science. 2008;9:215–229. doi: 10.1007/s11121-008-0097-6. [DOI] [PubMed] [Google Scholar]
- Lochman JE, Boxmeyer C, Powell N, Qu L, Wells K, Windle M. Dissemination of the Coping Power Program: Importance of intensity of counselor training. Journal of Consulting and Clinical Psychology. 2009;77(3):397–409. doi: 10.1037/a0014514. [DOI] [PubMed] [Google Scholar]
- Lochman JE, Wells KC. Contextual social-cognitive mediators and child outcome: A test of the theoretical model in the Coping Power Program. Development and Psychopathology. 2002;14:971–993. doi: 10.1017/s0954579402004157. [DOI] [PubMed] [Google Scholar]
- Lochman JE, Wells KC. Effectiveness study of Coping Power and classroom intervention with aggressive children: Outcomes at a one-year follow-up. Behavior Therapy. 2003;34:493–515. [Google Scholar]
- Lochman JE, Wells KC. The Coping Power Program for preadolescent aggressive boys and their parents: Outcome effects at the one-year follow-up. Journal of Consulting and Clinical Psychology. 2004;72:571–578. doi: 10.1037/0022-006X.72.4.571. [DOI] [PubMed] [Google Scholar]
- Lowry-Webster HM, Barrett PM, Dadds MR. A universal prevention trial of anxiety and depressive symptomatology in childhood: Preliminary data from an Australian study. Behaviour Change. 2001;18(1):36–50. [Google Scholar]
- Metropolitan Area Child Study Research Group. A cognitive/ecological approach to preventing aggression in economically-disadvantaged urban settings: Preliminary outcomes. Journal of Consulting and Clinical Psychology. 2002;70:179–194. [PubMed] [Google Scholar]
- Metropolitan Area Child Study Research Group. Changing the way children “think” about aggression: Social-cognitive effects of a preventive intervention. Journal of Consulting and Clinical Psychology. 2007;75(1):160–167. doi: 10.1037/0022-006X.75.1.160. [DOI] [PubMed] [Google Scholar]
- Miller-Heyl J, MacPhee D, Fritz JJ. DARE to be you: A family-support, early prevention program. The Journal of Primary Prevention. 1998;18(3):257–285. [Google Scholar]
- Morsette A, Swaney G, Stolle D, Schuldberg D, van den Pol R, Young M. Cognitive behavioral intervention for trauma in schools (CBITS): School-based treatment on a rural American Indian reservation. Journal of Behavior Therapy and Experimental Psychiatry. 2009;40:169–178. doi: 10.1016/j.jbtep.2008.07.006. [DOI] [PubMed] [Google Scholar]
- Mrazek PB, Haggerty RJ. Reducing risks for mental disorders: Frontiers for preventive intervention research. Washington, D.C: National Academy Press; 1994. [PubMed] [Google Scholar]
- Myers HF, Alvy KT, Arrington A, Richardson MA, Marigna M, Huff R, et al. The impact of a parent training program on inner-city African-American families. Journal of Community Psychology. 1992;20:132–147. doi: 10.1007/BF00941772. [DOI] [PubMed] [Google Scholar]
- Nabors L, Proescher E, DeSilva M. School-based mental health prevention activities for homeless and at-risk youth. Child & Youth Care Forum. 2001;30(1):3–18. [Google Scholar]
- Nabors LA, Weist MA, Shugarman R, Woeste MJ, Mullet E, Rosner L. Assessment, prevention, and intervention activities in a school-based program for children experiencing homelessness. Behavior Modification. 2004;28:565–578. doi: 10.1177/0145445503259517. [DOI] [PubMed] [Google Scholar]
- National Alliance on Mental Illness (NAMI) NAMI Basics; vision for Tomorrow. 2007 Accessed January 1, 2010 from www.NAMI.org.
- National Head Start Association. 2010 Accessed January 1, 2010 from http://www.nhsa.org/
- National Research Council and Institute of Medicine. Preventing mental, emotional, and behavioral disorders among young people: Progress and possibilities. In: O’Connell ME, Boat T, Warner KE, editors. Committee on the prevention of mental disorders and substance abuse among children, youth, and young adults: Research advances and promising interventions. Washington, D.C: The National Academies Press; 2009. (Board on Children, Youth, and Families, Division of Behavioral and Social Sciences and Education). [PubMed] [Google Scholar]
- Ngo V, Langley A, Kataoka SH, Nadeem E, Escudero P, Stein BD. Providing evidence-based practice to ethnically diverse youths: Examples from the cognitive behavioral intervention for trauma in schools (CBITS) program. Journal of the American Academy of Child and Adolescent Psychiatry. 2008;47(8):858–862. doi: 10.1097/CHI.0b013e3181799f19. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Niccols A. An ounce of prevention: COPEing with Toddler Behavior. Canadian Journal of Psychiatry. 2004;49(12):869. [PubMed] [Google Scholar]
- Niccols A. Immediate and short-term outcomes of ‘COPEing with Toddler Behaviour’ parent group. Journal of Child Psychology and Psychiatry. 2009;50(5):617–626. doi: 10.1111/j.1469-7610.2008.02007.x. [DOI] [PubMed] [Google Scholar]
- Nix RL, Pinderhughes EE, Bierman KL, Maples JJ, Conduct Problems Prevention Research Group Decoupling the relation between risk factors for conduct problems and the receipt of intervention services: Participation across multiple components of a prevention program. American Journal of Community Psychology. 2005;36(3–4):307–325. doi: 10.1007/s10464-005-8628-9. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Olin SS, Hoagwood KE, Rodriguez J, Ramos B, Burton G, Penn M, et al. The application of behavior change theory to family-based services: Improving parent empowerment in children’s mental health. Journal of Child and Family Studies. 2009;19(4):462–470. doi: 10.1007/s10826-009-9317-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Orrell-Valente JK, Pinderhughes EE, Valente E, Laird RD, The Conduct Problems Prevention Research Group If it’s offered, will they come? Influences on parents’ participation in a community-based conduct problems prevention program. American Journal of Community Psychology. 1999;27(6):753–783. doi: 10.1023/a:1022258525075. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Osher T, Penn M, Spencer SA. Partnerships with families for family-driven systems of care. In: Stroul BA, Blau GM, editors. The system of care handbook: Transforming mental health services for children, youth, and families. Baltimore, MD: Brookes Publishing; 2008. pp. 249–274. [Google Scholar]
- Pagani L, Boulerice B, Vitaro F, Tremblay RE. Effects of poverty on academic failure and delinquency in boys: A change and process model approach. Journal of Child Psychology and Psychiatry. 1999;40(8):1209–1219. [PubMed] [Google Scholar]
- Patterson GR, Chamberlain P, Reid JB. A comparative evaluation of a parent-training program. Behavior Therapy. 1982;13:638–650. doi: 10.1016/j.beth.2016.11.004. [DOI] [PubMed] [Google Scholar]
- Patterson GR, DeGarmo D, Forgatch MS. Systematic changes in families following prevention trials. Journal of Abnormal Child Psychology. 2004;32(6):621–633. doi: 10.1023/b:jacp.0000047211.11826.54. [DOI] [PubMed] [Google Scholar]
- Prinz RJ, Dumas JE, Smith EP, Laughlin JE. The Early Alliance prevention trial: A dual design to test reduction of risk for conduct problems, substance abuse, and school failure in childhood. Controlled Clinical Trials. 2000;21:286–302. doi: 10.1016/s0197-2456(00)00051-9. [DOI] [PubMed] [Google Scholar]
- Prinz RJ, Sanders MR, Shapiro CJ, Whitaker DJ, Luttzker JR. Population-based prevention of child maltreatment: The U.S. Triple P system population trial. Prevention Science. 2009a;10:1–12. doi: 10.1007/s11121-009-0123-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Prinz RJ, Sanders MR, Shapiro CJ, Whitaker DJ, Lutzker JR. Population-based prevention of child maltreatment: The U.S. Triple P System Population Trial. Preventive Science. 2009b;10:1–12. doi: 10.1007/s11121-009-0123-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Prinz RJ, Smith EP, Dumas JE, Laughlin JE, White DW, Barro′n R. Recruitment and retention of participants in prevention trials involving family-based interventions. American Journal of Preventive Medicine. 2001;20:31–37. doi: 10.1016/s0749-3797(00)00271-3. [DOI] [PubMed] [Google Scholar]
- Redmond C, Spoth R, Trudeau L. Family- and community-level predictors of parent support seeking. Journal of Community Psychology. 2002;30(2):153–171. [Google Scholar]
- Reid JB, Eddy JM, Fetrow RA, Stoolmiller M. Description and immediate impacts of a preventive intervention for conduct problems. American Journal of Community Psychology. 1999;27(4):483–517. doi: 10.1023/A:1022181111368. [DOI] [PubMed] [Google Scholar]
- Riley AW, Valdez CR, Barrueco S, Mills C, Beardslee W, Sandler I, et al. Development of a family-based program to reduce risk and promote resilience among families affected by maternal depression: Theoretical basis and program description. Clinical Child and Family Psychology Review. 2008;11:12–19. doi: 10.1007/s10567-008-0030-3. [DOI] [PubMed] [Google Scholar]
- Rishel CA. Evidence-based prevention practice in mental health: What is it and how do we get there? American Journal of Orthopsychiatry. 2007;77(1):153–164. doi: 10.1037/0002-9432.77.1.153. [DOI] [PubMed] [Google Scholar]
- Robbins V, Johnston J, Barnett H, Hobstetter W, Kutash K, Duchnowski AJ, et al. Parent to parent: A synthesis of the emerging literature. Tampa, FL: University of South Florida, The Louis de la Parte Florida Mental Health Institute Department of Child & Family Studies; 2008. [Google Scholar]
- Roberts C, Kane R, Bishop B, Matthews H, Thomson H. The prevention of depressive symptoms in rural school children: A follow-up study. International Journal of Mental Health Promotion. 2004;6(3):4–16. [Google Scholar]
- Sanders MR, Bor W, Morawska A. Maintenance of treatment gains: A comparison of enhanced, standard, and self directed Triple P—Positive Parenting Program. Journal of Abnormal Child Psychology. 2007;35:983–998. doi: 10.1007/s10802-007-9148-x. [DOI] [PubMed] [Google Scholar]
- Sanders MR, Montgomery DT, Brechman-Toussaint ML. The mass media and the prevention of child behavior problems: The evaluation of a television series to promote positive outcomes for parents and their children. Journal of Child Psychology and Psychiatry. 2000;41(7):939–948. [PubMed] [Google Scholar]
- Sandler IN, Ayers TS, Wolchik SA, Tein J, Kwok O, Haine RA, et al. The Family Bereavement Program: Efficacy evaluation of a theory-based prevention program for parentally bereaved children and adolescents. Journal of Consulting and Clinical Psychology. 2003;71(3):587–600. doi: 10.1037/0022-006x.71.3.587. [DOI] [PubMed] [Google Scholar]
- Sandler IN, Ma Y, Tein JY, Ayers TS, Wolchik S, Kennedy C, et al. Long-term effects of the Family Bereavement Program on multiple indicators of grief in parentally bereaved children and adolescents. Journal of Consulting and Clinical Psychology. 2010;78(2):131–143. doi: 10.1037/a0018393. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Shochet IM, Dadds MR, Holland D, Whitefield K, Harnett PH, Osgarby SM. The efficacy of a universal school-based program to prevent adolescent depression. Journal of Clinical Child Psychology. 2001;30:303–315. doi: 10.1207/S15374424JCCP3003_3. [DOI] [PubMed] [Google Scholar]
- Smith EP, Prinz RJ, Dumas JE, Laughlin J. Latent models of family processes in African American families: Relationships to child competence, achievement, and problem behavior. Journal of Marriage and Family. 2001;63(4):967–980. [Google Scholar]
- Spoth R, Clair S, Greenberg M, Redmond C, Shin C. Toward dissemination of evidence-based family interventions: maintenance of community-based partnership recruitment results and associated factors. Journal of Family Psychology. 2007;21(2):137–146. doi: 10.1037/0893-3200.21.2.137. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Spoth RL, Kavanagh KA, Dishion TJ. Family-centered preventive intervention science: toward benefits to larger populations of children, youth, and families. Prevention Science. 2002;3(3):145–152. doi: 10.1023/a:1019924615322. [DOI] [PubMed] [Google Scholar]
- Spoth R, Redmond C. Research on family engagement in preventive interventions: Toward improved use of scientific findings in primary prevention practice. The Journal of Primary Prevention. 2000;21(2):267–284. [Google Scholar]
- Stein BD, Jaycox LH, Kataoka SH, Wong M, Tu W, Elliott MN, et al. A mental health intervention for school-children exposed to violence: A randomized controlled trial. Journal of the American Medical Association. 2003;290(5):603–611. doi: 10.1001/jama.290.5.603. [DOI] [PubMed] [Google Scholar]
- Stice E, Shaw H, Bohon C, Marti CN, Rohde P. A meta-analytic review of depression prevention programs for children and adolescents: Factors that predict magnitude of intervention effects. Journal of Consulting and Clinical Psychology. 2009;77(3):486–503. doi: 10.1037/a0015168. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Stormshak EA, Dishion TJ, Light J, Yasui M. Implementing family-centered interventions within the public middle school: Linking service delivery to change in student problem behavior. Journal of Abnormal Child Psychology. 2005;33(6):723–733. doi: 10.1007/s10802-005-7650-6. [DOI] [PubMed] [Google Scholar]
- Strengthening Families Program. 2010 Accessed January 1, 2010 from http://www.strengtheningfamiliesprogram.org/
- Substance Abuse and Mental Health Services Administration (SAMHSA) Children in the Middle: Divorce Education for Parents. 2006 Downloaded January 1, 2010 from http://www.nrepp.samhsa.gov/ViewIntervention.aspx?id=5.
- Substance Abuse and Mental Health Services Administration (SAMHSA) An Action Plan for Behavioral Health Workforce Development; Executive Summary. 2007 Downloaded January 1, 2010 from http://www.annapoliscoalition.org/pages/default2.asp?active_page_id=80.
- Substance Abuse and Mental Health Services Administrator (SAMHSA) National Registry of Evidence-based Programs and Practices. 2011 Downloaded August 1, 2011 from http://nrepp.samhsa.gov.
- The Prevention Research Center for the Promotion of Human Development: Ten-year anniversary report. 1998–2008 Downloaded August 1, 2011 from http://www.prevention.psu.edu/
- Tolan P, Gorman-Smith D, Henry D. Supporting families in a high risk setting: Proximal effects of the SAFE-Children preventive intervention. Journal of Consulting and Clinical Psychology. 2004;72(5):855–869. doi: 10.1037/0022-006X.72.5.855. [DOI] [PubMed] [Google Scholar]
- Tolan PH, McKay MM. Preventing serious antisocial behavior in inner-city children: An empirically based family intervention program. Family Relations. 1996;45(2):148–155. [Google Scholar]
- Tremblay RE, McCord J, Boileau H, Charlebois P, Gagnon C, LeBlanc M, et al. Can disruptive boys be helped to become competent? Psychiatry. 1991;54:148–161. doi: 10.1080/00332747.1991.11024542. [DOI] [PubMed] [Google Scholar]
- University of Connecticut’s Family Development Credential Program. 2010 Accessed January 1, 2010 from http://www.familydevelopmentcredential.org/
- Visiting Nurse Association of America. 2010 Accessed January 1, 2010 from http://vnaa.org/vnaa/siteshelltemplates/homepage_navigate.htm.
- Webster-Stratton C, Reid MJ, Hammond M. Treating children with early-onset conduct problems: Intervention outcomes for parent, child, and teacher training. Journal of Clinical Child and Adolescent Psychology. 2004;33(1):105–124. doi: 10.1207/S15374424JCCP3301_11. [DOI] [PubMed] [Google Scholar]
- Wilhelm G. When depression is a family matter. 2006 Accessed January 1, 2010 from http://magazine.jhsph.edu/2006/Fall/news_briefs/depression/?subsection_id=50.
- Wilson SJ, Lipsey MW, Derzon JH. The effects of school-based intervention programs on aggressive behavior: A meta-analysis. Journal of Consulting and Clinical Psychology. 2003;71(1):136–149. [PubMed] [Google Scholar]
- Wolchik SA, Sandler IN, Millsap RE, Plummer BA, Greene SM, Anderson ER, et al. Six-year follow-up of preventive interventions for children of divorced: A randomized controlled trial. Journal of the American Medical Association. 2002;288(15):1873–1881. doi: 10.1001/jama.288.15.1874. [DOI] [PubMed] [Google Scholar]
- Wolchik SA, Schenck CE, Sandler IN. Promoting resilience in youth from divorced families: Lessons learned from experimental trials of the New Beginnings Program. Journal of Personality. 2009;77(6):1833–1868. doi: 10.1111/j.1467-6494.2009.00602.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Wolchik SA, West SG, Westover S, Sandler IN, Martin A, Lustig J, et al. The Children of Divorce Parenting Intervention: Outcome evaluation of an empirically based program. American Journal of Community Psychology. 1993;21(3):293–331. doi: 10.1007/BF00941505. [DOI] [PubMed] [Google Scholar]
- Woods ER, Samples CL, Melchiono MW, Keenan PM, Fox DJ, Chase LH, et al. Boston HAPPENS Program: A model of health care for HIV-positive, homeless, and at-risk youth. Journal of Adolescent Health. 1998;23(2):37–48. doi: 10.1016/s1054-139x(98)00048-2. [DOI] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.