Abstract
Background
The World Health Organization predicts that by 2030 internalising problems (e.g. depression and anxiety) will be second only to HIV/AIDS in international burden of disease. Internalising problems affect 1 in 7 school aged children, impacting on peer relations, school engagement, and later mental health, relationships and employment. The development of early childhood prevention for internalising problems is in its infancy. The current study follows two successful 'efficacy' trials of a parenting group intervention to reduce internalising disorders in temperamentally inhibited preschool children. Cool Little Kids is a population-level randomised trial to determine the impacts of systematically screening preschoolers for inhibition then offering a parenting group intervention, on child internalising problems and economic costs at school entry.
Methods/Design
This randomised trial will be conducted within the preschool service system, attended by more than 95% of Australian children in the year before starting school. In early 2011, preschool services in four local government areas in Melbourne, Australia, will distribute the screening tool. The ≈16% (n≈500) with temperamental inhibition will enter the trial. Intervention parents will be offered Cool Little Kids, a 6-session group program in the local community, focusing on ways to develop their child's bravery skills by reducing overprotective parenting interactions. Outcomes one and two years post-baseline will comprise child internalising diagnoses and symptoms, parenting interactions, and parent wellbeing. An economic evaluation (cost-consequences framework) will compare incremental differences in costs of the intervention versus control children to incremental differences in outcomes, from a societal perspective. Analyses will use the intention-to-treat principle, using logistic and linear regression models (binary and continuous outcomes respectively) to compare outcomes between the trial arms.
Discussion
This trial addresses gaps for internalising problems identified in the 2004 World Health Organization Prevention of Mental Disorders report. If effective and cost-effective, the intervention could readily be applied at a population level. Governments consider mental health to be a priority, enhancing the likelihood that an effective early prevention program would be adopted in Australia and internationally.
Trial Registration
ISRCTN: ISRCTN30996662
RCH Human Research Ethics Approval
30105A
Background
Few people in modern societies are untouched by internalising problems, a broad term that refers to emotional distress and encompasses the spectrum of emotional symptoms of anxiety and depression. Although in clinical practice anxiety and depression disorders are seen as multiple, distinct diagnoses, empirical evidence shows high overlap between them and supports use of the broad term internalising problems [1,2]. The World Health Organization (WHO) predicts that, by 2030, internalising problems will be second only to HIV/AIDS in burden of disease [3].
Mental health problems affect 1 in 7 school aged children [4], although they can occur in children of all ages. Internalising (emotional) and externalising (behavioural) problems are among the most common difficulties of early childhood, affecting approximately 15% of those aged 18 months to 5 years [5-8]. Australian community studies have recently confirmed this high prevalence and stability of internalising symptoms across early to mid childhood (e.g. Pearson r's = .53 to .63) [9,10]. By the time internalising disorders are detected problems can be severe and treatment effectiveness can be limited [11,12].
Early internalising problems often have longer-term consequences, with many adult problems having early roots in childhood [4,13,14]. Convergent evidence from prospective and retrospective studies confirms that internalising problems often persist into adolescence and then into adulthood [4,15-24]. Their impacts extend beyond mental health to adult relationships, employment opportunities, and even early mortality. For example, in the British National Child Development Study (N = 11,142), internalising problems at ages 7-11 years were predictive of higher mortality by age 45 (OR 1.20, 95% CI 1.06-1.35) [21].
Evidence suggests that early intervention is key to producing a positive impact because it may be more difficult to influence developmental outcomes later in childhood [25,26]. Though limited, the evidence also supports the cost-effectiveness of intervening early in development [25,27,28]. While emotional functioning continues to develop into adulthood, the early years constitute a window of opportunity for effective mental health promotion in at-risk children. The application of prevention to internalising problems in early childhood is still in its infancy [29]. In 2009, Bayer and colleagues conducted a systematic review of early interventions (age 0-8 years) to improve child mental health. This review found a paucity of randomised controlled trials aiming to reduce internalising problems in community settings [30].
Rationale for the proposed Cool Little Kids population-level study
The strongest precursor of internalising problems in young children is temperamental inhibition, manifested as fearfulness and a tendency to withdraw from new situations [29,31-34]. Additional known risks are harsh and overprotective parenting, and parent internalising problems [9,10,34-39]. Together, these account for up to 45% of the variance in early childhood internalising symptoms [9,10,35].
The only randomised trials testing a parenting prevention model in inhibited preschool children were conducted by Rapee. Rapee's Cool Little Kids program is the first (and, thus far, only) effective early childhood prevention program for internalising disorders [30,40-42]. Targeting child inhibition and overprotective parenting, this parenting program aims to help preschool children become resilient to situational fears and abstract distressing worries. It teaches parents strategies to modify their preschool child's fear and distress, as well as their own (if relevant), based on standard principles for treating internalising disorders in children and adults [11,42].
Two successful efficacy trials of the Cool Little Kids program have been reported. Rapee's first trial [41] recruited 146 children aged 4 years with temperamental inhibition, measured by parent-report questionnaire (>85th percentile) and intensive laboratory observation. Intervention parents received a university-based prevention program from teams of two clinical psychologists offering six group sessions designed to reduce overprotective parenting in response to early fearful behaviour. By age 5 years, the intervention children had developed significantly fewer anxiety disorders than controls (50% vs. 64%). These effects were even larger by age 7 (40% vs. 69%) [42]. Rapee's second study [40] recruited 71 inhibited preschoolers whose parents themselves had internalising disorders. The intervention group received an eight-session version of the program which extended to focus on parent anxiety as well as overprotective parenting. Six months later, the intervention children had substantially fewer internalising disorders, diagnosed in only 53% of the intervention group compared to 93% of controls.
Rapee's two efficacy trials are at the cutting edge of prevention research and have major potential public health implications. Population conclusions, however, are precluded by their sample bias (university location and self-selection by advertisement) and the labour-intensive laboratory observation methods used for selection. The unaddressed challenge is to determine 'real world' effectiveness across an entire population. We report the protocol for the next step - to conduct a population-level translational randomised trial.
Aims and hypotheses
The aims of this trial are to (a) determine the balance of benefits and harms of systematically screening preschoolers for temperamental inhibition and of a parenting intervention program offered to those at risk, (b) examine the impacts on child internalising problems at school entry, and (c) evaluate cost-effectiveness.
We hypothesise that children whose parents enter the program will do better one and two years after baseline (the first two years of school for most) than 'usual care' control children on the outcomes: i) fewer children with internalising disorders, ii) lower mean scores on early child internalising symptoms, iii) lower mean scores on harsh and overprotective parenting, iv) lower mean scores on parent internalising problems. We anticipate that the prevention program will be acceptable and cost-effective.
Methods/Design
Overview of Methods
Figure 1 summarises the time line of the trial. It shows graphically the features at each stage that are common to both the intervention and control groups, and unique to the intervention group, in the manner suggested by Perera et al. [43].
Cool Little Kids is prospectively registered with an international clinical trials registry (ISRCTN30996662), will be conducted in line with ISPOR guidelines for cost-effectiveness trials alongside RCTs [44], and reported in accordance with the CONSORT statement. Project approval has been obtained from the Ethics in Human Research Committee of the Royal Children's Hospital, Melbourne, Australia
Recruitment and participants
Extending Cool Little Kids to a population randomised trial requires more than evidence supporting intervention effectiveness. It requires 1) a universal service system attended by all or almost all 4 year olds, and 2) an acceptable screening tool to systematically identify the children at risk. Primary health care settings were not considered to be an appropriate setting for this screening, because in many countries health practitioners lack the time and resources to screen for this type of problem. In Australia, preschool services are accessed by almost all 4 year olds (95%) [45], at a time when parents and early childhood teachers are concerned about children's impending readiness for school [46]. Brief universal screening can therefore be reliably placed in the preschool setting. The known risk factors for internalising problems are child temperamental inhibition, parents' own internalising problems and overprotective and harsh discipline parenting. The potential benefit versus harm of screening will therefore be considered. For preschool children, it is likely to be more acceptable both to parents and the educational preschool setting to screen inhibition as a child precursor of internalising problems, rather than their parents' mental health and parenting characteristics.
Preschool services from four government areas will be selected to span the sociodemographic spectrum. Written and verbal briefing (study aims, recruiting procedure) will be delivered to preschools across local government areas in the second half of 2010. Recruitment will take place in early 2011 over the first few months of the preschool year. Preschools will distribute a study package including an Information Statement with a screening and consent questionnaire to all parents of children enrolled in their year prior to school. Parents will return this screening and consent questionnaire in a confidential envelope to a sealed letter box at their child's preschool. The questionnaire includes The Short Temperament Scales [47] to screen for child temperamental inhibition (see Table 1) and demographic items.
Table 1.
Construct | Measure | Administration time points | Number of items | Additional Information |
---|---|---|---|---|
Child measures | ||||
Temperamental inhibition | Short Temperament Scales - Inhibition subscale [47] | Screening | 7 | Children who score ≥85th percentile are eligible for the trial. |
Major health or developmental diagnoses | Parents' Evaluation of Developmental Status (Australian version)[53] | RCT baseline | 10 | Children with major diagnoses will be excluded: determined on a case-by-case basis. |
Behavioural and emotional problems | Strengths & Difficulties Questionnaire (4-10 year old Australian version)[54] | Screening 1 & 2 years |
25 | Behavioural screening measure; widely used in population health research; existing school-entry screen in Victoria. Emotional subscale may have concurrent validity with temperamental inhibition screen. Secondary outcome (impact on externalising/conduct problems). |
Anxiety diagnoses | Anxiety Disorders Interview Schedule for DSM-IV, Child Version, Parent Interview Schedule (ADIS-CP-IV) [55] | 1 & 2 years | Primary outcome. Conducted by telephone interview. | |
Internalising problems | Children's Moods, Fears and Worries Questionnaire [1] | 1 & 2 years | 34-38 | Primary outcome. Detailed measure of internalising symptoms (anxious, fearful, withdrawn, depressive) in young children. |
Anxiety problems | Preschool Anxiety Scale - Revised (PAS-R)[56] | 1 & 2 years | 28 | Primary outcome. Detailed measure of anxiety symptoms in young children. Sensitive to intervention in Cool Little Kids efficacy trial. |
Parent measures | ||||
Parenting practices | Parent Behavior Checklist (nurturing, harsh discipline) [57] Over-involved/protective parenting [10,35] |
Baseline 1 & 2 years |
32 8 |
Secondary outcome (intervention mechanism for impacting on child). |
Mental health | Depression, Anxiety, Stress Scale [58] | Baseline 1 & 2 years |
21 | Secondary outcome (impact on parent wellbeing). |
Wellbeing | SF-12 [59] | Baseline | 12 | Secondary outcome (economics measure). |
Assessment of Quality of Life (AQoL-8D) [49] | 1 & 2 years | 35 | Secondary outcome (economics measure). | |
Intervention 'process' measures | ||||
Fidelity | Group sessions content checklists, rated by facilitator and researcher | 6 month appraisal | 6-8 | Secondary outcome (integrity of intervention delivery). Adapted for this study. |
Acceptability to parents | Perceptions of screening process Perceptions of group sessions content, group facilitator |
6 month appraisal | 4 15 |
Secondary outcome (implications for translation/dissemination uptake by families). Adapted for this study. |
Cost-effectiveness | Child and adult health service use | 1 & 2 years | 6 | Secondary outcome (for policy/decision makers considering translation/dissemination). Generated for this study. |
After scoring, the study team will notify parents by letter if their child does not score highly on temperamental inhibition and is therefore ineligible for the trial. Eligible parents will be mailed the detailed trial Information Statement and Consent form with the baseline questionnaire ascertaining family risk for internalising problems and more detailed demographic characteristics (see Table 1). The study team will also telephone all eligible parents to explain trial procedures in detail and answer parents' questions.
Selection criteria
Inclusion criteria
Parents will be eligible for the universal screening component of the study (completing the brief parent-report questionnaire) if their child is enrolled for their preschool year (i.e. the year prior to school) at a participating preschool/kindergarten service. They will be eligible to join the trial if the child scores ≥85th percentile on the inhibition subscale of the Short Temperament Scales [47].
Exclusion criteria
Exclusion criteria are (1) parents with insufficient English to participate (determined by parent or teacher report, or by the study team following up on insufficiently completed screening questionnaires) and (2) children with major health or developmental problems who are considered unlikely to benefit from the intervention. Major health or developmental problems will be discussed on a case-by-case basis, which mirrors what would happen when subsequently translated to the broader population. As exclusion occurs before randomisation, it in no way affects the trial's internal validity.
Allocation
After recruitment and consent, the statistician will coordinate a concealed web-based randomisation process. Computer-generated sequences of random numbers will be used to determine the trial arm status of each child. A block randomisation process, stratified for each preschool separately, will minimise the imbalance between the numbers of intervention and control participants within each preschool. After families are randomised, the study team will notify all parents by letter whether they are in the intervention or control arm, and arrange group session bookings for intervention parents. Participant allocation will be concealed to the clinician assessing diagnostic outcomes; however, the group facilitators and parents cannot be blinded to their group allocation.
Intervention
Content
For this population-level randomised trial, the Cool Little Kids parenting intervention consists of manualised parenting group sessions as previously tested in Rapee's efficacy research [41]. Parents will receive a 'workbook' at the first parenting session that presents information on the nature of inhibition, fears, anxiety and emotional distress, and the developmental trajectory of internalising problems. Thereafter, it details instructions in exposing children to their specific triggers for emotional distress to develop reality-testing and coping skills. In addition, it presents effective ways of parenting inhibited children, and methods for parents to manage their own worries and distress. The latter component involves parents applying strategies for children to themselves, plus a section on cognitive restructuring. Parents are taught how to think more realistically to manage their own concerns, so that they can gradually introduce cognitive techniques to their children as they grow older. The manual is supplemented with extensive examples and detailed exercises. It also contains information on adult mental health problems and encourages parents to seek professional help if relevant. Families with low literacy, and culturally and linguistically diverse families, will be supported by using plain English content.
Process - Intervention group
The intervention includes six group sessions of 90 minutes. These sessions focus on the principles outlined in the manual. Sessions involve setting readings from the manual, scheduling and motivating implementation and practice, and trouble-shooting difficulties arising during practice at home. The first two group sessions are one week apart to ensure comprehension of materials, discuss motivation and encourage implementation of the earliest strategies. The next three sessions are at fortnightly intervals to allow parents time to implement strategies and to encounter any difficulties. The final session is a booster session four weeks later to motivate parents for their longer-term goals and incorporate strategies into broader aspects of family life.
Groups of parents (~12 individuals) with inhibited children will be offered the Cool Little Kids program, delivered by early childhood professionals skilled in cognitive behavioural therapy techniques and instructed in the program by accredited trainers. Parent groups will be run at one of the participating preschools, or another local venue (such as a local maternal and child health service) that is convenient and acceptable to parents.
Process - Control group
Families in the control arm will receive usual teaching and care from their preschool, early childhood and health services in the community. This may include advice on children's behaviour, but would not include a structured, evidence-based parenting program for temperamental inhibition or internalising problems.
Outcome measurement
Approximately one (2012) and two (2013) years after baseline, a clinician blind to group allocation will interview parents to ascertain child internalising diagnoses (see Table 1). These interviews will be conducted by telephone, which has demonstrated validity and is less expensive than face-to-face interviews [48]. A questionnaire mailed to parents will further measure child internalising symptoms, parenting practices, parent mental health and service use.
Sample size
The randomised trial will have a sample size of around 500 inhibited children, providing 80% power at the 5% level of significance to detect the level of reduction in internalising problems found in Rapee's prior efficacy trials, namely a 14% reduction in child internalising disorders between the intervention (50%) and control (64%) groups [41]. This sample size estimation considers an achievable attrition rate for a quality trial, allowing for up to 20% loss to follow up.
Data analyses
Regression analyses will compare child outcomes and costs at school-entry (1 and 2 years after baseline) between the intervention and control arms using the intention-to-treat principle, where participants are analysed in the groups to which they were randomised. Logistic regression will be used for binary outcomes (presenting the percentages for each trial arm and odds ratio between them) and linear regression for continuous outcomes (presenting the mean and standard deviation for each trial arm and mean difference between them). Both unadjusted analyses and analyses adjusted for potential confounding factors determined a priori before randomisation (child gender, family socioeconomic level, parent mental health) will be implemented. Tests of interaction, specified a priori, will explore differential intervention effects for children who are higher on risk factors at baseline. In line with Rapee's second efficacy trial [40], we anticipate larger group differences might emerge for children who are higher on risk factors at baseline.
Process evaluation
Parents and group facilitators will also be mailed questionnaires at the end of the intervention (late 2011) to evaluate the screening process and intervention, where applicable. All parents will report on perceived harms and benefits of screening. Intervention parents and group facilitators will report on intervention acceptability, extent to which components were implemented, and barriers to attendance. Group facilitators will complete a standard content checklist after each group session to record the degree to which the intervention was delivered. In addition, a research assistant will observe a random 10% of parent groups and evaluate protocol adherence using the content checklist.
Economic Evaluation
Economic evaluation will also be conducted to determine whether population application of Cool Little Kids provides value for money to governments (if dissemination were publicly funded), families and society in general. Economic evaluation is a comparative technique of an intervention's costs and consequences to a comparator's costs and consequences (in this instance the control group) measured as an incremental cost-effectiveness ratio (ICER). Since the current study employs a range of outcomes, the primary study design is that of a cost-consequence analysis (CCA). Such an analysis captures all relevant study outcomes which are subsequently presented to decision-makers, allowing them to make their own trade-offs regarding which are more important than others.
Most of the study outcomes are largely clinical in nature (e.g. diagnosis of anxiety disorders, scores of the various clinical scales). This means that the majority of analyses will be cost-effectiveness analyses (CEA). While such analyses are important they have limitations in deciding whether the costs and benefits of interventions represent good value-for-money or not. Cost-utility analysis (CUA) is a form of cost-effectiveness analysis where the costs are measured in monetary terms and the consequences in a generic outcome metric capable of capturing both mortality and morbidity effects, allowing judgments regarding the 'worth' or the 'value' of interventions to be made (as well as comparisons to other interventions both within and across the different disorder/diseases). Parental utility will be measured using the Assessment of Quality of Life Scale -8 Dimension (AQoL8D) [49]. There are no existing tools to measure utility in preschool children, though as the children age measures such as the Health Utilities Index 3 (HUI) may be used [50]. Alternatively, "proxy" utilities may need to suffice as used in a recent study which modeled the efficacy credentials of the Cool Little Kids intervention [51]. It is because the economic analyses will be comprised of both CEA and CUA analyses, the appropriate study-frame is a cost-consequence analysis.
The underlying principle in identifying costs relevant to the economic evaluation is that the inclusion/exclusion criteria should mirror the study perspective. This economic evaluation intends to adopt a largely societal perspective, so all costs to the health sector, participants and their families as well as other sectors impacted upon by the intervention will be included. As there are no previous economic evaluations in this area, a comprehensive resource use questionnaire is proposed to capture a wide variety of resource use for both parents and children (including time costs of parents). Costs associated with the initial research, design and set-up of the intervention and the development of any program materials will be excluded, as these are largely one-off 'sunk' costs (unrecoverable past expenditures), and will not be incurred in on-going routine implementation of the intervention.
The technique of 'bootstrapping' will be used to obtain confidence intervals for cost effectiveness ratios, since parametric techniques are inappropriate for use on both skewed variables and ratios. The sensitivity of the results will also be tested against: different discounting scenario; variation in the utility weights for the children; and, differences in unit cost prices. Costs falling upon the health sector, patients or their families, the government and other sectors will be presented in total and disaggregated form.
The value of economic evaluations alongside effectiveness trials is that a comprehensive analysis of the costs and benefits at an individual level can be obtained. However, such evaluations are usually time limited and do not capture the longer term costs and benefits associated with such interventions. Modelling techniques are a valuable addition to trial based evaluations. Firstly, the longer term costs and consequences associated with interventions can be estimated, though such analyses unavoidably require some assumptions to be made (e.g. a sustained effect of the intervention beyond the duration of the trial). Secondly, modelling allows the costs and benefits at a population level to be estimated. Such information is important to decision makers who are set with the task of allocating national health care budgets and must choose between different interventions. Such modelling of the current intervention is feasible and would build upon a previous study which evaluated the population cost-effectiveness of the Cool Little Kids intervention [51].
Discussion
This translational randomised trial aims to determine 'effectiveness' of the Cool Little Kids program administered across the population. Rapee's recent efficacy studies will be extended to:
a) determine the balance of benefits and harms of systematically screening preschoolers for temperamental inhibition
b) determine the balance of benefits and harms of a parenting intervention program offered from a universal preschool platform to all at risk children in the year prior to school,
c) examine the impacts on internalising problems at school entry, a key developmental point of considerable policy interest internationally,
d) include time-efficient and valid screening and outcome assessments including parenting practices and parent mental health (in addition to child internalising problems), and
e) evaluate cost-effectiveness, to inform policy and service delivery.
An outcome of this translational trial could be systematic screening leading to routine prevention for all or most preschoolers at risk, building on existing universal preschool and healthcare systems. If the Cool Little Kids program proves effective at population level, large-scale rollout is appropriate. A population approach to preventing internalising problems early in childhood will address gaps identified in the WHO Prevention of Mental Disorders Report [52]. It would be highly innovative to prevent internalising problems early in life, in contrast to current timing of mental health service entry, typically in adolescence after anxiety and depression become entrenched. Reducing child internalising problems early in life should subsequently narrow cumulative disparities in mental health and related disadvantage later in life. In Australia and internationally, governments currently consider mental health and early prevention to be a priority.
Competing interests
The authors declare that they have no competing interests.
Authors' contributions
JB took the leading role in designing the study and writing the grant that was subsequently funded by the Australian National Health and Medical Research Council (NHMRC) and modifying the grant for publication. RR developed the Cool Little Kids parenting intervention. RR, MW, HH, OU and CM contributed to the study design and grant preparation. SC assisted with the manuscript. All authors read and approved the final manuscript.
Pre-publication history
The pre-publication history for this paper can be accessed here:
Contributor Information
Jordana K Bayer, Email: jbayer@unimelb.edu.au.
Ronald M Rapee, Email: ron.rapee@psy.mq.edu.au.
Harriet Hiscock, Email: harriet.hiscock@rch.org.au.
Obioha C Ukoumunne, Email: obioha.ukoumunne@pcmd.ac.uk.
Cathrine Mihalopoulos, Email: cathy.mihalopoulos@deakin.edu.au.
Susan Clifford, Email: susan.clifford@mcri.edu.au.
Melissa Wake, Email: melissa.wake@rch.org.au.
Acknowledgements
This study has been funded by Australian NHMRC Project Grant 607302. The funding body had no role in study design or this manuscript. We wish to thank our Associate Investigator Ms Joyce Cleary for support of the project from the Victorian Department of Education and Early Childhood Development. JB, HH and OU are all supported by NHMRC Population Health Capacity Building Grant 436914 and CM by NHMRC Capacity Building Grant 456002. JB was also part supported by Australian Rotary Health. HH and MW are also supported by NHMRC Population Health Career Development Awards (607351 and 546405). OU is now based at the Institute of Health Services Research, Peninsula Medical School, UK.
References
- Bayer JK, Sanson AV, Hemphill SA. Children's moods, fears, and worries: development of an early childhood parent questionnaire. J Emot Behav Disord. 2006;14:41–49. doi: 10.1177/10634266060140010401. [DOI] [Google Scholar]
- Mash EJ, Barkley RA, Eds. Child psychopathology. 1. New York: The Guilford Press; 1996. [Google Scholar]
- Mathers CD, Loncar D. Projections of global mortality and burden of disease from 2002 to 2030. PLoS Med. 2006;3:e442. doi: 10.1371/journal.pmed.0030442. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Sawyer MG, Arney FM, Baghurst PA, Clark JJ, Graetz BW, Kosky RJ, Nurcombe B, Patton GC, Prior MR, Raphael B, Rey J, Whaites LC, Zubrick SR. The mental health of young people in Australia. Canberra: Commonwealth Department of Health and Aged Care; 2008. [DOI] [PubMed] [Google Scholar]
- Achenbach T, Rescorla L. Child Behavior Checklist for Ages 1 1/2 - 5. Burlington VT: ASEBA, University of Vermont; 2000. [Google Scholar]
- Barlow J, Parsons J. Group-based parent-training programmes for improving emotional and behavioural adjustment in 0-3 year old children. Cochrane Database Syst Rev. 2003. [DOI] [PubMed]
- Broeren S, Muris P. Psychometric evaluation of two new parent-rating scales for measuring anxiety symptoms in young Dutch children. J Anxiety Disord. 2008;22:949–958. doi: 10.1016/j.janxdis.2007.09.008. [DOI] [PubMed] [Google Scholar]
- Carter AS, Briggs-Gowan MJ, Jones SM, Little TD. The Infant-Toddler Social and Emotional Assessment (ITSEA): factor structure, reliability, and validity. J Abnorm Child Psychol. 2003;31:495–514. doi: 10.1023/A:1025449031360. [DOI] [PubMed] [Google Scholar]
- Bayer JK, Hiscock H, Ukoumunne OC, Price A, Wake M. Early childhood aetiology of mental health problems: a longitudinal population-based study. J Child Psychol Psychiatry. 2008;49:1166–1174. doi: 10.1111/j.1469-7610.2008.01943.x. [DOI] [PubMed] [Google Scholar]
- Bayer JK, Sanson AV, Hemphill SA. Early childhood aetiology of internalising difficulties: a longitudinal community study. Int J Mental Health Promotion. 2010;12:16–28. [Google Scholar]
- Carr A, Ed. What works for children and adolescents? 1. London: Routledge; 2000. [Google Scholar]
- Kapornai K, Vetro A. Depression in children. Curr Opin Psychiatr. 2008;21:1–7. doi: 10.1097/YCO.0b013e3282f25b01. [DOI] [PubMed] [Google Scholar]
- Kessler RC, Amminger GP, Aguilar-Gaxiola S, Alonso J, Lee S, Ustün TB. Age of onset of mental disorders: a review of recent literature. Curr Opin Psychiatry. 2007;20:359–364. doi: 10.1097/YCO.0b013e32816ebc8c. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Mrazek PJ, Haggerty RJ. Reducing the risks for mental disorders. Washington: National Academy Press; 1994. [PubMed] [Google Scholar]
- Asendorpf JB, Denissen JJA, van Aken MAG. Inhibited and aggressive preschool children at 23 years of age: personality and social transitions into adulthood. Dev Psychol. 2008;44:997–1011. doi: 10.1037/0012-1649.44.4.997. [DOI] [PubMed] [Google Scholar]
- Bosquet M, Egeland B. The development and maintenance of anxiety symptoms from infancy through adolescence in a longitudinal sample. Dev Psychopathol. 2006;18:517–550. doi: 10.1017/S0954579406060275. [DOI] [PubMed] [Google Scholar]
- Campbell SB. Behavior problems in preschool children: a review of recent research. J Child Psychol Psychiatry. 1995;36:113–149. doi: 10.1111/j.1469-7610.1995.tb01657.x. [DOI] [PubMed] [Google Scholar]
- Dadds MR, Barrett PM. Psychological management of anxiety disorders in childhood. J Child Psychol Psychiatry. 2001;42:999–1011. doi: 10.1111/1469-7610.00798. [DOI] [PubMed] [Google Scholar]
- Duchesne S, Vitaro F, Larose S, Tremblay RE. Trajectories of anxiety during elementary-school years and the prediction of high school noncompletion. J Youth Adolesc. 2008;37:1134–1146. doi: 10.1007/s10964-007-9224-0. [DOI] [Google Scholar]
- Horton R. Launching a new movement for mental health. Lancet. 2007;370:806. doi: 10.1016/S0140-6736(07)61243-4. [DOI] [PubMed] [Google Scholar]
- Jokela M, Ferrie J, Kivimaki M. Childhood problem behaviors and death by midlife: the British National Child Development Study. J Am Acad Child Adolesc Psychiatry. 2009;48:19–24. doi: 10.1097/CHI.0b013e31818b1c76. [DOI] [PubMed] [Google Scholar]
- Meltzer H, Gatward R, Corbin T, Goodman R, Ford T. Persistence, onset, risk factors and outcomes of childhood mental disorders. London: Office for National Statistics. HMSO; 2003. [Google Scholar]
- Stewart-Brown S. In: Parenting, schooling and children's behaviour. Buchanan A, Hudson B, editor. Sydney: Ashgate Press; 1998. Public health implications of childhood behaviour problems and parenting programs; pp. 21–33. [Google Scholar]
- World Health Organization. Investing in mental health. Geneva: Department of Mental Health and Substance Dependence, Noncommunicable Diseases and Mental Health; 2003. [Google Scholar]
- Heckman J. Invest in the very young. Chicago, Illinois: Ounce of Prevention Fund and the University of Chicago Harris School of Public Policy Analysis; 2002. [Google Scholar]
- Shonkoff JP, Phillips DA, Eds. From neurons to neighborhoods: the science of early childhood development. Washington: National Academy Press; 2000. [PubMed] [Google Scholar]
- Gibbard D, Coglan L, MacDonald J. Cost-effectiveness analysis of current practice and parent intervention for children under 3 years presenting with expressive language delay. Int J Lang Commun Disord. 2004;39:229–244. doi: 10.1080/13682820310001618839. [DOI] [PubMed] [Google Scholar]
- Mihalopoulos C, Sanders MR, Turner KMT, Murphy-Brennan M, Carter R. Does the Triple P - Positive Parenting Program provide value for money? Aust N Z J Psychiatry. 2007;41:239–246. doi: 10.1080/00048670601172723. [DOI] [PubMed] [Google Scholar]
- Bayer JK, Sanson AV. Preventing the development of emotional mental health problems from early childhood: recent advances in the field. Int J Mental Health Promotion. 2003;5:4–16. [Google Scholar]
- Bayer JK, Hiscock H, Scalzo K, Mathers M, McDonald M, Morris A, Birdseye J, Wake M. Systematic review of preventive interventions for children's mental health: what would work in Australian contexts? Aust N Z J Psychiatry. 2009;43:695–710. doi: 10.1080/00048670903001893. [DOI] [PubMed] [Google Scholar]
- Biederman J, Rosenbaum JF, Bolduc-Murphy EA, Faraone SV. A 3-year follow-up of children with and without behavioral inhibition. J Am Acad Child Adolesc Psychiatry. 1993;32:814–821. doi: 10.1097/00004583-199307000-00016. [DOI] [PubMed] [Google Scholar]
- Rosenbaum JF, Biederman J, Bolduc-Murphy EA, Faraone SV, Chaloff J, Hirshfeld DR, Kagan J. Behavioural inhibition in childhood: a risk factor for anxiety disorders. Harv Rev Psychiatry. 1993;1:2–16. doi: 10.3109/10673229309017052. [DOI] [PubMed] [Google Scholar]
- Prior M, Smart D, Sanson A, Oberklaid F. Does shy-inhibited temperament in childhood lead to anxiety problems in adolescence? J Am Acad Child Adolesc Psychiatry. 2000;39:461–468. doi: 10.1097/00004583-200004000-00015. [DOI] [PubMed] [Google Scholar]
- Rapee RM, Szollos AA. Developmental antecedents of clinical anxiety in childhood. Behav Change. 2002;19:146–157. doi: 10.1375/bech.19.3.146. [DOI] [Google Scholar]
- Bayer JK, Sanson AV, Hemphill SA. Parent influences on early childhood internalizing difficulties. J Appl Dev Psychol. 2006;27:542–559. doi: 10.1016/j.appdev.2006.08.002. [DOI] [Google Scholar]
- Coplan RJ, Arbeau A, Armer M. Don't fret, be supportive! Maternal characteristics linking child shyness to psychosocial and school adjustment in kindergarten. J Abnorm Child Psychol. 2008;36:359–371. doi: 10.1007/s10802-007-9183-7. [DOI] [PubMed] [Google Scholar]
- Rapee RM, Schniering CA, Hudson JL. Anxiety disorders during childhood and adolescence: origins and treatment. Annu Rev Clin Psychol. 2009;5:311–341. doi: 10.1146/annurev.clinpsy.032408.153628. [DOI] [PubMed] [Google Scholar]
- Rapee RM, Spence SH. The etiology of social phobia: empirical evidence and an initial model. Clin Psychol Rev. 2004;24:737–767. doi: 10.1016/j.cpr.2004.06.004. [DOI] [PubMed] [Google Scholar]
- Rubin KH, Burgess KB, Hastings PD. Stability and social-behavioral consequences of toddlers' inhibited temperament and parenting behaviors. Child Dev. 2002;73:483–495. doi: 10.1111/1467-8624.00419. [DOI] [PubMed] [Google Scholar]
- Kennedy SJ, Rapee RM, Edwards SL. A selective intervention program for inhibited preschool-aged children of parents with an anxiety disorder: effects on current anxiety disorders and temperament. J Am Acad Child Adolesc Psychiatry. 2009;48:602–609. doi: 10.1097/CHI.0b013e31819f6fa9. [DOI] [PubMed] [Google Scholar]
- Rapee RM, Kennedy S, Ingram M, Edwards S, Sweeney L. Prevention and early intervention of anxiety disorders in inhibited preschool children. J Consult Clin Psychol. 2005;73:488–497. doi: 10.1037/0022-006X.73.3.488. [DOI] [PubMed] [Google Scholar]
- Rapee RM, Kennedy SJ, Ingram M, Edwards SL, Sweeney L. Altering the trajectory of anxiety in at-risk young children. Am J Psychiatry. 2010;167(12):1518–1525. doi: 10.1176/appi.ajp.2010.09111619. [DOI] [PubMed] [Google Scholar]
- Perera R, Heneghan C, Yudkin P. Graphical method for depicting randomised trials of complex interventions. BMJ. 2007;334:127–129. doi: 10.1136/bmj.39045.396817.68. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Ramsey S, Willke R, Briggs A, Brown R, Buxton M, Chawla A, Cook J, Glick H, Liljas B, Petitti D, Reed S. Good research practices for cost-effectiveness analysis alongside clinical trials: the ISPOR RCT-CEA Task Force report. Value Health. 2005;8:521–533. doi: 10.1111/j.1524-4733.2005.00045.x. [DOI] [PubMed] [Google Scholar]
- Wake M, Sanson A, Berthelsen D, Hardy P, Mission S, Smith K, Ungerer J, LSAC Research Consortium. How well are Australian infants and children aged 4 to 5 years doing? Findings from the Longitudinal Study of Australian Children Wave 1 (Social Policy Research Paper No. 36) Canberra: Department of Families, Housing, Community services and Indigenous Affairs, Australian Government; 2008. [Google Scholar]
- Schor EL, Abrams M, Shea K. Medicaid: health promotion and disease prevention for school readiness. Health Aff (Millwood) 2007;26:420–429. doi: 10.1377/hlthaff.26.2.420. [DOI] [PubMed] [Google Scholar]
- Pedlow R, Sanson A, Prior M, Oberklaid F. Stability of maternally reported temperament from infancy to 8 years. Dev Psychol. 1993;29:998–1007. doi: 10.1037/0012-1649.29.6.998. [DOI] [Google Scholar]
- Lyneham HJ, Rapee RM. Agreement between telephone and in-person delivery of a structured interview for anxiety disorders in children. J Am Acad Child Adolesc Psychiatry. 2005;44:274–282. doi: 10.1097/00004583-200503000-00012. [DOI] [PubMed] [Google Scholar]
- Richardson J, Khan M, Iezzi A, Sinha K, Mihalopoulos C, Herrman H, Hawthorne G, Schweitzer I. The AQoL-8D (PsyQoL) MAU Instrument: Overview September 2009. Centre for Health Economics, Monash University. 2009.
- Feeny D, Furlong W, Boyle M, Torrance GW. Multi-attribute health status classification systems: Health Utilities Index. PharmacoEconomics. 1995;7:490–502. doi: 10.2165/00019053-199507060-00004. [DOI] [PubMed] [Google Scholar]
- Mihalopoulos C, Vos T, Pirkis J, Carter R. The economic analysis of prevention in mental health programs. Annu Rev Clin Psychol. in press . [DOI] [PubMed]
- WHO. Prevention of mental disorders: effective interventions and policy options, summary report. Geneva, Dept. of Mental Health and Substance World Health Organisation; 2004. [Google Scholar]
- Centre for Community Child Health, Royal Children's Hospital, Melbourne. Adapted with permission from Frances Page Glascoe, Ellsworth and Vandermeer Press Ltd; 2005. [Google Scholar]
- National Mental Health Strategy. Australian Mental Health Outcomes and Classification Network: Strengths and Difficulties Questionnaire training manual. New South Wales; 2005. [Google Scholar]
- Silverman WK, Albano AM. The Anxiety Disorders Interview Schedule for Children-IV (child and parent versions) San Antonio, Texas: Psychological Corporation; 1996. [Google Scholar]
- Edwards SL, Rapee RM, Kennedy SJ, Spence SH. The assessment of anxiety symptoms in preschool-aged children: the revised Preschool Anxiety Scale. J Clin Child Adolesc Psychol. pp. 400–9. [DOI] [PubMed]
- Brenner V, Fox RA. Parental discipline and behavior problems in young children. J Genet Psychol. 1998;159:251–256. doi: 10.1080/00221329809596149. [DOI] [PubMed] [Google Scholar]
- Lovibond PF, Lovibond SH. The structure of negative emotional states: comparison of the Depression Anxiety Stress Scales (DASS) with the Beck Depression and Anxiety Inventories. Behav Res Ther. 1995;33:335–343. doi: 10.1016/0005-7967(94)00075-U. [DOI] [PubMed] [Google Scholar]
- Sanderson K, Andrews G. The SF-12 in the Australian population: cross validation of item selection. Aust N Z J Public Health. 2002;26:343–345. doi: 10.1111/j.1467-842X.2002.tb00182.x. [DOI] [PubMed] [Google Scholar]