Abstract
Objective
To see whether a behaviourally based group parenting programme, delivered in regular clinical practice, is an effective treatment for antisocial behaviour in children.
Design
Controlled trial with permuted block design with allocation by date of referral.
Setting
Four local child and adolescent mental health services.
Participants
141 children aged 3-8 years referred with antisocial behaviour and allocated to parenting groups (90) or waiting list control (51).
Intervention
Webster-Stratton basic videotape programme administered to parents of six to eight children over 13-16 weeks. This programme emphasises engagement with parental emotions, rehearsal of behavioural strategies, and parental understanding of its scientific rationale.
Main outcome measures
Semistructured parent interview and questionnaires about antisocial behaviour in children administered 5-7 months after entering trial; direct observation of parent-child interaction.
Results
Referred children were highly antisocial (above the 97th centile on interview measure). Children in the intervention group showed a large reduction in antisocial behaviour; those in the waiting list group did not change (effect size between groups 1.06 SD (95% confidence interval 0.71 to 1.41), P<0.001). Parents in the intervention group increased the proportion of praise to ineffective commands they gave their children threefold, while control parents reduced it by a third (effect size between groups 0.76 (0.16 to 1.36), P=0.018). If the 31 children lost to follow up were included in an intention to treat analysis the effect size on antisocial behaviour was reduced by 16%.
Conclusions
Parenting groups effectively reduce serious antisocial behaviour in children in real life conditions. Follow up is needed to see if the children's poor prognosis is improved and criminality prevented.
What is already known on this topic
Children who persistently display a high level of antisocial behaviour are at high risk of social rejection, juvenile delinquency, and long term unemployment; the cost to society is high
While some behaviourally based parenting programmes have been shown to be effective in university centre trials with volunteers or specially selected cases, most trials of psychological treatments for children in real life settings have shown no effect
What this study adds
An evidence based intervention is available for use in regular clinical practice that effectively reduces antisocial behaviour in referred children
The intervention works well with children at risk of criminality from a combination of highly antisocial behaviour, multiple psychopathology, and social deprivation
Introduction
Aggression and fighting are part of normal child development and can help children to assert and defend themselves. Persistent, poorly controlled antisocial behaviour, however, is socially handicapping and often leads to poor adjustment in adults.1 It occurs in 5% of children,2 and its prevalence is rising.3 The children live with high levels of criticism and hostility from their parents and are often rejected by their peers.3 Truancy is common, most leave school with no qualifications, and over a third become recurrent juvenile offenders.4 In adulthood, offending usually continues, relationships are limited and unsatisfactory, and the employment pattern is poor. The long term public cost from childhood for individuals with this behaviour is up to ten times higher than for controls and involves many agencies.5
Antisocial behaviour accounts for 30-40% of referrals to child mental health services.6 Most referrals meet general clinical diagnostic guidelines for conduct disorder from ICD-10 (international classification of diseases, 10th revision), which require at least one type of antisocial behaviour to be marked and persistent. Rather fewer meet the diagnostic criteria for research, which for the oppositional defiant type of conduct disorder seen in younger children require at least four specific behaviours to be present.7 The early onset pattern—typically beginning at the age of 2 or 3 years—is associated with comorbid psychopathology such as hyperactivity and emotional problems, language disorders, neuropsychological deficits such as poor attention and lower IQ, high heritability,8 and lifelong antisocial behaviour.9 In contrast, teenage onset antisocial behaviour is not associated with other disorders or neuropsychological deficits, is more environmentally determined than inherited, and tends not to persist into adulthood.9
Harsh, inconsistent parenting is strongly associated with antisocial behaviour in children,4 but whether this is a cause or consequence or is due to a common genetic predisposition has been less clear.3 The pioneering work of Patterson and colleagues showed that parents had a causal role in maintaining antisocial behaviour by giving it attention and in extinguishing desirable behaviour by ignoring it.10 This led to behaviourally based training interventions for parents, which have been shown to be effective in many studies in the United States.11
Most trials of parenting programmes have been carried out in specialised university research clinics by the team who invented the treatment, who are highly motivated, extensively trained, and deal only with antisocial behaviour. Many trials used volunteers or people selected by referrers as willing to take part in parenting projects, thus excluding many disorganised, unmotivated, or disadvantaged families, who have the most antisocial children.2 A review of meta-analyses of published trials of psychological treatments for childhood disorders found that in university settings the effect size was large, from 0.71 to 0.84 SD.12 In contrast, a review of six studies of outcome in regular service clinics since 1950 showed no significant effects,12 and a large trial offering unrestricted access to outpatient services found no improvement.13 Reasons suggested for the poor outcome in clinic cases include that they have more severe problems, come from more distressed families, and receive less empirically supported interventions from staff with heavier caseloads. Some have concluded that though child psychotherapy works, the bad news is that it doesn't in real life. The true picture may be even less encouraging as none of the clinic trials included an intention to treat analysis.
As far as we are aware there has been no substantial controlled trial of parenting programmes or any other treatment for antisocial behaviour in Europe. We investigated whether a behaviourally based parenting programme would be effective in everyday NHS practice, with standard referrals to child mental health services and regular clinic staff to carry out the intervention. Our hypothesis was that children whose parents received management training would become less antisocial than those whose parents received no such training.
Methods
Protocol
Study population—The trial took place from 1995-9 in four NHS child and adolescent mental health services: Croydon, Brixton/Belgrave/Camberwell, St George's (all south London); Chichester (West Sussex). The relevant ethics committees approved the project. Eligible children were all those aged 3 to 8 years who were referred for antisocial behaviour to their local multidisciplinary child and adolescent mental health service. Exclusion criteria were clinically apparent major developmental delay, hyperkinetic syndrome, or any other condition requiring separate treatment. Parents had to be able to understand English and attend at group times. Written consent was obtained.
Intervention—We used the basic videotape parent training programme developed by Webster-Stratton.14 This has proved highly successful in trials from the university parenting clinic of its originator.15 Voices were dubbed into English accents. The parents of six to eight children were seen as a group for two hours each week over 13-16 weeks; the children did not take part, and no other treatment was given. The programme covered play, praise and rewards, limit setting, and handling misbehaviour. In each session, two group leaders showed videotaped scenes of parents and children together, which depict “right” and “wrong” ways of handling children. Parents discussed their own child's behaviour and were supported while they practised alternative ways of managing it. Each week tasks were set for parents to practise at home and telephone calls made to encourage progress. Therapists held regular jobs in their local service, came from a range of disciplines, and were trained over three months. Intervention sessions were videotaped, and weekly supervision meetings were held to ensure adherence to the manual.14
Intervention programme
Content
Structured sequence of topics, introduced with video clips of parents with children
Topics include play, praise, incentives, setting limits, and discipline
Emphasis on promoting sociable, self reliant child behaviour, and calm parenting
Constant reference to parent's own experience and predicament
Theoretical basis informed by extensive empirical research and made explicit
Detailed manual available to ensure treatment fidelity and to enable replicability
Delivery
Collaborative approach acknowledging parents' feelings and beliefs
Difficulties normalised, humour and fun encouraged
Parents supported to practise new approaches during session and through homework
Written feedback from parents after every session
Creche, good quality refreshments, and transport provided
Group leaders supervised weekly to ensure treatment fidelity and to develop skills, using videotape of last session to rehearse therapeutic approach
Measures were taken from mothers on entry to the trial and after completion of the intervention or waiting list period, five to seven months later. They included demographic details, six measures of child behaviour, and one of parent behaviour. We used the parent account of child symptoms interview as the primary outcome measure for antisocial behaviour. This well validated semistructured interview uses investigator based criteria to assess the frequency and severity of antisocial behaviours such as fighting, destruction, and disobedience; scores are strongly predictive of later psychosocial outcome.16 The κ inter-rater reliability statistic on 20 randomly selected interviews was 0.84 for the conduct problems scale, 0.81 for the hyperactivity scale, and 0.76 for the emotional problems scale. We also used the strengths and difficulties questionnaire (SDQ)17 and the child behaviour checklist.18 In the parent defined problems questionnaire, the parent lists the three problems they would most like to see changed and indicates the severity of each on a 10 cm line labelled “not a problem” at one end and “couldn't be worse” at the other. The parent daily report questionnaire records 36 behaviours as present or absent each day for a week.19 This measure is widely used as an alternative to prolonged direct observation in the home by an independent observer. A diagnosis of conduct disorder (oppositional defiant type) was made if ICD-10 research criteria were met at interview.7 Finally, parents were directly observed. An 18 minute structured play task20 was given to the mother and child at home and videotaped. We randomly selected 20 cases, which an assessor blind to their status coded using a manual.21 The assessor counted parental praise and inappropriate commands and combined them to give a ratio. Intraclass correlation coefficients were 0.96 and 0.97, respectively.
Calculation of sample size—We designed the trial to detect a minimum important difference in effect size of 0.6 SD on the primary outcome measure. To be detected with 80% power at α=0.05, with a 2:1 allocation ratio, this would require groups of 68 and 34 (total 102).
Analysis strategy—We use analysis of variance over time, covarying for age and sex, to test for an interaction between time and arm of trial. We analysed all allocated cases for which we had follow up data, irrespective of how much intervention was received. We also carried out an intention to treat analysis, in which we analysed data from all allocated cases, including those lost to follow up, for which we assumed there was no change since first assessment.
Assignment
In each centre we allocated participants to intervention or control (waiting list) using a permuted block design.22Each block consisted of a consecutive three month period, during which all eligible referrals were allocated to one arm of the trial. This design was chosen with the aim of recruiting at least six cases per parenting group, with the assumption that 5-15 cases were referred in each block. Allocation was determined by date of receipt of referral letter. Participants in the control arm were offered treatment after completion of the trial.
The planned overall ratio of intervention to control blocks was 2:1. Each centre had to have at least two intervention blocks per year to ensure that there were enough cases to run a group even after any drop outs. Also, intervention blocks had to be more than three months apart to ensure there were sufficient cases to run a group within six months of a child being assessed. Therefore we determined the sequence non-randomly for each centre annually in advance with the advice of a statistician. This gave 52 blocks: 35 intervention and 17 control (ratio 2.06:1). The sequence was kept in a locked cabinet.
Masking
Parents were blind to allocation at the initial assessment; interviews were carried out by researchers blind to the duration or sequence of blocks. Follow up assessments were carried out by a different researcher to avoid the parent giving socially desirable responses, but blinding at this stage was often not possible as parents talked about treatment.
Results
Participants—The figure shows participant flow and follow up. No parents of a child allocated to the waiting list received a parenting programme, and no parents of a child allocated to the parenting group were returned to the waiting list. No child received psychotropic medication. Table 1 gives characteristics of the referred children. Compared with population norms, mean scores were above the 97th centile for conduct problems, above the 90th centile for hyperactivity, and above the 78th centile for emotional problems. There were no significant differences between groups. Table 2 gives details of family characteristics; most were poor and disadvantaged. There were no significant differences between groups.
Table 1.
Characteristics of children referred for antisocial behaviour*
Parenting groups (n=73) | Waiting list controls (n=37) | Lost to follow up (n=31) | Not in trial (n=289)† | |
---|---|---|---|---|
No (%) of boys | 52 (71) | 27 (73) | 25 (81) | 216 (75) |
Mean (SD) age (years) | 5.45 (1.57) | 5.97 (1.72) | 5.81 (1.37) | 5.67 (1.54) |
Mean (SD) interview scores: | ||||
Conduct problems | 1.59 (0.45) | 1.53 (0.42) | 1.60 (0.42) | — |
Hyperactivity | 1.23 (0.70) | 1.13 (0.65) | 1.07 (0.60) | — |
Emotional problems | 0.76 (0.60) | 0.69 (0.37) | 0.72 (0.49) | — |
Groups did not differ significantly on any characteristic, with χ2 test for sex and analysis of variance for other variables.
Of 430 referrals, 67 families could not be contacted, 33 said they no longer had problems, 62 declined to take part, 124 did not fulfil criteria for eligibility, and three dropped out before consent or assessment.
Table 2.
Characteristics of families in study with children with antisocial behaviour (number (percentage))* and all families in United Kingdom
Parenting group (n=73) | Waiting list controls (n=37) | Lost to follow up (n=31) | Mean values for UK (%)† | |
---|---|---|---|---|
Lone parent | 30/67 (45) | 14/36 (39) | 12/27 (44) | 7 |
Parent in ethnic minority | 13/64 (20) | 4/31 (13) | 5/23 (22) | 9 |
Mother left school by 16 | 34/67 (51) | 20/35 (57) | 21/27 (61) | 13 |
Council or housing association home | 34/73 (47) | 19/35 (54) | 11/27 (41) | 17 |
No car | 30/73 (41) | 16/36 (44) | 11/28 (39) | 28 |
Child eligible for free school meals | 34/69 (49) | 17/34 (50) | 15/28 (54) | 18 |
Total weekly household income ⩽£175 | 14/63 (22) | 10/30 (28) | 6/26 (23) | 5 |
Denominators vary owing to missing data.
Groups within the study did not differ significantly on any characteristic with χ2 test.
Data from Social Trends London: Office of National Statistics, 2000.
Programme attendance and cost—The mean attendance was 9.1 (SD 4.2) sessions. Thirteen (18%) of the 73 families attended four or fewer times, which we consider dropping out, and 60 (82%) attended five or more, which we consider reasonable compliance. The programme cost £571 per child compared with £563 for usual individual treatment of six sessions, calculated with standard economic methods.5
Child behaviour—Table 3 gives results on the outcome measures from the semistucured interview. For antisocial behaviour, control children showed no change and intervention children showed a large improvement. A similar picture was seen on all other outcome measures. Parentally defined problems in the child included hitting people, running away, and fighting with sibling. Intention to treat analysis reduced the effect size by 16% on the primary outcome measure (antisocial behaviour) and by –6% to 36% (mean 22%) on the secondary measures. Symptoms of hyperactivity reduced significantly, as did overall emotional and behaviour problems.
Table 3.
Child and parent behaviour outcomes after parent had attended parenting group
Measure | Mean score (control)
|
Mean score (intervention)
|
Difference in change between groups*
|
Intention to treat (control n=51; intervention n=90)
|
|||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|
No | Before | After | No | Before | After | Difference (95% CI) | Effect size (95% CI); P value | Difference (95% CI) | Effect size (95% CI); P value | ||||
Child behaviour outcomes | |||||||||||||
Parent account of child symptoms: | |||||||||||||
Conduct problems | 37 | 1.53 | 1.57 | 73 | 1.59 | 1.16 | 0.49 (0.33 to 0.65) | 1.06 (0.71 to 1.41); <0.001 | 0.40 (0.26 to 0.53) | 0.89 (0.58 to 1.18); <0.001 | |||
Hyperactivity | 37 | 1.13 | 1.16 | 73 | 1.23 | 0.99 | 0.29 (0.08 to 0.49) | 0.43 (0.12 to 0.72); 0.008 | 0.21 (0.04 to 0.38) | 0.31 (0.06 to 0.56); 0.017 | |||
Strengths and difficulties questionnaire: | |||||||||||||
Conduct problems | 26 | 5.34 | 5.85 | 63 | 4.94 | 4.46 | 1.48 (0.70 to 2.26) | 0.73 (0.35 to 1.11); <0.001 | 1.05 (0.42 to 1.67) | 0.51 (0.20 to 0.81); 0.002 | |||
Total deviance | 26 | 20.1 | 19.7 | 63 | 19.5 | 16.9 | 2.75 (0.51 to 4.98) | 0.48 (0.09 to 0.87); 0.018 | 2.12 (0.33 to 3.91) | 0.37 (0.06 to 0.68); 0.022 | |||
Child behaviour checklist: | |||||||||||||
Externalising problems | 21 | 30.3 | 29.1 | 37 | 27.6 | 20.4 | 8.09 (3.4 to 12.7) | 0.86 (0.23 to 1.35); 0.001 | 5.23 (1.7 to 8.8) | 0.55 (0.18 to 0.93); 0.005 | |||
Total problems | 21 | 69.7 | 66.0 | 37 | 61.9 | 47.0 | 14.9 (4.1 to 25.8) | 0.65 (0.18 to 1.13); 0.010 | 9.98 (3.4 to 18.01) | 0.44 (0.15 to 0.79); 0.017 | |||
Parent defined problems† | 33 | 8.24 | 7.17 | 50 | 7.86 | 5.35 | 1.71 (0.66 to 2.75) | 1.11 (0.43 to 1.79); <0.001 | 1.41 (0.53 to 2.29) | 0.92 (0.36 to 1.49); 0.002 | |||
Parent daily report (total problems/day) | 23 | 13.9 | 13.6 | 52 | 11.9 | 9.5 | 3.74 (1.61 to 5.86) | 0.71 (0.31 to 1.11); 0.001 | 3.94 (2.18 to 5.71) | 0.75 (0.41 to 1.03); <0.001 | |||
Oppositional defiant disorder (ICD-10) | 36 | 33 | 32 | 69 | 55 | 34 | 0.33 (0.17 to 0.50) | P=0.002 | 0.22 (0.09 to 0.35) | P=0.002 | |||
Parent behaviour | |||||||||||||
Observed behaviour: inappropriate commands | 20‡ | 1.40 | 0.91 | 20‡ | 0.76 | 2.22 | 1.33 (0.28 to 2.38) | 0.76 (0.16 to 1.36); 0.018 |
Difference in change between intervention (parent group) and control (waiting list) conditions, measured by regression on final score, adjusted by analysis of covariance for initial score, age, and sex.
10 cm visual analogue scale, mean of all three problems.
Randomly selected for intensive coding of videotapes.
Clinical significance—The mean initial score for conduct problem on interview was above the 97th centile on population means, well into the clinical range. After intervention it fell to below the 82nd centile, within the normal range. However, 21% of children in the intervention group failed to improve by at least 0.3 SD, and a third still met research criteria for oppositional defiant disorder.
Parental behaviour—The ratio of praise to inappropriate commands increased threefold in the intervention group but fell by a third in the controls (table 3).
Discussion
The children recruited to this study were initially behaving in a highly aggressive and antisocial way; many were also hyperactive and had emotional problems. Most lived in deprived circumstances and were at high risk of later juvenile delinquency and social exclusion. The children of parents allocated to parenting groups showed a large reduction in antisocial behaviour, but those in the control group did not improve. After the intervention, parents were giving their children far more praise to encourage desirable behaviour and more effective commands to obtain compliance. Attendance at parenting groups was good, despite the population being notoriously hard to engage.
Methodological considerations
Sequential block designs can lead to biased allocation. Referrers, clinic staff, and parents might all have tried to influence allocation. However, at the time of referral, referrers did not know of the existence of the trial and were unaware of duration or sequence of blocks. Clinic staff and parents were unaware of the duration and sequence of blocks, and parents were not informed of allocation until after the first assessment.4 Our trial incorporated several features to avoid this bias, and there was no evidence that groups differed. Effects were shown across three different measurement perspectives: parental perception, investigator based criteria, and direct observation. No measure was taken of child behaviour in school as there was no intervention in this setting. Planned future studies include a follow up to see whether the improvements persist and a comparison with usual clinic treatment.
Implications for services
This intervention is an effective, evidence based treatment for antisocial behaviour in children in real life conditions. It works well with disadvantaged families and costs no more than conventional treatment. Groups could be delivered in community settings rather than in mental health services to reduce stigma and increase accessibility.23 However, parenting groups should not automatically be offered as the only intervention for antisocial behaviour. Careful assessment of children is necessary as a proportion (a third in this trial) have coexistent psychiatric diagnoses, such as the hyperkinetic syndrome, post-traumatic stress disorder, and encopresis, that require additional treatment. Such children were excluded from this trial only because the additional treatment would have made it hard to interpret which intervention was changing antisocial behaviour. We believe that in most cases parent training would be a beneficial and easily combined treatment.
Our results are likely to be related to the programme chosen and its implementation. This programme coherently combines behavioural principles with sympathetic support and other features shown in the literature to enhance effectiveness.24 Implementation was by personable, committed staff given adequate training and regular supervision to promote treatment fidelity.25 Such parenting programmes are only just beginning to become available in the United Kingdom. They show promise as a cost effective way to reduce the personal and economic burden of antisocial behaviour in children and to prevent criminality and social exclusion.
Figure.
Participant flow and follow up
Acknowledgments
We thank all participating parents, clinic staff, and intervention staff for their help; Jenny Price for data collection; Drs Byrne, Dare, Fitzpatrick, Nikapota, Subotsky, Warren, and Weeramanthri for arranging access to families; Professor Graham Dunn for advice on design and statistics, and Professor Webster-Stratton for advice and encouragement on the intervention.
Footnotes
Funding: NHS Research and Development Executive; Sussex Weald and Downs NHS Trust. SS received a Wellcome research training fellowship during the first year.
Competing interests: None declared
References
- 1.Scott S. Aggressive behaviour in childhood. BMJ. 1998;316:202–206. doi: 10.1136/bmj.316.7126.202. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Meltzer H, Gatward R, Goodman R, Ford T. The mental health of children and adolescents in Great Britain. London: Office of National Statistics; 2000. [DOI] [PubMed] [Google Scholar]
- 3.Rutter M, Hagell A, Giller H. Antisocial behaviour by young people. Cambridge: Cambridge University Press; 1998. [Google Scholar]
- 4.Farrington DP. The development of offending and antisocial behaviour from childhood: key findings from the Cambridge study in delinquent development. J Child Psychol Psychiatry. 1995;36:929–964. doi: 10.1111/j.1469-7610.1995.tb01342.x. [DOI] [PubMed] [Google Scholar]
- 5.Scott S, Knapp M, Henderson J, Maughan B. Financial cost of social exclusion: follow up study of antisocial children into adulthood. BMJ. 2001;323:191–194. doi: 10.1136/bmj.323.7306.191. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Audit Commission. London: Audit Commission; 1999. Children in mind. [Google Scholar]
- 7.World Health Organization. The ICD-10 classification of mental and behavioural disorders—diagnostic criteria for research. Geneva: World Health Organization; 1993. [Google Scholar]
- 8.Silberg J, Meyer J, Pickles A, Simonoff E, Eaves L, Hewitt J, et al. Heterogeneity among juvenile antisocial behaviours: findings from the Virginia twin study of adolescent behaviour. In: Bock G, editor. Genetics of criminal and antisocial behaviour. London: Wiley; 1996. [DOI] [PubMed] [Google Scholar]
- 9.Moffitt T. Adolescence-limited and life-course-persistent antisocial behaviour: a developmental taxonomy. Psychol Rev. 1993;100:674–701. [PubMed] [Google Scholar]
- 10.Patterson GR. Coercive family process. Eugene, OR: Castalia; 1982. [Google Scholar]
- 11.Kazdin AE. Parent management training: evidence, outcomes, and issues. J Am Acad Child Adol Psychiatry. 1997;36:10–18. doi: 10.1097/00004583-199710000-00016. [DOI] [PubMed] [Google Scholar]
- 12.Weisz J, Weiss B, Donenberg GR. The lab versus the clinic: effects of child and adolescent psychotherapy. Am Psychol. 1992;47:1578–1585. doi: 10.1037//0003-066x.47.12.1578. [DOI] [PubMed] [Google Scholar]
- 13.Andrade AR, Lambert WL, Bickman L. Dose effect in child psychotherapy: outcomes associated with negligble treatment. J Am Acad Child Adol Psychiatry. 2000;39:161–168. doi: 10.1097/00004583-200002000-00014. [DOI] [PubMed] [Google Scholar]
- 14.Webster-Stratton C, Hancock L. Training for parents of young children with conduct problems: content, methods, and therapeutic processes. In: Briesmeister JM, Schaefer CE, editors. Handbook of parent training. 2nd ed. New York: Wiley; 1998. [Google Scholar]
- 15.Webster-Stratton C, Hollinsworth T, Kolpacoff M. The long-term effectiveness and clinical significance of three cost-effective training programs for families with conduct-problem children. J Consult Clin Psychol. 1989;57:550–553. doi: 10.1037//0022-006x.57.4.550. [DOI] [PubMed] [Google Scholar]
- 16.Taylor E, Chadwick O, Heptinstall E, Danckaerts M. Hyperactivity and conduct problems as risk factors for adolescent development. J Am Acad Child Adolesc Psychiatry. 1996;35:1213–1226. doi: 10.1097/00004583-199609000-00019. [DOI] [PubMed] [Google Scholar]
- 17.Goodman R. The strengths and difficulties questionnaire. J Child Psychol Psychiatry. 1997;38:581–586. doi: 10.1111/j.1469-7610.1997.tb01545.x. [DOI] [PubMed] [Google Scholar]
- 18.Achenbach T M. Manual for the child behavior checklist 4-18. Burlington, VT: University Associates in Psychiatry; 1991. [Google Scholar]
- 19.Chamberlain P, Reid JB. Parent observation and report of child symptoms. Behavioral Assessment. 1987;9:97–109. [Google Scholar]
- 20.Conduct Problems Prevention Research Group. Initial impact of the fast track prevention trial for conduct problems: 1, The high risk sample. J Consult Clin Psychol. 1999;67:631–647. [PMC free article] [PubMed] [Google Scholar]
- 21.Aspland H. The assessment of parent-child interactions in children with conduct problems: an evaluation of structured direct observation. London: Institute of Psychiatry, University of London; 2001. (MPhil thesis). [Google Scholar]
- 22.Altman DG. Practical statistics for medical research. London: Chapman and Hall; 1982. [Google Scholar]
- 23.Scott S. Parenting programmes. In: Rutter M, Taylor E, eds. Child and adolescent psychiatry. 4th ed. Oxford: Blackwell Science (in press).
- 24.Webster-Stratton C. Preventing conduct problems in Head Start children: strengthening parenting competencies. J Consult Clin Psychol. 1998;66:715–730. doi: 10.1037//0022-006x.66.5.715. [DOI] [PubMed] [Google Scholar]
- 25.Henggeler SW, Melton GB, Brondino MJ, Schere DG, Hanley JH. Multisystemic therapy with violent and chronic juvenile offenders and their families: the role of treatment fidelity in successful dissemination. J Consult Clin Psychol. 1997;65:821–833. doi: 10.1037//0022-006x.65.5.821. [DOI] [PubMed] [Google Scholar]