Skip to main content
NIHR Open Research logoLink to NIHR Open Research
. 2024 Jul 1;4:13. Originally published 2024 Mar 25. [Version 2] doi: 10.3310/nihropenres.13563.2

Disciplinary behaviour management strategies in schools and their impact on student psychosocial outcomes: A systematic review

Sharea Ijaz 1,a, James Nobles 2, Loubaba Mamluk 1, Sarah Dawson 1, Bonnie Curran 3, Rachael Pryor 3,4, Sabi Redwood 1, Jelena Savović 1
PMCID: PMC11320041  PMID: 39145105

Version Changes

Revised. Amendments from Version 1

We have updated the text of our original submission in response to peer review. We added information in the background about the review's focus on secondary schools. We elaborated further in the methods why any meta-analyses were not conducted. We have provided more specific reasons for the exclusion of studies in the PRISMA diagram. We have included further reflection on link between punitive disciplinary strategies and poor academic outcomes, and the potential value of alternative approaches in discussion. We have added further reflections on our search for grey literature in the limitation section. See our detailed response to the reviews for specific locations of these updates.

Abstract

Background

Disciplinary behaviour management strategies are implemented in schools to manage pupil behaviour. There is limited evidence of their intended impact on behaviour but there is growing concern around the potential negative impacts on pupil wellbeing.

Methods

We carried out a systematic review to examine the impact of these strategies on psychosocial outcomes in pupils (PROSPERO Registration: CRD42021285427). We searched multiple sources and double-screened titles, abstracts, and full texts. Data extraction and risk of bias assessment were done by one reviewer and checked by another. Results were narratively synthesised.

Results

We included 14 studies, from 5375 citations, assessing temporary suspension (n=10), verbal reprimand (n=2), and mixed strategies (n=2). Depression was the most common outcome (n=7), followed by academic grades (n=4) and behaviour in class (n=4). All except one study were at high risk of bias. We found a recurring pattern in the evidence of disciplinary strategies associated with poor mental wellbeing and behaviour in pupils. The effect on academic attainment was unclear.

Conclusions

Disciplinary behaviour management strategies may have negative impact on pupil mental wellbeing and class behaviour. These important consequences should be assessed in better designed studies before these strategies are implemented.

Keywords: adolescent, school discipline, behaviour management, mental health, wellbeing, systematic review

Plain English Summary

How does school discipline affect pupil mental health and wellbeing? A systematic review

In England, a variety of approaches are used in schools to manage pupils’ behaviour. There isn’t much evidence about their impact on behaviour, but there’s growing concern they might negatively affect pupils’ wellbeing.

We systematically reviewed the published research to understand the impact of these behaviour management strategies on pupils’ wellbeing. We searched multiple sources and two people looked at titles, abstracts and full papers.

One reviewer extracted the data and assessed the studies for risk of bias, while another checked this work. Results from all studies were combined together in text and tables.

We included 14 studies from the 5,375 papers that we looked at. Included studies explored at a range of strategies, including temporary suspension (10 studies), verbal reprimand or being told off (2 studies), and a combination of strategies (2 studies).

Seven studies looked at whether these strategies led to depression, four looked at the impact on exam grades and four on behaviour in class. All except one study were at high risk of bias, meaning we can’t fully trust their findings.

Many of the studies showed these disciplinary strategies were linked to poor mental wellbeing and behaviour in pupils. The effect on exam results wasn’t clear.

It appears pupil mental wellbeing and class behaviour was made worse by these strategies. These are important impacts and should be researched in high quality studies before these strategies are used further.

Introduction

Disciplinary behaviour management strategies are implemented in schools to help manage pupil behaviour. There are several approaches towards behaviour management. There are punitive strategies which align with the theory of assertive discipline 1 , which set out clear rules that reward good behaviour and punish poor behaviour. Punitive approaches will typically directly respond to poor behaviour, whereby punishing a pupil is anticipated to reduce the likelihood of repeated disruptive behaviour. However, if a pupil misbehaves again or dependent on the misbehaviour itself, increasingly severe forms of punishment are then used. Punitive approaches include strategies such as verbal reprimanding (e.g., being shouted at in class), detentions, isolation rooms, in- and out-of-school suspensions, and expulsion (permanent exclusion). These punitive approaches are commonplace in the western world 2, 3 , and are more common in secondary schools in UK 4, 5 .

Conversely, there are alternative approaches that aim to understand why pupils act as they do, in the context of poor behaviour, and then work with the child to reduce the likelihood of these behaviours recurring. These include restorative approaches 6 , trauma informed approaches 7 , collaborative problem solving 8 , positive behavioural intervention and support (PBIS) 9 , or attachment-based strategies 10 . These strategies support pro-social behaviour between pupils, and collaborative interaction between pupils and teachers 11 . The evidence base in support of these alternative approaches has developed in recent years 1214 .

There is limited evidence regarding the intended impact of punitive approaches on behaviour and academic outcomes for affected pupils and their peers 1518 . There is also a growing concern for the potential negative implications that punitive approaches may have on wellbeing outcomes later in life 19, 20 . This is important given that young people’s mental health has declined in recent years in the UK, partly due to disruptions in school and home routines following COVID-19 and the pandemic response strategies 21 .

This concern about the potential negative mental health impact on pupils was voiced by secondary school age young people in a public consultation meeting in Bristol (England) when collaboratively identifying research priorities.

This review was then developed with input from these young people to investigate the existing evidence on the effects of punitive behaviour management strategies on mental health and wellbeing in secondary school age children and young people 22 .

Methods

Objectives

To examine whether the use of disciplinary behaviour management strategies (interventions) in secondary schools leads to adverse psychosocial outcomes for pupils

Secondary objectives were:

  • To explore whether adverse effects differ between children of different socio-demographic backgrounds

  • To determine whether there is evidence of effectiveness for these disciplinary behaviour management strategies in improving behaviour and academic outcomes

This review was registered with the international Prospective Register of Systematic Reviews (PROSPERO) in October 2021. Registration number CRD42021285427 23 .

Public Involvement

We held three involvement sessions with young people aged between 11 and 16 years old to develop the broad research questions. The first session involved the Young People’s Advisory Group (YPAG; a local public involvement group for young people interested in research) raising concerns about the effect of disciplinary behaviour management strategies on pupil wellbeing. A second workshop was conducted with funding from Create to Collaborate 24 to explore these concerns with a broader group of young people affiliated with a mental health charity. In this workshop, young people suggested that some school discipline practices affect their wellbeing negatively. We then ran a third workshop to refine the review questions and search terms with the input from YPAG.

Eligibility criteria

We included randomised and non-randomised study designs (including longitudinal and cross-sectional surveys). We excluded solely qualitative studies as this review’s scope was limited to effects of interventions.

Based on our public involvement work with young people, we were interested in zero-tolerance, punishment-based, or punitive disciplinary strategies that include verbal reprimanding, behaviour monitoring and reporting, isolation, detentions (either during- or after- school hours), and suspension (inclusive of temporary- or fixed- term exclusion). We did not include studies which only focused on permanent exclusion or expulsions from schools.

We limited our inclusions to the UK and other high-income countries in The Organisation for Economic Co-operation and Development (OECD). This meant that approaches such as corporal punishment, and physical- or chemical- restraint were not included given that they are not implemented in a UK (or similar) context.

We included studies of children and young people from the general population, aged 11–16 years, attending a main-stream school. We excluded studies focused on pupils in specialist schools, such as secure centres for children (similar to a juvenile correction facility in the USA), special behavioural units, and Special Educational Needs and Disability (SEND) schools.

Our primary outcomes were any measures of mental health and wellbeing. We included academic and social outcomes as secondary outcomes.

Search strategy

We developed search strategies with an information specialist (SD) and searched seven online databases from inception to October 15th, 2021: MEDLINE; Embase; PsycINFO; British Education Index; Australian Education Index; Education Resources Information Centre (ERIC); Web of Science Social Science Citation Index (SSCI). See Extended data for search strategies 25 . We also sent a standardised email through the Children and Young People’s Mental Health Coalition 26 to their 237 member organisations to help identify grey literature.

Study selection

Titles and abstracts identified through electronic database- and web- searching were independently screened for relevance in duplicate (JN, SI, & LM) using Rayyan 27 . Full texts were then retrieved for all relevant references and assessed against the inclusion criteria, in duplicate. Reasons for exclusion were documented (see table S1 in supplementary file) at this stage. Any discrepancies between reviewers at either stage were resolved through discussion or via a third reviewer (JS).

Data extraction and risk of bias assessment

Data extraction was undertaken by one reviewer (JN) using a standardised form in Microsoft Excel. To minimise bias and errors, a second reviewer (SI) checked the data extracted from all included papers. We extracted information on the following: a) study design, b) sample size and characteristics, c) the behaviour management strategy being studied, d) control / comparator [where available], e) context and setting, and f) information about, and results pertaining to, the primary and secondary outcomes. We assessed risk of bias in included studies using Cochrane Effective Practice and Organisation of Care (EPOC) group’s criteria for nonrandomised studies 28 . We considered a study to be at an overall low risk of bias when all items were scored at low risk, at an overall moderate risk of bias when more than half the items were at low risk of bias, and all others were rated high risk of bias.

Synthesis

We planned for a random effects meta-analysis if combinable data were available. However, a meta-analysis was not conducted as the studies were highly heterogeneous across populations, comparisons, follow up times, outcome measures, effect measures, and notably, study designs. The analyses presented were often unadjusted with numbers of analysed participants unclear. A narrative synthesis was therefore performed. Pooling these disparate data from high risk of bias studies in a meta-analysis would not have changed our conclusions and recommendations.

Results

Study selection

Electronic searches resulted in 5357 citations. We found no additional studies through contacts with experts and third sector organisations. Fifty papers were included for full text assessment. After full text screening, 14 studies 2942 out of these 50 were included in narrative synthesis. See Figure 1 for detail of the process.

Figure 1. PRISMA Flow diagram of review process.

Figure 1.

Description of included studies

Ten studies were from USA, followed by two from Australia and the UK respectively, and one from Poland. We found no randomised trials. Studies were either surveys or uncontrolled before and after designs. Sample sizes across studies varied widely, ranging from 23 pupils to 33 572 pupils (median = 1811 pupils).

Studies typically included more females than males. Most studies (n=9) 29, 30, 32, 33, 35, 3740 included high school pupils. White pupils were included less often (mean 36%, median 30% across studies) than non-white pupils. Five studies 31, 35, 39, 41, 42 focused on deprived populations, reported as majority (>50%) children being on free school meals and/or low earning.

Temporary suspension from school was most frequently studied (n=11) 29, 31, 3335, 37, 3943 , followed by verbal reprimanding or punishment (n=2) 36, 38 and various mixed (multiple combined) strategies (n=2) 30, 32 . We present result for these categories separately below.

The most common studied outcome was depression (n=7) 3032, 34, 35, 37, 40 using various scales: PHQ-9 (Patient health Questionnaire); CESD (Center for Epidemiological Studies Depression); SDQ (Strengths and Difficulties Questionnaire); California Healthy Kids Survey (WestEd) (Depression subscale); and Add Health survey. Two studies assessed internalising symptoms (i.e., problems of withdrawal, somatic complaints, and anxiety/depression) 44 , one using Teacher observation of classroom adaptation checklist (TOCAC) 31 and Youth Self Report (YSR) in the other 41 . One study assessed externalising symptoms (i.e., problems of aggression, impulsivity, and inattention) 44 on adapted Behavior Assessment System for Children: second edition (BASC 2) scale 29 . Anxiety was assessed in one study 36 using a Polish version of State-Trait Anxiety Inventory for Children. General mental wellbeing was assessed in three studies 33, 38, 39 , one using the Warwick and Edinburgh Mental Wellbeing Scale 33 , and two using author developed scales 38, 39 . Five studies 30, 35, 36, 39, 42 assessed impact of disciplinary strategies on educational attainment. See Table 1 for details of included studies.

Table 1. Characteristics of included studies by disciplinary strategies.

Author (Year)
Country
Study design Disciplinary
intervention
Setting, sample
and demographics
Outcomes reported Findings
Suspension
Strategies
Bottiani et al. (2017) 29
USA
Cross-sectional survey Out-of-school suspension Setting: High school
Sample size: 19 726 pupils

Age: 15.9 years
Sex: 50% female
Ethnicity: 64% White American
Deprivation: 37.5% of schools provided FSM
Externalising symptoms;

social belonging, perceived equity
Higher Black-to-White suspension gaps (higher suspension for Black students) led to higher levels of adjustment problems (externalising symptoms) in black pupils (γ=0.77, p<.001) at one year post suspension
Cohen et al. (2020) 31
USA
Prospective follow up In-school and out-of-school suspension Setting: Middle school
Sample size: 788 pupils

Age: N/R
Sex: 50% female
Ethnicity: 74% African American
Deprivation: 75% FSM
Student-reported depression, and emotional dysregulation;
behaviour; concentration in class
Neither in school nor out of school suspension frequency affected self-reported depression on PhQ-9:
In school suspension effect: b=0.015; SE 0.103, standardized beta weight (95% CI) = 0.007 (−0.086, 0.100)
out of school suspension effect: b=0.211 SE 0.186, standardized beta weight (95% CI) = 0.043 (−0.032, 0.118)

The frequency of in- and out-of-school suspension predicted greater disruptive behaviour ( b = 0.119, p ≤ .001)) more concentration problems (b=0.118, 0.028), p ≤ .001).

Suspension not our outcome
Fazel et al. (2021) 33
UK
Cross-sectional survey Out-of-school suspension Setting: High school
Sample size: 1648 pupils

Age: N/R
Sex: 60% female
Ethnicity: N/R
Deprivation: N/R
Mental wellbeing; accessing mental health services No significant difference in wellbeing scores between those who were suspended ( n=93) or not ( n=1555).

25.8% of those suspended accessed mental health services compared to 14% who were not suspended.

Suspended pupils more likely to be male, identify as “aggressive and violent”, and have been recently bullied compared to non-suspended pupils.
Ford et al. (2018) 34
UK
Longitudinal survey Out-of-school suspension Setting: N/A
Sample size: 5326 pupils

Age: N/R
Sex: N/R
Ethnicity: N/R
Deprivation: N/R
Depressive symptoms; psychopathology At baseline, suspended pupils have 13.7 (95%CI: 10.8-17.4) times greater odds of having a psychiatric disorder compared to non-suspended. At follow up, odds were 5.5 times greater (95%CI: 3.6-8.4).

Suspended pupils, have poorer scores on the Strengths and Difficulties Questionnaire at follow up compared to non-suspended (OR: 6.8, 95%CI: 5.9-7.7) and higher odds of a new psychiatric disorder (OR: 7.1, 95%CI: 5.1-9.9).

Not our outcome- the effect of these covariates (subgroups should be on our outcomes not on exposure)
Gase et al. (2017) 35
USA
Cross-sectional survey Out-of-school suspension Setting: High school
Sample size: 33 572 pupils

Age: N/R
Sex: 50.2% female
Ethnicity: 75% Hispanic
Deprivation: 70% of schools provided FSM
Depressive symptoms or suicidal ideation; educational attainment; health behaviour Suspension rates not associated with depressive symptoms or suicidal ideation (OR: 0.39, 95% CI: 0.15-1.04)

Suspension rate was significantly associated with marijuana use (adjusted odds ratio 6.41, 95% CI 1.64, 25.07) but not tobacco use or alcohol use.
No significant effect on grade point average in multilinear regression: −0.04 (−0.60, 0.53), and after controlling for age, sex, ethnicity and SES: 0.02 (−0.57, 0.62).
Quin (2019) 37
Australia
Cross-sectional survey Out-of-school suspension Setting: High school
Sample size: 304 pupils

Age: 14.7 years
Sex: 45.4% female
Ethnicity: 44% Asian, 24% English Australian
Deprivation: 28.9% received Education Maintenance Allowance
Depressive symptoms; school belonging; behaviour 39% of suspended students had a borderline score on the Strengths and Difficulties Questionnaire compared to 19% of non-suspended students ( p<0.001).
Statistically significant relationship between the total difficulties scores and suspension: χ2(1) = 12.35, p < .001
Rose et al. (2017) 39
USA
Cross-sectional survey Out-of-school suspension Setting: High school
Sample size: 1170 pupils

Age: 15.0 years
Sex: 52% female
Ethnicity: 69.2% African American
Deprivation: 54.8% of families earned less than $32 000
Mental wellbeing (poor, content or positive);
educational attainment
Suspended pupils had 2.1 times greater odds of being in poor mental health group rather than positive mental health group ( p≤0.05). Similarly, they had 1.9 times greater odds of being held back a grade ( p≤0.05).

Findings on relationship between grades and suspension not reported.

No statistically significant effect of ethnicity when comparing the positive mental health group to the others. But males had higher odds (OR=1.865) of being in the troubled group, and pupils from higher-income families had lower odds of being in vulnerable group (OR=0.721)
Rushton et al. (2002) 40
USA
Longitudinal survey Out-of-school suspension Setting: High school
Sample size: 13 568 pupils

Age: 15.6 years
Sex: 49.7% female
Ethnicity: 68% White American
Deprivation: 11.5% received public assistance
Depressive symptoms Suspended pupils had 1.9 (95%CI: 1.3-2.7) times greater odds of having depressive symptoms compared to non-suspended pupils. Results adjusted for race, grade in school, socio-economic status, maternal educational status, and single-parent household.
Smokowski et al. (2014) 41 USA Longitudinal survey Out-of-school suspension Setting: Middle school
Sample size: 4229 pupils

Age: 12.8 years
Sex: 52% female
Ethnicity: 28.4% American Indian, 26.7% White American, 23.3% African American
Deprivation: 85.8% FSM
Internalising symptoms; Self-esteem For every out-of-school suspension a pupil receives, their odds of internalised symptomology increased by 5% ( p≤0.05).

No association between out-of-school suspension and self-esteem.
Stanley et al. (2006) 42
USA
Cross-sectional survey Out-of-school suspension Setting: Middle school
Sample size: 23 pupils

Age: N/R
Sex: 35% female
Ethnicity: 69% Hispanic
Deprivation: 73% FSM
Adjustment problems,); Student academic resources (composite score of academic performance, academic habits, parent participation, social skills) Behavioural problems Suspension was significantly associated with greater adjustment problems scores ranging from 56 to 70 when normal scores are below 50

Suspension was also associated with significantly lower t scores on academic resources ranging from 26 to 36 which are below the norm (50 and above)
Verbal reprimand strategies
Piekarska (2000) 36
Poland
Prospective cross-sectional survey Verbal punishment induced school stress from teachers, inclusive of:
1) Threats
2) Mockery
3) Humiliation
4) Insulting
5) Verbal attack
6) Written or oral tests
Setting: Primary school in Poland (includes grade 1-8)

Sample size: 271 pupils

Age: 13-14 years
Sex: N/R
Ethnicity: N/R
Deprivation: N/R
Anxiety;

Educational attainment
School stress due to poor performance on sudden written and oral tests, reported by 77% and 53% of pupils respectively.

Significant association between school stress and anxiety (r = 0.30, p<0.001).
Significant association between school stress and educational attainment - grade point average (r = -0.29, p<0.001).
Roache et al. (2011) 38
Australia
Prospective cross-sectional survey Verbal punishments, inclusive of yelling in anger and embarrassing students deliberately
Compared to techniques using combination of rewards and punishments
Setting: High school
Sample size: 1975 pupils

Age: N/R
Sex: N/R
Ethnicity: N/R
Deprivation: N/R
General wellbeing;

School connectedness; Misbehaviour; Attitude and interest in subjects
No relationships reported between punishment-based or aggression-based classroom management and pupil wellbeing.

Significant relationships between aggressive classroom management techniques and pupil misbehaviour (r=0.48, p≤0.05), being distracted from work (r=0.72, p≤0.05), and pupil interest in the subject (r=-0.58, p≤0.05).
Mixed strategies
Chen et al. (2021) 30
USA
Prospective follow up Total punishment, inclusive of:
1) Corporal punishment
2) In-school and out-of-school suspension
3) Expulsion
4) Referral to law enforcement
5) School-related arrests
Setting: High school
Sample size: 261 pupils

Age: 11.2 years
Sex: 34.9% female
Ethnicity: 100% African American
Deprivation: 42.3% lived in relative poverty
Depressive symptoms; academic orientation; Educational attainment Attending a school that disproportionately punished Black students predicted more depressive symptoms at age 27 years β= 0.11 (95% CI: 0.04, 0.18).

Significant positive interaction between academic orientation and disproportionate school punishment β=0.12 (95% CI: 0.01, 0.24).

Disproportionate school punishment did not affect educational achievement at age 27 β=0.785 (95%CI:
1.466, 3.035) however, A positive main effect of academic orientation on adult educational attainment qualified by a significant interaction with disproportionate school punishment β= 0.11 (95% CI: 0.00, 0.23).
Eyllon et al. (2022) 32
USA
Longitudinal survey Severity of school disciplinary policies:
1) Lenient policies
2) In-school suspension
3) Out-of-school suspension
4) Expulsion
Assessed on a 7-point Likert scale to produce a mean score per school
Setting: High school
Sample size: 8878 pupils

Age: 15.7 years
Sex: 54% female
Ethnicity: 59% White American
Deprivation: 23% received public assistance
Depressive symptoms Significant association between mean disciplinary policy severity and depressive symptoms. A one-unit increase in mean discipline policy severity was associated with a 1.03 unit increase in depressive symptoms among non-excluded students (95% CI: 0.15, 1.91). Controlling for ethnicity did not modify the results.

CI- confidence intervals; FSM- free school meals

N/R- not reported

OR- Odds ratio

PHQ-9- Patient Health Questionnaire -9

SES- socioeconomic status

Risk of bias in included studies

Studies were mostly at high risk of bias across all domains (see Figure 2). Only one study 31 was considered at an overall moderate risk of bias. None were considered at a low risk of bias. For most studies there is risk of bias due to confounding. For cross-sectional studies and surveys the risk of reverse causality is a key problem, i.e., we can’t be sure whether poor mental health was the cause of 'bad behaviour' and thus the reprimand or suspension, rather than the consequence.

Figure 2. Risk of bias in included studies in the review.

Figure 2.

Effect of disciplinary strategies on pupil mental health and wellbeing outcomes

•    Depression

i.   School Suspension Strategies

Five studies 31, 34, 35, 37, 40 reported on depression due to suspension.

Odds of greater total difficulties (SDQ) were found to be significantly higher for those who were suspended in two studies 34, 37 . Rushton et al. 40 also found that being suspended from school was associated with increased odds of depressive symptomology. Two studies 31, 35 found self-reported depressive symptoms were not related to suspension.

ii.   Verbal reprimand strategies

None of the two studies assessing verbal punishment strategies reported on depression.

iii.   Mixed strategies

Two studies 30, 32 reported depression assessing two slightly different strategies that included suspensions and some other forms of punishments together. Both found that punishment-based policies led to more depressive symptoms, but at different time points.

Chen et al. 30 found that Black pupils attending a school that disproportionately punished Black students had greater depressive symptoms as an adult ten years later (β= 0.11,95% CI: 0.04, 0.18), compared to their White peers. Eyllon et al. 32 found strict (vs lenient) policies to increase depression in pupils so that each unit increase in school’s policy being strict led to a 1.03 unit rise in pupil depression scores on average (95% CI: 0.15, 1.91).

Impact on population subgroups

The two studies reporting data on ethnicity were not in agreement. While Chen et al. 30 found Black pupils to be disproportionately affected by disciplinary punishments and the consequent depression in later age, Eyllon et al. 32 found no link between ethnicity and higher depression due to strict school policies within one year.

•    Anxiety

No suspension or mixed strategy studies reported this outcome.

A single study set in Poland 36 found that higher school stress brought on by verbal reprimand strategies led to higher anxiety in pupils (R = 0.30, p <.001).

•    Psychiatric disorder

A single study 34 found children who had been suspended from school had higher odds of diagnosis of a new psychiatric disorder (OR 7.09; 95%CI 5.07 to 9.91; p < 0.001) compared to those not suspended.

No studies of verbal reprimand or mixed strategies reported this outcome.

•    General mental wellbeing

One study 33 assessing the effect of suspension found a non-significant (p=0.15) lower wellbeing (on Warwick Edinburgh Mental Wellbeing Scale) and significantly (p=0.003) greater use of mental health services for suspended children compared to pupils who have never been suspended. Another found children who were suspended were twice as likely to have poor mental health 39 .

A single study 38 assessing link between verbal disciplinary strategies and pupil mental wellbeing (on author developed scale) reported no outcome data.

No study on mixed strategies reported this outcome.

•    Internalising symptoms

One study on suspension 41 found that each additional suspension per school led to increase in internalising scores by 0.05%, while another 31 found that suspensions were not associated with internalising problems.

No verbal reprimand or mixed strategy studies reported this outcome.

•    Externalising symptoms

A single study found that in schools which suspended proportionally more Black pupils than White pupils, Black pupils overall showed higher externalising symptoms 29 .

No verbal reprimand or mixed strategy studies reported this outcome.

Effect of disciplinary strategies on pupil social and behavioural outcomes

i.   School Suspension Strategies

Three studies 31, 37, 42 found suspension was associated with poorer (more disruptive, less pro-social) behaviour.

Two studies found suspensions were associated with lower perception of social belonging at school 29, 37 .

School-level Black–White suspension gaps (i.e., excess risk of out-of-school suspension among Black students relative to White students,) were associated with Black students’ perceptions of less school equity in a single study 29 .

A single study 35 found suspensions led to greater marijuana use but had no association with tobacco or alcohol use. A single study 41 found no association between out-of-school suspension and self-esteem.

ii.   Verbal reprimand strategies

A single study (Roache) found that aggressive verbal punishments from teachers led to increased disruptive behaviour in the classroom (r=0.48, p<0.05), being more distracted from class work (r=0.72, p<0.05), and reduced pupil interest in the subject being taught (r=-0.58, p<0.05).

No studies in this category reported social outcomes.

iii.   Mixed strategies

      No studies of mixed strategies reported social outcomes.

Effect of disciplinary strategies on academic outcomes

  • i.

    School Suspension Strategies

Of the three studies assessing educational outcomes, one comprehensively reported data and 35 found no link between suspension and grade scores. This effect remained non-significant (although direction was opposite) after adjusting for demographic factors including ethnicity. One study 39 did not report data on the effect of suspension on grades, and the other 42 said they found lower scores on a composite of academic performance habits and skills but did not report data to support this finding.

  • ii.

    Verbal reprimand strategies

Piekarska et al. 36 found that verbal punishments from teachers caused school stress which negatively impacted academic performance as grade point average.

  • iii.

    Mixed strategies

While Chen et al. (2021) reported no direct effect of greater punishment on long-term educational attainment, they did find that for children who were not academically oriented, greater punishment was associated with lower educational attainment. This study included only Black American pupils.

Discussion

Summary of findings

Our review illustrates that evidence on the impact of disciplinary strategies in schools is scarce and of low quality. Although at high risk of bias, five out of seven studies assessing depressive symptomatology found it to be associated with exposure to disciplinary strategies. All three studies on general mental wellbeing found it to be associated with exposure to disciplinary strategies. Single studies on anxiety, psychiatric disorder diagnosis, and externalising symptoms also found that disciplinary strategies were associated with these issues. Internalising symptoms, and a similar link with externalising symptoms, were only seen in one of the two studies to be associated with a disciplinary approach. Similar effect was seen with social outcomes where, overall, disciplinary strategies were associated with poor social behaviour (n=4), lower school belonging (n=2), and greater marijuana use (n=1), but had no association with tobacco use or self-esteem (n=1). Evidence of the impact on educational attainment was limited and it was not clear how they were related to disciplinary strategies. A recent qualitative synthesis has found some evidence of a link between punitive disciplinary strategies and poor academic outcomes 45 .

Comparison to other systematic reviews

While there are reviews on suspensions and exclusions as outcomes 2, 46 , we did not find any that examine the mental health or wellbeing impact of these strategies. We found one systematic review reporting that pupils experiencing exclusionary discipline were more likely to have subsequent contact with the justice system 47 . To our knowledge, our systematic review is the first to question the impact of these strategies on mental wellbeing of school children. Considering the increasing levels of mental health problems in young people in the UK 48 it is important to assess these strategies for their potential impact on these outcomes which are important to pupils, their families and society.

Most of the evidence available was on suspensions. Suspensions have been rising in recent years in the UK, with the main reason for suspensions being disruptive behaviour 49 . Our review shows that suspensions can potentially increase disruptive behaviour, thus creating a vicious cycle of increase in both.

Although not the main focus of our review, we did see across three studies that children of Black, Asian, and Minority Ethnicities (BAME) origin were often at higher risk of disciplinary actions from teachers. This is in line with recent findings from both USA 50 and the UK 49 , indicating that the interaction of race and adverse childhood experiences predispose students of colour to be subject to school discipline. Future research should explore these links, and schools should consider these potential equality risks when implementing disciplinary strategies. Governments place importance on the safeguarding of all pupils’ wellbeing in their expectations from teachers 51, 52 . Our review suggests that currently approved strategies can negatively impact student wellbeing, which can make it hard for teachers to fulfil these expectations. This can be remedied by enabling teachers use of evidence-based interventions that can reliably support pupil wellbeing. There is growing evidence on trauma informed and restorative approaches for improving and managing disruptive behaviours in schools 53, 54 that are less likely to negatively impact pupil wellbeing.

Limitations of our review

We followed PRISMA standards when reporting the review and searched comprehensively using relevant scientific databases and grey literature sources. We were inclusive in our criteria for studies to allow us to examine the full range of effects of these commonly used strategies. Considering how widespread their use is, the empirical evidence on these strategies is limited for wellbeing, behaviour or academic outcomes. We found no studies from grey literature. Some of the databases we searched would have contained certain types of grey literature (e.g. conference abstracts, theses and dissertations). However, had we searched repositories of grey literature (e.g. OpenGrey or Overton (policy documents)), or the websites of international and regional education authorities, and government departments associated with our topic, we may have identified additional research published as monographs, reports, policy documents etc. It was difficult to translate our detailed search across to these grey literature sources, and we thought it more practical to talk to experts considering our limited resources.

Included studies were at high risk of bias in most domains. This is a major limitation of our findings. There is a need for better quality research to address these questions.

We searched for, and included studies that reported at least one primary (mental wellbeing) outcome. Our restriction to primary outcome reporting has likely overlooked evidence on educational and behavioural outcomes reported in studies without a focus on general mental wellbeing. Thus, our findings on these outcomes are likely not to be comprehensive, although they may be indicative of the general trend. This review included studies conducted only in mainstream schools and therefore the findings do not extend to other settings. However, when screening the literature, there were studies that focused on specialist schools or exclusively including pupils with additional learning needs (e.g., attention deficit hyperactivity disorder) and these should be assessed in a separate review.

We included all author definitions for strategies (e.g., suspension or temporary exclusion could be anything from a few hours to several days, and may or may not include supervised confinement to a room or location in school) to not miss any relevant evidence. There is however a lack of clear definitions and descriptions for any of the disciplinary strategies. Thus, there is a need to clearly define these interventions and their proposed impact before research on these can give clear conclusion on their relative impacts. For example, UK defines suspensions as any fixed time exclusion between one school period (length of a lesson varies from 30 minutes to 120 minutes) and 45 school days 49 . This definition may be different from those used in other nations. This would invariably also be reflected in studies from different countries. We would anticipate that the effect of a 45-minute isolation may be different from that of a week-long or month-long suspension. A differential or dose response effect may only be elicited if the definitions used in each study are clear.

Conclusions

Existing evidence indicates that disciplinary behaviour strategies might lead to poorer mental wellbeing and behaviours for pupils. There is some evidence to suggest these strategies may also inadvertently increase inequalities. However, the limitations of quality and size of the evidence precludes clear conclusions.

This means schools, and decision makers within educational systems, need to be cautious when adopting and advocating these strategies until better evidence on these is available. It would also be advantageous for schools to share data on disciplinary strategies and pupil health outcomes with research teams to facilitate a deeper level of exploration.

There is a need to assess wellbeing, social and academic effects of these disciplinary strategies (and other strategies) ideally in robustly designed trials comparing school clusters with different strategies in place. These trials (natural experiments) should be complemented with qualitative exploration of pupil perceptions of these strategies and their outcomes in various contexts. There are county-wide surveys and school-based surveys in the UK that routinely measure the health and wellbeing of pupils. These data could be compared to respective school level suspension rates and other disciplinary strategies (e.g., isolation/isolation rooms). As these wellbeing surveys are repeated annually, we should also be able to see trends of wellbeing over time, as well as the potential impacts of changing national or regional disciplinary policies on these outcomes at school level. Follow up data should also be gathered beyond the school period (into adulthood) as disciplinary strategies may have long term consequences 30, 47 .

Disciplinary strategies aimed at improving behaviour at school may have negative effects on the pupil mental wellbeing as well as school behaviour. These are important consequences and should be assessed in better designed studies before these strategies can be recommended.

Acknowledgements

We want to thank members of Young People’s Advisory Group and Off The Record who helped us develop and refine the review question and acknowledge the Create to Collaborate funding for workshops that helped in the development of project. We also want to thank Professor Esther Crawley for her support and guidance in setting up the project.

Funding Statement

This research was funded by the National Institute for Health and Care Research Applied Research Collaboration West (NIHR ARC West) (NIHR200181). The views expressed in this article are those of the author(s) and not necessarily those of the NIHR or the Department of Health and Social Care.

The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

[version 2; peer review: 2 approved]

Data availability

Underlying data

The underlying data for this article consists of bibliographic references, which are included in the References section.

Extended data

Open Science Framework: Behaviour management in schools review

https://doi.org/10.17605/OSF.IO/AJHGR 25

This project contains the following extended data:

  • Supplementary data file- BMS review.docx

  • PRISMA Flow Diagram

  • PRISMA checklist

Reporting guidelines

PRISMA checklist and flowchart for ‘Disciplinary behaviour management strategies in schools and their impact on student psychosocial outcomes: A systematic review’. https://doi.org/10.17605/OSF.IO/AJHGR 25

References

  • 1. Egeberg HM, McConney A, Price A: Classroom management and national professional standards for teachers: a review of the literature on theory and practice. Aust J Teach Educ. 2016;41(7):1–18. 10.14221/ajte.2016v41n7.1 [DOI] [Google Scholar]
  • 2. Valdebenito S, Eisner M, Farrington DP, et al. : School-based interventions for reducing disciplinary school exclusion: a systematic review. Campbell Syst Rev. 2018;14(1): i-216. 10.4073/csr.2018.1 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3. UK Department of Education: Behaviour in schools - advice for headteachers and school staff.edited by Department of Education, UK: UK Department of Education,2022;35. Reference Source [Google Scholar]
  • 4. Attendance and exclusions statistics team: Suspensions and permanent exclusions in England spring term 2022/23.edited by Department for Education (DfE): Department for Education (DfE),2024. Reference Source
  • 5. Department for Children Schools and Families: Internal exclusion guidance.edited by Department for Children Schools and Families, 4: DCSF Publications,2010. Reference Source
  • 6. Hendry R: Building and restoring respectful relationships in schools: a guide to using restorative practice.1st ed. London: Routledge,2009;176. 10.4324/9780203834633 [DOI] [Google Scholar]
  • 7. Alexander J, Nelson JA, Wines LA: Building trauma-sensitive schools.Brookes Publishing,2019. [Google Scholar]
  • 8. Think:Kids, Massachusetts General Hospital: Collaborative Problem Solving ® (Cps).Massachusetts General Hospital, (accessed 17/02/2023). Reference Source
  • 9. Centre on PBIS: "What Is Pbis?" Centre on PBIS.(accessed 17/02). Reference Source
  • 10. Riley P: Attachment theory and the teacher-student relationship: a practical guide for teachers, teacher educators and school leaders.1st ed. London: Routledge,2010;188. 10.4324/9780203845783 [DOI] [Google Scholar]
  • 11. Oxley L, Holden GW: Three positive approaches to school discipline: are they compatible with social justice principles? Educational and Child Psychology. 2021;38(2):71–81. Reference Source [Google Scholar]
  • 12. Moore D, Benham-Clarke S, Kenchington R, et al. : Improving behaviour in schools: evidence review. 2019. Reference Source
  • 13. Oxley L: Alternative approaches to behaviour management in schools: diverging from a focus on punishment.PhD University of York, York,2021. Reference Source
  • 14. Lee A, Gage NA: Updating and expanding systematic reviews and meta-analyses on the effects of school-wide positive behavior interventions and supports.2020;57(5):783–804. 10.1002/pits.22336 [DOI] [Google Scholar]
  • 15. LiCalsi C, Osher D, Bailey P: An empirical examination of the effects of suspension and suspension severity on behavioral and academic outcomes.Arlington, VA American Institutes for Research,2021. Reference Source
  • 16. American Psychological Association Zero Tolerance Task Force: Are zero tolerance policies effective in the schools?: An evidentiary review and recommendations. Am Psychol. 2008;63(9):852–62. 10.1037/0003-066X.63.9.852 [DOI] [PubMed] [Google Scholar]
  • 17. Bell C, Puckett T: I want to learn but they won’t let me: exploring the impact of school discipline on academic achievement. Urban Educ. 2020;58(10): 0042085920968629. 10.1177/0042085920968629 [DOI] [Google Scholar]
  • 18. Skiba RJ, Knesting K: Zero tolerance, zero evidence: an analysis of school disciplinary practice. New Dir Youth Dev. 2001;92:17–43. 10.1002/yd.23320019204 [DOI] [PubMed] [Google Scholar]
  • 19. Wolf KC, Kupchik A: School suspensions and adverse experiences in adulthood. Justice Q. 2017;34(3):407–30. 10.1080/07418825.2016.1168475 [DOI] [Google Scholar]
  • 20. Madia JE, Obsuth I, Thompson I, et al. : Long-term labour market and economic consequences of school exclusions in England: evidence from two counterfactual approaches. Br J Educ Psychol. 2022;92(3):801–16. 10.1111/bjep.12487 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21. Peytrignet S, Marszalek K, Grimm F, et al. : Children and young people’s mental health Covid-19 and the road ahead.In: News and Comment.UK: The Health Foundation,2022. Reference Source [Google Scholar]
  • 22. NIHR ARC West: How does school discipline affect pupil mental health and wellbeing?NIHR ARC West, (accessed 27/01/23). Reference Source
  • 23. Nobles J, Mamluk LD, Sarah SI, et al. : Disciplinary behaviour management strategies in schools and their impact on psychosocial qutcomes in pupils aged 11–16 years old: a systematic review.In: PROSPERO: CRD York,2021. [Google Scholar]
  • 24. NIHR ARC West: Create to collaborate: can we make working relationships between researchers and the public more open and engaging?NIHR ARC West, (accessed 07/02/2023). Reference Source
  • 25. Ijaz S, Nobles J, Mamluk L, et al. : Behaviour management in schools review.In: Open Science Framework.Center for Open Science,2024. 10.17605/OSF.IO/AJHGR [DOI] [Google Scholar]
  • 26. Children and young people’s mental health coalition. cypmhc.org.uk(accessed 07/03/2023). Reference Source
  • 27. Ouzzani M, Hammady H, Fedorowicz Z, et al. : Rayyan—a web and mobile app for systematic reviews. Syst Rev. 2016;5(1): 210. 10.1186/s13643-016-0384-4 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28. Effective Practice and Organisation of Care Review Group: Suggested risk of bias criteria for epoc reviews.In: EPOC Resources for Review Authors. Oslo: Norwegian Knowledge Centre for the Health Services,2015. Reference Source
  • 29. Bottiani JH, Bradshaw CP, Mendelson T: A Multilevel examination of racial disparities in high school discipline: black and white adolescents’ perceived equity, school belonging, and adjustment problems. J Educ Psychol. 2017;109(4):532–45. 10.1037/edu0000155 [DOI] [Google Scholar]
  • 30. Chen E, Brody GH, Yu T, et al. : Disproportionate school punishment and significant life outcomes: a prospective analysis of black youths. Psychol Sci. 2021;32(9):1375–90. 10.1177/0956797621998308 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 31. Cohen DR, Lewis C, Eddy CL, et al. : In-School and out-of-school suspension: behavioral and psychological outcomes in a predominately black sample of middle school students. J Sch Psychol Rev. 2023;52(1):14. 10.1080/2372966X.2020.1856628 [DOI] [Google Scholar]
  • 32. Eyllon M, Salhi C, Griffith JL, et al. : Exclusionary school discipline policies and mental health in a national sample of adolescents without histories of suspension or expulsion. J Youth Soc. 2022;54(1):20. 10.1177/0044118X20959591 [DOI] [Google Scholar]
  • 33. Fazel M, Newby D: Mental well-being and school exclusion: changing the discourse from vulnerability to acceptance. Emot Behav Diffic. 2021;26(1):78–86. 10.1080/13632752.2021.1898767 [DOI] [Google Scholar]
  • 34. Ford T, Parker C, Salim J, et al. : The relationship between exclusion from school and mental health: a secondary analysis of the british child and adolescent mental health surveys 2004 and 2007. Psychol Med. 2018;48(4):629–41. 10.1017/S003329171700215X [DOI] [PubMed] [Google Scholar]
  • 35. Gase LN, Gomez LM, Kuo T, et al. : Relationships among student, staff, and administrative measures of school climate and student health and academic outcomes. J Sch Health. 2017;87(5):319–28. 10.1111/josh.12501 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 36. Piekarska A: School stress, teachers’ abusive behaviors, and children’s coping strategies. Child Abuse Negl. 2000;24(11):1443–9. 10.1016/s0145-2134(00)00201-5 [DOI] [PubMed] [Google Scholar]
  • 37. Quin D: Levels of problem behaviours and risk and protective factors in suspended and non-suspended students. Educ Develop Psychol. 2019;36(1):8–15. 10.1017/edp.2019.4 [DOI] [Google Scholar]
  • 38. Roache JE, Lewis R: The carrot, the stick, or the relationship: what are the effective disciplinary strategies? Eur J Teach Educ. 2011;34(2):233–48. 10.1080/02619768.2010.542586 [DOI] [Google Scholar]
  • 39. Rose T, Lindsey MA, Xiao Y, et al. : Mental health and educational experiences among black youth: a latent class analysis. J Youth Adolesc. 2017;46(11):2321–40. 10.1007/s10964-017-0723-3 [DOI] [PubMed] [Google Scholar]
  • 40. Rushton JL, Forcier M, Schectman RM: Epidemiology of depressive symptoms in the National Longitudinal Study of Adolescent Health. J Am Acad Child Adolesc Psychiatry. 2002;41(2):199–205. 10.1097/00004583-200202000-00014 [DOI] [PubMed] [Google Scholar]
  • 41. Smokowski PR, Guo S, Rose R, et al. : Multilevel risk factors and developmental assets for internalizing symptoms and self-esteem in disadvantaged adolescents: modeling longitudinal trajectories from the rural adaptation project. Dev Psychopathol. 2014;26(4 Pt 2):1495–513. 10.1017/S0954579414001163 [DOI] [PubMed] [Google Scholar]
  • 42. Stanley MJ, Canham DL, Cureton VY: Assessing prevalence of emotional and behavioral problems in suspended middle school students. J Sch Nurs. 2006;22(1):40–7. 10.1177/10598405060220010701 [DOI] [PubMed] [Google Scholar]
  • 43. Pyne J: Suspended attitudes: exclusion and emotional disengagement from school. Sociol Educ. 2019;92(1):59–82. 10.1177/0038040718816684 [DOI] [Google Scholar]
  • 44. Levesque RJR: Externalizing and internalizing symptoms. In: Encyclopedia of Adolescence. edited by Roger J. R. Levesque, New York, NY: Springer New York,2011;903–905. 10.1007/978-1-4419-1695-2_539 [DOI] [Google Scholar]
  • 45. Duarte CD, Moses C, Brown M, et al. : Punitive school discipline as a mechanism of structural marginalization with implications for health inequity: a systematic review of quantitative studies in the health and social sciences literature. Ann N Y Acad Sci. 2023;1519(1):129–52. 10.1111/nyas.14922 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 46. Cruz RA, Allison R, Rodl JE: Disproportionality reduction in exclusionary school discipline: a best-evidence synthesis. Rev Educ Res. 2021;91(3):397–431. 10.3102/0034654321995255 [DOI] [Google Scholar]
  • 47. Novak A: The Association between Experiences of Exclusionary Discipline and Justice System Contact: A Systematic Review. Aggress Violent Behav. 2018;40:73–82. 10.1016/j.avb.2018.04.002 [DOI] [Google Scholar]
  • 48. NHS Digital, Lifestyles Team: Mental health of children and young people in England 2021 - wave 2 follow up to the 2017 survey. edited by Health and Social Care Information Centre. Surrey, UK: NHS Digital, part of the Government Statistical Service,2021. Reference Source
  • 49. UK Government: Autumn term 2021/22 permanent exclusions and suspensions in England. In: Education Statistics and data. UK Government,2022. Reference Source
  • 50. Joseph-McCatty AA, Sanders JE, Massey M, et al. : Tracking the early stages of the disciplinary gaze among students experiencing childhood adversities. J Ethn Cult Divers Soc Work. 2023;32(6):328–339. 10.1080/15313204.2022.2027314 [DOI] [Google Scholar]
  • 51. US Department of Education: Supporting child and student social, emotional, behavioral, and mental health needs. edited by Education. Washington DC: US department of Education,2021. Reference Source [Google Scholar]
  • 52. UK Department for Education: Teachers' standards. edited by Department for Education. UK: Department for Education,2011. Reference Source [Google Scholar]
  • 53. Avery JC, Morris H, Galvin E, et al. : Systematic review of school-wide trauma-informed approaches. J Child Adolesc Trauma. 2021;14(3):381–97. 10.1007/s40653-020-00321-1 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 54. Lodi E, Perrella L, Lepri GL, et al. : Use of restorative justice and restorative practices at school: a systematic literature review. Int J Environ Res Public Health. 2021;19(1): 96. 10.3390/ijerph19010096 [DOI] [PMC free article] [PubMed] [Google Scholar]
NIHR Open Res. 2024 Jul 15. doi: 10.3310/nihropenres.14788.r32270

Reviewer response for version 2

Nicholas A Gage 1

The authors have addressed my concerns.

Are the rationale for, and objectives of, the Systematic Review clearly stated?

Yes

Is the statistical analysis and its interpretation appropriate?

Partly

Are sufficient details of the methods and analysis provided to allow replication by others?

Partly

Are the conclusions drawn adequately supported by the results presented in the review?

Yes

Reviewer Expertise:

systematic review, meta-analysis, and quantitate methods

I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard.

NIHR Open Res. 2024 Apr 29. doi: 10.3310/nihropenres.14722.r31420

Reviewer response for version 1

Erica Gadsby 1

This is a systematic review of disciplinary behaviour management strategies and their impact on student psychosocial outcomes. This is an area that is under-researched and of significant importance given the state of young people's mental health in the UK.

The authors present a sound rationale, responding to the limited evidence on the intended impact, and concerns regarding unintended impact. 

Researchers singled out psychosocial outcomes as a focus and conducted a systematic review to examine the impact of behaviour management on these outcomes.

The question, in lay English was: How does school discipline affect pupil mental health and wellbeing?

The introduction provided a good explanation of punitive approaches to school discipline, and alternative approaches (e.g. trauma informed, restorative, collaborative problem solving, etc.).

The concern, that disciplinary strategies in school could be negatively impacting pupils' mental health, was raised in by young people within a consultation meeting in Bristol.

Methods: The review was developed with input from young people - this involvement is described briefly in the public involvement section. It would be good to know whether this involvement was evaluated at all. The review had two secondary objectives: to assess whether the potential negative effects differed between different SES groups, and to see whether there was any evidence of the strategies positively impacting behaviour or academic outcomes.

The focus are disciplinary measures of most concern was guided by young people - punitive measures, stopping short of permanent exclusion or expulsion. The review was limited to UK and OECD countries - justification that this does not include corporal punishment or other forms of restraint, which is reasonable. The population was young people aged 11 to 16, and the context mainstream school (not specialist schools). 

Primary outcomes - any measures of mental health and wellbeing. 

Secondary outcomes - academic and social outcomes.

The search involved an information specialist and is well described. Grey literature was sought through targeted emails (via a network) - given none was found, it would be useful to reflect on whether the authors might have missed any grey literature that they might have found via another strategy? The process and conduct of the systematic review was as according to best practice. A narrative synthesis of the findings was the only thing possible, given the quality and type of data.

In the description of included studies, the numbers don't add up. The paper states there are 14 studies in total: 10 from US, 2 from Australia and the UK (it's 2 from each, but this isn't very clear from the text), and 1 from Poland. That makes 15. I counted 9 from USA in table 1. What was the 10th?

The study from Poland was in a primary school setting and the age of pupils is stated as 'not reported'. I'm wondering how this study fits the inclusion criteria?

Discussion

Evidence on the effects of school disciplinary strategies is scarce and of low quality. 

There are caveats associated with the low quality evidence, but findings suggest a link between punitive disciplinary strategies and pupil mental health and wellbeing, and also social outcomes (social behaviour).

Evidence of impact on educational attainment is limited (though that wasn't the focus of this review I guess? - have other reviews looked at this?).

I found it a bit disappointing that the discussion didn't go into alternative disciplinary measures at all. The section ends: This can be remedied by enabling teachers use of evidence-based interventions that can reliably support pupil wellbeing. This could have usefully been followed up with a short discussion of what this might include.

Are the rationale for, and objectives of, the Systematic Review clearly stated?

Yes

Is the statistical analysis and its interpretation appropriate?

Not applicable

Are sufficient details of the methods and analysis provided to allow replication by others?

Yes

Are the conclusions drawn adequately supported by the results presented in the review?

Yes

Reviewer Expertise:

Health services and public health research focusing on social determinants of health

I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard.

NIHR Open Res. 2024 May 10.
Sharea Ijaz 1

Thank you for your generous comments on and appreciation of our work. We have listed the queries in your review below and have responded to each.

  • The review was developed with input from young people - this involvement is described briefly in the public involvement section. It would be good to know whether this involvement was evaluated at all.

The PPI for this project was not itself evaluated.  However, some of the young PPI members have remained involved as stakeholders throughout the project and we presented our findings to them before finalizing this paper. Some of the young PPI members also became peer interviewers for the second part of the project, which is a qualitative study of pupil experience, and their experience as peer interviewers was evaluated qualitatively and this second part is currently being drafted as another paper: https://arc-w.nihr.ac.uk/research/projects/how-does-school-discipline-affect-pupil-mental-health-and-wellbeing/

  • Grey literature was sought through targeted emails (via a network) - given none was found, it would be useful to reflect on whether the authors might have missed any grey literature that they might have found via another strategy? The process and conduct of the systematic review was as according to best practice. A narrative synthesis of the findings was the only thing possible, given the quality and type of data.

We used a pragmatic approach to find relevant literature in a field that has limited evidence.

We have added the below text to acknowledge the limitation of our grey search:

We found no studies from grey literature. Some of the databases we searched would have contained certain types of grey literature (e.g. conference abstracts, theses and dissertations). However, had we searched repositories of grey literature (e.g. OpenGrey or Overton (policy documents)), or the websites of international and regional education authorities, and government departments associated with our topic, we may have identified additional research published as monographs, reports, policy documents etc. It was difficult to translate our detailed search across to these grey literature sources, and we thought it more practical to talk to experts considering our limited resources.

  • In the description of included studies, the numbers don't add up. The paper states there are 14 studies in total: 10 from US, 2 from Australia and the UK (it's 2 from each, but this isn't very clear from the text), and 1 from Poland. That makes 15. I counted 9 from USA in table 1. What was the 10th?

Thank you for spotting this. We are sorry for the error and have now corrected it: 9 studies from USA, 2 each from UK and Australia and 1 from Poland, equalling 14 in total.

  • The study from Poland was in a primary school setting and the age of pupils is stated as 'not reported'. I'm wondering how this study fits the inclusion criteria?

This was an oversight from us. Thanks for pointing this out. “Primary school” in Poland lasts eight years (grades 1–8,  starting at age 6 or 7 and lasting until 14-15). This overlaps with primary and secondary school age in the UK. This specific study included 13–14-year-old students, which is compatible with secondary school age in the UK. We have now corrected and clarified this in the table.

  • Evidence of impact on educational attainment is limited (though that wasn't the focus of this review I guess? - have other reviews looked at this?).

You are correct that this was a secondary outcome and not a focus of our review. In addition, the included study evidence was of very limited size and quality, so we did not expand on this.

Within our search we found two reviews on educational attainment outcome although they did not study our interventions of interest:

  1. Craggs H, Kelly C. Adolescents' experiences of school belonging: A qualitative meta-synthesis. Journal of Youth Studies. 2018;21(10):1411-25.  https://www.tandfonline.com/doi/full/10.1080/13676261.2018.1477125

  2. Lee A, Gage NA. Updating and expanding systematic reviews and meta-analyses on the effects of school-wide positive behavior interventions and supports. Psychology in the Schools. 2020;57(5):783-804. https://onlinelibrary.wiley.com/doi/abs/10.1002/pits.22336

We found the following review outside of our search that included some evidence of link between academic outcomes and punitive disciplinary strategies:

Duarte CD, Moses C, Brown M, Kajeepeta S, Prins SJ, Scott J, Mujahid MS. Punitive school discipline as a mechanism of structural marginalization with implications for health inequity: A systematic review of quantitative studies in the health and social sciences literature. Ann N Y Acad Sci. 2023 Jan;1519(1):129-152. doi: 10.1111/nyas.14922. PMID: 36385456; https://pubmed.ncbi.nlm.nih.gov/36385456/

We have now added a sentence to expand on the evidence in reference to this review.

 

  • I found it a bit disappointing that the discussion didn't go into alternative disciplinary measures at all. The section ends: This can be remedied by enabling teachers use of evidence-based interventions that can reliably support pupil wellbeing. This could have usefully been followed up with a short discussion of what this might include.

We have now added a sentence to indicate what these alternative strategies may be and that these can be useful:

There is growing evidence on trauma informed and restorative approaches for improving and managing disruptive behavior's in schools[52, 53] that are less likely to negatively impact pupil wellbeing.

NIHR Open Res. 2024 Apr 25. doi: 10.3310/nihropenres.14722.r31518

Reviewer response for version 1

Nicholas A Gage 1

Thank you for the opportunity to review, Disciplinary behavior management strategies in schools and their impact on student psychosocial outcomes: A systematic review. This systematic review provides insights about the limited research and support for punitive disciplinary approaches in school. Overall, the manuscript is clearly written and the OSF materials provide more detail about the review. That being said, I do have a few concerns. First,

at the start of the methods section, the authors note that they focus on secondary schools. There is no mention of secondary schools in the introduction/literature review. Consider noting differences between elementary and secondary school and discipline to justify why the study focuses on secondary schools. Second, there is not enough information or justification for why a meta-analysis was not conducted. I understand that a number of outcome domains have only one study, but as an example, there are five studies focused on suspensions and depression that could be meta-analyzed. In fact, a quantitative synthesis would be very helpful to better understand the results. Essentially, if the authors want to not provide a meta-analysis, a stronger rationale needs to be provided in the manuscript. Lastly, I found the exclusion reasons in the PRISMA figure to be lacking specificity. Consider revising with clearer language and reasons.

Are the rationale for, and objectives of, the Systematic Review clearly stated?

Yes

Is the statistical analysis and its interpretation appropriate?

Partly

Are sufficient details of the methods and analysis provided to allow replication by others?

Partly

Are the conclusions drawn adequately supported by the results presented in the review?

Yes

Reviewer Expertise:

more justification for only including secondary schools and not doing a meta-analysis are needed.

I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard, however I have significant reservations, as outlined above.

NIHR Open Res. 2024 May 10.
Sharea Ijaz 1

Thank you for the opportunity to review, Disciplinary behavior management strategies in schools and their impact on student psychosocial outcomes: A systematic review. This systematic review provides insights about the limited research and support for punitive disciplinary approaches in school. Overall, the manuscript is clearly written and the OSF materials provide more detail about the review. That being said, I do have a few concerns.

Thank you for your feedback. We have made changes based on your comments and hope these are satisfactory

  • First, at the start of the methods section, the authors note that they focus on secondary schools. There is no mention of secondary schools in the introduction/literature review. Consider noting differences between elementary and secondary school and discipline to justify why the study focuses on secondary schools.

We welcome your observation and have edited the introduction section to reflect the focus on secondary schools as follows:

End of para 1: These punitive approaches are commonplace in the western world [2, 3] and are more common in secondary schools in UK [4,5]

Para 4: This concern about the potential negative mental health impact on pupils was voiced by secondary school age young people in a public consultation meeting in Bristol (England) when collaboratively identifying research priorities.

Para 5: This review was then developed with input from these young people to investigate the existing evidence on the effects of punitive behaviour management strategies on mental health and wellbeing in secondary school age children and young people [22].

 

  • Second, there is not enough information or justification for why a meta-analysis was not conducted. I understand that a number of outcome domains have only one study, but as an example, there are five studies focused on suspensions and depression that could be meta-analyzed. In fact, a quantitative synthesis would be very helpful to better understand the results.

Essentially, if the authors want to not provide a meta-analysis, a stronger rationale needs to be provided in the manuscript.

A meta-analysis was not conducted for the outcome of depression for suspensions as the 5 studies were very heterogeneous in not just populations (one study with 75% Black pupils, one study’s data from 1996), follow up times (no follow up in two studies, 1 year in two and 3 year in one study), outcome measures (dichotomous in 3 studies, continuous in 2) effect measures (odds ratios in 3 and regression coefficients in 2), comparisons (unspecified in three studies) but also study designs (one-time survey in two studies, repeated survey in two studies, and one controlled before-after study) and analyses (adjustment for confounders and numbers of analysed participants unclear in 3 studies).

We found the same for mixed strategies for depression outcome where the two studies (Chen 2021; Eyllon 2022) were very heterogeneous in study sample, follow up, and effect size.  

We believe that pooling these disparate data from high risk of bias studies would not have changed our conclusions and recommendations but presented as a forest plot may give a false sense of validity to reader.

We have now edited the text to explain our choice in our synthesis methods:

We planned for a random effects meta-analysis if combinable data were available. However, a meta-analysis was not conducted as the studies were highly heterogeneous across populations, comparisons, follow up times, outcome measures, effect measures, and notably, study designs. The analyses presented were often unadjusted with numbers of analysed participants unclear. A narrative synthesis was therefore performed. Pooling these disparate data from high risk of bias studies in a meta-analysis would not have changed our conclusions and recommendations.

  • Lastly, I found the exclusion reasons in the PRISMA figure to be lacking specificity. Consider revising with clearer language and reasons.

We had carried out screening of title/abstract and full texts in Rayyan and used these inbuilt labels in the platform to exclude and include studies. We have now revised the description in PRISMA to be more specific about the reasons.

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Data Availability Statement

    Underlying data

    The underlying data for this article consists of bibliographic references, which are included in the References section.

    Extended data

    Open Science Framework: Behaviour management in schools review

    https://doi.org/10.17605/OSF.IO/AJHGR 25

    This project contains the following extended data:

    • Supplementary data file- BMS review.docx

    • PRISMA Flow Diagram

    • PRISMA checklist

    Reporting guidelines

    PRISMA checklist and flowchart for ‘Disciplinary behaviour management strategies in schools and their impact on student psychosocial outcomes: A systematic review’. https://doi.org/10.17605/OSF.IO/AJHGR 25


    Articles from NIHR Open Research are provided here courtesy of Department of Health and Social Care (UK)

    RESOURCES