Skip to main content
. 2018 Oct 5;2018(10):CD009927. doi: 10.1002/14651858.CD009927.pub2

Beets 2009.

Methods Study name: Positive Action (Hawaii)
Study design (e.g. RCT, cluster RCT): cluster RCT
Intervention arm(s): Positive Action intervention
Comparator arm (s): standard education (as usual)
Sample size calculation performed: not reported
Subgroups prespecified: yes
Subgroup analyses: yes, by gender (boys vs girls)
Start date: 2001‐2002
Duration of follow‐up: immediately post intervention only
Number of follow‐ups: 1
Follow‐up time points: immediately post intervention, at the end of grade 5
ICC (if reported): student violent behaviours (0.06), substance use (0.05), and sexual activity (0.28)
Participants Number of schools randomised: 20 overall (intervention: 10, control: 10)
Number of participants randomised (total and by arm): N/S
Age (range or mean (SD)) or grade at the start: N/S; range from 6 to 8 years at baseline
Gender: 50:50 among responders
Ethnicity: Hawaiian or part Hawaiian (26.1%), multiple ethnic backgrounds (22.6%), non‐Hispanic White (8.6%), African American (1.6%), American Indian (1.7%), other Pacific Islander (4.7%), Japanese (4.6%), other Asian (20.6%), other (7.8%), unknown (1.6%)
SES: not reported
Inclusion criteria: schools meeting criteria (1) 25% of students received free or reduced‐price lunch; (2) Hawaiian schools were in the lower 3 quartiles of SAT scores and (3) were located on Oahu, Maui, or Molokai; (4) public schools from kindergarten to fifth or sixth grade (i.e. not specialised schools); (5) annual school stability rate > 80%
Exclusion criteria: students who left the study schools during the study period
Interventions Randomisation before or after baseline survey: before
Duration of the intervention (excluding follow‐up): 4 to 5 years
Description of the intervention: programme is a school curriculum with school‐wide, family, and community components designed to improve behaviour, character, and academic performance. It involves children in kindergarten to 12th grade. The programme has a detailed curriculum with almost daily lessons and a school‐wide climate programme undertaken by the principal and a Positive Action co‐ordinator or committee, with family and community involvement components. Sequenced elementary school curriculum of 140 lessons per grade per academic year is delivered in 15‐ to 20‐minute periods. During the academic year of 35 weeks, total programme time is approximately 35 hours. Teachers delivered the intervention; teachers, administrators, and support staff attended training at the start of the academic year. Booster sessions of 30 to 50 minutes were provided for each school at least once over the academic year. Content of lessons was grouped over 6 units: self‐concept; mind and body positive action, social and emotional actions; getting along with others; being honest; and self‐improvement. Involved structured discussions and activities with teachers and structured or semi‐structured small group activities including games, role‐play, and skill practice between students
Brief description of the theoretical model: theory of self‐concept, consistent with theories of triadic influence (loosely stated)
Description of the comparator: students in the control group received their usual school curriculum
Outcomes Primary outcomes: substance use for alcohol, drugs, tobacco; violent behaviours (carrying a knife or razor to cause harm, threatening to cut or stab someone, cut or stabbed someone, carried a gun, shot someone); sexual activity (voluntary heterosexual sex)
Secondary outcomes: teacher reports of substance use and violent behaviours
Setting Country: USA; State: Hawaii (schools on 3 islands: Oahu, Maui, Molokai)
Setting: school
Focus: universal
Process measures Process data reported: not reported
Method (qualitative or quantitative): N/A
Description: N/A
Statistics Sample size: N = 1993; 86% (n = 1714) of children responded to the questionnaire at fifth grade; teachers reported on 1225 children. Intervention: 10 schools (n = 976 in analysis); control: 10 schools (n = 738 in analysis)
Unit of randomisation: school
Unit of analysis: individual
Method to promote equivalence between groups:
Stratification: eligible schools were stratified based on year 2000 school report card data by an index including percentage of students receiving free or reduced‐price school lunch, school size, % student stability, and student ethnic distribution. Additional characteristics of the school (i.e. student‐teacher ratios and expenditure/student) and characteristics of student populations (i.e. proportion of gifted, special education, and English as a second language students) were also used, as were indicators of student behavioural and school performance outcomes (i.e. disciplinary referrals, suspension rates, and standardised achievement scores)
Statistical models: 2‐level over‐dispersion random‐effects Poisson models; generalised linear latent and mixed models
Baseline differences adjustment: no significant differences on the index tests or teacher reports of negative student behaviour between intervention and control groups
Repeated measures methods in analysis: N/A; only baseline and 1 follow‐up reported
Notes Equity: descriptive data at follow‐up: ethnicity primarily Hawaiian or part Hawaiian (26.1%), multiple ethnic backgrounds (22.6%), non‐Hispanic White (8.6%), African American (1.6%), American Indian (1.7%), other Pacific Islander (4.7%), Japanese (4.6%), other Asian (20.6%), other (7.8%), and unknown (1.6%)
Funding National Institute on Drug Abuse (grants DA13474 and DA018760)
Randomisation method, e.g. block, stratification, computer: stratification of the 111 schools was based on an index, resulting in 19 strata with at least 3 similar schools in each; 1 intervention and 1 control school were then randomly assigned in each stratum
Clustering accounted for in sample size calculation (if relevant): not reported
Cluster randomisation methods to account for clustering in analysis: 2‐level random‐effects models (binary and Poisson) were implemented to account for the heirarchical nature of the study design and the clustering
Risk of bias
Bias Authors' judgement Support for judgement
Random sequence generation (selection bias) Unclear risk Not reported
Allocation concealment (selection bias) Unclear risk Not reported
Blinding of participants and personnel (performance bias) 
 All outcomes High risk Participants, children, teachers, and project staff not blinded to intervention allocation and receipt
Blinding of outcome assessment (detection bias) 
 All outcomes High risk Self‐reported outcome measures
Incomplete outcome data (attrition bias) 
 All outcomes Unclear risk Insufficient information provided
Selective reporting (reporting bias) Unclear risk No published protocol
Other bias Unclear risk Impact of addition of new students and loss of students from schools unclear