Skip to main content
. 2019 Jan 28;2019(1):CD011651. doi: 10.1002/14651858.CD011651.pub2

Cicutto 2013.

Methods Included as process evaluation and outcome evaluation
Intervention study design: cluster RCT
Setting: 170 primary/elementary schools from 5 public health units across Ontario, Canada
Period: not reported
Participants Eligible sample frame: 180 schools were eligible and 170 schools were randomised (85 in each arm). 2502 families were eligible and 1316 were enrolled
Randomised: 1316 participants were enrolled
Completed (intervention): 1172 completed the study; 144 children withdrew, representing an 11% withdrawal rate
Inclusion criteria: parental report of physician‐diagnosed asthma, use of asthma medications, asthma symptoms at least 3 times in the past year, enrolment in grades 1 through 5 at school, ability to speak English, no other chronic conditions that could mimic asthma
Exclusion criteria: not reported
Baseline characteristics
Age of children: 8 years old
Ethnicity: not reported
Socio‐economic status: 26.4% of children had a mother who did not have a high school diploma
Gender: the sample comprised 57.4% males; 58.4% of control children and 56.6% of intervention children were male
Asthma status: asthmatic only
Interventions School type: primary/elementary
Intervention description: Roaring Adventures of Puff
Control description: usual care/nothing
Theoretical framework: social cognitive theory
Intervention: workshops included goal setting and self‐monitoring, trigger identification, control and avoidance, basic pathophysiology, medication and proper inhaler use, symptom recognition and the asthma action plan, lifestyle and exercise, managing an asthma exacerbation, and showcasing learning with teachers and parents. The intervention used interactive techniques to educate the children. Make‐up sessions were available for those who missed a class
Intensity: children attended six 45‐minute sessions
Instructor: public health nurses
Parental engagement: difficulty in getting parents/guardians involved
Child satisfaction: not reported
Timing of intervention in school day: lunchtime
Outcomes Extractable outcomes collected for:
Asthma symptoms leading to emergency hospital visits
Parent‐reported absence from school
Days of restricted activity
Unplanned visit to hospital or GP due to asthma symptoms
Health‐related quality of life
Withdrawal
Core processes evaluated (child level): attrition
Notes Process evaluation category: stand‐alone and Integrated (2 papers)
Breadth and depth: breadth ‐ not depth
Voice of children given prominence: not featured
Funding source: Ontario Ministry of Health and Long Term Care
Risk of bias
Bias Authors' judgement Support for judgement
Random sequence generation (selection bias) Low risk Random sequence: of the 180 schools, 170 schools with the largest numbers of students with asthma were randomised to intervention or control groups through a computer‐generated table of random numbers
Allocation concealment (selection bias) Low risk Central allocation indicated: of the 180 schools, 170 schools with the largest numbers of students with asthma were randomised to intervention or control groups through a computer‐generated table of random numbers
Blinding of participants and personnel (performance bias) 
 All outcomes Unclear risk Not clear whether measures were taken and whether this would have influenced the outcome
Blinding of outcome assessment (detection bias) 
 All outcomes Low risk Study authors reported: "Data collectors were blinded to group assignment. A post survey of data collectors revealed that blinding was successful. Data collectors became unblinded to group assignment for 9% of participating families, which occurred during the data collection interviews with parents/guardians"
Incomplete outcome data (attrition bias) 
 All outcomes Unclear risk Attrition data were presented, although data were not disaggregated by treatment status
Selective reporting (reporting bias) Unclear risk Absence of clear numbers hinders interpretation of some data
Other bias Unclear risk Missingness ‐ high risk ‐ evidence of unexplained missing data in Table 2
Baseline imbalance ‐ low risk ‐ study authors reported: "Randomisation was successful in that comparison of baseline variables for the control and experimental groups suggested they were similar or balanced before the intervention"
Risk of contamination ‐ low ‐ unit of randomisation was at the school level, reducing the threat of contamination
Transparent and clearly stated aims Low risk Study aims were clearly stated
Explicit theories underpinning and/or literature review Low risk Intervention development was informed by social cognitive theory
Transparent and clearly stated methods and tools Low risk Tools and methods were clearly reported
Selective reporting Unclear risk Unclear how this was addressed
Harmful effects Unclear risk Study authors did report on low parental engagement; however they offered no explanation as to why all treatment schools did not adopt the policy
Population and sample described well Unclear risk Individual schools were not described sufficiently
Continuous evaluation Low risk Policy development was monitored early on; 2 sets of data were collected after baseline
Evaluation participation equity and sampling High risk Stakeholders were not directly involved
Design and methods overall approach Low risk Pre‐post assessment data were collected
Tools and methods of data collection reliable/credible Low risk Study authors used validated data collection tools
Tools and methods of data analysis reliable/credible Low risk Data analysis methods used were suitable for the data
Performance bias/neutrality/credibility/conformability Unclear risk Blinding was attempted but was not always successful
Reliability of findings and recommendations Low risk Clearly reported by study authors. Findings appear to be reliable
Transferability of findings Unclear risk Not explored
Overall risk of bias of process evaluation Low risk Important indicators, for example, design methods and continuous evaluation, were at low risk