Table 2.
Validity of written survey items
| Category | Label | Written survey source | Response levels | Sample | Percentage agreement | Kappa | 95% lower CI | 95% upper CI | Validity assessment |
|---|---|---|---|---|---|---|---|---|---|
|
Physical activity |
|
||||||||
| Free play |
How much of the daily operating time, do 3 to 5 year old children have for child-initiated free playb |
Room Leader |
2 (<4.5 hrs/> = 4.5 hrs) |
40 |
63% |
0.25 |
−0.05 |
0.55 |
Fair |
| |
For how much of the child-initiated, free play time can children be physically activeb |
Room Leader |
2 (<2.5 hrs/> = 2.5 hrs) |
40 |
55% |
0.1a |
−0.21 |
0.41 |
Slight |
| |
Average proportion of children active during free play time |
Room Leader |
2 (<=75%/>75%) |
38 |
66% |
0.32a |
0.01 |
0.62 |
Fair |
| Small screen recreation |
Were computers or tablets used by children aged 3 to 5 |
Room Leader |
2 (yes/no) |
35 |
77% |
0.54a |
0.26 |
0.83 |
Moderate |
| |
Were television (TV), videos and DVDs, including educational programs and videos, viewed by children aged 3 to 5 |
Room Leader |
2 (yes/no) |
36 |
94% |
0.89a |
0.74 |
1.04 |
Almost Perfect |
| |
Purpose for watching TV/videos |
Nominated Supervisor |
2 (active vs not active) |
12 |
58% |
0.17a |
−0.42 |
0.75 |
Slight |
| Structured educator led physical activity |
Did educators in the 3–5 room provide structured, educator-led physical activity |
Room Leader |
2 (yes/no) |
35 |
94% |
0.89a |
0.73 |
1.04 |
Almost Perfect |
| |
How much time spent in structured educator led physical activityb |
Room Leader |
2 (<30 min/> = 30 min) |
37 |
54% |
0.08a |
−0.24 |
0.41 |
Slight |
| |
Average proportion of children active during structured, educator led physical activityb |
Room Leader |
2 (<90%/> = 90%) |
23 |
52% |
0.04a |
−0.37 |
0.46 |
Slight |
| Structured educator led Fundamental Movement Skills (FMS) |
Did educators in this room lead structured activity to develop FMS |
Room Leader |
2 (yes/no) |
34 |
53% |
0.06a |
−0.28 |
0.4 |
Slight |
| |
Average proportion of children active during structured, educator-led physical activity to develop FMSb |
Room Leader |
2 (<96%/> = 96%) |
10 |
60% |
0.2 |
−0.36 |
0.76 |
Slight |
|
Healthy eating |
|
|
|
|
|
|
|
|
|
| Child beverages |
Cordial available |
Room Leader |
2 (yes/no) |
36 |
100% |
1a |
1 |
1 |
Almost Perfect |
| |
Flavoured milk available |
Room Leader |
2 (yes/no) |
36 |
100% |
1a |
1 |
1 |
Almost Perfect |
| |
Fruit juice available |
Room Leader |
2 (yes/no) |
36 |
100% |
1a |
1 |
1 |
Almost Perfect |
| |
Only water and/or plain milk available |
Room Leader |
2 (yes/no) |
33 |
100% |
1a |
1 |
1 |
Almost Perfect |
| |
Plain milk available |
Room Leader |
2 (yes/no) |
36 |
94% |
0.88 |
0.73 |
1 |
Almost Perfect |
| |
Type of milk served to children |
Nominated Supervisor |
2 (regular vs reduced fat) |
14 |
79% |
0.57a |
0.13 |
1.02 |
Moderate |
| |
Soft drink available |
Room Leader |
2 (yes/no) |
36 |
100% |
1a |
1 |
1 |
Almost Perfect |
| |
Water available |
Room Leader |
2 (yes/no) |
36 |
89% |
0.78a |
0.57 |
0.99 |
Substantial |
| Child food |
Only Healthy Foods offered |
Nominated Supervisor |
2 (yes/no) |
11 |
73% |
0.45 |
-.10 |
1.01 |
Moderate |
| |
Confectionary, chocolate, ice cream |
Nominated Supervisor |
2 (yes/no) |
14 |
86% |
0.71 |
0.33 |
1.09 |
Substantial |
| |
Fruit or vegetable pieces, salad or platters |
Nominated Supervisor |
2 (yes/no) |
14 |
93% |
0.86 |
0.58 |
1.14 |
Almost Perfect |
| |
Pretzels, plain popcorn or oven-baked chips (not oiled) |
Nominated Supervisor |
2 (yes/no) |
14 |
100% |
1 |
1 |
1 |
Almost Perfect |
| |
Sweet biscuits with chocolate or cream filling |
Nominated Supervisor |
2 (yes/no) |
14 |
100% |
1 |
1 |
1 |
Almost Perfect |
| |
No foods |
Nominated Supervisor |
2 (yes/no) |
14 |
86% |
0.71 |
0.33 |
1.09 |
Substantial |
| Lunchbox monitoring |
Do educators monitor lunchboxes? |
Room Leader |
2 (yes/no) |
32 |
84% |
0.69a |
0.43 |
0.94 |
Substantial |
| |
Do educators monitor lunchboxes and provide feedback to families? |
Room Leader |
2 (yes/no) |
25 |
68% |
0.34 |
−0.03 |
0.71 |
Fair |
| |
Did parents provide any foods that weren’t compliant with guidelines |
Room Leader |
2 (yes/no) |
21 |
86% |
0.71a |
0.41 |
1.02 |
Substantial |
|
Role modelling |
|
|
|
|
|
|
|
|
|
| Food & drink |
Did staff members consume fruit in front of children |
Room Leader |
2 (yes/no) |
41 |
88% |
0.76a |
0.55 |
0.96 |
Substantial |
| |
How many staff consumed fruit in front of children |
Room Leader |
2 (all vs fewer staff) |
40 |
68% |
0.35a |
0.06 |
0.64 |
Fair |
| |
Did staff members consume vegetables in front of children |
Room Leader |
2 (yes/no) |
41 |
49% |
−0.02a |
−0.33 |
0.29 |
Poor |
| |
How many staff consumed vegetables in front of children |
Room Leader |
2 (all vs some staff) |
41 |
88% |
0.76a |
0.55 |
0.96 |
Substantial |
| |
Did educators make positive comments about healthy foods |
Room Leader |
2 (yes/no) |
35 |
86% |
0.71a |
0.48 |
0.95 |
Substantial |
| |
Did staff consume sweets, salty or sugary snacks or drinks in front of children |
Room Leader |
2 (yes/no) |
35 |
94% |
0.89a |
0.73 |
1.04 |
Almost Perfect |
| Active free play |
Did educators from this room participate alongside children in active play |
Room Leader |
2 (yes/no) |
36 |
69% |
0.39a |
0.08 |
0.69 |
Fair |
| |
How many educators participated alongside children in active play |
Room Leader |
2 (all vs fewer staff) |
41 |
61% |
0.22a |
−0.08 |
0.52 |
Fair |
| |
How often did educators join in with children in active play |
Room Leader |
2 (Never or Sometimes vs often or always) |
40 |
38% |
−0.06 |
−0.28 |
0.16 |
Poor |
| |
Did educators provide verbal prompts to encourage child activity |
Room Leader |
2 (yes/no) |
35 |
80% |
0.6a |
0.33 |
0.87 |
Moderate |
| |
How many educators provided prompts to encourage child activity |
Room Leader |
2 (all vs fewer staff) |
34 |
62% |
0.24a |
−0.1 |
0.57 |
Fair |
|
Policy |
|
|
|
|
|
|
|
|
|
| |
Written small screen recreation policy |
Nominated Supervisor |
2 (yes/no) |
35 |
89% |
0.77 |
0.56 |
0.98 |
Substantial |
| |
Written physical activity policy |
Nominated Supervisor |
2 (yes/no) |
38 |
79% |
0.59 |
0.36 |
0.82 |
Moderate |
| |
Written nutrition policy |
Nominated Supervisor |
2 (yes/no) |
40 |
75% |
0.5a |
0.23 |
0.77 |
Moderate |
| Written nutritional guidelines for families | Nominated Supervisor | 2 (yes/no) | 35 | 54% | 0.09a | −0.25 | 0.42 | Slight | |
aPABAK is reported where positive agreement > =75% or < =25%.
bItem required continuous response.