Table 3.
Reliability frequencies by domain for WHO IYCD items for the 90 retained items and the 33 removed items.
| Domain of Development | Type of Reliability Assessed | Mean RAP *** | Kappa <0.6 |
Kappa >0.6 & <0.8 |
Kappa >0.8 |
AC1 <0.6 |
AC1 >0.6 & <0.8 |
AC1 >0.8 |
Total Number of Items |
|---|---|---|---|---|---|---|---|---|---|
| Number of items retained meeting the criteria | |||||||||
| Motor | Inter | 0.95 | 3 | 8 | 29 | 0 | 1 | 39 | 40 |
| Intra | 0.96 | 0 | 6 | 34 | 0 | 0 | 40 | ||
| Language and Cognitive | Inter | 0.89 | 5 | 7 | 18 | 2 | 8 | 20 | 30 |
| Intra | 0.94 | 0 | 7 | 23 | 0 | 0 | 30 | ||
| Socio-emotional | Inter | 0.78 | 11 | 8 | 1 | 6 | 9 | 5 | 20 |
| Intra | 0.84 | 5 | 12 | 3 | 0 | 10 | 10 | ||
| Total items | 90 | ||||||||
| Removed Items ** | |||||||||
| Motor | Inter | 0.96 | 1 | 2 | 3 | 0 | 0 | 6 | 6 |
| Intra | 0.96 | 2 | 0 | 4 | 0 | 0 | 6 | ||
| Language and Cognitive | Inter | 0.88 | 2 | 5 | 2 | 1 | 2 | 6 | 9 |
| Intra | 0.94 | 2 | 2 | 5 | 0 | 1 | 8 | ||
| Socio-emotional | Inter | 0.71 | 17 | 1 | 0 | 10 | 7 | 1 | 18 |
| Intra | 0.79 | 6 | 12 | 0 | 4 | 9 | 5 | ||
| Total removed | 33 | ||||||||
** NOTE: Of the items removed, 9 had inter-rater reliability kappa statistics < 0.40, and 6 had intra-rater reliability kappa statistics < 0.40. These include the 10 behavior items showing no developmental trajectories that were later added to the final tool as important non-scoring items. RAP ***—Raw Agreement Proportion, Kappa—Kappa statistic of agreement, AC1—Gwet’s AC1 agreement statistic.