Table 4. Statistical analysis of the differential distribution the percentage of item without violations (flaws) after clustering of the resources into C1, C2, C3, and C4.
| Overall items violations | Good items a (%) | One flaw (%) | >1 flaw (%) | Structural violations | No flaws (%) | One flaw (%) | >1 flaw (%) |
|---|---|---|---|---|---|---|---|
| C1: study book–related MCQs | 16 | 39 | 45 | C1: study book–related MCQs | 69 | 17 | 14 |
| C2: review book–related MCQs | 10 | 26 | 64 | C2: review book–related MCQs | 42 | 37 | 21 |
| C3: self-assessment books b | 38 | 25 | 37 | C3: self-assessment books b | 66 | 22 | 12 |
| C4: online-shared MCQs | 7 | 21 | 72 | C4: online-shared MCQs | 44 | 32 | 24 |
| χ2 (KW) = 190.54, p = 0.000 | χ2 (KW) = 92.4, p = 0.000 | ||||||
| Test-wiseness violations | No flaws (%) | One flaw (%) | >1 flaw (%) | Irrelevant difficulty violations | No flaws (%) | One flaw (%) | >1 flaw (%) |
| C1: study book–related MCQs | 87 | 12 | 1 | C1: study book–related MCQs | 25 | 55 | 20 |
| C2: review book–related MCQs | 75 | 22 | 3 | C2: review book–related MCQs | 32 | 33 | 35 |
| C3: self-assessment books b | 90 | 9 | 1 | C3: self-assessment books b | 54 | 33 | 13 |
| C4: online-shared MCQs | 86 | 13 | 1 | C4: online-shared MCQs | 11 | 53 | 36 |
| χ2 (KW) = 36, p = 0.000 | χ2 (KW) = 237, p = 0.014 | ||||||
Abbreviations: MCQ, multiple-choice question.
Note: χ 2 (KW) Kruskal–Wallis H -test.
a
Items without any flaw (violation).
b
Highly significant ( p < 0.01).