Table 2. Different factors associated with the item analysis.
Respiratory | Cardiovascular | Renal | All three courses | |||||||
---|---|---|---|---|---|---|---|---|---|---|
Pre* | Post** | Pre* | Post** | Pre* | Post** | Pre | Post | |||
Factors | Categories | n(%) | n(%) | n(%) | n(%) | n(%) | n(%) | n(%) | n(%) | χ2(p) |
Difficulty Index (P) | Difficult (<20%) | 1(1.3) | 0(0) | 0(0) | 2(2.5) | 1(1.3) | 1(1.3) | 2(0.8) | 3(1.3) | 11.61(0.003) |
Moderated (20–70%) | 55(68.8) | 61(76.3) | 59(73.8) | 68(85.0) | 36(45.0) | 54(67.5) | 150(62.5) | 183(76.3) | ||
Easy (>70%) | 24(30.0) | 19(23.8) | 21(26.3) | 10(12.5) | 43(53.8) | 25(31.3) | 88(36.7) | 54(22.5) | ||
Total | 80(100) | 80(100) | 80(100) | 80(100) | 80(100) | 80(100) | 240(100) | 240(100) | ||
Discrimination Index (DI) | Non-DI(≤0.15) | 6(7.5) | 3(3.80) | 7(8.8) | 4(5.0) | 6(7.5) | 4(5.0) | 19(7.9) | 11(4.6) | 2.27 (0.13) |
DI(>0.15) | 74(92.5) | 77(96.3) | 73(91.3) | 76(95.0) | 74(92.5) | 76(95.0) | 221(92.1) | 229(95.4) | ||
Total | 80(100) | 80(100) | 80(100) | 80(100) | 80(100) | 80(100) | 240(100) | 240(100) | ||
Non-function distractors (NFD) | NFD | 4(5.0) | 2(2.5) | 8(10.0) | 7(8.8) | 16(20.0) | 4(5.0) | 28(11.7) | 13(5.4) | 6.00 (0.02) |
FD*** | 76(95.0) | 78(97.5) | 72(90.0) | 73(91.3) | 64(80.0) | 76(95.0) | 212(88.3) | 227(94.6) | ||
Total | 80(100) | 80(100) | 80(100) | 80(100) | 80(100) | 80(100) | 240(100) | 240(100) | ||
Bloom's taxonomy levels | K1 | 45(56.3) | 40(50.0) | 54(67.5) | 40(50.0) | 57(71.3) | 37(46.3) | 156(65.0) | 117(48.8) | 12.91 (<0.0001) |
K2 | 35(43.8) | 40(50.0) | 26(32.5) | 40(50.0) | 23(28.8) | 43(53.8) | 84(35.0) | 123(51.3) | ||
Total | 80(100) | 80(100) | 80(100) | 80(100) | 80(100) | 80(100) | 240(100) | 240(100) | ||
Items writing flaws (IWFs) | IWF | 22(27.5) | 1(1.3) | 15(18.8) | 0(0.0) | 10(12.5) | 4(5.0) | 47(19.6) | 5(2.1) | 38.04 (0.<0001) |
Without-IWF | 58(72.5) | 79(98.8) | 65(81.3) | 80(100) | 70(87.5) | 76(95.0) | 193(80.4) | 235(97.9) | ||
Total | 80(100) | 80(100) | 80(100) | 80(100) | 80(100) | 80(100) | 240(100) | 240(100) |
*Pre-training, **Post-training, ***Functional distractor, K1 = Non-scenario bases, K2 = Scenario bases.