Table 2.
Averaged FPR and TPR (%) Under the Conditions With Impact = 0 in Simulation 1.
| FPR |
TPR |
|||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 500/500 |
800/200 |
500/500 |
800/200 |
|||||||||
| OR | LR | MH | OR | LR | MH | OR | LR | MH | OR | LR | MH | |
| 0% | 3.20 | 4.75 | 4.10 | 3.55 | 4.70 | 3.50 | — | — | — | — | — | — |
| (3.45) | (3.75) | (3.80) | (3.70) | (4.90) | (3.65) | — | — | — | — | — | — | |
| Balanced DIF | ||||||||||||
| 10% | 3.33 | 5.05 | 4.17 | 3.50 | 5.28 | 4.06 | 87.50 | 94.50 | 94.00 | 79.00 | 85.50 | 84.50 |
| (3.50) | (4.56) | (4.06) | (3.44) | (5.06) | (4.17) | (87.50) | (91.50) | (89.50) | (78.50) | (83.00) | (79.50) | |
| 20% | 3.25 | 4.81 | 3.94 | 3.56 | 5.19 | 4.00 | 87.75 | 92.25 | 91.75 | 68.75 | 79.75 | 74.75 |
| (4.00) | (4.63) | (4.06) | (3.69) | (5.06) | (3.63) | (87.25) | (89.25) | (88.50) | (70.00) | (76.00) | (70.75) | |
| 30% | 3.14 | 5.50 | 4.14 | 2.86 | 4.71 | 3.93 | 83.50 | 89.33 | 87.50 | 70.67 | 78.33 | 77.00 |
| (3.57) | (5.21) | (4.00) | (3.29) | (4.93) | (4.00) | (82.50) | (85.67) | (82.33) | (70.50) | (75.17) | (71.83) | |
| 40% | 3.00 | 4.25 | 3.67 | 2.58 | 4.58 | 3.17 | 87.50 | 93.75 | 91.63 | 74.75 | 82.88 | 80.50 |
| (3.58) | (4.83) | (3.67) | (3.08) | (5.08) | (3.42) | (86.75) | (90.38) | (88.50) | (74.38) | (76.75) | (73.38) | |
| Unbalanced DIF | ||||||||||||
| 10% | 3.22 | 6.39 | 5.22 | 4.28 | 6.33 | 5.00 | 86.00 | 88.50 | 84.50 | 75.50 | 76.00 | 72.50 |
| (3.11) | (4.50) | (3.78) | (4.50) | (5.78) | (4.89) | (87.00) | (90.50) | (88.50) | (77.00) | (81.50) | (78.00) | |
| 20% | 4.44 | 11.00 | 9.44 | 4.75 | 8.50 | 7.63 | 80.50 | 80.25 | 74.50 | 61.00 | 60.75 | 56.25 |
| (4.25) | (5.31) | (4.56) | (4.31) | (6.13) | (4.25) | (83.75) | (89.25) | (85.00) | (65.50) | (69.50) | (67.75) | |
| 30% | 6.29 | 17.50 | 15.57 | 5.93 | 12.21 | 10.07 | 73.00 | 66.50 | 63.33 | 47.83 | 48.17 | 42.50 |
| (5.14) | (6.14) | (5.43) | (5.93) | (7.58) | (6.71) | (82.00) | (85.17) | (82.33) | (54.83) | (58.17) | (52.50) | |
| 40% | 10.75 | 26.08 | 22.42 | 11.17 | 20.75 | 18.42 | 59.88 | 54.63 | 50.88 | 34.75 | 36.75 | 31.50 |
| (7.42) | (10.17) | (8.00) | (11.00) | (16.75) | (13.58) | (72.75) | (74.50) | (73.13) | (42.50) | (43.88) | (38.63) | |
Note. The values in parentheses are obtained with the purification procedure. Inflated FPRs (≥7.5%) are marked in bold. FPR = false positive rate; TPR = true positive rate; OR = odds ratio; LR = logistic regression; MH = Mantel–Haenszel; DIF = differential item functioning.