Table 3.
Results of multiple logistic regression analyses regarding the effect of item quality on scoring results (≥0.6 vs <0.6 credit points).
| Method number | Pick-N | Multiple-True-False | ||||||||||
|
|
Use of inappropriate item type (yes vs no) | Presence of cues (yes vs no) | Use of inappropriate item type (yes vs no) | Presence of cues (yes vs no) | ||||||||
|
|
ORa (95% CI) | P value | OR (95% CI) | P value | OR (95% CI) | P value | OR (95% CI) | P value |
|
|||
| 1 | 0.553 (0.440-0.693) | <.001 | 0.882 (0.711-1.094) | .25 | 1.778 (1.273-2.496) | .001 | 2.296 (1.707-3.100) | <.001 |
|
|||
| 2 | 0.250 (0.092-0.574) | .002 | 1.887 (0.938-3.982) | .08 | 0.983 (0.446-2.393) | .97 | 2.365 (1.015-6.460) | .06 |
|
|||
| 3 | 0.553 (0.440-0.693) | <.001 | 0.882 (0.711-1.094) | .25 | 1.778 (1.273-2.496) | .001 | 2.296 (1.707-3.100) | <.001 |
|
|||
| 4 | 0.553 (0.440-0.693) | <.001 | 0.882 (0.711-1.094) | .25 | 1.778 (1.273-2.496) | .001 | 2.296 (1.707-3.100) | <.001 |
|
|||
| 5 | 0.559 (0.445-0.701) | <.001 | 0.870 (0.702-1.080) | .21 | 2.103 (1.300-3.538) | .003 | 5.432 (3.231-9.730) | <.001 |
|
|||
| 6 | 0.559 (0.445-0.701) | <.001 | 0.870 (0.702-1.080) | .21 | 2.103 (1.300-3.538) | .003 | 5.432 (3.231-9.730) | <.001 |
|
|||
| 7 | 0.559 (0.445-0.701) | <.001 | 0.870 (0.702-1.080) | .21 | 2.103 (1.300-3.538) | .003 | 5.432 (3.231-9.730) | <.001 |
|
|||
| 8 | 0.559 (0.445-0.701) | <.001 | 0.870 (0.702-1.080) | .21 | 2.103 (1.300-3.538) | .003 | 5.432 (3.231-9.730) | <.001 |
|
|||
| 9 | N/Ab | N/A | N/A | N/A | N/A | N/A | N/A | N/A |
|
|||
| 10 | 0.250 (0.092-0.574) | .002 | 1.887 (0.938-3.982) | .08 | 0.983 (0.446-2.393) | .97 | 2.365 (1.015-6.460) | .06 |
|
|||
| 11 | 0.250 (0.092-0.574) | .002 | 1.887 (0.938-3.982) | .08 | 0.983 (0.446-2.393) | .97 | 2.365 (1.015-6.460) | .06 |
|
|||
| 12 | 0.559 (0.445-0.701) | <.001 | 0.870 (0.702-1.080) | .21 | 2.103 (1.300-3.538) | .003 | 5.432 (3.231-9.730) | <.001 |
|
|||
| 13 | 0.553 (0.440-0.693) | <.001 | 0.882 (0.711-1.094) | .25 | 1.778 (1.273-2.496) | .001 | 2.296 (1.707-3.100) | <.001 |
|
|||
| 14 | 0.553 (0.440-0.693) | <.001 | 0.882 (0.711-1.094) | .25 | 1.778 (1.273-2.496) | .001 | 2.296 (1.707-3.100) | <.001 |
|
|||
| 15 | N/A | >.99 | N/A | >.99 | N/A | >.99 | N/A | >.99 |
|
|||
| 16 | 0.553 (0.440-0.693) | <.001 | 0.882 (0.711-1.094) | .25 | 1.778 (1.273-2.496) | .001 | 2.296 (1.707-3.100) | <.001 |
|
|||
| 17 | 0.553 (0.440-0.693) | <.001 | 0.882 (0.711-1.094) | .25 | 1.778 (1.273-2.496) | .001 | 2.296 (1.707-3.100) | <.001 |
|
|||
| 18 | 0.553 (0.440-0.693) | <.001 | 0.882 (0.711-1.094) | .25 | 1.778 (1.273-2.496) | .001 | 2.296 (1.707-3.100) | <.001 |
|
|||
| 19 | 0.559 (0.445-0.701) | <.001 | 0.870 (0.702-1.080) | .21 | 2.103 (1.300-3.538) | .003 | 5.432 (3.231-9.730) | <.001 |
|
|||
| 20 | 0.559 (0.445-0.701) | <.001 | 0.870 (0.702-1.080) | .21 | 2.103 (1.300-3.538) | .003 | 5.432 (3.231-9.730) | <.001 |
|
|||
| 21 | 0.559 (0.445-0.701) | <.001 | 0.870 (0.702-1.080) | .21 | 2.103 (1.300-3.538) | .003 | 5.432 (3.231-9.730) | <.001 |
|
|||
| 22 | 0.559 (0.445-0.701) | <.001 | 0.870 (0.702-1.080) | .21 | 2.103 (1.300-3.538) | .003 | 5.432 (3.231-9.730) | <.001 |
|
|||
| 23 | 0.489 (0.379-0.629) | <.001 | 1.364 (1.074-1.737) | .01 | 2.482 (1.501-4.310) | .001 | 5.349 (3.178-9.590) | <.001 |
|
|||
| 24 | 0.553 (0.440-0.693) | <.001 | 0.882 (0.711-1.094) | .25 | 1.778 (1.273-2.496) | .001 | 2.296 (1.707-3.100) | <.001 |
|
|||
| 25 | 0.553 (0.440-0.693) | <.001 | 0.882 (0.711-1.094) | .25 | 1.778 (1.273-2.496) | .001 | 2.296 (1.707-3.100) | <.001 |
|
|||
| 26 | 0.553 (0.440-0.693) | <.001 | 0.882 (0.711-1.094) | .25 | 1.778 (1.273-2.496) | .001 | 2.296 (1.707-3.100) | <.001 |
|
|||
| 27 | 0.480 (0.371-0.616) | <.001 | 1.394 (1.098-1.775) | .007 | 4.776 (2.401-10.911) | <.001 | 3.799 (2.227-6.877) | <.001 |
|
|||
| 28 | 0.486 (0.376-0.625) | <.001 | 1.374 (1.082-1.750) | .009 | 3.802 (1.957-8.320) | <.001 | 6.537 (3.393-14.220) | <.001 |
|
|||
| 29 | 0.250 (0.092-0.574) | .002 | 1.887 (0.938-3.982) | .08 | 0.927 (0.544-1.635) | .79 | 2.776 (1.540-5.382) | .001 |
|
|||
| 30 | 0.553 (0.440-0.693) | <.001 | 0.882 (0.711-1.094) | .25 | 2.993 (2.027-4.494) | <.001 | 6.977 (4.743-10.515) | <.001 |
|
|||
| 31 | 0.553 (0.440-0.693) | <.001 | 0.882 (0.711-1.094) | .25 | 2.993 (2.027-4.494) | <.001 | 6.977 (4.743-10.515) | <.001 |
|
|||
| 32 | 0.250 (0.092-0.574) | .002 | 1.887 (0.938-3.982) | .08 | 0.625 (0.420-0.940) | .02 | 0.451 (0.314-0.644) | <.001 |
|
|||
| 33 | 0.489 (0.379-0.629) | <.001 | 1.364 (1.074-1.737) | .01 | 1.331 (0.788-2.346) | .30 | 3.679 (2.065-7.074) | <.001 |
|
|||
| 34 | 0.480 (0.371-0.616) | <.001 | 1.394 (1.098-1.775) | .007 | 1.271 (0.878-1.867) | .21 | 0.849 (0.618-1.169) | .31 |
|
|||
| 35 | 0.480 (0.371-0.616) | <.001 | 1.394 (1.098-1.775) | .007 | 4.335 (2.247-9.441) | <.001 | 3.427 (2.054-6.020) | <.001 |
|
|||
| 36 | 0.250 (0.092-0.574) | .002 | 1.887 (0.938-3.982) | .08 | 0.625 (0.420-0.940) | .02 | 0.451 (0.314-0.644) | <.001 |
|
|||
| 37 | 0.553 (0.440-0.693) | <.001 | 0.882 (0.711-1.094) | .25 | 1.778 (1.273-2.496) | .001 | 2.296 (1.707-3.100) | <.001 |
|
|||
| 38 | 0.480 (0.371-0.616) | <.001 | 1.394 (1.098-1.775) | .007 | 5.724 (3.167-11.441) | <.001 | 0.869 (0.614-1.235) | .43 |
|
|||
| 39 | 0.559 (0.445-0.701) | <.001 | 0.870 (0.702-1.080) | .21 | 1.864 (1.331-2.626) | <.001 | 2.395 (1.777-3.244) | <.001 |
|
|||
| 40 | 0.553 (0.440-0.693) | <.001 | 0.882 (0.711-1.094) | .25 | 0.964 (0.662-1.421) | .85 | 2.485 (1.704-3.694) | <.001 |
|
|||
| 41 | 0.480 (0.371-0.616) | <.001 | 1.394 (1.098-1.775) | .007 | 0.984 (0.655-1.504) | .94 | 1.975 (1.325-3.006) | .001 |
|
|||
aOR: odds ratio.
bN/A: not applicable.