Table 2.
Mean scoring results across all examinees per item for different scoring methods.
| Method number | Scoring method | Scoring result, mean (SD) | |
|
|
|
Pick-N | Multiple-True-False (MTF) |
| 1 | Dichotomous Scoring | 0.752 (0.432) | 0.512 (0.500) |
| 2 | Dichotomized MTF | 0.982 (0.133) | 0.963 (0.190) |
| 3 | Half-point Scoring | 0.752 (0.431) | 0.675 (0.371) |
| 4 | Partial Scoring 50% (PS50, MTF)a | 0.867 (0.241) | 0.737 (0.285) |
| 5 | Blasberg-Method (Formula 4 by Blasberg et al [8]) | 0.807 (0.340) | 0.734 (0.312) |
| 6 | Negative No Carry-Over Marking System | 0.851 (0.267) | 0.794 (0.251) |
| 7 | Count-3 | 0.830 (0.299) | 0.771 (0.227) |
| 8 | Count-2 | 0.838 (0.288) | 0.773 (0.275) |
| 9 | Monash Medical School Schemeb | N/Ac | N/A |
| 10 | Partial Scoring 1/n (PS1/n) | 0.899 (0.183) | 0.861 (0.173) |
| 11 | Ebel-Method | 0.899 (0.183) | 0.861 (0.173) |
| 12 | Quadratisch | 0.842 (0.279) | 0.772 (0.262) |
| 13 | Kubisch | 0.808 (0.337) | 0.709 (0.319) |
| 14 | Quartisch | 0.787 (0.373) | 0.664 (0.359) |
| 15 | Guessing Fair Penalty | 0.953 (0.083) | 0.903 (0.099) |
| 16 | Guessing Penalty | 0.504 (0.864) | 0.024 (1.000) |
| 17 | Formula 1a by Hsu et al [21] | 0.742 (0.449) | 0.493 (0.520) |
| 18 | Formula 1b by Hsu et al [21] | 0.744 (0.446) | 0.496 (0.517) |
| 19 | Formula 6 by Hsu et al [21] | 0.829 (0.303) | 0.762 (0.282) |
| 20 | (+1/n, 0, –1/n) System | 0.798 (0.366) | 0.723 (0.347) |
| 21 | (+1/n, –0.6/n) System | 0.839 (0.292) | 0.778 (0.277) |
| 22 | (+1/n, 0, –0.5/n) System | 0.849 (0.274) | 0.792 (0.260) |
| 23 | Formula-Scoring | 0.875 (0.226) | 0.827 (0.216) |
| 24 | (+1/n, 0, –2/n) System | 0.697 (0.548) | 0.584 (0.520) |
| 25 | (+1/n, 0, –1.8/n) System | 0.718 (0.512) | 0.612 (0.485) |
| 26 | Formula 8 by Domnich et al [11] | 0.866 (0.243) | 0.716 (0.319) |
| 27 | Formula 1 by Duncan and Milton [20] | 0.879 (0.222) | 0.851 (0.234) |
| 28 | Formula 5 by Duncan and Milton [20] | 0.893 (0.194) | 0.856 (0.187) |
| 29 | Formula 6 by Duncan and Milton [20] | 0.904 (0.174) | 0.868 (0.170) |
| 30 | Formula 1 by Bandaranayake et al [22] | 0.757 (0.443) | 0.702 (0.468) |
| 31 | Formula 2 by Bandaranayake et al [22] | 0.790 (0.381) | 0.652 (0.544) |
| 32 | Formula 3 by Blasberg et al [8] | 0.982 (0.133) | 0.808 (0.394) |
| 33 | Subset Scoring | 0.896 (0.189) | 0.868 (0.170) |
| 34 | Ripkey Method | 0.879 (0.222) | 0.692 (0.378) |
| 35 | Morton Method | 0.879 (0.222) | 0.802 (0.233) |
| 36 | Formula 2 by Blasberg et al [8] | 0.899 (0.183) | 0.735 (0.364) |
| 37 | Partial Scoring 50% (PS50, Pick-N)a | 0.866 (0.243) | 0.638 (0.410) |
| 38 | Partial Scoring 1/tm (PS1/tm) | 0.879 (0.222) | 0.778 (0.258) |
| 39 | Odell-Method | 0.824 (0.319) | 0.595 (0.471) |
| 40 | (+1/t, –1/[n–t]) System | 0.791 (0.378) | 0.737 (0.339) |
| 41 | Balanced Scoring Method | 0.879 (0.222) | 0.785 (0.249) |
aWithin the context of Pick-N and Multiple-True-False items, the scoring method named Partial Scoring 50% (PS50) is related to different scoring methods.
bOnly used in case of 4 answer options/statements per item.
cN/A: not applicable.