Table 2.
Results of the item selection in Part B and Part C using CTT and IRT
| CTT | IRT | Final outcome |
|||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| Item | (1) | (2) | (3) | (4) | (5) | a | b1 | b2 | b3 | b4 | |
| B1-1 | 0.715 | 13.724 | 0.952 | 0.82 | 0.617 | 2.679 | 0.105 | 1.208 | 1.938 | 3.019 | √ |
| B1-2 | 0.752 | 13.808 | 0.951 | 0.75 | 0.578 | 3.015 | 0.206 | 1.307 | 2.036 | 3.193 | √ |
| B1-3 | 0.790 | 17.901 | 0.950 | 0.99 | 0.689 | 2.665 | -0.398 | 0.725 | 1.577 | 2.536 | √ |
| B1-4 | 0.821 | 18.080 | 0.949 | 0.82 | 0.579* | 3.306 | 0.029 | 1.077 | 1.786 | 3.098 | × |
| B1-5 | 0.782 | 18.375 | 0.951 | 1.07 | 0.732 | 2.392 | -0.436 | 0.759 | 1.403 | 2.355 | √ |
| B1-6 | 0.768 | 17.190 | 0.951 | 1.04 | 0.768 | 2.097 | -0.737 | 0.568 | 1.495 | 2.525 | √ |
| B1-7 | 0.758 | 15.226 | 0.952 | 1.07 | 0.783 | 2.123 | -0.62 | 0.624 | 1.433 | 2.57 | √ |
| B1-8 | 0.825 | 15.665 | 0.949 | 0.84 | 0.566* | 2.783 | -0.15 | 1.078 | 1.866 | 2.779 | × |
| B1-9 | 0.823 | 18.017 | 0.949 | 0.85 | 0.527* | 3.465 | -0.12 | 1.036 | 1.734 | 3.09 | × |
| B1-10 | 0.839 | 21.069 | 0.949 | 0.92 | 0.575 | 3.7 | -0.231 | 0.86 | 1.555 | 2.494 | √ |
| B1-11 | 0.833 | 18.171 | 0.949 | 0.79 | 0.572 | 4.16 | 0.044 | 1.039 | 1.888 | 2.627 | √ |
| B1-12 | 0.870 | 21.024 | 0.948 | 0.84 | 0.485* | 4.832 | -0.076 | 0.883 | 1.724 | 2.903 | × |
| B1-13 | 0.800 | 18.875 | 0.950 | 0.83 | 0.485* | 3.848 | 0.009 | 1.039 | 1.794 | 2.492 | × |
| B1-14 | 0.772 | 15.359 | 0.951 | 0.93 | 0.491* | 3.172 | -0.122 | 0.953 | 1.679 | 2.633 | × |
| B2-1 | 0.823 | 11.851 | 0.956 | 0.64 | 0.772 | 3.592 | 0.606 | 1.504 | 2.208 | 3.041 | √ |
| B2-2 | 0.864 | 11.953 | 0.955 | 0.67 | 0.786 | 4.365 | 0.606 | 1.386 | 1.987 | 2.933 | √ |
| B2-3 | 0.788 | 14.587 | 0.961 | 0.91 | 0.554 | 3.379 | 0.22 | 1.103 | 1.746 | 2.277 | √ |
| B2-4 | 0.822 | 13.238 | 0.957 | 0.74 | 0.702 | 4.101 | 0.396 | 1.294 | 2.038 | N/A | √ |
| B2-5 | 0.871 | 14.369 | 0.954 | 0.73 | 0.771 | 3.766 | 0.369 | 1.338 | 1.987 | 2.674 | √ |
| B2-6 | 0.895 | 15.585 | 0.953 | 0.73 | 0.736 | 4.842 | 0.342 | 1.257 | 1.892 | 2.904 | √ |
| B2-7 | 0.903 | 18.914 | 0.953 | 0.70 | 0.729 | 5.272 | 0.282 | 1.21 | 2.068 | 2.874 | √ |
| B2-8 | 0.899 | 19.329 | 0.953 | 0.74 | 0.694 | 5.555 | 0.247 | 1.142 | 1.883 | 2.855 | √ |
| B2-9 | 0.860 | 15.432 | 0.955 | 0.73 | 0.649 | 5.133 | 0.37 | 1.255 | 1.825 | 2.879 | √ |
| B2-10 | 0.890 | 14.889 | 0.954 | 0.67 | 0.754 | 6.066 | 0.491 | 1.318 | 2.062 | 2.823 | √ |
| B3-1 | 0.818 | 17.901 | 0.950 | 1.08 | 0.663 | 2.705 | -0.182 | 0.81 | 1.556 | 2.548 | √ |
| B3-2 | 0.856 | 19.612 | 0.942 | 0.79 | 0.608 | 3.884 | 0.019 | 1.051 | 1.816 | N/A | √ |
| B3-3 | 0.922 | 20.858 | 0.934 | 0.94 | 0.734 | 3.679 | -0.047 | 0.903 | 1.567 | 2.203 | √ |
| B3-4 | 0.912 | 22.353 | 0.936 | 0.91 | 0.703 | 4.076 | -0.055 | 0.889 | 1.648 | 2.283 | √ |
| B3-5 | 0.909 | 22.236 | 0.936 | 0.91 | 0.671 | 3.821 | -0.129 | 0.847 | 1.615 | 2.27 | √ |
| B3-6 | 0.868 | 21.320 | 0.942 | 1.01 | 0.656 | 3.3 | -0.215 | 0.849 | 1.437 | 2.086 | √ |
| B3-7 | 0.864 | 20.441 | 0.941 | 0.85 | 0.563 | 4.126 | 0.003 | 0.952 | 1.726 | 2.415 | √ |
| B4-1 | 0.842 | 16.132 | 0.944 | 0.80 | 0.633 | 4.116 | 0.32 | 1.181 | 1.804 | 2.971 | √ |
| B4-2 | 0.848 | 18.127 | 0.944 | 0.94 | 0.638 | 3.583 | 0.018 | 0.973 | 1.708 | 2.214 | √ |
| B4-3 | 0.865 | 16.003 | 0.943 | 0.75 | 0.649 | 4.957 | 0.293 | 1.113 | 1.829 | N/A | √ |
| B4-4 | 0.861 | 19.641 | 0.944 | 0.98 | 0.662 | 3.575 | -0.02 | 0.898 | 1.509 | 2.495 | √ |
| B4-5 | 0.868 | 19.355 | 0.942 | 0.93 | 0.665 | 3.583 | 0.001 | 0.985 | 1.51 | 2.707 | √ |
| B4-6 | 0.893 | 21.234 | 0.941 | 0.81 | 0.648 | 4.971 | 0.088 | 0.986 | 1.749 | 2.502 | √ |
| B4-7 | 0.868 | 19.372 | 0.943 | 0.78 | 0.678 | 4.334 | 0.128 | 1.067 | 1.812 | N/A | √ |
| B4-8 | 0.848 | 19.581 | 0.945 | 0.98 | 0.673 | 4.33 | 0.037 | 0.918 | 1.615 | 2.568 | √ |
| B4-9 | 0.735 | 11.899 | 0.950 | 0.72 | 0.587* | 3.423 | 0.44 | 1.313 | 2.015 | N/A | × |
| B5-1 | 0.963 | 18.816 | N/A | 0.96 | 0.592 | 3.494 | -0.093 | 0.945 | 1.579 | 2.334 | √ |
| B5-2 | 0.958 | 20.200 | N/A | 0.91 | 0.644 | 4.213 | 0.006 | 0.917 | 1.714 | 2.956 | √ |
| B6-1 | 0.805 | 14.417 | 0.892 | 0.81 | 0.535* | 3.74 | 0.281 | 1.181 | 1.856 | 3.039 | × |
| B6-2 | 0.896 | 16.107 | 0.845 | 0.89 | 0.579 | 3.868 | 0.211 | 1.097 | 1.792 | 2.47 | √ |
| B6-3 | 0.899 | 18.053 | 0.847 | 0.98 | 0.596 | 3.384 | -0.065 | 0.943 | 1.615 | 2.337 | √ |
| B6-4 | 0.882 | 18.436 | 0.861 | 0.99 | 0.598 | 2.929 | -0.062 | 0.963 | 1.617 | 2.376 | √ |
| C1-1 | 0.630 | 8.914 | 0.892 | 0.92 | 0.858 | 0.928 | 0.321 | 1.522 | 3.491 | √ | |
| C1-2 | 0.698 | 10.610 | 0.880 | 0.94 | 0.741 | 1.137 | -0.211 | 1.145 | 2.734 | √ | |
| C1-3 | 0.849 | 17.836 | 0.847 | 0.97 | 0.689 | 2.043 | -0.994 | 0.212 | 1.373 | √ | |
| C1-4 | 0.846 | 18.095 | 0.848 | 1.00 | 0.832 | 2.152 | -0.975 | 0.078 | 1.212 | √ | |
| C1-5 | 0.841 | 19.164 | 0.849 | 0.98 | 0.765 | 2.18 | -0.868 | 0.248 | 1.404 | √ | |
| C1-6 | 0.873 | 21.503 | 0.841 | 1.01 | 0.804 | 2.389 | -0.964 | 0.144 | 1.109 | √ | |
| C2-1 | 0.907 | 21.905 | 0.884 | 0.99 | 0.771 | 2.278 | -1.38 | -0.057 | 0.801 | √ | |
| C2-2 | 0.902 | 21.563 | 0.888 | 1.03 | 0.790 | 2.07 | -1.279 | -0.097 | 0.835 | √ | |
| C2-3 | 0.904 | 21.999 | 0.886 | 1.01 | 0.788 | 2.139 | -1.275 | -0.051 | 0.87 | √ | |
| C2-4 | 0.866 | 20.001 | 0.909 | 1.02 | 0.755 | 1.957 | -1.482 | -0.172 | 0.695 | √ | |
| C3-1 | 0.905 | 25.563 | 0.929 | 1.02 | 0.610 | 3.386 | -0.981 | -0.042 | 0.808 | √ | |
| C3-2 | 0.928 | 23.058 | 0.914 | 0.99 | 0.541 | 3.048 | -0.94 | -0.07 | 1.035 | √ | |
| C3-3 | 0.931 | 21.936 | 0.912 | 0.97 | 0.575 | 3.398 | -0.979 | 0.029 | 1.01 | √ | |
| C3-4 | 0.912 | 21.855 | 0.922 | 0.94 | 0.539 | 3.138 | -1.225 | -0.096 | 0.927 | √ | |
| C4-1 | 0.798 | 21.111 | 0.960 | 1.08 | 0.686 | 2.504 | -0.775 | 0.082 | 0.953 | √ | |
| C4-2 | 0.840 | 21.603 | 0.958 | 1.01 | 0.758 | 2.986 | -1.184 | -0.208 | 0.682 | √ | |
| C4-3 | 0.837 | 26.062 | 0.958 | 1.03 | 0.678 | 3.562 | -1.051 | -0.16 | 0.624 | √ | |
| C4-4 | 0.824 | 21.297 | 0.959 | 1.03 | 0.735 | 2.898 | -1.058 | -0.144 | 0.782 | √ | |
| C4-5 | 0.862 | 26.905 | 0.957 | 1.03 | 0.746 | 3.698 | -1.045 | -0.137 | 0.679 | √ | |
| C4-6 | 0.828 | 24.600 | 0.959 | 1.03 | 0.710 | 3.042 | -1.067 | -0.165 | 0.715 | √ | |
| C4-7 | 0.887 | 31.547 | 0.956 | 1.02 | 0.740 | 4.805 | -1.06 | -0.192 | 0.537 | √ | |
| C4-8 | 0.895 | 34.126 | 0.956 | 1.05 | 0.741 | 5.33 | -0.924 | -0.176 | 0.567 | √ | |
| C4-9 | 0.872 | 30.356 | 0.957 | 1.03 | 0.713 | 4.361 | -1.026 | -0.181 | 0.618 | √ | |
| C4-10 | 0.876 | 28.958 | 0.957 | 1.00 | 0.732 | 4.171 | -1.104 | -0.246 | 0.616 | √ | |
| C4-11 | 0.830 | 25.185 | 0.958 | 1.01 | 0.691 | 3.18 | -1.207 | -0.225 | 0.598 | √ | |
Note (1) represents correlation coefficient analysis; (2): the critical ratio; (3): Cronbach’s α coefficient analysis; (4): discrete tendency analysis; (5): factor analysis
* represents that the item was deleted, and the bold form means that the item does not meet the criteria