Table 2.
Test length | Item quality | Selection algorithms | ACCR |
PCCR | Difference | ||||
---|---|---|---|---|---|---|---|---|---|
A1 | A2 | A3 | A4 | A5 | |||||
5 | High | KL | 0.581 | 0.964 | 0.548 | 0.897 | 0.562 | 0.144 | |
ACDI | 0.720 | 0.989 | 0.492 | 0.941 | 0.492 | 0.187 | |||
CDI | 0.503 | 0.989 | 0.939 | 0.939 | 0.491 | 0.245 | |||
PWKL | 0.805 | 0.942 | 0.881 | 0.923 | 0.900 | 0.619 | |||
MI | 0.942 | 0.945 | 0.925 | 0.948 | 0.926 | 0.774 | 0.155 | ||
MPWKL | 0.921 | 0.943 | 0.916 | 0.923 | 0.904 | 0.772 | 0.153 | ||
PWACDI | 0.911 | 0.943 | 0.915 | 0.923 | 0.889 | 0.773 | 0.154 | ||
PWCDI | 0.923 | 0.943 | 0.917 | 0.923 | 0.906 | 0.773 | 0.154 | ||
Low | KL | 0.571 | 0.943 | 0.587 | 0.845 | 0.539 | 0.158 | ||
ACDI | 0.690 | 0.967 | 0.492 | 0.887 | 0.491 | 0.193 | |||
CDI | 0.504 | 0.966 | 0.888 | 0.889 | 0.491 | 0.238 | |||
PWKL | 0.762 | 0.875 | 0.835 | 0.867 | 0.835 | 0.512 | |||
MI | 0.887 | 0.888 | 0.846 | 0.894 | 0.866 | 0.627 | 0.115 | ||
MPWKL | 0.852 | 0.891 | 0.859 | 0.857 | 0.824 | 0.621 | 0.109 | ||
PWACDI | 0.838 | 0.892 | 0.856 | 0.856 | 0.811 | 0.635 | 0.123 | ||
PWCDI | 0.852 | 0.892 | 0.857 | 0.856 | 0.826 | 0.611 | 0.099 | ||
10 | High | KL | 0.591 | 0.989 | 0.753 | 0.928 | 0.842 | 0.337 | |
ACDI | 0.719 | 0.991 | 0.937 | 0.947 | 0.714 | 0.534 | |||
CDI | 0.939 | 0.992 | 0.939 | 0.933 | 0.924 | 0.771 | |||
PWKL | 0.997 | 0.981 | 0.977 | 0.980 | 0.971 | 0.909 | |||
MI | 0.981 | 0.973 | 0.967 | 0.978 | 0.976 | 0.900 | −0.09 | ||
MPWKL | 0.983 | 0.984 | 0.984 | 0.980 | 0.974 | 0.928 | 0.019 | ||
PWACDI | 0.976 | 0.980 | 0.978 | 0.971 | 0.972 | 0.921 | 0.012 | ||
PWCDI | 0.983 | 0.983 | 0.984 | 0.979 | 0.973 | 0.926 | 0.017 | ||
Low | KL | 0.578 | 0.981 | 0.825 | 0.9 | 0.655 | 0.277 | ||
ACDI | 0.688 | 0.972 | 0.883 | 0.891 | 0.685 | 0.460 | |||
CDI | 0.877 | 0.966 | 0.885 | 0.878 | 0.869 | 0.618 | |||
PWKL | 0.935 | 0.946 | 0.927 | 0.939 | 0.922 | 0.768 | |||
MI | 0.933 | 0.941 | 0.936 | 0.944 | 0.949 | 0.781 | 0.013 | ||
MPWKL | 0.937 | 0.949 | 0.944 | 0.935 | 0.930 | 0.798 | 0.030 | ||
PWACDI | 0.925 | 0.939 | 0.933 | 0.920 | 0.928 | 0.800 | 0.032 | ||
PWCDI | 0.938 | 0.947 | 0.944 | 0.936 | 0.930 | 0.800 | 0.032 |
Note. ACCR = attribute correct classification rate; A = attribute; PCCR = pattern correct classification rate; KL = Kullback–Leibler index method; ACDI = attribute-level cognitive diagnostic model discrimination index; CDI = cognitive diagnostic model discrimination index; PWKL = posterior-weighted Kullback–Leibler information method; MI = mutual information method; MPWKL = modified PWKL; PWACDI = posterior-weighted attribute-level cognitive diagnostic model discrimination index; PWCDI = posterior-weighted cognitive diagnostic model discrimination index.