TABLE 2.
Fit statistics for all simulated models.
Study 1 group |
Study 2 group |
Study 1 subject |
Study 2 subject |
Study 1 Xval classification |
Study 2 Xval classification |
|||||||||
Model | RMSE | cAIC | RMSE | cAIC | RMSE | cAIC | RMSE | cAIC | cAIC | Overall | Pair | cAIC | Overall | Pair |
P | 0.00312 | –6.33001 | 0.00198 | –7.1133 | 0.00381 | –6.1104 | 0.00237 | –5.4655 | –1.6882 | 23.39% | 84.23% | –1.3595 | 18.25% | 72.11% |
PI | 0.00083 | –6.41743 | 0.00073 | –7.1847 | 0.00201 | –6.1983 | 0.00130 | –5.4930 | –1.7201 | 35.94% | 88.10% | –1.3708 | 24.14% | 74.59% |
PD | 0.00312 | –6.32608 | 0.00197 | –7.1110 | 0.00355 | –6.1208 | 0.00234 | –5.4644 | –1.6870 | 26.82% | 85.53% | –1.3587 | 18.21% | 72.11% |
PID | 0.00065 | –6.41588 | 0.00071 | –7.1820 | 0.00158 | –6.2102 | 0.00120 | –5.4926 | –1.7206 | 38.76% | 88.77% | –1.3701 | 24.16% | 74.58% |
D1 | 0.00059 | –6.42106 | 0.00039 | –7.1932 | 0.00187 | –6.2049 | 0.00112 | –5.4950 | –1.7228 | 35.70% | 88.15% | –1.3713 | 22.69% | 73.66% |
D2 | 0.00059 | –6.41672 | 0.00039 | –7.1901 | 0.00174 | –6.2023 | 0.00100 | –5.4960 | –1.7187 | 35.72% | 88.28% | –1.3715 | 24.72% | 74.68% |
D3 | 0.00312 | –6.32608 | 0.00197 | –7.1110 | 0.00355 | –6.1208 | 0.00234 | –5.4644 | –1.6870 | 26.82% | 85.53% | –1.3587 | 18.21% | 72.11% |
D4 | 0.00116 | –6.40619 | 0.00083 | –7.1780 | 0.00183 | –6.1964 | 0.00145 | –5.4848 | –1.7157 | 37.75% | 88.42% | –1.3669 | 22.04% | 73.25% |
D5 | 0.00053 | –6.41737 | 0.00026 | –7.1921 | 0.00151 | –6.2129 | 0.00105 | –5.4941 | –1.7233 | 38.55% | 88.74% | –1.3706 | 23.07% | 73.78% |
D6 | 0.00052 | –6.41321 | 0.00021 | –7.1895 | 0.00137 | –6.2106 | 0.00092 | –5.4951 | –1.7195 | 38.73% | 88.89% | –1.3708 | 25.56% | 74.83% |
D7 | 0.00046 | –6.40946 | 0.00017 | –7.1867 | 0.00113 | –6.2103 | 0.00081 | –5.4942 | –1.7147 | 39.49% | 89.00% | –1.3697 | 25.65% | 74.93% |
D8 | 0.00052 | –6.40886 | 0.00017 | –7.1866 | 0.00117 | –6.2093 | 0.00092 | –5.4918 | –1.7142 | 38.53% | 88.78% | –1.3688 | 23.70% | 73.94% |
D9 | 0.00052 | –6.40451 | 0.00017 | –7.1835 | 0.00103 | –6.2065 | 0.00076 | –5.4930 | –1.7110 | 40.20% | 89.18% | –1.3689 | 26.05% | 75.06% |
D10 | 0.00048 | –6.40055 | 0.00013 | –7.1806 | 0.00100 | –6.2014 | 0.00071 | –5.4922 | –1.7070 | 40.37% | 89.14% | –1.3679 | 26.12% | 75.13% |
D11 | 0.00104 | –6.40902 | 0.00040 | –7.1900 | 0.00147 | –6.2129 | 0.00097 | –5.4964 | –1.7227 | 38.57% | 88.93% | –1.3713 | 25.38% | 75.08% |
D12 | 0.00051 | –6.40890 | 0.00027 | –7.1857 | 0.00111 | –6.2110 | 0.00078 | –5.4948 | –1.7129 | 39.06% | 88.94% | –1.3699 | 25.70% | 75.24% |
D13 | 0.00051 | –6.40889 | 0.00027 | –7.1857 | 0.00116 | –6.2099 | 0.00082 | –5.4944 | –1.7160 | 39.92% | 89.03% | –1.3698 | 25.07% | 75.15% |
D14 | 0.00051 | –6.40454 | 0.00013 | –7.1838 | 0.00105 | –6.2064 | 0.00076 | –5.4933 | –1.7110 | 40.71% | 89.18% | –1.3690 | 25.01% | 75.16% |
D15 | 0.00035 | –6.40165 | 0.00012 | –7.1807 | 0.00093 | –6.2027 | 0.00066 | –5.4924 | –1.7058 | 40.57% | 89.22% | –1.3682 | 26.32% | 75.27% |
Xval, cross-validation; RMSE, root-mean-square error; cAIC, corrected Akaike information criterion; Overall, overall accuracy (%); Pair, pairwise accuracy (%).
Boldface type indicates the model with lowest RMSE and cAIC for each study.
Blue shading indicates cAIC values that are within the cAIC threshold of the lowest cAIC value.