Table 3.

Classical Effect Sizes (η²) From a Two-Way Analysis of Variance (ANOVA) on False Positive Rates, True Positive Rates, Average Test Length, and Change Recovery.

Factor	η 2	Sum of squares	df
False positive rates
Starting $\theta$ (Trait)	0.300	0.019	10
Calibration size (Size)	0.170	0.011	4
AMC hypothesis test (Test)	0.152	0.010	2
Trait × Size	0.216	0.014	40
Trait × Test	0.124	0.008	20
Size × Test	0.006	0.000	8
Residuals	—	0.002	80
True positive rates
Starting $\theta$ (Trait)	0.060	1.082	10
Calibration size (Size)	0.001	0.017	4
AMC hypothesis test (Test)	0.021	0.372	2
True change (Change)	0.793	14.206	8
Trait × Size	0.023	0.415	40
Trait × Test	0.013	0.230	20
Trait × Change	0.049	0.879	80
Size × Test	0.000	0.001	8
Size × Change	0.004	0.072	32
Test × Change	0.002	0.035	16
Residuals	NA	0.599	1264
Average test length
Starting $\theta$ (Trait)	0.038	1605.090	10
Calibration size (Size)	0.002	78.258	4
AMC hypothesis test (Test)	0.002	89.332	2
True change (Change)	0.847	35872.322	9
Trait × Size	0.014	585.960	40
Trait × Test	0.022	936.969	20
Trait × Change	0.023	992.919	90
Size × Test	0.000	8.490	8
Size × Change	0.004	156.991	36
Test × Change	0.012	528.193	18
Residuals	NA	1498.775	1412
Change recovery index
Starting $\theta$ (Trait)	0.170	3.189	10
Calibration size (Size)	0.012	0.219	4
AMC hypothesis test (Test)	0.002	0.040	2
True change (Change)	0.307	5.744	9
Trait × Size	0.032	0.608	40
Trait × Test	0.048	0.901	20
Trait × Change	0.277	5.185	90
Size × Test	0.001	0.023	8
Size × Change	0.016	0.303	36
Test × Change	0.011	0.202	18
Residuals	NA	2.296	1412

Note. Classical effect sizes greater than or equal to 0.02 have been bolded. AMC = Adaptive measurement of change.