Table VIII.
Median bias, reduction in bias, coverage, and RMSE of the mathematics and vocabulary treatment effect estimates for RAS and MITSS in simulations based on Shadish et al. [44] data.
| Constant effect
|
Heterogeneous effect
|
|||
|---|---|---|---|---|
| M–N–m | MITSS | M–N–m | MITSS | |
| Bias math | 0.04 | 0.04 | 0.04 | 0.03 |
| Bias vocabulary | 0.07 | 0.04 | 0.05 | 0.04 |
| % Reduction in bias math | 0.81 | 0.76 | 0.72 | 0.79 |
| % Reduction in bias vocabulary | 0.67 | 0.69 | 0.59 | 0.65 |
| Coverage super-population math | 0.95 | 0.98 | 0.98 | 1.00 |
| Coverage super-population vocabulary | 0.95 | 0.98 | 0.98 | 0.98 |
| Coverage super-population joint | — | 0.98 | — | 1.00 |
| Super-population interval width math | 0.77 | 0.68 | 0.85 | 0.76 |
| Super-population interval width vocabulary | 0.82 | 0.73 | 0.83 | 0.74 |
| RMSE math | 0.40 | 0.37 | 0.44 | 0.38 |
| RMSE vocabulary | 0.42 | 0.38 | 0.43 | 0.38 |