Table 2. Different Types of Statistical Tasks, their Target(s), and Typical Performance Measures.
| Estimation | Estimand(s) (True effects/parameters) | Bias, variance, mean square error, coverage, CI width |
| Hypothesis testing | True hypothesis(es) | Type I error rate, power |
| Model selection | True model(s) | Model-recovery rate, sensitivity, specificity |
| Prediction | New data | Prediction error, calibration, discrimination |
| Clustering | True cluster(s) | Fidelity to the true cluster structure |
| Design | Design characteristics | Expected sample size, minimum/maximum sample size, power, precision (for a fixed sample size) |
Note. Table adapted from Morris et al. (2019, Table 3).