Fig. 3.

Example of estimating predictive model performance using Formula-fold cross validation (in this case, threefold). The estimated predictive performance is an average of the validation scores from each of the Formula-folds (and often from multiple iterations of Formula-fold CV). The folds are randomly partitioned training and testing groups. It is important that feature selection and classifier parameter selection occur within the cross validation in order to avoid estimation bias.