Figure 1.

Regularization corrects for overfitting. A sample reconstruction of the $2^{20}$ (≈1 million) probabilities for a landscape, based on 256 datapoints. Without the regularization constraint (red points), the model underestimates the probabilities of some reasonably common configurations. The effect is largely controlled for when using regularization with cross-validation (blue points).