Figure 1:

Parameter Ensembling by Perturbation (PEP) on pre-trained InceptionV3 [44]. The rectangle shaded in gray in (a) is shown in greater detail in (b). The average log-likelihood of the ensemble average, $\mathbb{L}(\sigma )$, has a well-defined maximum at σ = 1.85 × 10⁻³. The ensemble also has a noticeable increase in likelihood over the individual ensemble item average log-likelihoods, $(\overline{\ln (L)})$ and over their average. In this experiment, an ensemble size of 5 (M = 5) was used for PEP and the experiments were run on 5000 validation images.