Figure 6.

Uncertainty quantification

First row: distribution of the probability assigned to the correct label for correct predictions and incorrect predictions (see Equation 1). Second row: calibration plot. The probabilities are obtained using Codex 5-shot CoT and an ensemble of $k=100$ predictions sampled with temperature $\tau =0.5$.