|
Algorithm 3: Source-Fitted Reliability-Gated Selective Classification |
Input: Calibrated probabilities; predictive entropy; logit-derived energy; conformal prediction set; source-fitted standardization parameters; signal weights; acceptance threshold; review threshold. |
Output: AI-supported triage, specialist review, or reliability-based deferral. |
Method:
Compute one minus maximum calibrated confidence.
Compute predictive entropy.
Compute the logit-derived energy reliability feature.
Determine conformal prediction-set size.
Apply the fixed source-derived standardization to the four reliability signals.
Combine the standardized signals to obtain the reliability-risk score.
If the score is below the acceptance threshold, retain the prediction for AI-supported triage.
If the score lies between the acceptance and review thresholds, assign the case to specialist review.
Otherwise, assign the case to reliability-based deferral.
Report retained coverage, accepted-case accuracy, selective risk, and non-retained rate.
DDI OOD scores and explanation-stability measurements are not inputs to this decision rule. |