TABLE II.

Beamformer performance metrics for the four algorithms (delay sum and integrate (DSI), robust Capon Beamforming (RCB), Phase Coherence Factor Masked DSI (PDSI), and Amplitude Coherence Factor Masked DSI (ADSI)) for each Source Pattern with a Source Density of 7.5×10⁵ Sources/mL. Spatial Filter Thresholds were Based on Precision-Recall Analysis. Bolded Numbers Highlight the Maximum Values for the Beamformer Performance Binary Classifier Metrics. Italicized Numbers are Statistically Significantly Lower than the Maximum Values.

Source Pattern	Binary Classifier Metric (%)	DSI	RCB	PDSI	ADSI
1 Cloud 32,789 sources	AUROC	97.6± 0.2	98.2 ± 0.2	89.6± 0.4	89.8 ± 0.4
	Specificity	96.5 ± 0.1	96.0 ± 0.1	96.8 ± 0.1	96.8 ± 0.1
	Sensitivity	82.4 ± 0.7	89.0 ± 0.6	80.5 ± 0.7	81.4 ± 0.7
	PPV	71.7 ± 0.8	70.2 ± 0.7	72.9 ± 0.7	72.8 ± 0.7
	F1	76.7± 0.6	78.5 ± 0.6	76.5 ± 0.6	76.9 ± 0.6
4 clouds 21,860 sources	AUROC	97.0 ± 0.3	97.6 ± 0.2	88.1 ± 0.5	88.4 ± 0.5
	Specificity	96.1 ± 0.1	95.0 ± 0.1	96.3 ± 0.2	96.2 ± 0.1
	Sensitivity	78.6± 0.9	87.2 ± 0.7	77.1 ± 0.9	78.8 ± 0.9
	PPV	60.3 ± 0.9	57.0 ± 0.9	61.4 ± 1.0	61.1 ± 0.9
	F1	68.2 ± 0.8	68.9 ± 0.7	68.3 ± 0.8	68.8 ± 0.8
2 lateral clouds 10,930 sources	AUROC	97.6± 0.3	99.3 ± 0.2	87.6± 0.7	87.8 ± 0.7
	Specificity	99.33 ± 0.04	99.47 ± 0.04	99.33 ± 0.04	99.28 ± 0.05
	Sensitivity	72.7 ± 1.3	71.7 ± 1.4	73.2 ± 1.4	74.9 ± 1.3
	PPV	79.7 ± 1.3	83.0 ± 1.3	79.8 ± 1.3	79.0 ± 1.3
	F1	76.0 ± 1.0	76.9 ± 1.0	76.3 ± 1.0	76.9 ± 1.0
2 axial clouds 10,930 sources	AUROC	98.5 ± 0.3	98.7 ± 0.2	85.7± 0.7	85.1 ± 0.7
	Specificity	98.84 ± 0.06	98.70 ± 0.06	98.76± 0.06	98.79 ± 0.06
	Sensitivity	67.4 ± 1.4	64.3 ± 1.4	69.8 ± 1.4	70.5 ± 1.3
	PPV	68.1 ± 1.3	64.6 ± 1.3	67.5 ± 1.3	67.7 ± 1.3
	F1	67.7 ± 1.0	64.4 ± 1.1	68.6 ± 1.1	69.1 ± 1.1