Table 5.

Comparison of the Statistical Packages for Receiver Operating Characteristic Curve Analyses

Statistical packages		ROC plot	Confidence interval	pAUC	Multiple comparisons	Cut-off values	Sample size	Open source	Web tool access	User interface
Commercial program	IBM SPSS (ver. 25)	○	○	×	×	×	×	×	×	○
	STATA (ver. 14)	○	○	○	○	○	×	×	×	○
	MedCalc (ver. 19.4.1)	○	○	×	○	○	○	×	×	○
	NCSS 2021	○	○	×	○	○	○	×	×	○
Free program	OptimalCutpoints	○	○	×	×	○	×	○	×	×
	(ver. 1.1-4)
	ROCR (ver. 1.0-11)	○	○	○	×	×	×	○	×	×
	pROC (ver. 1.17.0.1)	○	○	○	○	○	○	○	×	○
	easyROC (ver. 1.3.1)	○	○	○	○	○	○	○	○	○
	plotROC (ver. 2.2.1)	○	○	×	○	○	×	○	○	○

This table was adapted and modified from Goksuluk et al. [33]. ROC: receiver operating characteristic, pAUC: partial area under the ROC curve. O: possible, X: impossible.