. Author manuscript; available in PMC: 2021 Oct 1.

Published in final edited form as: Med Ultrasound Preterm Perinat Paediatr Image Anal (2020). 2020 Oct 1;12437:180–188. doi: 10.1007/978-3-030-60334-2_18

Table 3.

Results of operator skill level classification with different models using motion data when scanning the brain. “EX” and “NQ” denotes expert and newly qualified respectively. “Macro” and “Weighted” refers to the mean and weighted mean for each evaluation metric.

		Precision	Recall	F1 Score	Accuracy
1D ResNet18	EX	0.88	0.71	0.79	0.85
	NQ	0.83	0.94	0.88
	Macro	0.86	0.82	0.83
	Weighted	0.85	0.85	0.84

1D ResNet 18 with operator loss	EX	0.91	0.97	0.94	0.95
	NQ	0.98	0.94	0.96
	Macro	0.94	0.95	0.95
	Weighted	0.95	0.95	0.95

SVM	EX	0.67	0.65	0.66	0.75
	NQ	0.80	0.81	0.80
	Macro	0.73	0.73	0.73
	Weighted	0.75	0.75	0.75