Table 1.

Baseline data and test results of each functional segment of SurgSmart models

Model name	Dataset	Labeling	Labeling frames	Total frames	Videos	Annotating κ	Precision (%)	Recall	mAP	Accuracy	F1-score
Surgical phase and steps	Training	IT	27 131	215 170	178	0.90
		EA	10 877
		AL	13 511
		MHT	78 128
		DGB	34 868
		EG	20 312
		COR	30 343
	Validating	IT	2281	20 906	22
		EA	825
		AL	776
		MHT	9066
		DGB	3531
		EG	1855
		COR	2572
	Testing	IT	4110	25 598	22		91.31	84.38	NA	88.61	78.61
		EA	1841				78.53	82.08
		AL	1047				98.97	56.62
		MHT	9865				90.36	97.89
		DGB	3598				85.98	91.28
		EG	2705				92.00	83.25
		COR	2432				80.48	91.84
Parkland grading	Training	Mild (grade 1–2)	3862	6525	172	0.97
		Severe (grade 3–5)	2663
	Validating	Mild (grade 1–2)	468	850	22
		Severe (grade 3–5)	382
	Testing	Mild (grade 1–2)	468	858	22		100.00	92.31	NA	95.45	95.37
		Severe (grade 3–5)	390				90.00	100.00
Critical division action	Training	Artery/cystic duct division	4550	5120	142	0.92
	Validating		196		22
	Testing		374		23		75.08	89.31	NA	98.49	76.94
CVSI	Training	−1	5906	21 863	339	0.89
		0	3894
		1	11 293
		2	770
	Validating	−1	658	2126	76
		0	466
		1	924
		2	78
	Testing	−1	19	5305	22		61.29	100.00	76.86	80.64	70.66
		0	675				39.02	82.67
		1	4579				96.84	80.24
		2	32				54.00	84.38
CVSII	Training	−1	6144	22 298	342	0.88
		0	15 560
		2	594
	Validating	−1	738	2273	78
		0	1429
		2	106
	Testing	−1	29	6060	22		24.14	96.55	71.04	97.62	59.42
		0	5994				99.68	97.91
		2	37				33.93	51.35
CVSIII	Training	−1	5950	20 337	316	0.89
		0	8690
		1	3985
		2	1712
	Validating	−1	671	2006	74
		0	830
		1	323
		2	182
	Testing	−1	19	4530	22		37.25	100.00	66.49	78.87	56.82
		0	3541				92.48	84.69
		1	896				51.17	56.36
		2	74				20.08	67.57

The labeling of CVS=−1 means no area for CVS evaluation was detected.

AL, adhesion lysis; COR, clear the operative region; CVSI, hepatocystic triangle criterion; CVSII, cystic plate criterion; CVSIII, two structures criterion; CVS, the critical view of safety; DGB, dissecting gallbladder from liver bed; EA, establishing access; EG, extracting the gallbladder; IT, idle time; mAP, mean average precision; MHT, mobilizing the hepatocystic triangle; NA, not applicable.