Table 8. Scaling Across Multiple GPU Instances^a.

instances	total cores	ranks × threads	MEM (ns/d)	EMEM	RIB (ns/d)	ERIB
1	16	1 × 16/16 × 1	95.3	95.3	5.15	1.00
2	32	4 × 8	65.0	65.0	8.49	0.82
4	64	8 × 8/32 × 2	73.1	73.1	15.80	0.77
8	128	32 × 4/64 × 2	63.7	63.7	21.25	0.52
16	256	32 × 8			25.86	0.31
32	512	32 × 16			22.78	0.14

^aAs in Table 7, but for g4dn.8xl instances with hyperthreading off.