FIGURE 4.
Training loss of ACNS with various combinations of and
; the designated
,
, and
; and
of 4. The area marked with a red rectangle in (a) is magnified as (b). A y-axis, i.e. loss, is in a log scale. A cyan dashed line is the result of ACNS(8, 4, 5, 9, 5, 4), a red dashed line is the result of ACNS(16, 4, 5, 9, 5, 4), a red solid line is the result of ACNS(16, 8, 5, 9, 5, 4), a red dotted line is the result of ACNS(16, 16, 5, 9, 5, 4), a green dashed line is the result of ACNS(32, 16, 5, 9, 5, 4), a green solid line is the result of ACNS(32, 32, 5, 9, 5, 4), a blue dashed line is the result of ACNS(48, 16, 5, 9, 5, 4), a blue solid line is the result of ACNS(48, 24, 5, 9, 5, 4), and a blue dotted line is the result of ACNS(48, 48, 5, 9, 5, 4).