Table 5.

FakeBERT layered architecture

Layer	Input size	Output size	Param number
Embedding	1000	1000 × 100	25187700
Conv1D	1000 × 100	998 × 128	38528
Conv1D	1000 × 100	997 × 128	51328
Conv1D	1000 × 100	996 × 128	64128
Maxpool	998 × 128	199 × 128	0
Maxpool	997 × 128	199 × 128	0
Maxpool	996 × 128	199 × 128	0
Concatenate	199 × 128, 199 × 128, 199 × 128	597 × 128	0
Conv1D	597 × 128	593 × 128	82048
Maxpool	593 × 128	118 × 128	0
Conv1D	118 × 128	114 × 128	82048
Maxpool	114 × 128	3 × 128	0
Flatten	3 × 128	384	0
Dense	384	128	49280
Dense	128	2	258