Table 4.

“Dictionary transfer” network

Layer	Type	Input(s)	No. of output neurons	Notes
ml1	LSTM	mi1	128
ml2	LSTM	mi1	128	Reversed
mm1	Concatenate	ml1, ml2		Dropout of 0.5
mb1	Bidirectional LSTM	mm1	64 per direction, total 128	Dropout of 0.5
mb2	Bidirectional LSTM	mb1	64 per direction, total 128	Dropout of 0.5
mp1	GlobalMaxPooling1D	mb2	128
md4	Dense	mp1	3	Activation = sigmoid