A Cooperative Lightweight Translation Algorithm Combined with Sparse-ReLU

Table 3

Parameters of the model.

Parameter name	Small model
d_model	512
n_heads	3
d_queries	128
d_values	128
d_inner	1024
n_layers	7
max_len	300
cnn_kernel	(5,512)
beam_size	5