Accelerated and Highly Correlated ASIC Synthesis of AI Hardware Subsystems Using CGP

Table 3

Four data format configurations used for inputs in the six activation functions represented as (integer part, fractional part) bits in a n-bit number.

Function	Config-1	Config-2	Config-3	Config-4
Sigmoid, ReLU, GeLU, Softplus	(n − 1, 0)	(3, n − 4)	(n − ⌊n/2⌋ − 1, ⌊n/2⌋)	(n − ⌊n/2⌋ − 1, ⌊n/2⌋ − 1)
Tanh	(n − 1, 0)	(2, n − 3)	(n − ⌊n/2⌋ − 1, ⌊n/2⌋)	(n − ⌊n/2⌋ − 1, ⌊n/2⌋ − 1)
Gaussian	(n − 1, 0)	(1, n − 2)	(n − ⌊n/2⌋ − 1, ⌊n/2⌋)	(n − ⌊n/2⌋ − 1, ⌊n/2⌋ − 1)