Table 1.

Commonly used activation functions and segmented spline activation function.

Activation Function	Definition
ReLU	$f\left(x\right)=max(0, x)$
Sigmoid	$f\left(x\right)=\frac{1}{1+e^{-x}}$
Hyperbolic Tangent	$f\left(x\right)=\frac{e^x-e^{-x}}{e^x+e^{-x}}$
Segmented Spline	$f\left(x\right)=\left(C\right[i+1]-C[i\left]\right)\left(\right(x+1)\Delta -i)+C\left[i\right]$