Figure 3.
Derivative approximation of the non-differentiable spike activity. (A) Step activation function of the spike activity and its original derivative function which is a typical Diract function δ(u) with infinite value at u = 0 and zero value at other points. This non-differentiable property disables the error propagation. (B) Several typical curves to approximate the derivative of spike activity.