| 1 |
BFGS quasi-Newton backpropagation |
BFG |
| 2 |
conjugate gradient backpropagation
with Powell–Beale restarts |
CGB |
| 3 |
conjugate gradient backpropagation
with Fletcher–Reeves updates |
CGF |
| 4 |
conjugate gradient backpropagation
with Polak–Ribiére updates |
CGP |
| 5 |
gradient descent backpropagation |
GD |
| 6 |
gradient descent with adaptive
learning rate backpropagation |
GDA |
| 7 |
gradient descent with momentum
backpropagation |
GDM |
| 8 |
gradient descent with momentum
and adaptive learning rate backpropagation |
GDX |
| 9 |
Levenberg–Marquardt backpropagation |
LM |
| 10 |
one-step secant
backpropagation |
OSS |
| 11 |
resilient backpropagation |
RP |
| 12 |
scaled conjugate gradient
backpropagation |
SCG |
| 13 |
bayesian regularization
backpropagation |
BR |