| DNN | Deep neural network |
| AdaNet | Adaptive structural learning of artificial neural networks |
| BO | Bayesian optimization |
| BP | Backpropagation |
| BN | Deep neural network with batch-normalization |
| Casc-Corr | Cascade-correlation learning architecture |
| GBTP | Gradient-based target propagation |
| LN | Deep neural network with layer normalization |
| MLP | Multilayer perceptron |
| s-ReLU | Sparse rectifier linear unit |
| RDTP | Residual driven target propagation |
| ResNet | Deep residual neural networks |
| SNN | Self-normalizing neural networks |
| TP | Target propagation |
| WN | Deep neural network with weight normalization |