Table 5:
Trial Numbers for Figure S2, Comparing Nonlinear Activation Functions for the Dendrite Nodes in the FCNN For Each Dataset.
| MNIST | ||||||
|---|---|---|---|---|---|---|
|
| ||||||
| 1-tree | 2-tree | 4-tree | 8-tree | 16-tree | 32-tree | |
| ReLU | 10 | 10 | 10 | 10 | 10 | 10 |
| LReLU | 10 | 10 | 10 | 10 | 10 | 10 |
| Sigmoid | 10 | 10 | 10 | 10 | 10 | 10 |
| Swish | 10 | 10 | 10 | 10 | 10 | 10 |
| NaCaK | 10 | 10 | 10 | 10 | 10 | 10 |
|
| ||||||
| FMNIST | ||||||
|
| ||||||
| 1-tree | 2-tree | 4-tree | 8-tree | 16-tree | 32-tree | |
| ReLU | 7 | 10 | 10 | 10 | 10 | 10 |
| LReLU | 10 | 10 | 10 | 10 | 10 | 10 |
| Sigmoid | 10 | 10 | 10 | 10 | 10 | 10 |
| Swish | 10 | 10 | 10 | 10 | 10 | 10 |
| NaCaK | 10 | 10 | 10 | 10 | 10 | 10 |
|
| ||||||
| KMNIST | ||||||
|
| ||||||
| 1-tree | 2-tree | 4-tree | 8-tree | 16-tree | 32-tree | |
|
| ||||||
| ReLU | 10 | 10 | 10 | 10 | 10 | 10 |
| LReLU | 10 | 10 | 10 | 10 | 10 | 10 |
| Sigmoid | 10 | 10 | 10 | 10 | 10 | 10 |
| Swish | 10 | 10 | 10 | 10 | 10 | 10 |
| NaCaK | 10 | 10 | 10 | 10 | 10 | 10 |
|
| ||||||
| EMNIST | ||||||
|
| ||||||
| 1-tree | 2-tree | 4-tree | 8-tree | 16-tree | 32-tree | |
|
| ||||||
| ReLU | 10 | 10 | 10 | 10 | 10 | 10 |
| LReLU | 10 | 10 | 10 | 10 | 10 | 10 |
| Sigmoid | 10 | 10 | 10 | 10 | 10 | 10 |
| Swish | 10 | 10 | 10 | 10 | 10 | 10 |
| NaCaK | 10 | 10 | 10 | 10 | 10 | 10 |
|
| ||||||
| SVHN | ||||||
|
| ||||||
| 1-tree | 2-tree | 4-tree | 8-tree | 16-tree | 32-tree | |
|
| ||||||
| ReLU | 1 | 0 | 1 | 4 | 2 | 5 |
| LReLU | 4 | 6 | 8 | 6 | 7 | 9 |
| Sigmoid | 1 | 0 | 1 | 0 | 2 | 1 |
| Swish | 2 | 2 | 0 | 1 | 0 | 2 |
| NaCaK | 0 | 1 | 0 | 0 | 1 | 0 |
|
| ||||||
| USPS | ||||||
|
| ||||||
| 1-tree | 2-tree | 4-tree | 8-tree | 16-tree | 32-tree | |
|
| ||||||
| ReLU | 8 | 10 | 10 | 10 | 10 | 10 |
| LReLU | 10 | 10 | 10 | 10 | 10 | 10 |
| Sigmoid | 10 | 10 | 10 | 10 | 10 | 10 |
| Swish | 10 | 10 | 10 | 10 | 10 | 10 |
| NaCaK | 10 | 10 | 10 | 10 | 10 | 10 |
|
| ||||||
| CIFAR10 | ||||||
|
| ||||||
| 1-tree | 2-tree | 4-tree | 8-tree | 16-tree | 32-tree | |
|
| ||||||
| ReLU | 0 | 1 | 1 | 2 | 2 | 3 |
| LReLU | 9 | 9 | 9 | 10 | 7 | 8 |
| Sigmoid | 5 | 6 | 4 | 6 | 6 | 3 |
| Swish | 5 | 4 | 5 | 4 | 6 | 3 |
| NaCaK | 8 | 8 | 10 | 10 | 10 | 10 |