Skip to main content
. Author manuscript; available in PMC: 2023 May 1.
Published in final edited form as: Neuroscience. 2021 Aug 6;489:262–274. doi: 10.1016/j.neuroscience.2021.07.036

Table 5:

Trial Numbers for Figure S2, Comparing Nonlinear Activation Functions for the Dendrite Nodes in the FCNN For Each Dataset.

MNIST

1-tree 2-tree 4-tree 8-tree 16-tree 32-tree
ReLU 10 10 10 10 10 10
LReLU 10 10 10 10 10 10
Sigmoid 10 10 10 10 10 10
Swish 10 10 10 10 10 10
NaCaK 10 10 10 10 10 10

FMNIST

1-tree 2-tree 4-tree 8-tree 16-tree 32-tree
ReLU 7 10 10 10 10 10
LReLU 10 10 10 10 10 10
Sigmoid 10 10 10 10 10 10
Swish 10 10 10 10 10 10
NaCaK 10 10 10 10 10 10

KMNIST

1-tree 2-tree 4-tree 8-tree 16-tree 32-tree

ReLU 10 10 10 10 10 10
LReLU 10 10 10 10 10 10
Sigmoid 10 10 10 10 10 10
Swish 10 10 10 10 10 10
NaCaK 10 10 10 10 10 10

EMNIST

1-tree 2-tree 4-tree 8-tree 16-tree 32-tree

ReLU 10 10 10 10 10 10
LReLU 10 10 10 10 10 10
Sigmoid 10 10 10 10 10 10
Swish 10 10 10 10 10 10
NaCaK 10 10 10 10 10 10

SVHN

1-tree 2-tree 4-tree 8-tree 16-tree 32-tree

ReLU 1 0 1 4 2 5
LReLU 4 6 8 6 7 9
Sigmoid 1 0 1 0 2 1
Swish 2 2 0 1 0 2
NaCaK 0 1 0 0 1 0

USPS

1-tree 2-tree 4-tree 8-tree 16-tree 32-tree

ReLU 8 10 10 10 10 10
LReLU 10 10 10 10 10 10
Sigmoid 10 10 10 10 10 10
Swish 10 10 10 10 10 10
NaCaK 10 10 10 10 10 10

CIFAR10

1-tree 2-tree 4-tree 8-tree 16-tree 32-tree

ReLU 0 1 1 2 2 3
LReLU 9 9 9 10 7 8
Sigmoid 5 6 4 6 6 3
Swish 5 4 5 4 6 3
NaCaK 8 8 10 10 10 10