Table 1:
Hyperparameters of exemplar RNN.
| Hyperparameter | Value |
|---|---|
|
| |
| Number of units | 300 |
| Number of areas | 3 |
| Learning rate | 5e-5 |
| Time Constant | 50ms |
| Discretization bin width | 10ms |
| Rate regularization | 0 |
| Weight regularization | 1 |
| Activation function | Relu |
| Feedforward connection | 10% |
| Feedback connections | 5% |
| Dale law | Yes |