Table 2.
Hyperparameters used in MSML-DenseXmer.
| S.No. | Hyperparameter | Optimal values | Experimental value |
|---|---|---|---|
| 1 | Batch size | 4 | 4,8,16 |
| 2 | Patch size | 1 | 1, 2, 3, 4 |
| 3 | Window size | 7 | 4,7,8 |
| 4 | Learning rate | 1e-5 | 1e-4, 1e-3, 1e-2 |
| 5 | Epoch | 25 | 10, 15, 20, 25, 30, 35, 40, 45, and 50 |
| 6 | Image size | 224 × 224 | 224 × 224 |
| 7 | Input channel | 1 | Gray scale image |
| 8 | Output channel | 1 | Gray scale image |
| 9 | Embedding dimension | 96 | 48, 96, 192 |
| 10 | Number of attention heads | 3 | 1, 2, 3, 4, 6 |
| 11 | MLP ratio | 4 | 2, 3, 4 |
| 12 | Number of RSTB blocks | 3 | 1, 2, 3, 4, 5 |
| 13 | Number of STL per RSTB | 6 | 2, 4, 6, 8 |
| 14 | Number of ST blocks per STL | 2 | 1, 2, 3 |
| 15 | MSML-Dense: Growth Rate | 32 | 16, 32, 64 |