Table 13.
NET | OPTIMIZER | TOTAL TRAINABLE PARAMETERS (millions) | NUMBER OF EPOCHS | Total Runtime (in Sec) | Average Runtime per epoch (in Sec) |
---|---|---|---|---|---|
VGG16 | SGD | 40 | 10 | 579 | 57.9 |
VGG16 | RMSProp | 40 | 5 | 312 | 62.4 |
VGG16 | Adam | 40 | 5 | 311 | 62.2 |
VGG19 | SGD | 45 | 10 | 800 | 80 |
VGG19 | RMSProp | 45 | 10 | 802 | 80.2 |
VGG19 | Adam | 45 | 10 | 812 | 81.2 |
Inception | SGD | 21 | 30 | 2490 | 83 |
Inception | RMSProp | 21 | 15 | 1215 | 81 |
Inception | Adam | 21 | 40 | 3250 | 81 |
Xception | SGD | 20 | 20 | 1631 | 81.55 |
Xception | RMSProp | 20 | 10 | 1343 | 134.3 |
Xception | Adam | 20 | 10 | 880 | 88 |
DenseNet | SGD | 20 | 20 | 1721 | 86.05 |
DenseNet | RMSProp | 20 | 20 | 1828 | 91.4 |
DenseNet | Adam | 20 | 20 | 1798 | 89.9 |
Inception-ResNet-V2 | SGD | 64 | 30 | 2439 | 81.3 |
Inception-ResNet-V2 | RMSprop | 64 | 30 | 3251 | 108.36 |
Inception-ResNet-V2 | Adam | 64 | 30 | 2464 | 82.13 |
EfficientNet B0 | SGD | 4 | 20 | 1104 | 55.2 |
EfficientNet B0 | RMSProp | 4 | 10 | 555 | 55.5 |
EfficientNet B0 | Adam | 4 | 20 | 1122 | 56.1 |
EfficientNet B4 | SGD | 17 | 20 | 1268 | 63.4 |
EfficientNet B4 | RMSProp | 17 | 20 | 1279 | 63.95 |
EfficientNet B4 | Adam | 17 | 20 | 1228 | 61.4 |