TABLE II.
MLPerf Tiny v0.5 Inference Benchmarks [9]
Application | Dataset (Input Size) | Model Type (TFLM model size) | Quality Target (Metric) |
---|---|---|---|
Keyword Spotting | Speech Commands [10] (49×10) | DS-CNN [11] [12] [13] (52.5 kB) | 90% (Top-1) |
Visual Wake Words | VWW Dataset [14] (96×96) | MobileNetV1 [12] (325 kB) | 80% (Top-1) |
Image Recognition | CIFAR-10 [15] (32×32) | ResNetV1 [16] (96 kB) | 85% (Top-1) |
Anomaly Detection | ToyADMOS [17], MIMII [18] (5×128) | FC-Autoencoder [9] (270 kB) | 0.85 AUC |