Table 6.
Comparison of inference times using Raspberry Pi 4B according to the batch size and framework used for inference.
| Item | Batch Size | |
|---|---|---|
| 1 | 16 | |
| Inference time (ms) using Pytorch | 426.93 | 7.677 |
| Inference time (ms) using TVM | 7.811 | 5.772 |
Comparison of inference times using Raspberry Pi 4B according to the batch size and framework used for inference.
| Item | Batch Size | |
|---|---|---|
| 1 | 16 | |
| Inference time (ms) using Pytorch | 426.93 | 7.677 |
| Inference time (ms) using TVM | 7.811 | 5.772 |