Table 2.
Performance of transition-probability-based model caching.
| Cache Size | Hit Rate | Latency (s) |
|---|---|---|
| 1 (No Cache) | 88.7% | 0.33 |
| 2 | 95.7% | 0.13 |
| 3 | 97% | 0.09 |
| 4 | 97.4% | 0.08 |
| 5 | 97.5% | 0.07 |
| 6 | 97.5% | 0.07 |
| 10 | 100% | 0.00 |
Performance of transition-probability-based model caching.
| Cache Size | Hit Rate | Latency (s) |
|---|---|---|
| 1 (No Cache) | 88.7% | 0.33 |
| 2 | 95.7% | 0.13 |
| 3 | 97% | 0.09 |
| 4 | 97.4% | 0.08 |
| 5 | 97.5% | 0.07 |
| 6 | 97.5% | 0.07 |
| 10 | 100% | 0.00 |