Official websites use .gov
A
.gov website belongs to an official
government organization in the United States.
Secure .gov websites use HTTPS
A lock (
) or https:// means you've safely
connected to the .gov website. Share sensitive
information only on official, secure websites.
Results of all experiments performed.
| Experiment performed | Model | Validation accuracy |
|---|---|---|
| Baseline teacher training | ResNeXt29 | 75% |
| MobileNetV2 | 60.71% | |
|
| ||
| Normal KD | ResNeXt29 teacher | 60.71% |
| MobileNetV2 student | ||
|
| ||
| Reverse KD | MobileNetV2 teacher | 65.58% |
| ResNeXt29 student | ||
|
| ||
| Bilateral KD | Phase 1+phase 2+phase 3 | 96.3% |
