Official websites use .gov
A
.gov website belongs to an official
government organization in the United States.
Secure .gov websites use HTTPS
A lock (
) or https:// means you've safely
connected to the .gov website. Share sensitive
information only on official, secure websites.
Results comparison of whether to use the gradual enhancement of the teacher-constraint method. gMD, incremental distillation weights; fMD, fixed distillation weights.
| Dataset | CIFAR10 | CIFAR100 | ||||
|---|---|---|---|---|---|---|
| Model | Baseline | fMD | gMD | Baseline | fMD | gMD |
| AlexNet | 77.58 | 79.49 | 79.87 | 43.85 | 49.96 | 50.13 |
| VGG19 | 93.36 | 93.93 | 94.33 | 72.57 | 75.32 | 75.45 |
