Figure 8.
Convergence of teacher and student models. Student model trained with KD converges quicker and to lower loss values when compared to the teacher model.
Official websites use .gov
A
.gov website belongs to an official
government organization in the United States.
Secure .gov websites use HTTPS
A lock (
) or https:// means you've safely
connected to the .gov website. Share sensitive
information only on official, secure websites.