Fig. 7.
The process of knowledge distillation. A smaller student model is trained to mimic a pretrained larger teacher model [44]
Official websites use .gov
A
.gov website belongs to an official
government organization in the United States.
Secure .gov websites use HTTPS
A lock (
) or https:// means you've safely
connected to the .gov website. Share sensitive
information only on official, secure websites.