|
Algorithm 2 Compression Algorithm |
-
Input:
Use as the training set and a teacher model .
-
1:
for each epoch do
-
1:
Calculate the soft loss .
-
1:
Calculate the hard loss .
-
1:
Calculate the total loss in Equation (4).
-
2:
end for
-
3:
Output: A new student model .
|