Algorithm 2 Fine-tuning Procedure |
1:
|
▹ Pretrained student model |
2: D
|
▹ Target dataset |
3:
|
▹ Total number of folds |
4:
|
▹ Total number of training epochs |
5:
|
▹ Patience number for early stopping |
6: procedure Fine-tune() |
|
7: for fold in range [1, ] do
|
|
8: = LoadData() |
|
9: for in range [1, ] do
|
|
10: for i in range [1, ] do
|
|
11:
|
|
12: Backpropagate
|
|
13:
|
|
14: CheckForEarlyStopping() |
|
15: Accuracy
|
|
16: =
|
|
17: return
|
|
* In this study, , , and . |
|