Skip to main content
. 2022 Apr 19;13:2032. doi: 10.1038/s41467-022-29763-x

Fig. 2. Influence of mutual distillation on the mentee and mentor models.

Fig. 2

The mean values of AUC scores on MIND and F1 scores on ADR as well as their 95% confidence intervals are illustrated (n = 5 independent experiments). We compare the performance of mentors and the four-layer or two-layer mentee models when mutual distillation (MD) is used or not. The results show that mutual distillation can improve the performance of both mentee and mentor models, which is because useful knowledge can be reciprocally transferred between the mentee and mentor.