Table 1. Carbon footprints of Teacher (ResNet18) and Student (MobileNetV2) model before KD (top two rows), traditional KD [26] and Ours approach on three different datasets.
CIFAR 10 | CIFAR 10 | Tiny ImageNet | |||||||
---|---|---|---|---|---|---|---|---|---|
Method | Accuracy (%) ↑ | Energy (kWh) ↓ | CO2_eq (g) ↓ | Accuracy (%) ↑ | Energy (kWh) ↓ | CO2_eq (g) ↓ | Accuracy (%) ↑ | Energy (kWh) ↓ | CO2_eq (g) ↓ |
Teacher | 95.04 | 0.28 | 74.25 | 76.03 | 0.25 | 65.55 | 63.39 | 1.43 | 413.60 |
Student | 90.52 | 0.16 | 45.02 | 67.80 | 0.16 | 44.23 | 59.64 | 0.68 | 182.53 |
KD [26] | 91.78 | 3.99 | 1173.44 | 69.70 | 3.80 | 1170.40 | 60.46 | 19.09 | 5595.31 |
Ours | 91.67 | 0.21 | 61.76 | 69.40 | 0.20 | 61.60 | 60.53 | 1.02 | 304.88 |