TABLE IV:
Test accuracy for federated fine-tuning on COVID-FL Central (centralized) and Split (non-IID). T represents the communication rounds of federated fine-tuning.
Pre-training |
Test Accuracy (%) |
T | |||
---|---|---|---|---|---|
Method | Setup | Dataset | Central | Split | |
| |||||
None | None | None | 91.42 | 77.08 | 1000 |
Supervised | Centralized | ImageNet | 95.35 | 86.89 | 100 |
BEiT [29] | Centralized | ImageNet | 95.62 | 84.45 | 100 |
MAE [30] | Centralized | ImageNet | 96.35 | 84.32 | 100 |
| |||||
Supervised | Centralized | ChestX-ray14 | 92.78 | 82.26 | 100 |
BEiT [29] | Centralized | ChestX-ray14 | 96.07 | 90.28 | 100 |
MAE [30] | Centralized | ChestX-ray14 | 96.35 | 91.04 | 100 |
| |||||
Fed-BEiT | Distributed | COVID-FL | 95.75 | 87.09 | 100 |
Fed-MAE | Distributed | COVID-FL | 95.77 | 91.47 | 100 |