TABLE IV:
Test accuracy for federated fine-tuning on COVID-FL Central (centralized) and Split (non-IID). T represents the communication rounds of federated fine-tuning.
| Pre-training |
Test Accuracy (%) |
T | |||
|---|---|---|---|---|---|
| Method | Setup | Dataset | Central | Split | |
|
| |||||
| None | None | None | 91.42 | 77.08 | 1000 |
| Supervised | Centralized | ImageNet | 95.35 | 86.89 | 100 |
| BEiT [29] | Centralized | ImageNet | 95.62 | 84.45 | 100 |
| MAE [30] | Centralized | ImageNet | 96.35 | 84.32 | 100 |
|
| |||||
| Supervised | Centralized | ChestX-ray14 | 92.78 | 82.26 | 100 |
| BEiT [29] | Centralized | ChestX-ray14 | 96.07 | 90.28 | 100 |
| MAE [30] | Centralized | ChestX-ray14 | 96.35 | 91.04 | 100 |
|
| |||||
| Fed-BEiT | Distributed | COVID-FL | 95.75 | 87.09 | 100 |
| Fed-MAE | Distributed | COVID-FL | 95.77 | 91.47 | 100 |