Table 2.
Comparing the accuracy of the first category.
| Mechanism | Dataset | Parameters | Epoch | Accuracy (%) | |
|---|---|---|---|---|---|
| DP-SGD | MNIST | ε=0.5, δ=10−5 | 16 | 90 | |
| ε=2, δ=10−5 | 140 | 95 | |||
| ε=8, δ=10−5 | 800 | 97 | |||
| CIFAR-10 | ε=2; δ=10−5 | 60 | 67 | ||
| ε=4; δ=10−5 | 130 | 70 | |||
| ε=8; δ=10−5 | 700 | 73 | |||
|
| |||||
| The improvement of DP-SGD | MNIST | Time | k = 0.05 | 38 | 93.4 |
| Step | k = 0.6; period = 10 | 31 | 92.8 | ||
| Exp | k = 0.01 | 71 | 93.4 | ||
| Poly | k = 3; σend=2; period = 100 | 44 | 93.0 | ||
| Validation | k = 0.7; m = 5; σ=0.01; period = 10 | 64 | 93.0 | ||
| CIFAR-10 | Exp | σ 0=30; k = 0.001 | 200 | 43 | |
| Validation | σ 0=35; k = 0.99; period = 50; m = 1; δ=0.01 | 200 | 45 | ||
|
| |||||
| AdLM | MNIST | ε=0.25 | 500 | 90.2 | |
| ε=0.5 | 500 | 93.66 | |||
| CIFAR-10 | ε=2.5 | 800 | 72.1 | ||
| ε=8 | 800 | 77 | |||