Skip to main content
. Author manuscript; available in PMC: 2020 Nov 27.
Published in final edited form as: Harv Data Sci Rev. 2020 Sep 30;2020(23):10.1162/99608f92.cfc5dd25. doi: 10.1162/99608f92.cfc5dd25

Table 1:

Experimental results for NoisySGD and their privacy analyses on MNIST. The accuracy is averaged over 10 independent runs. The hyperparameters in the first three rows are the same as in [2]. The μ in the 6th row is calculated using (5), which carries over to the 7th row via (6) with δ = 10−5. The number of epochs is equal to T × mini-batch size/n = pT.

η R σ Epochs Test accuracy (%) CLT μ CLT ε MA ε
0.25 1.5 1.3 15 95.0 0.23 0.83 1.19
0.15 1.0 1.1 60 96.6 0.57 2.32 3.01
0.25 1.5 0.7 45 97.0 1.13 5.07 7.10
0.25 1.5 0.6 62 97.6 2.00 9.98 13.27
0.25 1.5 0.55 68 97.8 2.76 14.98 18.72
0.25 1.5 0.5 100 98.0 4.78 31.12 32.40