Table 2:
AutoLFADS Performance. An evaluation of AutoLFADS performance on Ray and KubeFlow. Test trial performance comparison on four neurally relevant metrics for evaluating latent variable models: co-smoothing on held-out neurons (co-bps), hand trajectory decoding on held-out neurons (vel R2), match to peristimulus time histogram (PSTH) on held-out neurons (psth R2), forward prediction on held-in neurons (fp-bps). The trained models converge with less than 5% difference between the frameworks on the above metrics. The percent difference is calculated with respect to the Ray framework.
| Framework | co-bps (↑) | vel R2 (↑) | psth R2 (↑) | fp-bps (↑) |
|---|---|---|---|---|
| Ray | 0.3364 | 0.9097 | 0.6360 | 0.2349 |
| KubeFlow | 0.35103 | 0.9099 | 0.6339 | 0.2405 |
| Percent difference (%) | +4.35 | +0.03 | −0.33 | +2.38 |