TABLE IV.
Comparison of lossless compression algorithms in terms of total time to generate converted HDF5 file (reading raw gain + ADC frames, conversion to photon, frame summation, compression, and writing converted data to SSDs) processing time with XDS and compression factor for a large lysozyme dataset collected at the Swiss Light Source X06SA beamline JUNGFRAU 4M at 1.1 kHz using 12.4 keV x-rays, 100% beam transmission, and 0.088°/880 μs steps. 2045 images (180° rotation) were taken for data analysis. For writing corresponding frequency is noted. Writing time was averaged over 10 runs while processing time over 20 runs due to smaller differences.
| Compression algorithm | Writing time/frequency | Processing time | Compression (bit/pxl) |
|---|---|---|---|
| No compression | 12.9 s/158 Hz | 73.5 s | 16.0 |
| LZ4 | 6.4 s/320 Hz | 73.3 s | 6.8 |
| Bitshuffle/LZ4 | 3.7 s/550 Hz | 74.3 s | 2.3 |
| Zstd | 6.3 s/324 Hz | 75.4 s | 2.8 |
| Bitshuffle/Zstd | 5.8 s/351 Hz | 73.2 s | 1.8 |
| Gzip | 66.7 s/31 Hz | 75.1 s | 2.4 |