Table 3. Summation integration of 1 × 105 simulated spots.
In the column of equation references, M indicates a reference to MOSFLM, described by Leslie (1999 ▸). The stated precisions are given by the standard errors of the estimators.
| Zone A | Zone B | |||||
|---|---|---|---|---|---|---|
| Statistics over 1 × 105 samples | Refer to equation | Raw | Corrected | Raw | Corrected | |
| Summation integration intensity distribution | mean(I S) (ADU) | Equation (15) | 8205.3 (4) | 8254.0 (4) | 8204.7 (4) | 8206.4 (4) |
| var(I S) (ADU2) | Equation (15) | 18240 (80) | 18890 (80) | 18060 (80) | 18640 (80) | |
| Variance estimates | mean( ) (ADU2) |
Equation (11) in M | 11651.0 (4) | 12385.3 (4) | 11640.1 (4) | 12367.6 (4) |
mean( ) (ADU2) |
Equation (18) | 18761.8 (6) | 20302.2 (6) | 18745.0 (6) | 20274.8 (6) | |