TABLE 4.
Estimating ρ for resequencing data where θ = 100 and NT = number of reads required to use homozygous genotype calls in the inference
| X | NT | ρ0 = 20 | ρ0 = 40 | ρ0 = 60 |
|---|---|---|---|---|
| 16× | 3 | 21.6 (7.4) | 42.2 (12.1) | 63.9 (16.3) |
| 5 | 21.9 (7.6) | 43.3 (12.9) | 64.2 (16.7) | |
| 7 | 21.9 (7.6) | 42.3 (12.5) | 64.2 (16.7) | |
| 8× | 3 | 21.6 (7.6) | 42.2 (12.1) | 63.9 (16.6) |
| 5 | 21.6 (7.3) | 43.3 (12.9) | 63.2 (15.9) | |
| 7 | 21.9 (7.5) | 42.3 (12.5) | 62.7 (16.3) | |
| 4× | 3 | 21.4 (7.6) | 42.7 (12.9) | 62.1 (15.8) |
| 5 | 21.2 (7.3) | 40.9 (11.4) | 61.5 (15.5) | |
| 7 | 19.8 (6.3) | 37.6 (10.8) | 54.6 (14.6) | |
| 2× | 3 | 19.8 (6.6) | 38.0 (11.1) | 55.9 (14.3) |
| 5 | 13.4 (7.7) | 22.7 (18.5) | 30.4 (30.5) | |
| 7 | NA | NA | NA |
We report mean (and RMSE) of the estimates over 1000 simulations. NA, not applicable due to too few two-locus pairs meeting the read criteria.