Skip to main content
. 2009 May 13;119(3):397–416. doi: 10.1007/s00122-009-1047-9

Table 2.

Results from a simulation study on Inline graphic for a range of values of genetic similarity pgs and expected numbers of fragments m1 and m2, 10,000 replicated pairs of AFLP profiles, 1,000 bootstrap resamples, fldFS from A. thaliana with N = 450

Parameter settings Part I Results for Inline graphic
pgs m1 m2 Mean and SE 95% BCa bootstrap ci
Mean Mean after bias correction Bootstrap SE Non-coverage % (too low, too high) Length
0.0 40 40 −0.0016 −0.0014 0.0643 5.34 (3.04, 2.30) 0.2584
70 70 −0.0028 −0.0022 0.0685 5.45 (2.88, 2.57) 0.2680
120 120 −0.0030 −0.0024 0.0733 5.38 (3.11, 2.27) 0.2862
0.1 40 40 0.0986 0.0998 0.0743 4.53 (2.28, 2.25) 0.2942
70 70 0.0987 0.0995 0.0712 4.93 (2.53, 2.40) 0.2781
120 120 0.0970 0.0978 0.0717 4.92 (2.80, 2.12) 0.2797
0.3 40 40 0.2976 0.3002 0.0821 4.73 (2.16, 2.57) 0.3205
70 70 0.2981 0.2997 0.0713 5.29 (2.55, 2.74) 0.2780
120 120 0.2978 0.2989 0.0661 5.08 (2.58, 2.50) 0.2582
0.5 40 40 0.4976 0.5007 0.0788 4.30 (2.17, 2.13) 0.3070
70 70 0.4974 0.4993 0.0653 4.72 (2.30, 2.42) 0.2548
120 120 0.4977 0.4989 0.0576 4.99 (2.68, 2.31) 0.2250
0.7 40 40 0.6973 0.7000 0.0658 4.76 (2.47, 2.29) 0.2586
70 70 0.6987 0.7003 0.0529 4.76 (2.41, 2.35) 0.2078
120 120 0.6984 0.6993 0.0451 5.38 (2.73, 2.65) 0.1770
0.9 40 40 0.8978 0.8990 0.0391 3.83 (2.18, 1.65) 0.1613
70 70 0.8994 0.9001 0.0309 4.29 (2.36, 1.93) 0.1250
120 120 0.8996 0.9000 0.0258 4.65 (2.36, 2.29) 0.1032
0.95 40 40 0.9495 0.9501 0.0267 5.16 (1.59, 3.57) 0.1173
70 70 0.9497 0.9500 0.0215 4.63 (2.22, 2.41) 0.0907
120 120 0.9498 0.9500 0.0180 4.37 (2.30, 2.07) 0.0742
0.5 100 50 0.4975 0.4991 0.0599 5.03 (2.56, 2.47) 0.2336
0.5 100 80 0.4979 0.4993 0.0606 5.03 (2.65, 2.38) 0.2367
0.7 70 40 0.6979 0.6998 0.0551 4.81 (2.17, 2.64) 0.2157
0.7 80 70 0.6983 0.6998 0.0515 5.21 (2.83, 2.38) 0.2021
Part II Results for truncated Inline graphic
Median and SE 95% BCa bootstrap ci
Median Median after bias correction Bootstrap SE Non-coverage % (too low, too high) Length
0.0 40 40 0 0 0.0386 2.30 (2.30) 0.1522
70 70 0 0 0.0374 2.57 (2.57) 0.1396
120 120 0 0 0.0403 2.27 (2.27) 0.1387
0.1 40 40 0.0980 0.0992 0.0649 4.53 (2.28, 2.25) 0.2511
70 70 0.0987 0.0998 0.0616 4.93 (2.53, 2.40) 0.2297
120 120 0.0985 0.0997 0.0609 4.92 (2.80, 2.12) 0.2223
0.3 40 40 0.2985 0.3012 0.0818 4.73 (2.16, 2.57) 0.3197
70 70 0.2990 0.3006 0.0712 5.29 (2.55, 2.74) 0.2776
120 120 0.2974 0.2989 0.0660 5.08 (2.58, 2.50) 0.2579

Part I shows mean, mean after bias correction, mean of the bootstrap standard error, non-coverage percentage of 95% BCa bootstrap confidence intervals (with left and right non-coverage percentages), and mean length of the interval. Part II shows, for pgs ≤ 0.3, the same type of results as part I, but for Inline graphic truncated at zero. Instead of means, medians are given. At pgs = 0.0, only non-coverage at the right of pgs = 0.0 is considered