Table 3.
Type I error rates under the null hypothesis of μ1 = μ2 = 5.0 from comparing the observed data in the Main study without any adjustment (“Raw”), comparing the observed data with adjustment discussed in section 2.2 (“Adj”), and comparing the simulated unobservable true values (“True”).
n1 = n2 | τ2 | δ2 | n = 50 | n = 100 | n = 200 | ||||||
---|---|---|---|---|---|---|---|---|---|---|---|
Raw | Adj | True | Raw | Adj | True | Raw | Adj | True | |||
50 | 0.1 | 0 | 0.05 | 0.05 | 0.05 | 0.05 | 0.05 | 0.05 | 0.05 | 0.05 | 0.05 |
200 | 0.05 | 0.06 | 0.05 | 0.05 | 0.05 | 0.06 | 0.05 | 0.05 | 0.05 | ||
1000 | 0.05 | 0.05 | 0.05 | 0.05 | 0.05 | 0.05 | 0.05 | 0.05 | 0.05 | ||
50 | 0.5 | 0.66 | 0.05 | 0.05 | 0.66 | 0.05 | 0.05 | 0.66 | 0.05 | 0.05 | |
200 | 1.00 | 0.06 | 0.05 | 1.00 | 0.05 | 0.06 | 1.00 | 0.05 | 0.05 | ||
1000 | 1.00 | 0.05 | 0.05 | 1.00 | 0.05 | 0.05 | 1.00 | 0.05 | 0.05 | ||
50 | 1.0 | 1.00 | 0.05 | 0.05 | 1.00 | 0.05 | 0.05 | 1.00 | 0.05 | 0.05 | |
200 | 1.00 | 0.06 | 0.05 | 1.00 | 0.05 | 0.06 | 1.00 | 0.05 | 0.05 | ||
1000 | 1.00 | 0.05 | 0.05 | 1.00 | 0.05 | 0.05 | 1.00 | 0.05 | 0.05 | ||
50 | 0.5 | 0 | 0.05 | 0.05 | 0.05 | 0.05 | 0.05 | 0.05 | 0.05 | 0.05 | 0.05 |
200 | 0.05 | 0.05 | 0.05 | 0.05 | 0.05 | 0.06 | 0.05 | 0.05 | 0.05 | ||
1000 | 0.05 | 0.06 | 0.05 | 0.05 | 0.05 | 0.05 | 0.05 | 0.05 | 0.05 | ||
50 | 0.5 | 0.54 | 0.05 | 0.05 | 0.52 | 0.05 | 0.05 | 0.53 | 0.05 | 0.05 | |
200 | 0.98 | 0.05 | 0.05 | 0.98 | 0.05 | 0.06 | 0.98 | 0.05 | 0.05 | ||
1000 | 1.00 | 0.06 | 0.05 | 1.00 | 0.05 | 0.05 | 1.00 | 0.05 | 0.05 | ||
50 | 1.0 | 0.98 | 0.05 | 0.05 | 0.98 | 0.05 | 0.05 | 0.98 | 0.05 | 0.05 | |
200 | 1.00 | 0.05 | 0.05 | 1.00 | 0.05 | 0.06 | 1.00 | 0.05 | 0.05 | ||
1000 | 1.00 | 0.06 | 0.05 | 1.00 | 0.05 | 0.05 | 1.00 | 0.05 | 0.05 | ||
50 | 1.0 | 0.0 | 0.05 | 0.05 | 0.05 | 0.05 | 0.05 | 0.05 | 0.05 | 0.05 | 0.05 |
200 | 0.05 | 0.05 | 0.05 | 0.05 | 0.05 | 0.06 | 0.05 | 0.05 | 0.05 | ||
1000 | 0.05 | 0.06 | 0.05 | 0.06 | 0.05 | 0.05 | 0.05 | 0.05 | 0.05 | ||
50 | 0.5 | 0.42 | 0.05 | 0.05 | 0.42 | 0.05 | 0.05 | 0.42 | 0.05 | 0.05 | |
200 | 0.94 | 0.05 | 0.05 | 0.94 | 0.05 | 0.06 | 0.94 | 0.05 | 0.05 | ||
1000 | 1.00 | 0.06 | 0.05 | 1.00 | 0.05 | 0.05 | 1.00 | 0.05 | 0.05 | ||
50 | 1.0 | 0.94 | 0.05 | 0.05 | 0.94 | 0.05 | 0.05 | 0.94 | 0.05 | 0.05 | |
200 | 1.00 | 0.05 | 0.05 | 1.00 | 0.05 | 0.06 | 1.00 | 0.05 | 0.05 | ||
1000 | 1.00 | 0.06 | 0.05 | 1.00 | 0.05 | 0.05 | 1.00 | 0.05 | 0.05 |
Note: n1 and n2 are the sample sizes of the Assay comparison study from Lab 1 and Lab 2, respectively; τ2 is the measurement error variance for both labs; ρ is the correlation between the Lab 1 and Lab 2 measurements in the Assay-comparison study; δ2 is the mean of the measurement error from Lab 2, and Lab 1 is regarded as the reference(i.e., δ1 = 0); and n is the sample size of the Main Study.