Abstract
Background
Skewed X chromosome inactivation (XCI), which is a non-random process, is frequently observed in both healthy and affected females. Furthermore, skewed XCI has been reported to be related to many X-linked diseases. However, no statistical method is available in the literature to measure the degree of the skewness of XCI for case-control design. Therefore, it is necessary to develop methods for such a task.
Results
In this article, we first proposed a statistical measure for the degree of XCI skewing by using a case-control design, which is a ratio of two logistic regression coefficients after a simple reparameterization. Based on the point estimate of the ratio, we further developed three types of confidence intervals (the likelihood ratio, Fieller’s and delta methods) to evaluate its variation. Simulation results demonstrated that the likelihood ratio method and the Fieller’s method have more accurate coverage probability and more balanced tail errors than the delta method. We also applied these proposed methods to analyze the Graves’ disease data for their practical use and found that rs3827440 probably undergoes a skewed XCI pattern with 68.7% of cells in heterozygous females having the risk allele T active, while the other 31.3% of cells keeping the normal allele C active.
Conclusions
For practical application, we suggest using the Fieller’s method in large samples due to the non-iterative computation procedure and using the LR method otherwise for its robustness despite its slightly heavy computational burden.
Electronic supplementary material
The online version of this article (10.1186/s12859-018-2587-2) contains supplementary material, which is available to authorized users.
Keywords: X chromosome inactivation, Skewness, Case-control design, Confidence interval, Graves’ disease
Background
X chromosome inactivation (XCI) is an epigenetic phenomenon. Under XCI, one of two X chromosomes in females is silenced during early embryonic development to achieve dosage compensation between two sexes [1]. As such, the genetic effect of two risk alleles in females is expected to be equivalent to that of one risk allele in males. Most of X-linked genes undergo XCI and only about 15% of genes on X chromosome escape from XCI (XCI-E) [2]. Both alleles in the genes under XCI-E will be active, which are similar to autosomal genes. Generally, XCI has been treated as random (XCI-R) where both maternal and paternal X chromosomes have equal chance to be inactivated, i.e. for an X-linked gene, nearly 50% of the cells have one allele active while the remaining cells have the other allele active. However, recent studies have revealed that the skewed XCI (XCI-S) is a biological plausibility and even a common feature in both healthy and affected females [3–5]. XCI-S is a non-random process, which has been defined as a significant deviation from XCI-R, for instance, the inactivation of one of the alleles in more than 75% of cells [6–8].
The mechanism of XCI-S remains mysterious and XCI-S in human may be likely caused by secondary selection [6, 9, 10]. Specifically, the initial choice of active X chromosome is considered as random. However, during body growth, when an X-linked mutation affects cells proliferation or survival, there will be a larger or smaller proportion of cells with an active mutant allele. Due to the selection pressure, this type of secondary skewing varies in different tissues and is also associated with age. For heterozygous females, positive selection cells with mutant allele will lead to more severe expression of the disease, whereas negative selection cells with mutant allele can provide protection from deleterious effects [11, 12]. For example, in heterozygous females with a mutant FoxP3 allele, the XCI-S against the mutant allele in specific tissues can prevent autoimmune disease, whereas the XCI-S towards the mutant allele in breast epithelial cells can result in breast cancer [13]. On the other hand, some diseases, such as ovarian cancer, Rett syndrome, Klinefelter syndrome, and recurrent miscarriages, are reported to be related to XCI-S [14–17]. Therefore, it is necessary to develop methods for measuring such XCI skewing.
Recently, there has been an increasing interest to incorporate the information on XCI into X-chromosome genetic association studies [18–23]. Clayton’s method first takes XCI-R into account and treats males as homozygous females [18]. In this regard, two genotypes of males are coded as 0 or 2, while three genotypes of females are coded as 0, 1 or 2, respectively. This coding strategy also implies that the genetic effect of heterozygous genotype in females lies midway between two homozygous genotypes, which seems reasonable as in heterozygous females about half of cells express the mutant allele while the rest of cells express the normal allele. However, this method does not consider the XCI-E and XCI-S patterns. So, a resampling-based method was proposed by maximizing the likelihood ratio (LR) over all the three biological patterns (XCI-E, XCI-R and XCI-S), where the three genotypes of females are coded as 0, γ or 2 under XCI-S [21]. Note that γ is an unknown parameter which is used to measure the degree of XCI skewing. For instance, γ=1 represents XCI-R; γ=1.5 indicates XCI-S where 75% of the cells have the mutant allele active, whereas the other 25% of the cells have the normal allele active. On the other hand, the detection of XCI-S is either by measuring the level of methylation or by integrative analysis of whole exome and RNA sequencing data [24, 25]. Although Xu et al. has recently developed a statistical measure for the skewness of XCI based on family trios [26], there is still no statistical method available in the literature to measure the skewness of XCI for case-control design.
Therefore, in this article, we first showed that γ can be represented as a ratio of two logistic regression coefficients after a simple reparameterization, based on case-control data. We then obtained the point estimate of γ by the maximum likelihood estimates (MLEs) of these two regression coefficients. Further, we derived the confidence interval (CI) of γ by the delta method, the Fieller’s method and the LR method. We also applied all the proposed approaches to analyze the Graves’ disease data for their practical use.
Results
Statistical properties of confidence interval
Tables 1 and 2 list the estimated coverage probability (CP), left tail error (ML), right tail error (MR) (missing the true value of γ), ML/(ML+MR) and proportion of the discontinuous CIs (DP) of the LR, Fieller’s and delta methods under various simulation settings with N=500, ρ=0, and λ2=1.5 and 2, respectively. From the tables, the LR and Fieller’s methods control the CP well when p=0.3. However, when p=0.1, both the LR and Fieller’s methods appear to overestimate the CP except for γ=0. Note that the CPs of the LR method are closer to the pre-set level than the Fieller’s method, which indicates the robustness property of the LR method for relatively small samples. Besides, the delta method generally has the worst CP under all the situations. When p=0.1, the delta method overestimates the CP for γ=0, while underestimates the CP for γ=1, 1.5 and 2, irrespective of λ2 being 1.5 or 2. When p increases from 0.1 to 0.3, the delta method overestimates the CP for γ=0, 0.5 and 1, while underestimates the CP for γ=1.5 and 2, regardless of λ2=1.5 or 2. From the estimated ML, MR and ML/(ML+MR) values, we find that ML and MR of the delta-type CIs are not balanced since nearly all the values of ML/(ML+MR) are far away from 0.5, while the LR and Fieller’s methods have more balanced ML and MR than the delta method, especially when p=0.3. On the other hand, we see that the values of the DP for both the LR and Fieller’s methods are not over 3% under our simulation settings. Further, when p increases from 0.1 to 0.3 or λ2 changes from 1.5 to 2, DP will generally become smaller.
Table 1.
LR | Fieller | Delta | |||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|
p | γ | CP | (ML, MR) | DP | CP | (ML, MR) | DP | CP | (ML, MR) | DP | |||
0.1 | 0 | 94.75 | (4.78, 0.47) | 0.91 | 1.96 | 94.93 | (4.89, 0.18) | 0.96 | 2.28 | 100 | (0, 0) | — | 0 |
0.5 | 95.78 | (1.49, 1.65) | 0.47 | 1.44 | 96.81 | (1.58, 0.62) | 0.72 | 1.49 | 95.72 | (0, 4.28) | 0 | 0 | |
1 | 96.13 | (0.90, 2.33) | 0.28 | 1.82 | 98.18 | (0.73, 0.60) | 0.55 | 1.82 | 79.38 | (0, 20.62) | 0 | 0 | |
1.5 | 96.39 | (0.64, 2.84) | 0.18 | 1.69 | 98.72 | (0.37, 0.75) | 0.33 | 1.85 | 70.83 | (0, 29.17) | 0 | 0 | |
2 | 96.68 | (0, 3.32) | 0 | 2.35 | 98.99 | (0, 1.01) | 0 | 2.49 | 67.71 | (0, 32.29) | 0 | 0 | |
0.3 | 0 | 94.72 | (3.88, 1.40) | 0.73 | 1.27 | 94.75 | (3.87, 1.38) | 0.74 | 1.31 | 99.22 | (0.78, 0) | 1 | 0 |
0.5 | 95.21 | (2.45, 1.96) | 0.56 | 0.73 | 95.25 | (2.44, 1.93) | 0.56 | 0.73 | 99.75 | (0.02, 0.23) | 0.08 | 0 | |
1 | 94.77 | (1.99, 2.85) | 0.41 | 0.69 | 94.88 | (1.98, 2.78) | 0.42 | 0.65 | 96.70 | (0, 3.30) | 0 | 0 | |
1.5 | 95.22 | (1.26, 3.33) | 0.27 | 0.88 | 95.39 | (1.25, 3.14) | 0.28 | 0.91 | 92.29 | (0, 7.71) | 0 | 0 | |
2 | 94.72 | (0.37, 4.91) | 0.07 | 1.29 | 95.16 | (0.34, 4.50) | 0.07 | 1.36 | 88.11 | (0, 11.89) | 0 | 0 |
Table 2.
LR | Fieller | Delta | |||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|
p | γ | CP | (ML, MR) | DP | CP | (ML, MR) | DP | CP | (ML, MR) | DP | |||
0.1 | 0 | 94.59 | (4.59, 0.82) | 0.85 | 1.97 | 94.78 | (4.71, 0.51) | 0.90 | 2.72 | 100 | (0, 0) | — | 0 |
0.5 | 95.24 | (2.12, 1.96) | 0.52 | 1.10 | 96.20 | (2.17, 0.86) | 0.72 | 1.28 | 94.44 | (0, 5.56) | 0 | 0 | |
1 | 96.07 | (1.39, 2.38) | 0.37 | 1.14 | 97.78 | (1.27, 0.73) | 0.64 | 1.23 | 84.05 | (0, 15.95) | 0 | 0 | |
1.5 | 96.56 | (0.99, 2.39) | 0.29 | 0.90 | 98.37 | (0.85, 0.72) | 0.54 | 0.98 | 81.08 | (0, 18.92) | 0 | 0 | |
2 | 96.49 | (0.01, 3.50) | 0 | 0.43 | 98.37 | (0.01, 1.62) | 0.01 | 0.43 | 79.71 | (0, 20.29) | 0 | 0 | |
0.3 | 0 | 94.88 | (2.80, 2.32) | 0.55 | 0.60 | 94.93 | (2.79, 2.28) | 0.55 | 0.61 | 98.10 | (1.89, 0.01) | 0.99 | 0 |
0.5 | 95.01 | (2.40, 2.54) | 0.49 | 0.14 | 95.01 | (2.40, 2.53) | 0.49 | 0.15 | 99.13 | (0.20, 0.67) | 0.23 | 0 | |
1 | 95.15 | (2.10, 2.71) | 0.44 | 0.08 | 95.28 | (2.09, 2.60) | 0.45 | 0.09 | 96.37 | (0, 3.63) | 0 | 0 | |
1.5 | 94.81 | (2.03, 3.14) | 0.39 | 0.21 | 95.03 | (2.05, 2.90) | 0.41 | 0.22 | 92.51 | (0, 7.49) | 0 | 0 | |
2 | 94.88 | (1.80, 3.32) | 0.35 | 0.08 | 95.18 | (1.78, 3.04) | 0.37 | 0.08 | 91.80 | (0, 8.20) | 0 | 0 |
Tables 3 and 4 give the estimated CP, ML, MR, ML/(ML+MR) and DP of the LR, Fieller’s and delta methods when N=2000, ρ=0, and λ2=1.5 and 2, respectively. When N increases from 500 to 2000, the LR method has similar performance with the Fieller’s method. It can be seen from the tables that the CPs of all the methods are more accurate. Both the LR and Fieller’s methods control the CP well, while the delta method still generally has the poor CP, especially when p=0.1. Note that when p=0.3, all the values of ML/(ML+MR) for the LR method and the Fieller’s method are around 0.5 regardless of λ2 being 1.5 or 2. But when p=0.1, the values of ML/(ML+MR) for the LR method and the Fieller’s method are deviated from 0.5, especially when γ0 are 0 and 2. Further, the Fieller’s method has slightly more balanced tail errors than the LR method when p=0.1. In addition, the delta method has the most unbalanced tail errors. We also find that the values of the DP generally decrease to be less than 2% when N increases to be 2000. In general, the LR method and the Fieller’s method control the CP well with the relatively balanced tail errors on the left and on the right. All the other results of CP, ML, MR, ML/(ML+MR) and DP with ρ=0.05 are given in Tables S1-S4 [see Additional file 1], which are similar to those in Tables 1, 2, 3 and 4 except for N=500 and p=0.1, indicating that Hardy-Weinberg disequilibrium has limited effect on the results. Notice that under the scenario of N=500 and p=0.1, we observe that the CPs of all the methods in Additional file 1: Tables S1 and S2 are better than those in Tables 1 and 2, respectively. One possible explanation of this phenomenon is that the genotype frequency of AA in the control sample increases from 0.01 to 0.0145 when ρ changes from 0 to 0.05.
Table 3.
LR | Fieller | Delta | |||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|
p | γ | CP | (ML, MR) | DP | CP | (ML, MR) | DP | CP | (ML, MR) | DP | |||
0.1 | 0 | 94.89 | (4.31, 0.80) | 0.84 | 2.04 | 94.91 | (4.36, 0.73) | 0.86 | 2.04 | 99.98 | (0.01, 0.01) | 0.50 | 0 |
0.5 | 94.38 | (2.10, 2.84) | 0.43 | 1.03 | 94.78 | (2.13, 2.43) | 0.47 | 0.96 | 93.29 | (0, 6.71) | 0 | 0 | |
1 | 95.09 | (1.53, 3.19) | 0.32 | 0.73 | 95.88 | (1.52, 2.43) | 0.38 | 0.71 | 84.16 | (0, 15.84) | 0 | 0 | |
1.5 | 94.49 | (1.24, 4.21) | 0.23 | 0.56 | 95.59 | (1.25, 3.13) | 0.29 | 0.56 | 81.18 | (0, 18.82) | 0 | 0 | |
2 | 94.68 | (0.01, 5.31) | 0 | 0.22 | 95.81 | (0.01, 4.18) | 0 | 0.22 | 81.01 | (0, 18.99) | 0 | 0 | |
0.3 | 0 | 95.23 | (2.59, 2.18) | 0.54 | 0.35 | 95.23 | (2.59, 2.18) | 0.54 | 0.33 | 97.89 | (2.07, 0.04) | 0.98 | 0 |
0.5 | 95.00 | (2.66, 2.31) | 0.54 | 0.07 | 95.01 | (2.66, 2.30) | 0.54 | 0.07 | 99.08 | (0.12, 0.80) | 0.13 | 0 | |
1 | 94.80 | (2.60, 2.56) | 0.50 | 0.07 | 94.86 | (2.60, 2.51) | 0.51 | 0.07 | 95.91 | (0, 4.09) | 0 | 0 | |
1.5 | 95.05 | (2.16, 2.79) | 0.44 | 0.03 | 95.10 | (2.16, 2.74) | 0.44 | 0.03 | 93.58 | (0, 6.42) | 0 | 0 | |
2 | 94.58 | (2.34, 3.08) | 0.43 | 0.01 | 94.68 | (2.34, 2.98) | 0.44 | 0.01 | 91.86 | (0, 8.14) | 0 | 0 |
Table 4.
LR | Fieller | Delta | |||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|
p | γ | CP | (ML, MR) | DP | CP | (ML, MR) | DP | CP | (ML, MR) | DP | |||
0.1 | 0 | 95.45 | (2.89, 1.66) | 0.64 | 1.57 | 95.48 | (2.89, 1.63) | 0.64 | 1.66 | 99.81 | (0.14, 0.05) | 0.74 | 0 |
0.5 | 94.92 | (2.24, 2.75) | 0.45 | 0.18 | 95.27 | (2.28, 2.34) | 0.49 | 0.23 | 92.63 | (0, 7.37) | 0 | 0 | |
1 | 94.39 | (2.38, 3.21) | 0.43 | 0.12 | 95.31 | (2.39, 2.28) | 0.51 | 0.11 | 88.87 | (0, 11.13) | 0 | 0 | |
1.5 | 94.77 | (1.56, 3.67) | 0.30 | 0 | 95.77 | (1.61, 2.62) | 0.38 | 0 | 87.92 | (0, 12.08) | 0 | 0 | |
2 | 94.45 | (0.42, 5.13) | 0.08 | 0 | 95.57 | (0.42, 4.01) | 0.09 | 0 | 87.32 | (0, 12.68) | 0 | 0 | |
0.3 | 0 | 95.02 | (2.68, 2.30) | 0.54 | 0.01 | 95.03 | (2.67, 2.30) | 0.54 | 0.01 | 96.64 | (3.08, 0.28) | 0.92 | 0 |
0.5 | 94.97 | (2.37, 2.66) | 0.47 | 0 | 94.97 | (2.37, 2.66) | 0.47 | 0 | 96.94 | (1.04, 2.02) | 0.34 | 0 | |
1 | 95.13 | (2.40, 2.47) | 0.49 | 0 | 95.17 | (2.40, 2.43) | 0.50 | 0 | 96.05 | (0.16, 3.79) | 0.04 | 0 | |
1.5 | 94.68 | (2.78, 2.54) | 0.52 | 0 | 94.76 | (2.79, 2.45) | 0.53 | 0 | 94.65 | (0, 5.35) | 0 | 0 | |
2 | 94.86 | (2.53, 2.61) | 0.49 | 0 | 94.89 | (2.56, 2.55) | 0.50 | 0 | 93.81 | (0, 6.19) | 0 | 0 |
Sizes and powers
We also simulated the corresponding size and power for testing γ=γ0 [see Appendix B of Additional file 1]. The size results are given in Additional file 1: Tables S5–S8 and the power results are displayed in Figures S1-S12 [see Additional file 1]. It can be seen that the LR method and the Fieller’s method control the size well except for N=500 and p=0.1, while the size of the delta method is either conservative or inflated. On the other hand, the power of the LR method and the Fieller’s method are close to each other, but the LR method is generally slightly more powerful than the Fieller’s method. However, the power of the delta method can be quite different from those of the LR and Fieller’s methods.
Application to Graves’ disease data
The GPR174 gene is located on X chromosome, which is associated with autoimmune thyroid disease, including Graves’ disease [27]. An X chromosome genome-wide association study (GWAS) was conducted by Chu et al. to study the association between the GPR174 gene and Graves’ disease among Han population [27]. In this study, 14,141 single nucleotide polymorphisms on X chromosome were genotyped. Among them, rs3827440 is a non-synonymous single nucleotide polymorphism within the GPR174 gene, with the minor allele frequency being 0.45 in this population, and thus is a functional variant of interest. Further, statistical analysis of both the GWAS data and the replication data showed that rs3827440 is statistically significantly associated with Graves’ disease. At rs3827440, there are two alleles T and C, where T is the susceptible allele which is associated with a higher expression level of the GPR174 gene. Several studies [7, 15] showed that XCI-S is associated with autoimmune thyroid disease. So, we applied the LR, Fieller’s and delta methods to explore if rs3827440 undergoes an XCI-S pattern. We only selected the females to estimate the degree of XCI skewing as well as its 95% CI. In the GWAS stage, 2242 females were sampled (1115 cases and 1127 controls). In the case group, the numbers of females with genotypes CC, TC, and TT are 163, 508, and 444, respectively. Those in the control group are 219, 541, and 367, respectively. In the replication stage, 6260 females were sampled with genotype counts 471, 1606, and 1298 in the case group, and 584, 1344, and 957 in the control group for CC, TC, and TT, respectively. The estimated allele frequency of T in females is 0.57 and 0.56 for the GWAS stage and the replication stage, respectively. We applied each of the proposed methods to the data in the GWAS stage and those in the replication stage. After that, we used our proposed methods to deal with the pooled data, by incorporating the stage as a covariate.
Table 5 gives the point estimate and its 95% CIs, based on the LR, Fieller’s and delta methods. From the table, we observe that the LR-type CIs and the Fieller’s CIs are almost the same. The delta-type CIs are nested within the LR-type and Fieller’s CIs for the replication stage and the pooled data, which may be caused by the fact that the delta method underestimates the CP. We also find that the LR-type CI and the Fieller’s CI are asymmetrical around its point estimate in the GWAS stage but are nearly symmetrical around the point estimate in the replication stage and the pooled analysis, which is probably due to the larger sample size in the replication stage and the pooled dataset. In the GWAS stage, the point estimate is 0.957. All of the three types of CIs contain 1 (XCI-R). In the replication stage, the point estimate is 1.513 and all the CIs do not contain 1. The results in the replication stage suggest the XCI-S pattern at rs3827440 with 75.7% (1.513/2) of cells having the risk allele T active and the other 24.3% of cells having the normal allele C active. Note that the statistical results for both two stage data suggest different XCI patterns. One possible reason is that the variance of is larger in the GWAS data and there may exist study heterogeneity between those two stages. The results for the pooled data give the point estimate by adjusting the stage and all of the three types of CIs do not contain 1. This demonstrates that rs3827440 probably undergoes the XCI-S pattern with 68.7% (1.373/2) of cells keeping the risk allele T active, while the other 31.3% of cells keeping the normal allele C active. However, this observation needs to be further confirmed by functional analysis of this variant.
Table 5.
95% CI | ||||
---|---|---|---|---|
Stage | LR | Fieller | Delta | |
GWAS | 0.957 | [0, 1.657] | [0, 1.658] | [0.241, 1.672] |
Replication | 1.513 | [1.123, 1.930] | [1.122, 1.930] | [1.126, 1.900] |
Pooled | 1.373 | [1.028, 1.719] | [1.028, 1.719] | [1.037, 1.708] |
Discussion
In this article, we proposed a statistical measure to estimate the degree of the skewness of XCI (i.e. γ). We first showed that γ can be expressed as a ratio of two logistic regression coefficients. Then, we constructed a ratio estimate for γ and also derived three types of CIs (the LR, Fieller’s and delta methods) to evaluate its variation. The delta method is a simple and non-iterative procedure but generally has poor statistical properties, which is probably caused by the skewness of . On the other hand, the LR method and the Fieller’s method are based on a simple reparameterization procedure and thus does not require the normality assumption of . The simulation results demonstrate that the LR method and the Fieller’s method have better performance than the delta method. On the other hand, note that the LR-type CI will be close to the Fieller’s CI when N is large. In this regard, the Fieller’s CI is preferential since it is a non-iterative procedure. However, when N is relatively small, the LR-type CI is recommended for its robustness. In addition, our software SkewXCI is freely available at http://www.echobelt.org/web/UploadFiles/SkewXCI.html, which is implemented in R (http://www.r-project.org/, version 3.5.1).
Our proposed methods have several limitations. First, our methods assume that the genetic effect of the mutant allele among all the cells is additive on the disease. On the other hand, notice that Model (1) under XCI is different from genetic models (dominant, additive, and recessive) on autosomes or on X chromosome under XCI-E. Specifically, genetic model defines the relationship between two alleles at a locus and usually varies from locus to locus [28–30]. However, when XCI occurs, only one allele is active at each locus in each cell and most of the loci share the same XCI pattern. As such, the magnitude of γ/2 is a measure of the proportion of cells with the mutant allele active among all the cells in heterozygous females. For instance, adrenoleukodystrophy has been previously viewed as an X-linked recessive disorder where the female carriers are commonly thought to be normal or only mildly affected [31]. However, a recent study showed that the heterozygous females with adrenoleukodystrophy have a wide spectrum of clinical manifestations, ranging from mild to severe phenotypes, which is probably due to the various degree of XCI-S towards the mutant allele. Second, we simply cut the estimated CI within the interval [ 0, 2] and this may lead to potential loss of information. However, if we incorporate this interval constraint into statistical inference, then the LR, Fieller’s and delta methods no longer follow a simple chi-square distribution or a standard normal distribution due to the boundary problem [32]. An alternative method is the Bayesian inference, where such constraint can be regarded as prior information. For instance, when no other information is available, we can choose an uniform prior distribution within the interval [ 0,2] for γ. Once the posterior distribution is derived, its percentiles or variance can be used to construct the corresponding CI. Third, note that the validity of our proposed measure is based on the assumption that there exists association between disease and allele A. Therefore, in GWAS, we can first screen the associated single nucleotide polymorphisms as candidate loci before making any inference about γ. If such association is not statistically significant, our proposed methods may not be reliable. In this situation, according to Fieller’s theorem, the Fieller’s CI and the LR-type CI can be discontinuous as shown in Tables 1, 2, 3, and 4, which is difficult to interpret.
Generally, the LR method and the Fieller’s method have accurate CP and control the ML and MR well, and hence are recommended in practical application. In future work, we will incorporate the information on the interval constraint into analysis so as to further improve the efficiency of the proposed methods. Moreover, we will generalize our methods to quantitative traits.
Conclusions
When the sample size is greater than 2000, the Fieller’s method has similar performance to the LR method and thus is preferential due to the non-iterative computation procedure. However, the LR method is recommended otherwise because it has better statistical properties, especially in small samples.
Methods
Point estimation for γ
Consider an X-linked diallelic locus with normal allele a and mutant allele A. We only select the females because XCI is unrelated to males. For females, suppose that aa, Aa and AA are three genotypes and let X={0, γ, 2} be the corresponding genotypic value, respectively, with γ∈ [ 0, 2]. For a case-control design, let Y=1 (0) denote that the female is affected (unaffected). Then, the association between Y and X can be expressed using a logistic regression model
1 |
where β0 is the intercept, β is the regression coefficient for X, z is a vector of covariates that need to be adjusted (e.g. age), and bT is a vector of regression coefficients for z.
To estimate γ, we decompose the genotypic value X as X=γX1+(2−γ)X2, where X1=I{G=Aa or AA}, X2=I{G=AA}, G denotes the genotype of the female and I{.} is the indicator function. It can be seen that X1 indicates if the genotype contains the mutant allele A and X2 represents if the genotype is the homozygote AA. As such, Model (1) becomes
Let β1=βγ and β2=β(2−γ). Then, the above model can be rewritten as
2 |
Further, due to this reparameterization, γ can be represented as
3 |
when β=(β1+β2)/2≠0. γ can only be well defined in presence of the association between the disease and the allele A. Note that γ∈ [ 0, 2] means that β1 and β2 have the same sign. That is, the genetic effect of heterozygous genotype in females lies between those of two homozygotes, which is generally satisfied in real applications. From Eq. (3), we have γ=0 (2) if and only if β1=0 and β2≠0 (β1≠0 and β2=0), representing XCI-S fully towards the normal (mutant) allele a (A), while γ=1 if and only if β1=β2≠0, which means XCI-R. So, if we get the MLEs and of β1 and β2, then is the MLE of γ by the invariance property of MLE.
Note that and can be easily calculated through the standard logistic regression procedure. Specifically, suppose that we collect N unrelated females from a homogeneous population. Then, the log-likelihood function of the sample can be written as
where yi, xi1, xi2 and zi respectively are the values of Y, X1, X2 and z of female i. Then, and are obtained by maximizing the above log-likelihood function, i.e.
where and are the MLEs of β0 and bT, respectively.
Confidence interval of γ based on delta method
Once the point estimate of γ is derived, we need to calculate the standard error or CI to evaluate its precision. Since is also a ratio estimate, a natural idea is to use the first order Taylor series expansion of and then obtain its asymptotic variance. Specifically, by the consistency of MLE, and are close to β1 and β2, respectively, when N is large. Note that β=(β1+β2)/2 and thus γ can be rewritten as β1/β. Making a first order Taylor expansion of around the point (β1, β) and evaluating this at , we have
where . Taking variance from both sides, the above equation becomes
4 |
Notice that
and
where , and are the elements of the variance-covariance matrix V of and . Generally, V has no simple form when covariates are included in the model, but can be derived from the empirical Fisher’s information matrix for (β0, β1, β2, bT)T [33]. For Model (2),
where U=(1, X1, X2, z) is the design matrix, X1=(x11,x21,...,xN1)T, X2=(x12,x22,...,xN2)T, z=(z1,z2,...,zN)T, is a diagonal matrix with diagonal elements
and
represents the estimated penetrances for female i. Once is estimated, the partial information matrix for β1 and β2 given β0 and bT can be computed and thus . If there is no covariate in the model, then V has the following form [see Appendix A of Additional file 1]
where naa, nAa and nAA are the numbers of the females with aa, Aa and AA, respectively, and N=naa+nAa+nAA; , and are the weighted elements for aa, Aa and AA, respectively, with
and
and
representing the estimated penetrances for aa, Aa and AA, respectively.
Replacing β and β1 by and in Eq. (4), we estimate the delta-type standard error [34]
As such, the delta-type CI at level (1−α) can be expressed as
where Z1−α/2 denotes the (1−α/2)-quantile of the standard normal distribution. Note that the estimated CI may be out of the range of [0, 2] when the variation is large, which should be cut off. To test the null hypothesis H0:γ=γ0 against the alternative hypothesis H1:γ≠γ0, we have
under H0, where γ0 is an arbitrary constant between [ 0, 2], such as 1 (XCI-R).
The delta method is a non-iterative procedure and thus is easy to be implemented. However, the CI of a ratio estimate is generally skewed, while the delta-type CI is symmetrical [35, 36]. Therefore, it is necessary to propose the Fieller’s and likelihood ratio methods to overcome this shortcoming in the following sections.
Confidence interval of γ based on Fieller’s method
The Fieller’s method is another widely used non-iterative approach for constructing CI for ratio estimate [37]. This type of CI can be asymmetrical around . To propose the Fieller’s CI, we first need to build a Wald test for testing γ=γ0. Specifically, under γ=γ0, we have β1−γ0β=0. Therefore, the Wald test for testing γ=γ0 can be written as
which follows a standard normal distribution. Then, the confidence limits and for Fieller’s CI at level (1−α) can be found by solving the following equation
Rearranging the above equation yields a quadratic equation with respect to γ0
where
and
Suppose Δ=E2−4DF>0, then this equation must have two unequal roots with and being . According to Fieller’s theorem, we know that D>0 implies Δ>0. In this situation, the Fieller’s CI is continuous and can be denoted by . Note that D>0 is equivalent to . That is, there exists statistically significant association between the disease and the allele A at the significance level α. However, if there is no such association (i.e. D<0), the Fieller’s CI will be unbounded. For instance, if Δ<0, the Fieller’s CI will be (−∞,∞). If Δ>0, the Fieller’s CI will be , which is the discontinuous CI. In real applications, it generally makes little sense to infer about γ if there is no association between the disease and the allele A according to its definition. In addition, the Fieller’s CI should also be restricted to the interval [0,2] when needed.
The Fieller’s method usually demonstrates better coverage probability than the delta method. Notice that the Fieller’s CI is based on the inversion of the Wald test. Since the LR test is expected to have more robust properties in small samples, so it is desirable to propose the LR method in the next section.
Confidence interval of γ based on likelihood ratio method
To obtain the LR-based CI, we first construct a likelihood ratio test for testing γ=γ0. As mentioned above, we have derived the MLEs , , and of β0, β1, β2 and bT under H1. To calculate the likelihood ratio test statistic λ, we further evaluate the likelihood function under H0:γ=γ0. If H0 holds, the genotypic value X equals 0, γ0 and 2 for aa, Aa and AA, respectively. In this regard, Model (1) is reduced to be a standard logistic model and the log-likelihood function under H0 can be written as
where xi is the genotypic value of X of female i. Let , and be the MLEs of β0, β and bT under H0, respectively. Then,
and λ can be computed as
λ asymptotically follows a chi-square distribution with the degree of freedom being one .
Now, we introduce how to obtain the LR-type CI. For each given γ0, we can calculate the corresponding value of the log-likelihood function l0 and under H0. So, l0 and are single variable functions with respect to γ0 and can be denoted by l0=l0(γ0) and , respectively. At the significance level α, the confidence limits and of the LR-type CI is determined by the following equation with respect to γ0
5 |
where q1−α denotes the (1−α)-quantile of the distribution. Obviously, Eq. (5) has no closed form solutions and numerical method can be adopted. Note that θ=(β0,β,bT)T are nuisance parameters in Eq. (5) which depend on γ0. To solve this equation, it generally requires several iterations with different values of γ0, and for each γ0, the iterative maximization over the remaining parameters is also needed to determine . This procedure is relatively time-consuming. Therefore, to reduce the computational burden, borrowing the idea of Venzon and Moolgavkar [38], we can find the roots of Eq. (5) by solving the following system of non-linear equations
which is easily implemented in the commonly used software (e.g. nleqslv package in R). Note that the above system differs only in the first equation from the system (with the first equation being replaced by ) that defines the MLEs and . Therefore, finding a root of such system almost has the same difficulty as that of finding the MLEs of Model (2) [38]. As such, this algorithm is generally more efficient.
On the other hand, based on the fact that the Wald test and the LR test are asymptotically equivalent in large samples, we know that the confidence limits of the Fieller’s CI and the LR-type CI should be close to each other. Therefore, we used the confidence limits of the Fieller’s CI as the initial values for γ0. For example, when searching the lower limit, we chose the initial values for γ0 and θ as and , respectively, where can be computed from the standard logistic regression procedure. Similarly, we used the same strategy to search the upper limit. The algorithm based on this choice of the initial values works well in most situations. However, in some scenarios, the Fieller’s CI and the LR-type CI may be very different. Thus, using the confidence limits of the Fieller’s CI as the initial values may cause that the algorithm does not converge. In this regard, we should directly solve the single variable function of Eq. (5). For example, we can use the bisection method to find the roots of Eq. (5) within the interval [ 0,2] (e.g. rootSolve package in R).
Like the Fieller’s CI, the LR-type CI can be unbounded when there is no association between the disease and the allele A. Specifically, when Equation (5) has no root, then the LR-type CI will be (−∞,∞). Otherwise, there will be two roots and . If , then the LR-type CI is continuous and can be represented as . If , then the LR-type CI will be , which is the discontinuous CI. Similar to the delta and Fieller’s methods, the LR-type CI is also truncated by [ 0, 2] if necessary.
The LR-based CI and the Fieller’s CI can be asymmetrical which is an appealing choice, compared to the delta method. This is because the distribution of a ratio estimate is generally non-normal with a heavy tail, especially when N is small. Additionally, it will be quite straightforward to incorporate covariates using the LR method.
Simulation settings
For simplicity, we assumed that there is no covariate included in the model in our simulation study. We incorporated the covariate into the real data analysis later. For a case-control design, we presumed that the genotype distribution in the case group and that in the control group of females follow trinomial distributions with probabilities (h0, h1, h2) and (g0, g1, g2), respectively, where h0 (g0), h1 (g1) and h2 (g2) are the frequencies of aa, Aa and AA in the case (control) group, respectively. Let h0/g0=m, h1/g1=λ1(h0/g0)=λ1m and h2/g2=λ2(h0/g0)=λ2m, where λ1 and λ2 are the odds ratios for Aa and AA compared to aa in females, respectively. By h0+h1+h2=1, we have m=1/(g0+λ1g1+λ2g2), h0=g0/(g0+λ1g1+λ2g2), h1=λ1g1/(g0+λ1g1+λ2g2) and h2=λ2g2/(g0+λ1g1+λ2g2). Thus, (h0, h1, h2) is calculated by (g0, g1, g2), λ1 and λ2. The value of (g0, g1, g2) is determined by the allele frequency of A (denoted by p=1−q) and the inbreeding coefficient ρ, i.e. g0=q2+ρpq, g1=2(1−ρ)pq and g2=p2+ρpq. Specifically, ρ=0 implies that Hardy-Weinberg equilibrium holds in the control group and ρ≠0 indicates Hardy-Weinberg disequilibrium. Furthermore, from Model (2), β0=log(m), β1=log(λ1) and β1+β2=log(λ2). Then, γ=2log(λ1)/log(λ2), i.e. . As such, we defined the simulation settings as follows: p is fixed at 0.1 and 0.3, and ρ is set to be 0 and 0.05. The true value of γ is fixed at 0, 0.5, 1, 1.5 and 2. λ2 is assigned to be 1.5 and 2. We selected N as 500 (2000) where both the case and control groups have 250 (1000) females. The confidence level is fixed at (1−α)=95% and the number of replications k is 10,000.
We compared the performance of three types of CIs based on CP, ML, MR, ML/(ML+MR) and DP. CP is defined to be the proportion that the CI contains the true value of γ among k replications, regardless of whether the CI is continuous or not. ML and MR are calculated by , and , respectively, where # denotes the counting measure, and γL and γU are the confidence limits of the estimated CI. Note that means that the CI is continuous. As such, we only consider the continuous CIs when estimating ML and MR, since it is impossible to distinguish between the left side and the right side if the CI is discontinuous. Further, DP is computed as . We believed that a good CI should control the CP well as well as have the balanced ML and MR. ML and MR are used together to measure the location of CI. If a balance between ML and MR is achieved, then ML/(ML+MR) is close to 0.5. On the other hand, note that the delta-type CI is always bounded. Therefore, the DP for the delta method will stay at 0. However, for the Fieller’s CI and the LR-type CI, small DP is desirable.
Additional file
Acknowledgements
The authors would like to thank the editor and three anonymous reviewers for their valuable comments which highly improved the presentation of the article and the authors also appreciate Dr. Yuqiang Xue’s kind assistance.
Funding
This work was supported by the National Natural Science Foundation of China [81773544, 81373098, 81573207], the National and Guangdong University Students’ Innovation and Enterprise Training Project of China [201612121017], and the General Program of Applied Basic Research Programs of Yunnan Province [2017FB002]. All the funding supporters had no role in the design of the study and collection, analysis, and interpretation of data and in writing the manuscript.
Availability of data and materials
The dataset supporting the conclusions of this article can be found in the article of Chu et al. [27].
Abbreviations
- CI
Confidence interval
- CP
Coverage probability
- DP
Proportion of discontinuous CIs
- GWAS
Genome-wide association study
- LR
Likelihood ratio
- ML
Left tail error
- MLE
Maximum likelihood estimate
- MR
Right tail error
- XCI; X chromosome inactivation; XCI-E
Escape from X chromosome inactivation
- XCI-R; Random X chromosome inactivation; XCI-S
Skewed X chromosome inactivation
Authors’ contributions
PW helped design the study, drafted the article, and conducted the simulation study. YZ helped conduct the simulation study and the data analysis, and design the study’s analytic strategy. BQW revised the article critically and helped interpret the results of the data analysis. JLL helped design the study, plot the figures and conduct the literature review. YXW helped interpret the results of the data analysis and prepare the introduction section and the discussion section. DP helped draft the article, helped the analysis and the interpretation of the data, and revised the article. XBW and WKF helped design the study, reviewed the whole paper and critically revised the article. JYZ helped design the study, supervised the field activities, and directed its implementation, including quality assurance and control. All authors read and approved this version of the manuscript.
Ethics approval and consent to participate
Not applicable.
Consent for publication
Not applicable.
Competing interests
The authors declare that they have no competing interests.
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Contributor Information
Peng Wang, Email: pengwang_sta2013@163.com.
Yu Zhang, Email: 15818114636@163.com.
Bei-Qi Wang, Email: gillianbeiqi@yahoo.com.
Jian-Long Li, Email: 13631347131@163.com.
Yi-Xin Wang, Email: wangyx0203@163.com.
Dongdong Pan, Email: ddpan@ynu.edu.cn.
Xian-Bo Wu, Email: wuxb1010@gmail.com.
Wing Kam Fung, Email: wingfung@hku.hk.
Ji-Yuan Zhou, Email: zhoujiyuan5460@hotmail.com.
References
- 1.Lyon MF. Gene action in the X-chromosome of the mouse (Mus musculus L.) Nature. 1961;190:372–3. doi: 10.1038/190372a0. [DOI] [PubMed] [Google Scholar]
- 2.Berletch JB, Ma W, Yang F, Shendure J, Noble WS, Disteche CM, et al. Escape from X inactivation varies in mouse tissues. PloS Genet. 2015;11:e1005079. doi: 10.1371/journal.pgen.1005079. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.Plenge RM, Stevenson RA, Lubs HA, Schwartz CE, Willard HF. Skewed X-chromosome inactivation is a common feature of X-linked mental retardation disorders. Am J Hum Genet. 2002;71:168–73. doi: 10.1086/341123. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Amos-Landgraf JM, Cottle A, Plenge RM, Friez M, Schwartz CE, Longshore J et al. X chromosome–inactivation patterns of 1005 phenotypically unaffected females. Am J Hum Genet. 2006;79:493–9. doi: 10.1086/507565. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Busque L, Paquette Y, Provost S, Roy DC, Levine RL, Mollica L, et al. Skewing of X-inactivation ratios in blood cells of aging women is confirmed by independent methodologies. Blood. 2009;113:3472–4. doi: 10.1182/blood-2008-12-195677. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Minks J, Robinson WP, Brown CJ. A skewed view of X chromosome inactivation. J Clin Invest. 2008;118:20–3. doi: 10.1172/JCI34470. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Chabchoub G, Uz E, Maalej A, Mustafa CA, Rebai A, Mnif M, et al. Analysis of skewed X-chromosome inactivation in females with rheumatoid arthritis and autoimmune thyroid diseases. Arthritis Res Ther. 2009;11:R106. doi: 10.1186/ar2759. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Renault NKE, Pritchett SM, Howell RE, Greer WL, Sapienza C, Ørstavik KH, et al. Human X-chromosome inactivation pattern distributions fit a model of genetically influenced choice better than models of completely random choice. Eur J Hum Genet. 2013;21:1396–402. doi: 10.1038/ejhg.2013.84. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Brown CJ. Skewed X-chromosome inactivation: cause or consequence? J Natl Cancer Inst. 2010;91:303–4. doi: 10.1093/jnci/91.4.304. [DOI] [PubMed] [Google Scholar]
- 10.Belmont JW. Genetic control of X inactivation and processes leading to X-inactivation skewing. Am J Hum Genet. 1996;58:1101–8. [PMC free article] [PubMed] [Google Scholar]
- 11.Medema RH, Boudewijn MT. The X factor: skewing X inactivation towards cancer. Cell. 2007;129:1275–86. doi: 10.1016/j.cell.2007.06.008. [DOI] [PubMed] [Google Scholar]
- 12.Deng X, Berletch JB, Nguyen DK, Disteche CM. X chromosome regulation: diverse patterns in development, tissues and disease. Nat Rev Genet. 2014;15:367–78. doi: 10.1038/nrg3687. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Zuo T, Wang L, Morrison C, Chang X, Zhang H, Li W, et al. FOXP3 is an X-linked breast cancer suppressor gene and an important repressor of the HER-2/ErbB2 oncogene. Cell. 2007;129:1275–86. doi: 10.1016/j.cell.2007.04.034. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Li G, Jin T, Liang H, Tu Y, Zhang W, Gong L, et al. Skewed X-chromosome inactivation in patients with esophageal carcinoma. Diagn Pathol. 2013;8:56–62. doi: 10.1186/1746-1596-8-55. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Simmonds MJ, Kavvoura PK, Brand OJ, Newby PR, Jackson LE, Hargreaves CE, et al. Skewed X chromosome inactivation and female preponderance in autoimmune thyroid disease: an association study and meta-analysis. J Clin Endocrinol Metab. 2013;99:127–31. doi: 10.1210/jc.2013-2667. [DOI] [PubMed] [Google Scholar]
- 16.Iitsuka Y, Bock A, Nguyen D, Samango-Sprouse CA, Simpson JL, Bischoff FZ. Evidence of skewed X-chromosome inactivation in 47, XXY and 48, XXYY Klinefelter patients. Am J Med Genet Part A. 2001;98:25–31. doi: 10.1002/1096-8628(20010101)98:1<25::AID-AJMG1015>3.0.CO;2-X. [DOI] [PubMed] [Google Scholar]
- 17.Sangha KK, Stephenson MD, Brown CJ, Robinson WP. Extremely skewed X-chromosome inactivation is increased in women with recurrent spontaneous abortion. Am J Hum Genet. 1999;65:913–17. doi: 10.1086/302552. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Clayton D. Testing for association on the X chromosome. Biostatistics. 2008;9:593–600. doi: 10.1093/biostatistics/kxn007. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Clayton D. Sex chromosomes and genetic association studies. Genome Med. 2009;1:110–6. doi: 10.1186/gm110. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Hickey PF, Bahlo M. X chromosome association testing in genome wide association studies. Genet Epidemiol. 2011;35:664–70. doi: 10.1002/gepi.20616. [DOI] [PubMed] [Google Scholar]
- 21.Wang J, Yu R, Shete S. X-chromosome genetic association test accounting for X-inactivation, skewed X-inactivation, and escape from X-inactivation. Genet Epidemiol. 2014;38:483–93. doi: 10.1002/gepi.21814. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Chen Z, Ng HKT, Li J, Liu Q, Huang H. Detecting associated single-nucleotide polymorphisms on the X chromosome in case control genome-wide association studies. Stat Methods Med Res. 2017;26:567–82. doi: 10.1177/0962280214551815. [DOI] [PubMed] [Google Scholar]
- 23.Ma L, Hoffman G, Keinan A. X-inactivation informs variance-based testing for X-linked association of a quantitative trait. BMC Genomics. 2015;16:241–9. doi: 10.1186/s12864-015-1463-y. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.Busque L, Mio R, Mattioli J, Brais E, Blais N, Lalonde Y, et al. Nonrandom X-inactivation patterns in normal females: lyonization ratios vary with age. Blood. 1996;88:59–65. [PubMed] [Google Scholar]
- 25.Szelinger S, Malenica I, Corneveaux JJ, Siniard AL, Kurdoglu AA, Ramsey KM, et al. Characterization of X chromosome inactivation using integrated analysis of whole-exome and mRNA sequencing. Plos One. 2014;9:e113036. doi: 10.1371/journal.pone.0113036. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Xu SQ, Zhang Y, Wang P, Liu W, Wu XB, Zhou JY. A statistical measure for the skewness of X chromosome inactivation based on family trios. BMC Genet. 2018;19:109. doi: 10.1186/s12863-018-0694-8. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27.Chu X, Shen M, Xie F, Miao XJ, Shou WH, Liu L, et al. An X chromosome-wide association analysis identifies variants in GPR174 as a risk factor for Graves’ disease. J Med Genet. 2013;50:479–85. doi: 10.1136/jmedgenet-2013-101595. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.Dobyns WB, Filauro A, Tomson BN, Chan AS, Ho AW, Ting NT, et al. Inheritance of most X-linked traits is not dominant or recessive, just X-linked. Am J Med Genet Part A. 2004;129:136–43. doi: 10.1002/ajmg.a.30123. [DOI] [PubMed] [Google Scholar]
- 29.Biggar RJ, Bergen AW, Poulsen GN. Impact of X chromosome genes in explaining the excess risk of cancer in males. Am J Epidemiol. 2009;170:65–71. doi: 10.1093/aje/kwp083. [DOI] [PubMed] [Google Scholar]
- 30.Ober C, Loisel DA, Gilad Y. Sex-specific genetic architecture of human disease. Nat Rev Genet. 2008;9:911–22. doi: 10.1038/nrg2415. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.Lourenço CM, Simão GN, Santos AC, Marques JW. Sex-specific genetic architecture of human disease. Arq Neuropsiquiatr. 2012;70:487–91. doi: 10.1590/S0004-282X2012000700003. [DOI] [PubMed] [Google Scholar]
- 32.Molenberghs G, Verbeke G. Likelihood ratio, score, and Wald tests in a constrained parameter space. Am Stat. 2007;61:22–7. doi: 10.1198/000313007X171322. [DOI] [Google Scholar]
- 33.Wood SN. Generalized Additive Models: An Introduction With R. 1st ed. London: Chapman & Hall Ltd; 2006. [Google Scholar]
- 34.Oehlert GW. A note on the delta method. Am Stat. 1992;46:27–9. [Google Scholar]
- 35.Tin M. Comparison of some ratio estimators. J Am Stat Assoc. 1965;60:294–307. doi: 10.1080/01621459.1965.10480792. [DOI] [Google Scholar]
- 36.Choquet D, L’ecuyer P, Léger C. Bootstrap confidence intervals for ratios of expectations. Acm T Model Comput S. 1999;9:326–48. doi: 10.1145/352222.352224. [DOI] [Google Scholar]
- 37.Fieller EC. Some problems in interval estimation. J R Stat Soc B. 1954;16:175–85. [Google Scholar]
- 38.Venzon DJ, Moolgavkar SH. A method for computing profile-likelihood-based confidence intervals. J R Stat Soc C-Appl. 1988;37:87–94. [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
Data Availability Statement
The dataset supporting the conclusions of this article can be found in the article of Chu et al. [27].