Abstract
We present a meta-analysis of independent studies on the potential implication in the occurrence of coronary heart disease (CHD) of the single-nucleotide polymorphism (SNP) at the −308 position of the tumor necrosis factor alpha (TNF-alpha) gene. We use Bayesian analysis to integrate independent data sets and to infer statistically robust measurements of correlation. Bayesian hypothesis testing indicates that there is no preference for the hypothesis that the −308 TNF-alpha SNP is related to the occurrence of CHD, in the Caucasian or in the Asian population, over the null hypothesis. As a measure of correlation, we use the probability of occurrence of CHD conditional on the presence of the SNP, derived as the posterior probability of the Bayesian meta-analysis. The conditional probability indicates that CHD is not more likely to occur when the SNP is present, which suggests that the −308 TNF-alpha SNP is not implicated in the occurrence of CHD.
Keywords: Bayesian meta-analysis, Coronary heart disease, −308 TNF-alpha
Introduction
Coronary heart disease (CHD) is now widely accepted to consist of a chronic inflammatory disease (Hansson, 2005). CHD is a complex disease with multifold etiology, with both genetic and environmental factors contributing to its occurrence and development.
Among the genetic factors potentially implicated in the emergence of CHD, the tumor necrosis factor alpha (TNF-α) has attracted a great interest for its involvement in the inflammatory response of the immune system (Vassali, 1992). There is evidence that TNF-α is implicated in an increased susceptibility to the pathogenesis of a variety of diseases. In particular, high serum levels of TNF-α affect endothelial cell hemostatic function and hence may modify the risk for developing CHD (Plutzky, 2001). There is also the suggestion that the TNF-α gene affects the modulation of lipid metabolism, obesity susceptibility and insulin resistance, thus being potentially implicated in the development of CHD (see Vourvouhaki & Dedoussis, 2008 and references therein).
Among the several single-nucleotide polymorphisms (SNPs) that have been identified in the human TNF-α, the best documented one is at the position −308 of the TNF-α gene promoter. This SNP involves the substitution of guanine (G) for adenine (A) and the subsequent creation of two alleles (TNF1(A) and TNF2(G)) and three genotypes (GG, GA and AA) (Wilson et al., 1992). It has been hypothesised that the TNF-α SNP could change the susceptibility to CHD. However, the results on its association with CHD are contradictory, some implying different influence of the two alleles on the prevalence of CHD, others implying no association (see Zhang et al., 2011 and references therein).
In order to infer the risk of CHD derived from potential risk factors, it is important to develop a formalism that infers correlations among different intervening factors and combines independent data sets for a consistent inference of the correlations. In Vourvouhaki & Carvalho (2011) we introduced a formalism based on Bayesian inference to infer the correlation of the occurrence of CHD with two risk factors and tested a simplistic model for the signal pathway on the three-variable data set from Vendrell et al. (2003). In this manuscript, we extend the formalism to extract information from the combination of data from independent studies and to quantify the combined risk of occurrence of CHD from the −308 TNF-α SNP.
The most exhaustive meta-analysis to date on this correlation is the frequentist analysis in Zhang et al. (2011) covering Caucasian, Asian, Indian and African populations. This meta-analysis found a 1.5 fold increased risk of developing CHD when the SNP is present in the Caucasian population, but found no association in the other ethnicities. A more recent meta-analysis, covering the same data sets, found no association in the Caucasian or in the Asian population (Chu et al., 2013).
In this manuscript we propose a meta-analysis based on Bayesian analysis in an attempt to establish the potential implication of −308 TNF-α SNP in the occurrence of CHD. This manuscript is organized as follows. In ‘Methods’ we describe the method. In particular, in ‘Data selection’ we describe the data sets selected; in ‘Hypotheses testing’ we propose two hypotheses and test which best and most simply describes the data. In ‘Results’ we perform the Bayesian analysis of the selected data sets, combined by ethnicity and CHD phenotype, and present the results. In particular, in ‘Inference of conditional probabilities’ we infer the conditional probabilities for the occurrence of CHD given the presence of the SNP; in ‘Sensitivity of the results’ we test the sensitivity of this formalism to low-significance data sets, to data sets with extreme results and to extreme data sets. Finally in ‘Conclusions’ we draw the conclusions. Below there follows a flow chart describing summarily the reasoning of this meta-analysis (Figs. 1, 2 and 3).
Figure 1. Flow chart.

Panel 1 of 3. Ellipses indicate the main actions. Rectangles indicate detailed actions. Rectangles with rounded corners indicate the main results.
Figure 2. Flow chart.

Panel 2 of 3.
Figure 3. Flow chart.

Panel 3 of 3.
Methods
Data selection
This analysis is based on twenty data sets (indexed i) on two CHD phenotypes (indexed j) selected from the studies compiled in Zhang et al. (2011), following a well-documented study identification, data acquisition and selection strategy, including also statistical tests (Hardy–Weinberg equilibrium, heterogeneity, publication bias). The selected data sets are the studies that report the genotypes of both CHD patients and non-CHD (control) patients for the two CHD phenotypes separately. In particular, there were included: fifteen data sets from studies on Caucasians, where six studies are on the CHD phenotype coronary stenosis (CS) (Allen et al., 2001; Elahi et al., 2008; Georges et al., 2003; Sbarsi et al., 2007; Szalai et al., 2002; Vendrell et al., 2003) and nine studies are on the CHD phenotype myocardial infarction (MI) (Antonicelli et al., 2005; Bennet et al., 2006; Dedoussis et al., 2005; Herrmann et al., 1998; Koch et al., 2001; Padovani et al., 2000; Tobin et al., 2004; Tulyakova et al., 2004); and five data sets from studies on Asians on the CHD phenotype coronary stenosis (Hou et al., 2009; Liu et al., 2009; Shun et al., 2009; Li et al., 2003; Chen et al., 2001). The rejected data sets are: three studies on Caucasians (for not reporting data on non-CHD patients); four studies on Asians (three for not reporting data on non-CHD patients and one for not separating the CHD phenotypes); the study on Indians and the study on Africans (both for not separating the CHD phenotypes).
The data consist of frequencies of occurrence of the −308 TNF-α SNP in randomly selected CHD patients and non-CHD patients, respectively nSNP,CHD and . The data are summarized in Table 1 (columns 3–6). The errors indicated were computed from error propagation. Assuming that the methods for measuring the presence of the SNP have a success rate of rsuc = 0.88 (Sharifian, 2010), and furthermore that the error of a counting result is given by the Poisson approximation , then the error of a counting result n on the presence of the SNP is given by
Table 1. Data sets and results of hypothesis testing.
Column 1: Studies selected for the meta-analysis. The index (A) indicates that a possible association was measured in the original publication; the index (NA) indicates that no association was measured in the original publication. Column 2: The phenotype of the patients in the studies grouped by ethnicity. Columns 3–6: Genotypic frequencies of TNFα-308 in CHD patients and non-CHD (control) patients from twenty studies (indexed i) and for two CHD phenotypes (indexed j), namely coronary stenosis (CS) and myocardial infarction (MI). Columns 7–8: The Bayes factors for the hypotheses considered, for each data set , and for the meta-data set of each CHD phenotype .
| Study | Phenotype | CHD patients | Controls | Bayes factor | |||
|---|---|---|---|---|---|---|---|
| (i) | (j) | GG | GA/AA | GG | GA/AA | ||
| Allen et al. (NA) | Cauc CS | 127 | 53 | 222 | 107 | 0.14 ± 0.05 | |
| Elahi et al. (A) | 59 | 38 | 41 | 54 | 3.54 ± 1.12 | 0.049 ± 0.014 | |
| Georges et al. (A) | 613 | 236 | 222 | 92 | 0.08 ± 0.03 | 0.041 ± 0.016* | |
| Sbarsi et al. (A) | 175 | 73 | 185 | 56 | 0.33 ± 0.11 | ||
| Szalai et al. (A) | 229 | 89 | 181 | 87 | 0.19 ± 0.07 | 0.048 ± 0.019** | |
| Vendrell et al. (A) | 231 | 110 | 159 | 48 | 1.33 ± 0.46 | ||
| Antonicelli et al. (A) | Cauc MI | 224 | 69 | 246 | 64 | 0.12 ± 0.04 | |
| Bennet et al. (A) | 799 | 368 | 1,037 | 460 | 0.05 ± 0.02 | ||
| Dedoussis et al. (A) | 206 | 31 | 227 | 10 | 26.14 ± 8.56 | 0.026 ± 0.011 | |
| Herrmann et al.a (NA) | 325 | 120 | 376 | 158 | 0.11 ± 0.04 | ||
| Herrmann et al.b (NA) | 117 | 79 | 97 | 79 | 0.19 ± 0.06 | 0.035 ± 0.015* | |
| Koch et al. (NA) | 565 | 228 | 244 | 96 | 0.07 ± 0.03 | 0.030 ± 0.012** | |
| Padovani et al. (A) | 120 | 28 | 114 | 34 | 0.17 ± 0.06 | ||
| Tobin et al. (A) | 365 | 182 | 337 | 168 | 0.07 ± 0.03 | ||
| Tulyakova et al. (NA) | 242 | 64 | 177 | 69 | 0.60 ± 0.21 | ||
| Chen et al. (NA) | Asian CS | 29 | 11 | 21 | 9 | 0.27 ± 0.08 | 0.151 ± 0.057 |
| Hou et al. (NA) | 268 | 32 | 802 | 103 | 0.05 ± 0.02 | ||
| Li et al. (NA) | 66 | 8 | 138 | 20 | 0.12 ± 0.04 | 0.114 ± 0.043* | |
| Li et al. (A) | 234 | 52 | 142 | 34 | 0.10 ± 0.03 | 0.103 ± 0.037** | |
| Shun et al. (A) | 54 | 19 | 118 | 20 | 1.10 ± 0.34 | ||
Notes.
French cohort.
Irish cohort.
Excluding Elahi et al. (2008), Dedoussis et al. (2005) and Chen et al. (2001), respectively for each phenotype.
Excluding Georges et al. (2003), Bennet et al. (2006) and Hou et al. (2009), respectively for each phenotype.
Data heterogeneity
In order to investigate the heterogeneity in the data sets, we compare the size of the effect (defined as a measure of the difference between CHD and non-CHD patients) in each study (Walker, Hernandez & Kattan, 2008). As a measure of the size of the effect, we use the fraction of SNP in the population of CHD patients and in the population of non-CHD patients, respectively fSNPinCHD = nSNP,CHD/nCHD and , where is the total number of CHD patients and is the total number of non-CHD patients. Moreover, the ratio of these two fractions gives an indication of the correlation sign. Hence, if , the SNP is proportionally more frequent in CHD than in non-CHD patients, hence the study favours a positive correlation between the presence of the SNP and the occurrence of CHD; if , the SNP is proportionally less frequent in CHD than in non-CHD patients, hence the study favours a negative correlation; if , the SNP is equally frequent in CHD and in non-CHD patients, hence the study favours no correlation.
We plot this ratio of fractions for each study, grouped by ethnicity and CHD phenotype, in Fig. 4. We also plot the ratio for the combined data sets included in each panel. We observe that the ratio of the data sets are asymmetrical distributed about the ratio equal to one, showing a predominance of ratios smaller than one. The ratio of the combined data sets included in each panel is slightly smaller than one for the Caucasian studies (for both CHD phenotypes) and larger than one for the Asian studies. This asymmetry indicates heterogeneity in the studies, as also observed in the meta-analysis of Zhang et al. (2011).
Figure 4. Funnel plot for the ratio of SNP fractions.
The ratio of the fraction of SNP in the population of CHD patients to the fraction of SNP in the population of non-CHD patients, , for each study, grouped by ethnicity and CHD phenotype. (A) Caucasians with coronary stenosis; (B) Caucasians with myocardial infarction; (C) Asians with coronary stenosis. The solid horizontal line is the ratio of the combined data sets included in each panel. The dashed horizontal line marks the ratio equal to one.
In Fig. 5A, we plot this ratio of fractions as a function of the sample size. We observe that smaller data sets are distributed across a wide range of values of this ratio, whereas larger data sets are distributed more closely to one. This implies that smaller data sets favour either positive or negative correlation, whereas larger data sets favour no correlation.
Figure 5. Scatter plots as a function of the sample size.
(A) The ratio of the frequency of SNP in the CHD population to the frequency of SNP in the non-CHD population as a function of the sample size. (B) The Bayes factor for the two hypotheses discussed in the text as a function of the sample size.
Hypotheses testing
First we test the hypothesis H1 that the presence of TNF-α SNP is related to the occurrence of CHD against the null hypothesis H0 that the presence of the SNP is unrelated to the occurrence of CHD. By the Bayes theorem, the probability of a hypothesis Hi given the data DSNP is the posterior probability of the corresponding hypothesis
| (1) |
where P(DSNP|Hi) is the evidence, P(Hi) is the prior probability of Hi and The subscript in DSNP reminds us that the random variable is the occurrence of the SNP. In order to infer which hypothesis is more likely in view of the data, we compare the evidence computed for the two hypotheses. The evidence is the integral of the likelihood over the j-dimensional parameter space pi,j of the hypothesis Hi
| (2) |
Assuming equal prior probabilities for the two hypotheses, then from Eq. (1) it follows that
| (3) |
We compute the evidence of the two hypotheses, for each data set separately and for the combined data sets grouped by CHD phenotype. We follow the procedure detailed in Vourvouhaki & Carvalho (2011), which we here summarize for one data set and then generalize for the combined data sets. In all cases, we choose a uniform distribution for the prior of the parameters, which is justified by the absence of an a priori bias on the values of the parameters (MacKay, 2003).
The evidence of H0, P(DSNP|H0), is computed assuming that the presence of the SNP is described by a binomial distribution with one parameter only, namely the probability p0 that the SNP occurs in a given population. For nSNP occurrences of the SNP and non-occurrences of the SNP in a sample of size , the likelihood P(DSNP|p0, H0) is given by
| (4) |
Moreover, assuming a uniform prior distribution for p0, P(p0) = 1, we find that
| (5) |
where n! stands for the factorial of n.
The evidence of H1, P(DSNP|H1), is computed assuming that the presence of the SNP is described by a binomial distribution with two parameters, namely the probability p1,CHD that the SNP occurs in the subset of CHD patients and the probability that the SNP occurs in the subset of non-CHD patients,
| (6) |
For nSNP,CHD occurrences of the SNP and non-occurrences of the SNP in a subset of CHD patients , and also for occurrences of the SNP and non-occurrences of the SNP in a subset of non-CHD patients the likelihood is separable, i.e., it can be decomposed into the product of the likelihoods P(DSNP|p1,CHD, H1) and , as follows
| (7) |
Assuming a uniform probability for p1,CHD and 1 and moreover that the priors on p1,CHD and are separable, the posterior distribution will also be separable and given by
| (8) |
In order to compare the hypotheses, we take the ratio of the corresponding evidences, B10 = P(H1|D)/P(H0|D), which we present in Table 1 (columns 7–8). This quantity is known as the Bayes factor and gives empirical levels of significance for the strength of the evidence of the test hypothesis over that of the null hypothesis. It also encapsulates the Occam’s factor, which measures the adequacy of a hypothesis to the data over the parameter space of the hypothesis (MacKay, 2003). The levels of significance ascribed to the Bayes factor are calibrated by the Jeffrey’s scale (Kass & Raftery, 1995). According to this scale, a Bayes factor larger than one indicates that H1 is favoured over H0. Otherwise, H0 is favoured over H1. For the data sets taken separately, the results from this hypothesis test mostly agree with the corresponding results presented in the meta-analysis by Chu et al. (2013, see Fig. 1).
We plot the Bayes factor for each study, grouped by ethnicity and CHD phenotype, in Fig. 6. For the data sets taken separately, we observe that the Bayes factor is asymmetrically distributed about the Bayes factor equal to one, with most Bayes factors being smaller than one. The exceptions are Elahi et al. (2008), Vendrell et al. (2003) and Dedoussis et al. (2005) for the Caucasian population, and Shun et al. (2009) for the Asian population. This asymmetry indicates heterogeneity in the results. For the combined data sets included in each panel, the Bayes factor takes values 0.03–0.05 for the Caucasian population and 0.15 for the Asian population, which indicates that there is no evidence for H1 over H0. We also observe that, for the Caucasian population, the Bayes factor of the combined data sets is outside the range of variability of the Bayes factor of the data sets considered separately. This suggests that the combination of the Caucasian data sets causes a new data pattern to emerge. Conversely the combination of the Asian data sets leads to an approximately average data pattern. Hence we conclude that the data favour H0 over H1. Since H0 yields trivial results, in the subsequent subsections we present the results also for H1 to illustrate the application of the formalism to a more general setup. It is also instructive to compare the subsequent results using both hypotheses.
Figure 6. Funnel plot for the Bayes factor.
The Bayes factor for each study, grouped by ethnicity and CHD phenotype. (A) Caucasians with coronary stenosis; (B) Caucasians with myocardial infarction; (C) Asians with coronary stenosis. The solid horizontal line marks the average Bayes factor of the data sets included in each panel. The dashed horizontal line marks the Bayes factor equal to one.
In Fig. 5B, we plot the Bayes factor as a function of the sample size. We observe that smaller data sets are distributed across a wide range of values of the Bayes factor, whereas larger data sets are distributed across values smaller than one. This implies that smaller data sets favour either H0 or H1, whereas larger data sets favour H0.
Correlation sign
Comparing Fig. 6 with Fig. 4, we observe that, among the studies with Bayes factor larger than one, Elahi et al. (2008) has a ratio , i.e., the SNP is proportionally less frequent in CHD than in non-CHD patients, which indicates a negative correlation between the presence SNP and the occurrence of CHD. Another example of comparatively large Bayes factor and low ratio is the study of Tulyakova et al. (2004). This indicates that the hypotheses as formulated do not distinguish the correlation sign.
To further explore how the ratio affects the result of the hypothesis testing, we consider several realizations of CHD populations with the same nCHD but with different fractions of SNP. More specifically for each combined data set, we vary nSNP,CHD while varying simultaneously so as to keep nCHD constant. Throughout the different realizations, the size of the control population is kept equal to the size of the control population of the combined data sets grouped by ethnicity and CHD phenotype. For each realization, we compute both fSNPinCHD (note that is by construction kept fixed) and B10, and plot the results in Fig. 7. The realizations with the fSNPinCHD of a real combined data set are marked as red points. In Fig. 7A, we plot B10 as a function of , from which there result three parabolae centred at the same point. In Fig. 7B, for a better visualization of the behaviour of B10, we plot B10 as a function of fSNPinCHD, from which there result three parabolae centred at different points. We observe that B10 follows a parabola, taking the minimum value when and increasing in both directions with the increase of , i.e., with the increase of the distance from 1. This confirms that the hypotheses as formulated do not distinguish between a positive correlation of the SNP with CHD () and a negative correlation (). Hence, the value of complements the value of B10 in the characterization of the correlation.
Figure 7. Bayes factor as a function of the frequency of SNP in the CHD populations.
The Bayes factor for several realizations of CHD populations with the same nCHD but with different fractions of SNP, grouped by ethnicity and CHD phenotype. The realizations that correspond to a real combined data set are marked as red points. The dashed horizontal line marks the Bayes factor equal to one. (A) The Bayes factor as a function of . (B) The Bayes factor as a function of fSNPinCHD.
Results
Inference of conditional probabilities
Posterior probability for the occurrence of CHD
We proceed to compute the probability for the occurrence of CHD, i.e., given the data on the presence of the SNP, we determine the probability that a patient has CHD. This is defined as the posterior probability
| (9) |
The prior probability P(CHD) is based on the available information on the occurrence of CHD. This probability can be computed by combining all the risk factors per age interval per pathology. According to the European guidelines, less than 4 in 1,000 people have CS (Hamm et al., 2011), whereas about 1 in 1,000 people have MI (Steg et al., 2012). We then use P(CHD) = 0.004 for CS and P(CHD) = 0.001 for MI.
The evidence P(DSNP|Hi) can be decomposed as
| (10) |
In the case of H0,
| (11) |
whereas in the case of H1,
| (12) |
In the previous section, we computed the evidence by marginalizing the parameters of each hypothesis. Here, assuming a hypothesis Hi and using the Bayes theorem, we compute the posterior probability of each parameter pi,j given the data
| (13) |
and find for pi,j the value that maximizes the likelihood P(DSNP|pi,j). In the case of H0, we compute the posterior probability of the single parameter pi,j = p0, where P(DSNP|p0) is given by Eq. (4), P(DSNP|H0) is given by Eq. (5) and P(p0|H0) is assumed uniform. Taking the derivative with respect to p0 and solving for dP(p0|DSNP)/dp0 = 0, we find for the maximum-likelihood value of p0 the value
| (14) |
Similarly in the case of H1, we compute the posterior probability of each of the two parameters , where P(DSNP|p1,CHD) and are given by Eq. (6), P(DSNP|H1) is given by Eq. (8) and both P(p1,CHD|H1) and are assumed uniform, finding for the maximum-likelihood values of p1,CHD and respectively
| (15) |
| (16) |
Analogously we define the posterior probability
| (17) |
Finally, using the maximum-likelihood value of pi,j, we compute P(CHD|DSNP, Hi) for the data sets combined, which we present in Table 2.
Table 2. Probabilities inferred from the combined data sets.
To each hypothesis there correspond several rows consisting of (A) the parameters pi,j given by the maximum-likelihood values, in particular, p0 (hence one row) in the case of H0, p1,CHD and (hence two rows) in the case of H1; (B) the posterior probability for the occurrence of (CHD, P(CHD|DSNP, Hi) (hence one row for each hypothesis); (C) the predicted probabilities for the presence of the SNP, namely P(nextSNP, CHD|DSNP, Hi), and P(nextSNP|DSNP, Hi) (hence three rows for each hypothesis); and (D) the probability ratio that measures the influence of CHD in the presence of the SNP, rnextSNP,CHD ≡ P(nextSNP, CHD|DSNP, Hi)/P(nextSNP|DSNP, Hi), computed from the combined data of each phenotype (hence one row for each hypothesis). Column 1: The hypotheses. Column 2: The inferred quantities, as described above. Columns 3–5: The values of the inferred quantities for the combined ethnicity and CHD phenotype.
| Hypothesis | Probabilities | Phenotype (j) | ||
|---|---|---|---|---|
| Cauc CS | Cauc MI | Asian CS | ||
| H 0 | p 0 | 0.299 ± 0.001 | 0.284 ± 0.001 | 0.141 ± 0.001 |
| P(CHD|DSNP, H0) | (4.00 ± 1.31) ⋅ 10−3 | (1.00 ± 0.25) ⋅ 10−3 | (4.00 ± 0.91) ⋅ 10−3 | |
| P(nextSNP, CHD|DSNP, H0) | (1.19 ± 0.39) ⋅ 10−3 | (0.28 ± 0.07) ⋅ 10−3 | (0.56 ± 0.13) ⋅ 10−3 | |
| 0.298 ± 1.093 | 0.284 ± 1.752 | 0.141 ± 0.360 | ||
| P(nextSNP|DSNP, H0) | 0.299 ± 1.093 | 0.284 ± 1.572 | 0.141 ± 0.360 | |
| r nextSNP,CHD | (4.00 ± 14.65) ⋅ 10−3 | (1.00 ± 5.54) ⋅ 10−3 | (4.00 ± 10.22) ⋅ 10−3 | |
| H 1 | p 1,CHD | 0.295 ± 0.001 | 0.283 ± 0.001 | 0.158 ± 0.001 |
| 0.305 ± 0.001 | 0.285 ± 0.001 | 0.132 ± 0.001 | ||
| P(CHD|DSNP, H1) | (3.42 ± 7.94) ⋅ 10−3 | (0.98 ± 3.26) ⋅ 10−3 | (5.00 ± 7.02) ⋅ 10−3 | |
| P(nextSNP, CHD|DSNP, H1) | (1.00 ± 2.34) ⋅ 10−3 | (0.28 ± 0.92) ⋅ 10−3 | (0.79 ± 1.11) ⋅ 10−3 | |
| 0.304 ± 0.598 | 0.285 ± 0.926 | 0.131 ± 0.244 | ||
| P(nextSNP|DSNP, H1) | 0.305 ± 0.598 | 0.285 ± 0.926 | 0.132 ± 0.244 | |
| r nextSNP,CHD | (3.30 ± 10.02) ⋅ 10−3 | (0.98 ± 4.54) ⋅ 10−3 | (6.00 ± 13.84) ⋅ 10−3 | |
In the case of H0, no information is added to the posterior probability, since by Eq. (11) the posterior probabilities equal the prior. Conversely in the case of H1, information is added to the posterior probability, since by Eq. (12) there result posterior probabilities different from the prior albeit compatible with the prior.
Prediction of the presence of the SNP
We now proceed to compute the probability for the presence of the SNP, i.e., given the data, we determine the probability that a randomly selected patient (with or without CHD) has the SNP. This probability is defined as
| (18) |
In the case of H0,
| (19) |
whereas in the case of H1,
| (20) |
Using the maximum-likelihood values of pi,j and the posterior probability P(CHD|DSNP, Hi) computed above, we compute P(nextSNP|DSNP, Hi), which we present in Table 2.
For completion, using the Bayes theorem, we invert P(nextSNP|DSNP, CHD) to find the probability that CHD will occur given that the SNP is present in a randomly selected patient
| (21) |
Similarly, inverting , we find the probability that CHD will not occur given that the SNP is present in a randomly selected patient, , which can be found simply by replacing CHD by in Eq. (21).
In order to quantify the influence of CHD in the presence of the SNP, we compute the ratio of P(nextSNP, CHD|DSNP) to P(nextSNP|DSNP, Hi), which gives an estimate of how much the occurrence of CHD indicates the presence of the SNP. This is also the probability in Eq. (21). In the case of H0, this ratio equals the posterior probability of occurrence of CHD. Conversely in the case of H1, this ratio is different from the posterior probability of occurrence of CHD albeit compatible with it. The occurrence of CHD indicates the presence of the SNP in of order 0.1% of patients (0.1–0.4% in the case of H0, 0.1–0.6% in the case of H1), which suggests that the occurrence of CHD is not a good marker for the presence of the SNP.
In order to quantify the influence of the SNP in the occurrence of (CHD, we compute the ratio of P(CHD|nextSNP, Hi) to P(CHD|DSNP, Hi), which gives an estimate of how much the presence of the SNP indicates the occurrence of CHD. This is also the probability in Eqs. (19) and (20). The presence of SNP indicates the occurrence of CHD in of order 0.1% of patients (0.141–0.299% in the case of H0, 0.158–0.295% in the case of H1), which suggests that the presence of the SNP is not a risk factor for the emergence of CHD.
Sensitivity of the results
To test the robustness of this meta-analysis, we conceive two tests of the sensitivity of the results, namely to low-significance data sets, to data sets with extreme results and to extreme data sets.
To test the sensitivity of the results to low-significance data sets, we exclude the data sets with comparatively small sample sizes for the same CHD phenotype, namely the study by Elahi et al. (2008) and the study by Chen et al. (2001), from the combination. We also exclude the studies with extreme results (i.e., the studies with the largest Bayes factor), namely the study in Dedoussis et al. (2005). We recompute both the Bayes factors (Table 1) and the probabilities of CHD (Table 3). We observe that the Bayes factor in the new combination changes by 18%, −38% and 24%, respectively for the CS Caucasian, the MI Caucasian and the CS Asian population. The inferred parameters and probabilities vary by −6 to 6%, −5 to 2%, and −1 to 4%, respectively for the CS Caucasian, the MI Caucasian and the CS Asian population. The largest difference is observed for the CS Caucasian population due to the exclusion of the study by Elahi et al. (2008). The exclusion of the study by Dedoussis et al. (2005) from the MI Caucasian population causes predominantly negative differences.
Table 3. Probabilities inferred from the combined data sets excluding the low-significance data sets and the data sets with extreme results.
Excluded: Elahi et al. (2008), Dedoussis et al. (2005) and Chen et al. (2001). Similarly to Table 2, to each hypothesis there correspond several rows consisting of: (A) the parameters given by the maximum-likelihood values (one row in the case of H0 and two rows in the case of H1); (B) the posterior probability for the occurrence of CHD (one row for each hypothesis); (C) the predicted probabilities for the presence of the SNP (three rows for each hypothesis); and (D) the probability ratio that measures the influence of CHD in the presence of the SNP, computed from the combined data of each phenotype (one row for each hypothesis). Column 1: The hypotheses. Column 2: The inferred quantities, as described above. Columns 3–5: The values of the inferred quantities for the combined ethnicity and CHD phenotype.
| Hypothesis | Probabilities | Phenotype (j) | ||
|---|---|---|---|---|
| Cauc CS | Cauc MI | Asian CS | ||
| H 0 | p 0 | 0.288 ± 0.001 | 0.296 ± 0.001 | 0.136 ± 0.001 |
| P(CHD|DSNP, H0) | (4.00 ± 1.26) ⋅ 10−3 | (1.00 ± 0.24) ⋅ 10−3 | (4.00 ± 0.89) ⋅ 10−3 | |
| P(nextSNP, CHD|DSNP, H0) | (1.15 ± 0.36) ⋅ 10−3 | (0.30 ± 0.07) ⋅ 10−3 | (0.55 ± 0.12) ⋅ 10−3 | |
| 0.287 ± 1.018 | 0.296 ± 1.605 | 0.136 ± 0.340 | ||
| P(nextSNP|DSNP, H0) | 0.289 ± 1.018 | 0.296 ± 1.605 | 0.136 ± 0.340 | |
| r nextSNP,CHD | (4.00 ± 14.16) ⋅ 10−3 | (1.00 ± 5.54) ⋅ 10−3 | (4.00 ± 10.00) ⋅ 10−3 | |
| H 1 | p 1,CHD | 0.290 ± 0.001 | 0.292 ± 0.001 | 0.151 ± 0.001 |
| 0.287 ± 0.001 | 0.300 ± 0.001 | 0.128 ± 0.001 | ||
| P(CHD|DSNP, H1) | (3.34 ± 7.57) ⋅ 10−3 | (0.99 ± 3.18) ⋅ 10−3 | (5.11 ± 6.96) ⋅ 10−3 | |
| P(nextSNP, CHD|DSNP, H1) | (0.97 ± 2.19) ⋅ 10−3 | (0.29 ± 0.93) ⋅ 10−3 | (0.77 ± 1.05) ⋅ 10−3 | |
| 0.286 ± 0.542 | 0.300 ± 0.947 | 0.128 ± 0.234 | ||
| P(nextSNP|DSNP, H1) | 0.287 ± 0.543 | 0.300 ± 0.947 | 0.129 ± 0.234 | |
| r nextSNP,CHD | (3.38 ± 9.96) ⋅ 10−3 | (0.96 ± 4.34) ⋅ 10−3 | (6.02 ± 13.67) ⋅ 10−3 | |
To test the sensitivity of the results to extreme data sets, we exclude the data sets with comparatively large samples sizes for the same CHD phenotype, namely the study by Georges et al. (2003), the study by Bennet et al. (2006) and the study by Hou et al. (2009), from the combination. These are also the studies with the smallest Bayes factor for each CHD phenotype. We recompute both the Bayes factors (Table 1) and the probabilities of CHD (Table 4). We observe that the Bayes factor in the new combination changes by 3%, −19% and 32%, respectively for the CS Caucasian, the MI Caucasian and the CS Asian population. The inferred parameters and probabilities vary by −20 to −1%, 5 to 11%, and −26 to 25%, respectively for the CS Caucasian, the MI Caucasian and the CS Asian population. The largest difference is observed for the CS Asian population due to the exclusion of the study by Hou et al. (2009). The exclusion of the study by Georges et al. (2003) from the CS Caucasian population causes predominantly negative differences.
Table 4. Probabilities inferred from the combined data sets excluding the extreme data sets.
Excluded: Georges et al. (2003), Bennet et al. (2006) and Hou et al. (2009). Similarly to Table 2, to each hypothesis there correspond several rows consisting of: (A) the parameters given by the maximum-likelihood values (one row in the case of H0 and two rows in the case of H1); (B) the posterior probability for the occurrence of CHD (one row for each hypothesis); (C) the predicted probabilities for the presence of the SNP (three rows for each hypothesis); and (D) the probability ratio that measures the influence of CHD in the presence of the SNP, computed from the combined data of each phenotype (one row for each hypothesis). Column 1: The hypotheses. Column 2: The inferred quantities, as described above. Columns 3–5: The values of the inferred quantities for the combined ethnicity and CHD phenotype.
| Hypothesis | Probabilities | Phenotype (j) | ||
|---|---|---|---|---|
| Cauc CS | Cauc MI | Asian CS | ||
| H 0 | p 0 | 0.308 ± 0.001 | 0.271 ± 0.001 | 0.177 ± 0.001 |
| P(CHD|DSNP, H0) | (4.00 ± 1.08) ⋅ 10−3 | (1.00 ± 0.20) ⋅ 10−3 | (4.00 ± 0.63) ⋅ 10−3 | |
| P(nextSNP, CHD|DSNP, H0) | (1.12 ± 0.33) ⋅ 10−3 | (0.27 ± 0.05) ⋅ 10−3 | (0.71 ± 0.11) ⋅ 10−3 | |
| 0.306 ± 0.923 | 0.270 ± 1.220 | 0.177 ± 0.314 | ||
| P(nextSNP|DSNP, H0) | 0.308 ± 0.923 | 0.271 ± 1.220 | 0.177 ± 0.314 | |
| r nextSNP,CHD | (4.00 ± 12.05) ⋅ 10−3 | (1.00 ± 4.51) ⋅ 10−3 | (4.00 ± 7.11) ⋅ 10−3 | |
| H 1 | p 1,CHD | 0.306 ± 0.001 | 0.270 ± 0.001 | 0.190 ± 0.001 |
| 0.309 ± 0.001 | 0.271 ± 0.001 | 0.165 ± 0.001 | ||
| P(CHD|DSNP, H1) | (3.93 ± 6.97) ⋅ 10−3 | (0.92 ± 2.58) ⋅ 10−3 | (3.90 ± 4.35) ⋅ 10−3 | |
| P(nextSNP, CHD|DSNP, H1) | (1.20 ± 2.14) ⋅ 10−3 | (0.25 ± 0.70) ⋅ 10−3 | (0.74 ± 0.828) ⋅ 10−3 | |
| 0.308 ± 0.535 | 0.271 ± 0.698 | 0.165 ± 0.187 | ||
| P(nextSNP|DSNP, H1) | 0.309 ± 0.535 | 0.271 ± 0.698 | 0.165 ± 0.187 | |
| r nextSNP,CHD | (3.90 ± 9.68) ⋅ 10−3 | (0.91 ± 3.48) ⋅ 10−3 | (4.48 ± 7.13) ⋅ 10−3 | |
In both tests, the differences in the Bayes factor leave the result of the hypothesis testings unchanged, while the differences in the inferred parameters and probabilities also leave the conclusions unchanged. We thus infer that this formalism is largely insensitive to (a) low-significante data sets combined with data with extreme results, and to (b) extreme data sets, which renders this formalism significantly robust.
Conclusions
In this manuscript we investigated the correlation between the occurrence of CHD with the presence of the −308 TNF-α SNP from fifteen independent data sets on Caucasians for two CHD phenotypes and from five independent data sets on Asian for one CHD phenotype. We showed how to combine independent data sets and to infer correlations using Bayesian analysis.
Hypothesis testing on the combined data sets indicated that there is no evidence for a correlation between the occurrence of CHD and the presence of the SNP, either on Caucasians or on Asians. This result agrees with previous meta-analyses (Zhang et al., 2011; Chu et al., 2013). As a measure of an eventual correlation, we computed the conditional probability of CHD given the SNP, normalized to the probability that CHD occurs, finding that the presence of the SNP indicates the occurrence of CHD in of order 0.1% of patients, i.e., in of order 0.1% of the occurrence of CHD is concomitant with the presence of SNP. We also tested the sensitivity of the results by excluding selected data sets from the meta-analysis. We found changes of order 10%, leaving the results unchanged and thus establishing this formalism as significantly robust.
An interesting extension of this work for the sake of completion is the inclusion of studies referring to Africans and Indians which are currently too few to extract convincing results.
Acknowledgments
The author thanks E Vourvouhaki and G Tsiliki for useful discussions.
Funding Statement
The author is funded by Fundacao para a Ciencia e a Tecnologia (FCT), Grant no. SFRH/BPD/65993/2009. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Additional Information and Declarations
Competing Interests
The author declares there are no competing interests.
Author Contributions
C. Sofia Carvalho analyzed the data, wrote the paper, prepared figures and/or tables, reviewed drafts of the paper.
References
- Allen et al. (2001).Allen RA, Lee EM, Roberts DH, Park BK, Pirmohamed M. Polymorphisms in the TNF-alpha and TNF-receptor genes in patients with coronary artery disease. European Journal of Clinical Investigation. 2001;31:843–851. doi: 10.1046/j.1365-2362.2001.00907.x. [DOI] [PubMed] [Google Scholar]
- Antonicelli et al. (2005).Antonicelli R, Olivieri F, Cavallone L, Spazzafumo L, Bonafe M, Marchegiani F, Cardelli M, Galeazzi R, Giovagnetti S, Perna GP, Franceschi C. Tumor necrosis factor-alpha gene −308G → A polymorphism is associated with ST-elevation myocardial infarction and with high plasma levels of biochemical ischemia markers. Coronary Artery Disease. 2005;16:489–493. doi: 10.1097/00019501-200512000-00006. [DOI] [PubMed] [Google Scholar]
- Bennet et al. (2006).Bennet AM, Van Maarle MC, Hallqvist J, Morgenstern R, Frostegard J, Wiman B, Prince JA, De Faire U. Association of TNF-alpha serum levels and TNFA-alpha promoter polymorphisms with risk of myocardial infarction. Atherosclerosis. 2006;187:408–414. doi: 10.1016/j.atherosclerosis.2005.09.022. [DOI] [PubMed] [Google Scholar]
- Chen et al. (2001).Chen ZQ, Zheng ZF, Ma JF, Qiu FY, Shi Sl, Chen H. Plasma levels at TNF-α but not TNF-α G-308A gene polymorphism, is associated with coronary heart disease. Chinese Journal of Geriatric Cardiovascular and Cerebrovascular Diseases. 2001;6:156–158. [Google Scholar]
- Chu et al. (2013).Chu H, Yang J, Mi S, Bhuyan SS, Li J, Zhong L, Liu S, Tao Z, Li J, Chen H. Tumor necrosis factor-alpha G-308 A polymorphism and risk of coronary heart disease and myocardial infarction: a case-control study and meta-analysis. Journal of Cardiovascular Disease Research. 2013;3:84–90. doi: 10.4103/0975-3583.95359. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Dedoussis et al. (2005).Dedoussis GV, Panagiotakos DB, Vidra NV, Louizou E, Chrysohoou C, Germanos A, Mantas Y, Tokmakidis S, Pitsavos C, Stefanadis C. Association between TNF-alpha −308G → A polymorphism and the development of acute coronary syndromes in Greek subjects: the CARDIO2000-GENE Study. Genetics in Medicine. 2005;7(6):411–416. doi: 10.1097/01.GIM.0000170993.75385.F4. [DOI] [PubMed] [Google Scholar]
- Elahi et al. (2008).Elahi MM, Gilmour A, Matata BM, Mastana SS. A variant of position −308 of the Tumor necrosis factor alpha gene promoter and the risk of coronary heart disease. Human Molecular Genetics. 2008;17(1):14–18. doi: 10.1016/j.hlc.2007.05.009. [DOI] [PubMed] [Google Scholar]
- Georges et al. (2003).Georges JL, Rupprecht HJ, Blankenberg S, Poirier O, Bickel C, Hafner G, Nicaud V, Meyer J, Cambien F, Tiret L. Impact of pathogen burden in patients with coronary artery disease in relation to systemic inflammation and variation in genes encoding cytokines. American Journal of Cardiology. 2003;92:515–521. doi: 10.1016/S0002-9149(03)00717-3. [DOI] [PubMed] [Google Scholar]
- Hamm et al. (2011).Hamm CW, Bassand J-P, Agewall S, Bax J, Boersma E, Bueno H, Caso P, Dudek D, Gielen S, Huber K, Ohman M, Petrie MC, Sonntag F, Uva MS, Storey RF, Wijns W, Zahger D, Bax JJ, Auricchio A, Baumgartner H, Ceconi C, Dean V, Deaton C, Fagard R, Funck-Brentano C, Hasdai D, Hoes A, Knuuti J, Kolh P, McDonagh T, Moulin C, Poldermans D, Popescu BA, Reiner Z, Sechtem U, Sirnes PA, Torbicki A, Vahanian A, Windecker S, Windecker S, Achenbach S, Badimon L, Bertrand M, Botker HE, Collet J-P, Crea F, Danchin N, Falk E, Goudevenos J, Gulba D, Hambrecht R, Herrmann J, Kastrati A, Kjeldsen K, Kristensen SD, Lancellotti P, Mehilli J, Merkely B, Montalescot G, Neumann F-J, Neyses L, Perk J, Roffi M, Romeo F, Ruda M, Swahn E, Valgimigli M, Vrints CJ, Widimsky P. ESC Guidelines for the management of acute coronary syndromes in patients presenting without persistent ST-segment elevation. European Heart Journal. 2011;32:2999–3054. doi: 10.1093/eurheartj/ehr236. [DOI] [PubMed] [Google Scholar]
- Hansson (2005).Hansson GK. Inflammation, atherosclerosis and coronary heart disease. New England Journal of Medicine. 2005;352:1685–1695. doi: 10.1056/NEJMra043430. [DOI] [PubMed] [Google Scholar]
- Herrmann et al. (1998).Herrmann SM, Ricard S, Nicaud V, Mallet C, Arveiler D, Evans A, Ruidavets JB, Luc G, Bara L, Parra HJ, Poirier O, Cambien F. Polymorphims of the tumor necrosis factor-alpha gene, coronary heart disease and obesity. European Journal of Clinical Investigation. 1998;28:59–66. doi: 10.1046/j.1365-2362.1998.00244.x. [DOI] [PubMed] [Google Scholar]
- Hou et al. (2009).Hou L, Huang J, Lu X, Wang L, Fan Z, Gu D. Polymorphisms of tumor necrosis factor-α gene and coronary hear disease in a Chinese Han population: interaction with cigarette smoking. Thrombosis Research. 2009;123:822–826. doi: 10.1016/j.thromres.2008.07.016. [DOI] [PubMed] [Google Scholar]
- Kass & Raftery (1995).Kass RE, Raftery AE. Bayes Factors. Journal of the American Statistical Association. 1995;90(430):773–795. doi: 10.1080/01621459.1995.10476572. [DOI] [Google Scholar]
- Koch et al. (2001).Koch W, Kastrati A, Böttiger C, Mehili J, Von Beckerath N, Schomig A. Interleukin-10 and tumor necrosis factor gene polymorphisms and risks of coronary artery disease and myocardial infarction. Arterosclerosis. 2001;159:137–144. doi: 10.1016/S0021-9150(01)00467-1. [DOI] [PubMed] [Google Scholar]
- Liu et al. (2009).Liu Y, Jin W, Lu L, Chen QJ, Shen WF. Association between single nucleotide polymorphism in the promoter of tumor necrosis factor-α gene and coronary heart disease. Journal of Diagnostics Concepts & Practice. 2009;5:506–509. [Google Scholar]
- Li et al. (2003).Li Y, Xu P, Chen H, Zhang PA, Huang CX. Association between tumor necrosis factor-α G-308A gene polymorphism and coronary heart disease: a case-control study. Chinese Journal of Geriatrics. 2003;9:568–569. [Google Scholar]
- MacKay (2003).MacKay DJC. Information Theory, Inference, and Learning Algorithms. Cambridge: Cambridge University Press; 2003. [Google Scholar]
- Padovani et al. (2000).Padovani JC, Pazin–Filho A, Simoes MV, Marin–Neto JA, Zago MA, Franco RF. Gene polymorphisms in the TNF locus and the risk of myocardial infarction. Thrombosis Research. 2000;100:263–269. doi: 10.1016/S0049-3848(00)00315-7. [DOI] [PubMed] [Google Scholar]
- Plutzky (2001).Plutzky J. Inflammatory pathways in atherosclerosis and acute coronary syndromes. American Journal of Cardiology. 2001;88:10–15. doi: 10.1016/S0002-9149(01)01924-5. [DOI] [PubMed] [Google Scholar]
- Sbarsi et al. (2007).Sbarsi I, Falcon C, Boiocchi C, Campo I, Zorzetto M, De Silvestri A, Cuccia M. Inflammation and atherosclerosis: the role of TNF and TNH receptors polymorphisms in coronary artery disease. International Journal of Immunopathology and Pharmacology. 2007;20:145–154. doi: 10.1177/039463200702000117. [DOI] [PubMed] [Google Scholar]
- Sharifian (2010).Sharifian H. Master Thesis. 2010. Errors induced during PCR amplification. Available at http://dx.doi.org/10.3929/ethz-a-006088024 . [Google Scholar]
- Shun et al. (2009).Shun SY, Zeng XQ, Qi AM, Fan WH, Zhang JC. Association of tumor necrosis factor-α gene polymorphisms in the promoter region with chronic periodontitis and coronary heart disease. Journal of Clinical Stomatology. 2009;5:279–282. [Google Scholar]
- Steg et al. (2012).Steg G, James SK, Atar D, Badano LP, Lundqvist CB, Borger MA, Di Mario C, Dickstein K, Ducrocq G, Fernandez-Aviles F, Gershlick AH, Giannuzzi P, Halvorsen S, Huber K, Juni P, Kastrati A, Knuuti J, Lenzen MJ, Mahaffey KW, Valgimigli M, van’t Hof A, Widimsky P, Zahger D, Bax JJ, Baumgartner H, Ceconi C, Dean V, Deaton C, Fagard R, Funck-Brentano C, Hasdai D, Hoes A, Kirchhof P, Knuuti J, Kolh P, McDonagh T, Moulin C, Popescu BA, Reiner Ž, Sechtem U, Sirnes PA, Tendera M, Torbicki A, Vahanian A, Windecker S, Hasdai D, Astin F, Åström-Olsson K, Budaj A, Clemmensen P, Collet J-P, Fox KA, Fuat A, Gustiene O, Hamm CW, Kala P, Lancellotti P, Maggioni AP, Merkely B, Neumann F-J, Piepoli MF, Van de Werf F, Verheugt F, Wallentin L. ESC Guidelines for the management of acute myocardial infarction in patients presenting with ST-segment elevation. European Heart Journal. 2012;33(20):2569–2619. doi: 10.1093/eurheartj/ehs215. [DOI] [PubMed] [Google Scholar]
- Szalai et al. (2002).Szalai C, Füst G, Duba J, Kramer J, Romics L, Prohászka Z, Császár A. Association of polymorphisms and allelic combinations in the tumour necrosis factor-alpha complement MHC region with coronary artery disease. Journal of Medical Genetics. 2002;39:46–51. doi: 10.1136/jmg.39.1.46. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Tobin et al. (2004).Tobin MD, Braund PS, Burton PR, Thompson JR, Steeds R, Channer K, Cheng S, Lindpaintner K, Samani NJ. ia multilocus case-control study. European Heart Journal. 2004;25:459–467. doi: 10.1016/j.ehj.2003.11.014. [DOI] [PubMed] [Google Scholar]
- Tulyakova et al. (2004).Tulyakova G, Nasibullin T, Salmanov A, Avzaletdinova, Khusnutdinova E, Zakirova A, Mustafina O. Association of the −308 (G → A) polymorphism of tumor necrosis factor-α with myocardial infarction and sudden cardiac death. Balkan Journal of Medical Genetics. 2004;8:31–35. [Google Scholar]
- Vassali (1992).Vassali P. The pathophysiology of tumor necrosis factors. Annual Review of Immunology. 1992;10:411–452. doi: 10.1146/annurev.iy.10.040192.002211. [DOI] [PubMed] [Google Scholar]
- Vendrell et al. (2003).Vendrell J, Fernandez-Real J-M, Gutierrez C, Zamora A, Simon I, Bardaji A, Ricart W, Richart C. A polymorphism in the promoter of the tumor necrosis factor-α gene (−308) is associated with coronary disease in type 2 diabetic patients. Atherosclerosis. 2003;167:257–264. doi: 10.1016/S0021-9150(02)00429-X. [DOI] [PubMed] [Google Scholar]
- Vourvouhaki & Carvalho (2011).Vourvouhaki E, Carvalho CS. A Bayesian approach to the probability of coronary heart disease subject to genetic risk factors. BioSystems. 2011;105:181–189. doi: 10.1016/j.biosystems.2011.03.010. arXiv:0907.2043 [g-bio.QM] [DOI] [PubMed] [Google Scholar]
- Vourvouhaki & Dedoussis (2008).Vourvouhaki E, Dedoussis GV. Cholesterol ester transfer protein: a therapeutic target in atherosclerosis? Expert Opinion on Therapeutic Targets. 2008;12:937–948. doi: 10.1517/14728222.12.8.937. [DOI] [PubMed] [Google Scholar]
- Walker, Hernandez & Kattan (2008).Walker E, Hernandez AV, Kattan MW. Meta-analysis: its strengths and limitations. Cleveland Clinic Journal of Medicine. 2008;75(6):431–439. doi: 10.3949/ccjm.75.6.431. [DOI] [PubMed] [Google Scholar]
- Wilson et al. (1992).Wilson AG, Di Giovine FS, Blakemore AI, Duff GW. Single base polymorphism in the humor tumour necrosis factor alpha (TNF alpha) gene detectable by NcoI restriction of PCR product. Human Molecular Genetics. 1992;1:353–353. doi: 10.1093/hmg/1.5.353. [DOI] [PubMed] [Google Scholar]
- Zhang et al. (2011).Zhang HF, Xie SL, Wang JF, Chen YX, Wang Y, Huang TC. Tumor necrosis factor-alpha G-308A gene polymorphism and coronary hear disease susceptibility: an updated meta-analysis. Thrombosis Research. 2011;127:400–405. doi: 10.1016/j.thromres.2010.12.018. [DOI] [PubMed] [Google Scholar]




