Pooling biomarker data from different studies of disease risk, with a focus on endogenous hormones

Abstract

Large numbers of observations are needed to provide adequate power in epidemiological studies of biomarkers and cancer risk. However, there are currently few large mature studies with adequate numbers of cases with biospecimens available. Therefore pooling biomarker measures from different studies is a valuable approach, enabling investigators to make robust estimates of risk and to examine associations in subgroups of the population. The ideal situation is to have standardized methods in all studies so that the biomarker data can be pooled in their original units. However, even when the studies do not have standardized methods, as with existing studies on hormones and cancer, a simple approach using study-specific quantiles or percentage increases can provide substantial information on the relationship of the biomarker with cancer risk.

Introduction

Studies of biomarkers and cancer risk require large numbers of observations to provide adequate power, particularly to examine consistency across subgroups. Since there are currently few large mature studies with adequate numbers of cases with biospecimens available, the only way to provide sufficient numbers for analysis is to pool the data from individual studies for collaborative re-analysis. Pooled analyses provide several advantages over meta-analyses of published results: data from all the studies can be analysed with the same statistical approach, using the same categories and adjustments, and heterogeneity of the main association can be assessed according to characteristics of the studies and of the individuals, such as the type of assay used and the sub-type of tumors.

Ideally, biomarker data would be combined using the raw data from the original studies to provide hazard ratios per unit change in the concentration of the biomarker. For example, in the Prospective Studies Collaboration, data from 61 studies worldwide were combined and vascular mortality was reported per mmol/l difference in cholesterol concentration (1). In this example, cholesterol assays have very well established methods and provide measurements that are both accurate and precise, making it reasonable to pool the results from different studies. In contrast, other biomarkers are measured using less well standardized assays and accurate measurements may be difficult. A well known example is estradiol in postmenopausal women; concentrations are very low (around 30 pmol/l), and although research laboratories have selected or developed assays sensitive enough to measure these low concentrations, the methods vary and this leads to large differences in measured concentrations (2). This potential variation in biomarker measurements has important implications for the choice of appropriate methods for pooling biomarker data across studies.

Pooling biomarker data: assessing whether variation in measures is due to methods or due to true variation between populations

Figure 1 shows circulating estradiol concentrations (medians and interquartile ranges) for postmenopausal women who were controls in the Endogenous Hormones and Breast Cancer Collaborative Group (EHBCCG; 3) and the European Prospective Investigation into Cancer and Nutrition (EPIC; 4). In the EHBCCG, studies were conducted in different places at different times, with no standardization of methods for blood collection and storage, or type of assay used. The Figure shows that median estradiol concentrations in controls varied from 21.7 pmol/l in the ORDET study in Italy to 101 pmol/l in the New York University Women’s Health Study in the USA, a 4.7-fold difference, and concentrations varied almost as much (4.6-fold) between the six studies within the USA. In EPIC, with standardized methods of blood collection and all assays conducted in the same laboratory (but not in the same batch), there was relatively little difference in median circulating concentrations between women in the seven participating European countries (1.5-fold variation), but estradiol concentrations in all seven countries in EPIC were much higher than those in two other studies in European countries in the EHBCCG (Italy and the UK). The large differences between studies even within one country, together with the smaller differences between countries in the standardized EPIC study, strongly suggest that most of the difference in median estradiol concentrations between studies is due to the assay and other methodological characteristics (e.g. blood collection procedures, time between blood collection and freezing of the samples, temperature of storage), rather than due to true differences in hormone levels between populations. Some of the difference between studies appears to be due to whether or not the estradiol assay incorporated an extraction step, since non-extraction methods generally produce higher estimates of estradiol than extraction methods ((5) and Figure 1: studies using extraction assays marked with an asterisk).

Figure 1.

Median circulating estradiol concentrations (inter-quartile ranges) for postmenopausal control women from studies in the Endogenous Hormones and Breast Cancer Collaborative Group and the European Prospective Investigation into Cancer and Nutrition (3,4).

The nearly 5-fold variation between studies in median estradiol concentrations in postmenopausal women may be an extreme case, but substantial variation also occurs for other hormones. For the other hormones in postmenopausal women analysed by the EHBCCG, variations in median concentrations between studies were over 3-fold for estrone, and between 2 and 3-fold for androstenedione, dehydroepiandrosterone sulfate, testosterone, and sex hormone binding globulin (SHBG). In the Endogenous Hormones and Prostate Cancer Collaborative Group (EHPCCG), a collaborative analysis of 18 prospective studies with hormone measures in men (6, 7), variations between studies were between 1.5 and 2-fold for dihydrotestosterone and androstenedione, between 2 and 3-fold for testosterone, androstanediol glucuronide and dehydroepiandrosterone sulfate, and over 3-fold for estradiol and SHBG.

Hormones may vary relatively little between populations because they are subject to homeostasis, whereas biomarkers of nutrient intake can vary more widely because they are dependent on dietary habits. Figure 2 shows the medians and interquartile ranges for two hormones, for SHBG, and for three nutritional biomarkers, measured in controls in nested case-control analyses of prostate cancer risk in men in six countries in EPIC (8-12). For all these measures blood was collected, processed and stored according to a standardized protocol, and all assays for each biomarker were conducted in the same laboratory. The biomarker concentrations are plotted with values scaled to the overall median concentration to enable easy comparison. For testosterone, SHBG and insulin-like growth factor-I, the variation in medians between European countries is less than 1.5-fold. Docosahexaenoic acid (DHA) also differs relatively little between countries (1.6-fold), but for genistein and lycopene, which are present at very high levels in soya products and tomatoes respectively, the difference between countries is substantially greater (4.8-fold and 2.1-fold, respectively), and the interquartile ranges within each country are also relatively wide. In this multi-country study with standardized methods the large differences in some biomarker levels between countries are due to true differences in diet.

Figure 2.

Median circulating biomarker concentrations (inter-quartile ranges), and relative medians (inter-quartile ranges) for control men in nested case-control studies of prostate cancer from the European Prospective Investigation into Cancer and Nutrition (8-12). SHBG = sex hormone binding globulin; IGF-I = insulin-like growth factor-I, DHA = Docosahexaenoic acid.

Laboratories routinely include quality control samples in each assay batch to estimate the within-assay and between-assay variation. This information should be reported in the methods for pooled analyses, and could be used to categorize studies according to this measure of assay precision. If all contributing studies used the same samples for quality control, it would be possible to use the quality control measures to adjust values from each study to a common scale (13). Data of this type have not been available in the pooled analyses done to date, but this would be a desirable design feature for future studies. Examples of standardized quality control schemes are the United Kingdom National External Quality Assessment Service (UK NEQAS) which provides collaborating laboratories with the same quality control samples so that the differences in measures between laboratories can be quantified (14, 15), and the Centers for Disease Control project on standardizing steroid hormone measurements (16, 17).

One factor which could cause real differences in biomarker concentrations between populations is ethnic group, and its associated lifestyle and genetic characteristics. As with the general discussion above, uncertainties in the comparability of assays can make it impossible to determine whether differences in biomarker levels in different ethnic groups from separate studies are real or are due to methodological differences. On the other hand, if some of the studies include more than one ethnic group with biomarker measurements made using the same methods, ethnic group can be examined as a potential modifier of any associations observed.

Methods for combined analysis of pooled biomarker data from different studies

Where blood collection, storage and assay methods have been standardized, and or in pooled analyses of biomarkers that do not vary much by type of assay (for example cholesterol), we can be reasonably confident that differences between cohorts are due to true differences between populations; ideally the comparability of the measures from the contributing studies can be confirmed by the use of common quality control samples, or by re-measurement in one laboratory of a sample of specimens from each study. Standard methods of statistical analysis are appropriate; relative risks can be estimated in relation to the actual concentration of the biomarker, and analyses in categories should use the same cut-points across all contributing centres. This approach maximizes the ability to examine associations across the whole range of biomarker levels covered by the contributing individual studies.

Where methods have not been standardized, and there are substantial differences between contributing studies which are thought to be largely due to methodological differences, statistical analyses cannot directly use the measured concentrations of the biomarker of interest. For example, in the EHBCCG and the EHPCCG, we assumed that the true mean and range of hormone concentrations in each study is similar, and analysed the data using study-specific quintiles, summing the study-specific odds ratios to provide an overall risk estimate. A possible alternative would be to standardize the data for each study (possibly after log transformation) to have a mean of zero and a standard deviation of one, and then analyse the data using an increment of one standard deviation. This method makes similar assumptions to using study-specific quintiles, but is slightly more complex in that the results are expressed in units of standard deviations, which may be less easy to interpret. In addition to categorical analyses, it is useful to summarize the results with a continuous measure of risk. In individual studies, or in multi-center studies with standardized methods, this is best done by estimating the relative risk per unit increment in the concentration of the biomarker of interest (on an appropriate scale). This is not possible when the measures from different studies vary due to methodological differences. A simple alternative is to estimate the relative risk in each contributing study for a difference in the biomarker from the median of the lowest fifth to the median of the highest fifth – i.e. from the 10th to the 90^th centile. This gives a linear estimate which should be similar to the relative risk in the highest versus the lowest fifth, and this is the approach we used in analyses of sex hormones, insulin-like growth factor-I and prostate cancer risk (6, 7); however, a limitation of this approach is that it gives no information on the magnitude of the difference in biomarker concentrations between the highest and lowest fifths. An alternative is to estimate the relative risk for a biologically plausible percentage increase of the biomarker, such as a doubling (100% increase); this is again a simple approach, which can be readily transferred to biomarker concentrations in an individual study, and is the one we have used in analyses of sex hormones and breast cancer risk in postmenopausal women (3); a disadvantage is that this method assumes a log-linear relationship.

Matching

Most nested-case-control studies of biomarkers and cancer have used a matched design, where controls are matched on characteristics such as date of and age at blood collection. Usually the matched sets of blood samples from each case and corresponding control(s) are sent to the laboratory in batches to ensure that they will be assayed on the same day, thus eliminating between-batch variation from the case-control comparisons. In this situation it is preferable to maintain the original matching in future pooled analyses unless there is a particular reason for breaking the matching.

Other aspects of the analysis of pooled data on biomarkers

Most aspects of the analysis of pooled biomarker data are the same as those which apply to observational epidemiology in general. An area which requires particular attention is to examine the data for evidence of heterogeneity between studies due to technical differences, such as the type of blood sample, conditions of blood processing, storage time and temperature, and type of assay. In practice this may be complex, because studies are likely to differ from each other in several ways and it is hard to be confident which differences are most relevant. There may be an a priori reason to expect heterogeneity due to technical factors. For example, in our analyses of sex hormones and breast cancer in postmenopausal women, we divided the studies according to whether the assays for the major sex hormones had, or had not, incorporated an extraction step. These analyses did not suggest large differences in associations with breast cancer risk according to the assay protocol (3).

Measurement error in biomarkers and within-person variation lead to regression dilution bias, and various methods have been developed to correct for this bias, using repeat measures on a sample of participants (18). So far there has been relatively little work on correcting pooled analyses of hormone data for measurement error, but this is an important topic and will require more studies with repeat measures of hormones.

Conclusions

Pooling biomarker results from different studies is important, mainly because it increases the sample size, enabling investigators to make robust estimates of risk and to examine associations in major subgroups of the population. The ideal situation is to have standardized methods in all studies so that the biomarker data can be pooled in their original units and, after appropriate correction for measurement error, the results can be expressed as the change in risk for a specified change in biomarker concentration. However, even when the studies do not have standardized methods, as with existing studies on hormones and cancer, simple approaches using study-specific quantiles or percentage increases can provide valuable information on the relationship of the biomarker with cancer risk (3, 6, 7).