Abstract
Most disease clustering methods assume specific shapes and do not evaluate statistical power using the applicable geography, at-risk population, and covariates. Cluster Morphology Analysis (CMA) conducts power analyses of alternative techniques assuming clusters of different relative risks and shapes. Results are ranked by statistical power and false positives, under the rationale that surveillance should (1) find true clusters while (2) avoiding false clusters. CMA then synthesizes results of the most powerful methods. CMA was evaluated in simulation studies and applied to pancreatic cancer mortality in Michigan, and finds clusters of flexible shape while routinely evaluating statistical power.
Keywords: Clustering methods, meta-analysis, statistical power, medical geography
Introduction
A major difficulty in the geographic analysis of disease outcomes is that the patterns observed reflect the influence of a complex constellation of demographic, social, economic, cultural and environmental factors that likely change through time and space, and interact with the different types and scales of places where people live (Tunstall et al. 2004). The shape of these patterns as manifested in disease clusters may be thought of as an imperfect projection of this constellation of factors onto a map, and the clusters we observe may likely be of arbitrary shape and change dynamically through time. There thus is a need for cluster analysis approaches that detect clusters of arbitrary shape, recognize that this shape can morph through time, and shift location as underlying demographics and environmental factors wax and wane in relative importance at different places and at different times. One should also account for the known covariates and risk factors, by working with observed and expected case counts, and for uncertainties introduced by small cases counts as well as small populations at risk (e.g. small numbers problem).
The identification of sub-populations with excess disease burdens, and the detailing of disease clusters in terms of geographic extent, population impacts, and amount of excess risk, are priority issues for the National Institutes of Health (Pickle et al. 2005), and cluster studies are now routinely undertaken in cancer surveillance to focus cancer control efforts (Wheeler 2007). Yet a major barrier to the accurate identification and quantification of sub-populations with excess risk is the inability of clustering methods to find clusters of arbitrary shape and to accomplish this through time as population distributions and demography change (Jacquez 2004). In many health agencies the current state-of-the-art in disease cluster investigations employs scan statistics as are available in SatScan (Kulldorff 2004). This means only one cluster shape (circle or ellipse) is evaluated. But when this shape is not strictly correct both false positives – phantom cancer clusters – and false negatives – missed signals – can occur. This paper describes a new, meta-analytic approach to cluster analysis. This approach first conducts power comparisons using the place and disease geography of interest. Next, results from the alternative techniques are compared and contrasted using specificity, power and type 1 and type 2 error. Cluster Morphology Analysis then synthesizes the results for those techniques demonstrated to have the best power and smallest type 1 error. This is a significant advance that provides researchers with detailed knowledge of the statistical performance of clustering methods for the specific cancer outcomes, populations, spatial resolution and geography they are analyzing, and that finds clusters of arbitrary shape with high statistical power and fewer false positives than any one method considered.
The remainder of this Introduction considers the rationale for conducting cluster studies, the basics of probabilistic pattern recognition, and types of cluster tests in common use. It then describe some limitations of cluster studies and how relaxing the shape assumption allows researchers to more accurately distinguish true clusters from methodological artifacts. We then describe recent advances in space-time intelligence system software. The Methods section details the simulation approach and statistical methods, and applies the approach to white male pancreatic cancer in Michigan. Next, the results are described, and the Discussion outlines future research directions.
Objectives of Cluster Analysis
Cluster analyses evaluate both event- and population-based data. Event-based data include observed and expected counts (e.g. number of cases diagnosed within a county over a given time period, and the expected number of cases based on the state rate). Population-based data incorporate information on the at-risk population, and include cancer incidence and mortality rates. A disease cluster may be defined as an excess of cases in geographic space, in time, or in both space and time.
Cluster analysis is used to guide the construction of spatial models and in Exploratory Spatial Data Analysis (ESDA). Model construction requires an understanding of the patterns of spatial variation in order to incorporate relevant features into the model. ESDA involves the identification and description of spatial patterns and has two objectives: geographic pattern recognition and hypothesis generation to specify realistic and testable explanations for those patterns. Spatial patterns are of interest because they summarize the geographic signatures of processes, covariates, and factors (e.g. environmental exposures; access to cancer screening facilities; behaviors mediating cancer risks) that determine how disease risk varies across and is expressed within human populations.
Inference from Cluster Models
Within a hypothesis-testing framework cluster tests proceed by calculating a cluster statistic describing a relevant aspect of spatial pattern in a health outcome. The numerical value of this statistic is then compared to the distribution of that statistic under a null spatial model, providing a probabilistic assessment of how unlikely the observed cluster statistic is under the null hypothesis (Gustafson 1998; Jacquez et al. 1996b; Kulldorff et al. 2006c). Spatial cluster tests have five components (Waller and Jacquez 1995). The test statistic quantifies a relevant aspect of spatial pattern such as Cuzick and Edwards (Cuzick and Edwards 1990) Tk or the scan statistic (Kulldorff et al. 2006a; Tango and Takahashi 2005). The alternative hypothesis describes the spatial pattern the test is designed to detect. The null hypothesis describes the spatial pattern expected when the alternative hypothesis is false (e.g. uniform cancer risk). The null spatial model is a mechanism for generating the reference distribution (Goovaerts and Jacquez 2004). Most disease cluster tests employ heterogeneous Poisson and Bernoulli models for specifying null hypotheses (Lawson and Kulldorff 1999). The reference distribution is the distribution of the test statistic when the null hypothesis is true. Comparison of the test statistic to the reference distribution allows calculation of the probability of the observed value of the test statistic under the null hypothesis of no clustering. There are dozens of cluster statistics that may be categorized for convenience as global, local, and focused tests (Jacquez et al. 1996a; Jacquez et al. 1996b; Kulldorff et al. 2006c; Lawson and Kulldorff 1999). Global cluster statistics are sensitive to clustering anywhere in the study area. Local statistics such as G and G* (Ord and Getis 1995) quantify clustering around individual locations that comprise the study geography. Focused statistics quantify clustering around a specific foci (Tango 2002) and are used to explore clusters of cases near potential sources of environmental pollutants (Lawson 1989; Lawson and Waller 1996; Waller et al. 1992).
Assumptions of Clustering Methods
Hundreds of cluster investigations are recorded in the literature, are used to direct disease control activities and can initiate formal epidemiological studies to identify potential causes (CDC 1990). Cancers studied include leukemia, brain, liver, breast, prostate, bladder, lung, and colorectal cancers. Geographic patterns in therapies, screening behaviors and cancer disparities (Abe et al. 2006; Aschengrau et al. 1996; Bonner et al. 2005; Clarke et al. 2002; Fang et al. 2004; Gregorio et al. 2002; Gregorio et al. 2001; Gregorio et al. 2004; Gregorio et al. 2006; Han et al. 2004; Hsu et al. 2004; Jacquez and Greiling 2003a, b; Jemal et al. 2002; Joseph Sheehan et al. 2004; Paulu et al. 2002; Thomas and Carlin 2003; Turnbull et al. 1990; Vieira et al. 2005; Zhan 2002; Zhan and Lin 2003) are also studied. But to date many cluster studies still employ methods that assume one cluster shape (circle, ellipse, adjacency, nearest neighbors), and we do not know when a reported cluster is real, or explicable as an artifact of the shape assumption (Figure 1).
In addition, cluster analysis software such as SatScan (Kulldorff 2004) and Flexscan (Takahashi et al. 2004) use centroids (e.g. the center of a census unit) when constructing clusters, and these are not reasonable representations of spatial support (e.g. area) or extent. We now consider pitfalls of these strong assumptions, drawing on a published map of lung cancer in New York State (Figure 1). We use the circular scan statistic as an example because it is widely used in local and state health departments.
Assumption of Cluster Shape
The scan statistic (Kulldorff 2004) assumes circular clusters, and as a result, the clusters shown in Figure 1 are circular. Is this best explained as a methodological artifact, or do we really expect cancer clusters to be circular? Within each circular cluster a likelihood statistic is calculated from observed and expected counts, and assesses how unlikely the within-cluster risk is. This can result in false positives within clusters, since an area with a low rate – even a rate 50% below the global mean (as shown in Figure 1) – is declared part of the cluster provided the local average within the circle is sufficiently elevated. These areas of low risk are not legitimate cluster members and as false positives are methodological artifacts. A recent power study by Tango and Takahashi (Tango and Takahashi 2005) found “.... The circular spatial scan statistic tends to detect a larger cluster than the true cluster by absorbing surrounding regions where there is no elevated risk.” Returning false positives as part of a cluster appears to be a property of scan-type statistics that employ a likelihood function to average risk across cluster member candidates – it is not limited only to circular spatial scan statistics.
Assumption of Centroids – No Spatial Support
Centroids are points in the geographic space that represent the sub-areas (e.g. census blocks) that are being studied. Centroids thus ignore spatial support (geographic extent of the sub-area) and relationships between adjoining areas (common boundaries). Disease geography doesn’t stop at the edge of the study area, and the spatial extent of clusters can be biased by edge effects. For example, when a true cluster straddles a border but only half of it is analyzed (as shown in Figure 1 along the northwest border) the geographic center of the cluster may be declared to be further from the border than it really is. In addition, when centroids are used intervening geographic barriers -- such as large bodies of water -- are ignored, and clusters may straddle disjoint geographic units of disparate population characteristics. New approaches are needed that accurately detect clusters of arbitrary shape, based on realistic representations of the geography and demographics of the study populations, and that readily account for changes in disease outcomes and covariates through time.
Space Time Intelligence Systems
The representation of geographies (e.g. census units), demographics and populations as unchanging rather than dynamic is due in part to the static world-view of GIS (Geographic Information System) software, which is largely incapable of representing temporal change and is best suited to “snapshots” of static systems (Goodchild 2000; Hornsby and Egenhofer 2002; Jacquez et al. 2005). This static view hinders the mapping, representation, and analysis of dynamic health, socioeconomic, and environmental information for populations that are dispersed and mobile. Recent technological advances have resulted in Space Time Intelligence Systems (STIS) that implement constructs for representing temporal change (Avruskin et al. 2004; Greiling et al. 2005; Jacquez et al. 2005; Meliker et al. 2005). The STIS technology has the following advantages. First, it is built on true space-time data structures, enabling complex space-time queries not possible in conventional “spatial only” GIS. Second, it has space-time data models that provide realistic representations of human mobility and dynamic geography such as residential histories, geospatial lifelines and morphing polygons. Third, it incorporates statistical tests for space-time pattern such as univariate and bivariate local indicators of spatial autocorrelation. Fourth, it employs dynamic linked windows that enable both cartographic and statistical brushing. Fifth, it constructs and simulates spatio-temporal statistical models including linear, poisson and logistic regression, geographically weighted regression and space-time estimation procedures such as kriging and variogram models. Finally, it displays animated “movies” for exploring how health outcomes (e.g. maps of incidence, mortality, case counts and expectations, and clusters themselves) change through space and time.
Methods
This section describes the CMA approach, and the simulation study design used to evaluate the technique. It concludes with a description of the pancreatic cancer mortality data set used in a first application of the method.
Cluster Morphology Analysis
It should be apparent that different methods are sensitive to different aspects of clustering, since they may be founded on different null hypotheses, employ different spatial weights, and may be designed to be sensitive to different alternative hypotheses. Further, applied studies vary greatly in terms of geography (e.g. county vs. census units vs. ZIP codes), underlying risk (e.g. rare vs. common cancers) and sizes of the population at risk, and any given clustering technique cannot reasonably be expected to be the most powerful in all situations. We therefore developed CMA, whose steps are as follows.
Using the cancer geography of interest to the researcher, construct a cluster model incorporating the observed and expected numbers of cases, the observed at-risk populations, and the observed background risk for that cancer. Model clusters comprised of 1 or more contiguous areas with relative risks the researcher wishes to be able to detect. In this study we used pancreatic cancer in Michigan, described later.
Conduct a power and error analysis of alternative clustering techniques. In this study we evaluated 10 methods and a range of parameter values, for a total of 23 comparisons (shown later in Table 2).
Rank the methods 1st by power and second by proportion of false positives, and select m top ranked members to use in the CMA. In this study methods for the detection of clusters of flexible shape (B, ULS, FlexScan, Kernel) and the circular scan had power=1, with false positives from 0.069 to 0.276 (we used m=5).
Define the set Cq to be the members of the candidate clusters found for method q. For example, if method q found a cluster of 5 counties, then the cluster set would be comprised of those 5 counties.
-
The CMA clusters are then:
(Equation 1) Calculate Probabilities of the CMA clusters. Probabilities for the CMA clusters are then calculated as the average of the probabilities from the m clustering methods used in the CMA.
Table 2.
Found | |||
---|---|---|---|
cluster | background | ||
Truth | cluster | a | b |
background | c | d |
Notice each Cq is comprised of two types of candidate clusters: true cluster members and false positives. CMA therefore reduces the number of false positives whenever the false positives found by each method are not the same over all of the m methods. There still is a tradeoff between power and type 1 error, but, because it is based on a statistical power analysis (step 2, above), under CMA this tradeoff is documented. In this study CMA had power=1 and proportion of false positives=0.017. CMA may be thought of as a meta-analysis of the results of clustering approaches found to have the best statistical performance for a given disease, geography, and at-risk population.
Simulation Design in CMA Step 1
We conducted a CMA analysis that compared the statistical power of 11 methods (described below) using data from NCI’s National Atlas of Cancer Mortality for white male pancreatic cancer mortality in Michigan counties from 1970 through 1994. We used the observed age-standardized at-risk population (Figure 2, top left), and calculated the background risk of 9.57 deaths per 100,000 as the state-wide age-standardized mortality rate for white males. Next we modeled two clusters, one in the north (relative risk 2.0) and one in the south (relative risk 1.5), each comprised of five counties (Figure 2, top center) and encompassing heterogeneous rural and urban populations. We then sampled from this risk surface as a Poisson process using the population size in each county, resulting in realizations of observed deaths under the cluster model (Figure 2, top right), with variance reflecting the actual geographic heterogeneity in the at-risk population. In effect we used the modeled relative risk in each cluster/area and multiplied it by the population at risk to obtain an expected number of deaths for each county. The mean expected number of deaths was then used to sample from the population at risk as a Poisson variable to obtain the modeled number of deaths in that realization. We validated the model by plotting the expected number of deaths in each county under the model as a function of the observed number of deaths from the Atlas of Cancer Mortality (Figure 2, lower left). In Figure 2 the user has brush selected the modeled clusters to highlight them on the scattergrams, histograms and maps. Also shown is the histogram of mortality in the counties at background and in the two clusters (Figure 2, lower center); and the corresponding histogram under the Poisson model. Table 1 gives characteristics of the simulation model.
Table 1.
Pop at risk (Age- adjusted) | Observed Deaths (NCI Mortality Atlas) | Expected Deaths (Model) | Model RR | r | Number of counties | |||||
---|---|---|---|---|---|---|---|---|---|---|
mean | std | Total | mean | std | Total | |||||
North Cluster | 42,089 | 20.0 | 11.01 | 100 | 40.3 | 17.14 | 201.4 | 2.0 | 0.96 | 5 |
South Cluster | 294,534 | 145.8 | 47.28 | 729 | 211.4 | 68.39 | 1057.0 | 1.5 | 0.98 | 5 |
Background | 3,080,886 | 132.7 | 297.32 | 7,696 | 127.1 | 269.66 | 7,371.0 | 1.0 | 0.97 | 58 |
Michigan | 3,417,509 | 125.4 | 276.53 | 8,525 | 126.9 | 251.93 | 8,629.0 | 0.99 | 68 |
Clustering Methods used in CMA Step 2
In CMA step 2 (above) we used 11 clustering tests: Circular scan, FlexScan, ULS scan, B-statistic, Kernel, Turnbull, Besag & Newell, local G and G*, local Moran, and wombling methods. These methods were selected because they have different alternative hypotheses and provide a practical basis for power comparison. In this study we evaluated four approaches to flexible clustering: the Upper Level Set scan statistic (Patil et al. 2006), the flexible scan statistic (Tango and Takahashi 2005); B-statistics (Jacquez et al. 2008); and probability maps from kernel-based density estimation (Rushton et al. 2004). These are now described in some detail, since they are relatively new. The other more established methods are only briefly described.
Upper Level Set (ULS) scan statistic
The basic idea is to define the shapes of the candidate clusters from a map of the data, and to then use likelihood statistics like those in Kulldorff’s scan test (Kulldorff et al. 1998; Kulldorff et al. 1997; Kulldorff et al. 2006b; Kulldorff and Nagarwalla 1995) to evaluate their significance. While ULS has been applied to crime, disease, and ecological applications, its power has yet to be evaluated, and when applied to cancer uncertainty due to spatially heterogeneous population sizes is not fully accounted for. ULS may be used to evaluate case-control clustering as a Bernoulli process, and for observed and expected counts using a Poisson framework (Modarres and Patil 2007; Patil et al. 2006). We present the Poisson version. Let ci denote the cases within the ith area (e.g. census block) and ni the size of the population at risk in that area. A raw rate (e.g. incidence, mortality) is then xi= ci/ni. The study region R may be divided into a zone, O, that is comprised of a spatially contiguous subset of the areas. The set of all such possible zones is denoted Ω, and represents the universe of all possible clusters of arbitrary shape and size. The problem then is to find from among this universe that set of zones that are true cancer clusters. The innovative aspect of ULS is that it uses the map of the data to prune the search space so that only a subset of Ω, denoted ΩULS is considered. ΩULS is constructed by ranking the observed rates, xi, from highest to lowest (one also can rank the rates from smallest to largest to find “coldspots”). Membership in ΩULS is defined by the parameter g which is incremented sequentially over each level of the ranked xi until the sum of the population sizes within the zones defined at the highest level of g reaches a given threshold (usually 50%) of the total population size. This defines successive closed curves on a spatial response surface in a manner analogous to the creation of “rings” in a bathtub as the water is drained. A likelihood ratio, L(O)/Lo, for each of the candidate clusters (zones) in ΩULS under the null hypothesis of no clustering is then calculated (Eqn 2).
(Equation 2) |
Here co is the observed number of cases in zone O, eo is the expected number of cases in that zone, Σci is the total number of cases in the study area, and Σei is the covariate-adjusted expected number of cases in the entire study area under the null hypothesis. Since the analysis is conditioned on the total number of cases observed, Σci − eo is the expected number of cases outside the window. Those zones with the largest likelihood ratios are deemed candidate clusters, and their significance is evaluated under randomization by repeatedly allocating the cases across the study areas, calculating the likelihood ratio, and by then accumulating them to generate the distribution of likelihood ratios under the null hypothesis of no clustering.
While able to construct clusters of arbitrary shape, ULS does not account for instability in the disease rates in the definition of the upper level sets. Hence areas with small population sizes are more likely to be deemed candidate clusters, and areas with elevated rates but large population sizes may be ignored. In this study we addressed this problem by constructing the ΩULS from the Poisson p-values for the rates, which takes into account both the rate and the size of the at-risk population. We then evaluated the approach in simulation studies as discussed later.
Flexible scan statistic (FlexScan)
Tango and Takahashi (Tango and Takahashi 2005) implemented a flexibly based scan statistic that constructs the set of candidate clusters by generating all possible permutations of contiguous areas up to a specified maximum cluster size, k. They found this method to have superior power relative to the circular scan statistic for non-circular clusters (Tango and Takahashi 2005), but it is computation intensive, and its power has yet to be compared to ULS. Kulldorff (Kulldorff 1997) originally made no assumptions regarding the shape of the scanning window, and circular and elliptical shapes have come into common use because of their ease of calculation. The fundamental difference between the circular, elliptical, ULS and FlexScan methods is in how the sets of candidate clusters are generated. The statistical mechanics of calculating a likelihood statistic and using it to identify the most likely cluster (MLC, that candidate cluster with the largest likelihood) are the same for circular, elliptical, the ULS and the FlexScan methods. This underlying statistical mechanism is common to all scan-type statistics and explains the tendency of scan tests to find clusters that are larger than warranted. Tango and Takahashi therefore suggested that a criterion in addition to the maximum likelihood ratio be used in cluster model selection, a suggestion that motivated the development of the B-statistic.
B-statistic
The B-statistic finds clusters of any shape by grouping adjacent areas that have similar (e.g. high or low) risks. While techniques for spatially agglomerative clustering have been available for some time (Legendre and Legendre 1987), they often do not assign probabilities to the resulting clusters. The B-statistic (Jacquez et al. 2008) detects clusters of arbitrary shape, and provides cluster probabilities under realistic null hypotheses. It works by evaluating boundaries between adjacent areas with different values, as well as links between adjacent areas with similar values. Clusters of high values (hotspots) are then constructed by joining adjacent areas that are significantly high (e.g., an unusually high disease rate) and connected through a “link” such that the values in the adjoining areas are not significantly different from one another. Coldspots are identified in an analogous fashion but by joining areas adjacent to significantly low locations. Significance is evaluated using distribution theory based on the product of two continuous (e.g. non-discrete) variables, or by a “distribution free” algorithm based on resampling of the observed values. The procedure for constructing clusters using the B-statistic is as follows.
Evaluate the borders between adjacent areas on the map to determine whether the rates in the two areas are significantly different from one another. The border between two areas whose rates are not significantly different is referred to as a “link”.
Identify areas that have significantly high or low cancer rates using the Poisson distribution to account for the size of the at risk population in that area. Each of these significantly high or low areas is referred to as a “seed”.
Consider each seed in turn, and deem an adjacent area to be part of the cluster only when it is connected to the seed through a link.
Continue growing the cluster by repeating Step 3 until no additional areas can be added to the cluster through adjacent links. The contiguous area formed by connecting the seed through the links is the spatial extent of the cluster.
Kernel density estimation
Kernel density estimation methods result in spatially continuous maps of the probability of a disease outcome (Rushton 1997; Rushton et al. 2004) and appear capable of circumscribing clusters of variable shape. The method computes, for a grid whose size is defined by the user, the local rate at each grid intersection, using a spatial filter whose properties (e.g. diameter) are also user-defined. These rates are then contoured using software for creating isarithmic maps. This technique results in probability maps whose topology can describe arbitrary shapes defined by exceeding a given probability threshold (e.g. 0.05).
Turnbull’s method (Turnbull et al. 1990) scans populations within the study area for clusters of cases. A circular window is centered on each region in turn and expanded to include neighboring regions until the total aggregated population within the window equals a user-defined threshold, R. These circular windows may overlap and the counts within the windows will not be independent. The test statistic, MR, is the maximum number of cases observed among all windows of population size R, whereas the scan statistics presented earlier use a likelihood statistic. Turnbull’s method is most powerful when the population size at elevated risk is known a priori.
Besag & Newells method (Besag and Newell 1991; Newell and Besag 1996) is designed for case and population-at-risk data aggregated into regions with small population sizes. It evaluates local and global clustering using two statistics. The local statistic is the number of contiguous regions that need to be grouped to achieve a cluster of at least k cases. The global statistic is the total number of significant local clusters. The cluster size, k, is defined by the researcher. Waller and Turnbull (Waller and Turnbull 1993) demonstrated the power of this technique depends on how well k matches the actual scale of clustering.
The Local G and G* statistics (Getis and Ord 1992; Ord and Getis 1995) test for spatial clustering in case and population-at-risk data and assess the spatial association in risk within a particular distance of each observation. They may detect local clusters that exist despite negative tests for global spatial autocorrelation. In a study of colon cancer in counties of the south-eastern US (Greiling et al. 2005) the local G was found to give similar, but not identical results to the local Moran.
The local Moran test (Anselin 1995) evaluates clustering under the null hypothesis of no association between rates in adjacent areas. The rates are first standardized to a zero mean. The statistic is the product of the standardized rate for the location being considered and the average value for its adjacent neighbors. A negative value indicates negative local auto-correlation and the presence of a spatial outlier. Clusters of low or high values yield positive values of the statistic. In a study of incidence of breast cancer on Long Island (Jacquez and Greiling 2003b) the local Moran localized excess relative risk to the ZIP code level and confirmed clusters reported by the New York Department of Health using the circular scan statistic.
In our study statistical significance for these methods was evaluated through randomization Cluster analyses for the 10 methods were conducted in TerraSeer’s Space-Time Intelligence System software.
Power Analysis Methods used in CMA Step 3
A classification table (Table 2) was created for each method and for each model realization. For our analysis the marginal totals are the number of counties in hot spots = a+b=10, and number of counties at background = c+d=58. For a given method a is the number of counties that were correctly found to be part of a cluster; b is the number of counties that were incorrectly identified as background when they were actually part of a cluster (a false negative), c is the number of counties that were mistakenly identified as part of a cluster (a false positive), and d is the number of counties that were correctly identified as background (not part of a cluster). We then calculated Power = a/(a+b), the proportion of counties that were correctly identified as cluster members; proportion of false negatives = b/(a+b); proportion of false positives = c/(c+d); and specificity = d/(c+d), the proportion of counties that were correctly identified as background. Finally, we calculated detection accuracy = a/(a+c), the proportion of counties found to be cluster members that were within true clusters (declared clusters as a proportion of true clusters). For methods that require additional parameters (e.g. k, number of cases in the cluster for Besag & Newell) we undertook several runs using a range of parameter values to explore parameter sensitivity.
Results
We first present the CMA results for the simulation study, followed by our findings from the analysis of pancreatic cancer in white males in Michigan.
Cluster Morphology Analysis – Results for Simulated Clusters
The results of the power comparison are summarized in Table 3. To conduct CMA we ranked the results by statistical power, followed by the proportion of false positives, under the rationale that the objective of cluster-based cancer surveillance should be to (1) find the true clusters while (2) avoiding false clusters. The B-statistic, flexible scan, circular scan, kernel-based density estimation, Turnbull and ULS scan correctly identified all members of the North and South clusters. This occurred at the cost of false positives, with the B-statistic having the fewest false positives, followed by the FlexScan with cluster size set to five counties (k=5), the circular scan, FlexScan at k=7 and kernel with a radius of 10 kilometers. For FlexScan the parameter k is the maximum number of counties to include in the cluster, and this method does best when k matches the actual (but usually unobservable) cluster size. Cluster Morphology Analysis had power=1.0 with a proportion of false positives of 0.0172, substantially better than any one method in Table 3 (Figure 3, top panel). This result applies sensu strictu to (i) white male pancreatic cancer in Michigan, which is exactly what we want, since we are interested in that geography and cancer; and (ii) for the cluster sizes and relative risks modeled in the simulation, which unlike (i) are unobservable. In practice analysts will analyze sensitivity to cluster specification, an exercise readily accomplished in the Cluster Morphology Analysis software tools that are being developed at BioMedware with funding from the National Cancer Institute.
Table 3.
Test | Parameter | Power | False negative | False positive | Specificity | Accuracy |
---|---|---|---|---|---|---|
B | 1.000 | 0.000 | 0.069 | 0.931 | 0.714 | |
FlexScan | k=3 | 1.000 | 0.000 | 0.086 | 0.914 | 0.667 |
FlexScan | k=5 | 1.000 | 0.000 | 0.086 | 0.914 | 0.667 |
Circular Scan | 1.000 | 0.000 | 0.103 | 0.897 | 0.625 | |
FlexScan | k=7 | 1.000 | 0.000 | 0.138 | 0.862 | 0.556 |
Kernel | r=10 | 1.000 | 0.000 | 0.138 | 0.862 | 0.556 |
FlexScan | k=9 | 1.000 | 0.000 | 0.224 | 0.776 | 0.435 |
Turnbull | R=2,000,000 | 1.000 | 0.000 | 0.276 | 0.724 | 0.385 |
ULS Scan RR | 1.000 | 0.000 | 0.276 | 0.724 | 0.385 | |
ULS Scan 1-p(RR) | 1.000 | 0.000 | 0.310 | 0.690 | 0.357 | |
Kernel | r=15 | 0.900 | 0.100 | 0.017 | 0.983 | 0.900 |
FlexScan | k=2 | 0.900 | 0.100 | 0.017 | 0.983 | 0.900 |
Besag & Newell | k=210 (N. cluster size) | 0.700 | 0.300 | 0.052 | 0.948 | 0.700 |
Kernel | r=25k | 0.500 | 0.500 | 0.000 | 1.000 | 1.000 |
Turnbull | R=400,000 | 0.500 | 0.500 | 0.034 | 0.966 | 0.714 |
Turnbull | R=800,000 | 0.500 | 0.500 | 0.103 | 0.897 | 0.455 |
Local Moran | 0.400 | 0.600 | 0.000 | 1.000 | 1.000 | |
Kernel | r=50 | 0.400 | 0.600 | 0.000 | 1.000 | 1.000 |
Kernel | r=20k | 0.400 | 0.600 | 0.000 | 1.000 | 1.000 |
Turnbull | R=250,000 | 0.400 | 0.600 | 0.017 | 0.983 | 0.800 |
G* | 0.400 | 0.600 | 0.069 | 0.931 | 0.500 | |
G | 0.400 | 0.600 | 0.069 | 0.931 | 0.500 | |
Besag & Newell | k=1034 (S. Cluster size) | 0.200 | 0.800 | 0.138 | 0.862 | 0.200 |
Cluster Morphology Analysis – Results for Observed Mortality Data
Is there evidence of clusters of pancreatic cancers in white males in Michigan, and do they change through time? Findings of persistent clusters may indicate the action of a risk factor or covariate that is geographically localized and elevated through time. To address these questions we applied CMA to observed pancreatic cancer mortality data in white males for two time periods: 1950–70 and 1970–95. The ability to rapidly explore cluster change through time is available in the STIS software using the animation toolbar (Figure 3, center of bottom panel). For 1970–95 (Figure 3, bottom panel) we found two significant clusters under CMA, one in the north and one in the southeast including portions of the Detroit metropolitan area. The northern cluster is ephemeral and was not present in 1950–70. The southeast cluster consisted only of Wayne County in 1950–70 and expanded to include Macomb County in 1970–95.
Is the finding of a persistent cluster of pancreatic cancer in the Detroit metropolitan area independently confirmed by more recent incidence data of higher temporal resolution? To address this question we used incidence and mortality data from NCI’s Surveillance Epidemiology and End Results program, SEER (Ries et al. 2007). SEER provides cancer registry data for 17 areas across the United States, including Atlanta, rural Georgia, California (Bay Area, San Francisco-Oakland, San Jose-Monterey, Los Angeles and Greater California), Connecticut, Hawaii, Iowa, Kentucky, Louisiana, New Jersey, New Mexico, Seattle-Puget Sound, Utah and Detroit. For 2000–2004 of the 17 SEER areas Detroit had the highest age-adjusted incidence rate for white males at 15.0 cases per 100,000, and the second highest mortality rate at 12.9 deaths per 100,000. These compare to SEER-wide averages for white males in this period of 12.8 incident cases and 12.0 deaths per 100,000. Further, for the Detroit registry pancreatic cancer mortality for white males in this period increased 0.9% per year (Calculated by SEER*Stat from the National Vital Statistics System public use data file). The population covered by the Detroit registry in this period was 1,365,315 white males, indicating a substantial and increasing burden of pancreatic cancer in this population. The clusters found by CMA thus were independently confirmed by data from SEER and found to persist from 1950 through 2004.
Discussion
To date, one of the major deficiencies of geographic studies of disease is that they typically rely on only one clustering technique whose statistical power and type 1 error are unknown for the health outcome, at-risk population and geography being studied. This is a severe methodological shortcoming that is akin to undertaking a case-control study in the absence of a statistical power analysis of the study design. Within the context of cancer control and surveillance, the substantial benefit of the CMA approach is that it will allow cancer control professionals to detect clusters of arbitrary shape through time using a meta-analytic approach that synthesizes the results of those clustering methods found to be most powerful for a given cancer geography.
Should CMA be corrected for multiple comparisons? Adjustments for multiple comparisons are employed when a statistical procedure (e.g. clustering test) is applied to a host of different datasets (e.g. disease data from different areas, or different diseases in the same area), or when different tests are applied to the same dataset. Multiple tests are then thought of as replicates of the same or similar experiments. Given a type 1 error rate for the test of α and m datasets or tests,, one might then expect to find false positive results arising α * m times. One then would use a multiple testing procedure (e.g. Simes, Holmes, others) to obtain an adjusted type-1 error. CMA employs simulations to compare and contrast different clustering methods, hence the statistical power, type-1 error, and type-2 error are based on simulation results where the true clusters are known a priori. Correction for multiple comparisons is not needed since the true type 1 error is known from simulation.
How many cluster tests should be used in CMA? Should only a few methods be used that happen to give quite different results, the intersection rule in CMA (equation 1) at first blush appears might have low power to detect true clusters. Recall however the first step in the CMA is to undertake simulation studies to quantify the abilities of the statistical methods to detect true clustering. Methods that have low power are then excluded from the CMA when the methods are ranked after the power analysis (e.g. Table 3). In our studies at least some of the methods we’ve included in the CMA have had power=1.0. Provided power is 1.0 for all of the methods in the CMA then the intersection approach in Equation 1 will yield a CMA with power=1.0. This results in a proposed “rule-of-thumb”: Always include a sufficient number of methods/parameter sets to yield at least 5 methods that in the simulations have power=1.0. At the time of this writing we are still exploring the statistical behavior of the CMA approach, and have not further validated this recommendation.
The methods and examples presented here are for area-based data such as incidence and mortality rates. The CMA approach is directly extensible to case-control data and is a future research direction.
We currently are developing a CMA software tool that will allow cancer epidemiologists to readily construct cluster models premised on their specific cancer geography and incorporating cluster count, size, shape and relative risk as specified by the researcher; and to then automatically evaluate the statistical power of a suite of clustering methods to detect such clusters. While we have focused this software tool on the identification of cancer clusters through CMA, the software will be highly flexible and will have, through its visualization and analysis capabilities, clear applications in (a) monitoring and surveillance of cancer incidence and mortality, (b) the generation of hypotheses for in depth individual studies of risk factors that are causal, or impact survival or morbidity; and (c) establishing the rationale for targeted cancer control interventions for localized excesses in risk whose shape, extent and size will have been established and documented with an unprecedented level of statistical power and accuracy.
Acknowledgments
The author thankfully acknowledges the support of National Cancer Institute grants R44CA112743 and R43CA135818 to BioMedware. The perspectives presented in this publication are those of the author and do not necessarily represent the official position of the National Cancer Institute.
Footnotes
Publisher's Disclaimer: This is a PDF file of an unedited manuscript that has been accepted for publication. As a service to our customers we are providing this early version of the manuscript. The manuscript will undergo copyediting, typesetting, and review of the resulting proof before it is published in its final citable form. Please note that during the production process errors may be discovered which could affect the content, and all legal disclaimers that apply to the journal pertain.
References
- Abe T, I, Martin B, Roche LM. Clusters of census tracts with high proportions of men with distant-stage prostate cancer incidence in New Jersey, 1995 to 1999. Am J Prev Med. 2006;30(2 Suppl):S60–66. doi: 10.1016/j.amepre.2005.09.003. [DOI] [PubMed] [Google Scholar]
- Anselin L. Local indicators of spatial association-LISA. Geographical Analysis. 1995;27:93–115. [Google Scholar]
- Aschengrau A, Ozonoff D, Coogan P, Vezina R, Heeren T, Zhang Y. Cancer risk and residential proximity to cranberry cultivation in Massachusetts. Am J Public Health. 1996;86(9):1289–1296. doi: 10.2105/ajph.86.9.1289. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Avruskin GA, Jacquez GM, Meliker JR, Slotnick MJ, Kaufmann AM, Nriagu JO. Visualization and exploratory analysis of epidemiologic data using a novel space time information system. Int J Health Geogr. 2004;3(1):26. doi: 10.1186/1476-072X-3-26. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Besag J, Newell J. The detection of clusters in rare diseases. Journal of the Royal Statistical Society Series A. 1991;154:143–155. [Google Scholar]
- Bonner MR, Han D, Nie J, Rogerson P, Vena JE, Muti P, Trevisan M, Edge SB, Freudenheim JL. Breast cancer risk and exposure in early life to polycyclic aromatic hydrocarbons using total suspended particulates as a proxy measure. Cancer Epidemiol Biomarkers Prev. 2005;14(1):53–60. [PubMed] [Google Scholar]
- CDC. Guidelines for investigating clusters of health events. Mortality and Morbidity Weekly Report. 1990;39:1–16. [PubMed] [Google Scholar]
- Clarke CA, Glaser SL, West DW, Ereman RR, Erdmann CA, Barlow JM, Wrensch MR. Breast cancer incidence and mortality trends in an affluent population: Marin County, California, USA, 1990–1999. Breast Cancer Res. 2002;4(6):R13. doi: 10.1186/bcr458. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Cuzick J, Edwards R. Spatial clustering for inhomogeneous populations. Journal of the Royal Statistical Society Series B. 1990;(52):73–104. [Google Scholar]
- Fang Z, Kulldorff M, Gregorio DI. Brain cancer mortality in the United States, 1986 to 1995: a geographic analysis. Neuro-oncol. 2004;6(3):179–187. doi: 10.1215/S1152851703000450. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Getis Arthur, Ord JK. The Analysis of Spatial Association by Use of Distance Statistics. Geographical Analysis. 1992;24:189–206. [Google Scholar]
- Goodchild M. GIS and Transportation: Status and Challenges. GeoInformatica. 2000;4:127–139. [Google Scholar]
- Goovaerts P, Jacquez GM. Accounting for regional background and population size in the detection of spatial clusters and outliers using geostatistical filtering and spatial neutral models: the case of lung cancer in Long Island, New York. Int J Health Geogr. 2004;3(1):14. doi: 10.1186/1476-072X-3-14. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Gregorio DI, Kulldorff M, Barry L, Samociuk H. Geographic differences in invasive and in situ breast cancer incidence according to precise geographic coordinates, Connecticut, 1991–95. Int J Cancer. 2002;100(2):194–198. doi: 10.1002/ijc.10431. [DOI] [PubMed] [Google Scholar]
- Gregorio DI, Kulldorff M, Barry L, Samocuik H, Zarfos K. Geographical differences in primary therapy for early-stage breast cancer. Ann Surg Oncol. 2001;8(10):844–849. doi: 10.1007/s10434-001-0844-4. [DOI] [PubMed] [Google Scholar]
- Gregorio DI, Kulldorff M, Sheehan TJ, Samociuk H. Geographic distribution of prostate cancer incidence in the era of PSA testing, Connecticut, 1984 to 1998. Urology. 2004;63(1):78–82. doi: 10.1016/j.urology.2003.08.008. [DOI] [PubMed] [Google Scholar]
- Gregorio DI, Samociuk H, Dechello L, Swede H. Effects of study area size on geographic characterizations of health events: prostate cancer incidence in Southern New England, 1994–1998. Int J Health Geogr. 2006;5(1):8. doi: 10.1186/1476-072X-5-8. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Greiling DA, Jacquez GM, Kaufmann AM, Rommel RG. Space time visualization and analysis in the Cancer Atlas Viewer. Journal of Geographical Systems. 2005;7:67–84. doi: 10.1007/s10109-005-0150-y. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Gustafson EJ. Quantifying landscape spatial pattern: What is the state of the art? Ecosystems. 1998;1:143–156. [Google Scholar]
- Han D, Rogerson PA, Nie J, Bonner MR, Vena JE, Vito D, Muti P, Trevisan M, Edge SB, Freudenheim JL. Geographic clustering of residence in early life and subsequent risk of breast cancer (United States) Cancer Causes Control. 2004;15(9):921–929. doi: 10.1007/s10552-004-1675-y. [DOI] [PubMed] [Google Scholar]
- Hornsby K, Egenhofer M. Modeling moving objects over multiple granularities. Annals of Mathematics and Artificial Intelligence. 2002;36:177–194. [Google Scholar]
- Hsu C, Jacobson HE, Mas FS. Evaluating the disparity of female breast cancer mortality among racial groups; a spatiotemporal analysis. International Journal of Health Geographics. 2004;3(4) doi: 10.1186/1476-072X-3-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Jacquez GM, Greiling D, Kaufmann A. Design and Implementation of Space-Time Information Systems. Journal of Geographical Systems. 2005;7:7–31. doi: 10.1007/s10109-005-0150-y. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Jacquez GM. Current practices in the spatial analysis of cancer: flies in the ointment. Int J Health Geogr. 2004;3(1):22. doi: 10.1186/1476-072X-3-22. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Jacquez GM, Greiling DA. Geographic boundaries in breast, lung and colorectal cancers in relation to exposure to air toxics in Long Island, New York. Int J Health Geogr. 2003a;2(1):4. doi: 10.1186/1476-072X-2-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Jacquez GM, Greiling DA. Local clustering in breast, lung and colorectal cancer in Long Island, New York. Int J Health Geogr. 2003b;2(1):3. doi: 10.1186/1476-072X-2-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Jacquez GM, Grimson R, Waller LA, Wartenberg D. The analysis of disease clusters, Part II: Introduction to techniques. Infect Control Hosp Epidemiol. 1996a;17(6):385–397. doi: 10.1086/647325. [DOI] [PubMed] [Google Scholar]
- Jacquez GM, Waller LA, Grimson R, Wartenberg D. The analysis of disease clusters, Part I: State of the art. Infect Control Hosp Epidemiol. 1996b;17(5):319–327. doi: 10.1086/647301. [DOI] [PubMed] [Google Scholar]
- Jacquez Geoff, Kaufmann Andy, Goovaerts Pierre. Boundaries, links and clusters: a new paradigm in spatial analysis? Environmental and Ecological Statistics. 2008;15 doi: 10.1007/s10651-007-0066-4. In Press. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Jemal A, Kulldorff M, Devesa SS, Hayes RB, Fraumeni JF., Jr A geographic analysis of prostate cancer mortality in the United States, 1970–89. Int J Cancer. 2002;101(2):168–174. doi: 10.1002/ijc.10594. [DOI] [PubMed] [Google Scholar]
- Joseph Sheehan T, DeChello LM, Kulldorff M, Gregorio DI, Gershman S, Mroszczyk M. The geographic distribution of breast cancer incidence in Massachusetts 1988 to 1997, adjusted for covariates. Int J Health Geogr. 2004;3(1):17. doi: 10.1186/1476-072X-3-17. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kulldorff M. A spatial scan statistic. Communications in Statistics. 1997;26:1481–1496. [Google Scholar]
- Kulldorff M. SaTScan v4.0: Software for the spatial and space-time scan statistics. Information Management Services 2004 [Google Scholar]
- Kulldorff M, Athas WF, Feurer EJ, Miller BA, Key CR. Evaluating cluster alarms: a space-time scan statistic and brain cancer in Los Alamos, New Mexico. Am J Public Health. 1998;88(9):1377–1380. doi: 10.2105/ajph.88.9.1377. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kulldorff M, Feuer EJ, Miller BA, Freedman LS. Breast cancer clusters in the northeast United States: a geographic analysis. Am J Epidemiol. 1997;146(2):161–170. doi: 10.1093/oxfordjournals.aje.a009247. [DOI] [PubMed] [Google Scholar]
- Kulldorff M, Huang L, Pickle L, Duczmal L. An elliptic spatial scan statistic. Stat Med. 2006a doi: 10.1002/sim.2490. [DOI] [PubMed] [Google Scholar]
- Kulldorff M, Huang L, Pickle L, Duczmal L. An elliptic spatial scan statistic. Stat Med. 2006b;25(22):3929–3943. doi: 10.1002/sim.2490. [DOI] [PubMed] [Google Scholar]
- Kulldorff M, Nagarwalla N. Spatial disease clusters: detection and inference. Stat Med. 1995;14(8):799–810. doi: 10.1002/sim.4780140809. [DOI] [PubMed] [Google Scholar]
- Kulldorff M, Song C, Gregorio D, Samociuk H, DeChello L. Cancer map patterns: are they random or not? Am J Prev Med. 2006c;30(2 Suppl):S37–49. doi: 10.1016/j.amepre.2005.09.009. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Lawson AB. Score tests for detection of spatial trend in morbidity data. Dundee: Dundee Institute of Technology; 1989. [Google Scholar]
- Lawson AB, Kulldorff M. A review of cluster detection methods. In: Lawson AB, editor. Advanced Methods of Disease Mapping and Risk Assessment for Public Health Decision Making. London: Wiley; 1999. [Google Scholar]
- Lawson AB, Waller LA. A review of point pattern methods for spatial modelling of events around sources of pollution. Environmetrics. 1996;7:471–487. [Google Scholar]
- Legendre P, Legendre L. Numerical Ecology. Berlin: Springer-Verlag; 1987. [Google Scholar]
- Meliker JR, Slotnic MJ, AvRuskin GA, Kaufmann A, Jacquez GM, Nriagu JO. Improving exposure assessment for environmental epidemiology: Applications of a Space-Time Information System. Journal of Geographical Systems. 2005;7:49–66. [Google Scholar]
- Modarres R, Patil GP. Hotspot detection with bivariate data. Journal of Statistical Planning and Inference. 2007;137(11):3643–3654. [Google Scholar]
- Newell JN, Besag JE. Methods for investigating localized clustering of disease. The detection of small-area database anomalies. IARC Sci Publ. 1996;(135):87–100. [PubMed] [Google Scholar]
- Ord JK, Getis A. Local spatial autocorrelation statistics: Distributional issues and an application. Geographical Analysis. 1995;27:286–306. [Google Scholar]
- Patil GP, Modarres R, Myers WL, Patankar P. Spatially constrained clustering and upper level set scan hotspot detection in surveillance geoinformatics. Environmental and Ecological Statistics. 2006;13(4):365–377. [Google Scholar]
- Paulu C, Aschengrau A, Ozonoff D. Exploring associations between residential location and breast cancer incidence in a case-control study. Environ Health Perspect. 2002;110(5):471–478. doi: 10.1289/ehp.02110471. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Pickle LW, Waller LA, Lawson AB. Current practices in cancer spatial data analysis: a call for guidance. Int J Health Geogr. 2005;4(1):3. doi: 10.1186/1476-072X-4-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Ries LAG, Harkens D, Krapacho M, Mariotto A, Miller BA, Feuer EJ, Clegg L, Eisner MP, Horner MJ, Howlader N, Hayat M, Hankey BF, Edwards BK. SEER Cancer Statistics Review, 1975–2004. Bethesda, MD: National Cancer Institute; 2007. [Google Scholar]
- Rushton G. Improving public health through geographical information systems: an instructional guide to major concepts and their implementation [CD-ROM]. Version 2.0. Iowa City: University of Iowa, Department of Geography; 1997. [Google Scholar]
- Rushton G, Peleg I, Banerjee A, Smith G, West M. Analyzing Geographic Patterns of Disease Incidence: Rates of Late-Stage Colorectal Cancer in Iowa. Journal of Medical Systems. 2004;28:223–236. doi: 10.1023/b:joms.0000032841.39701.36. [DOI] [PubMed] [Google Scholar]
- Takahashi K, Yokoyama T, Tango T. FleXScan: Software for the flexible spatial scan statistic. National Institute of Public Health; Japan: 2004. [Google Scholar]
- Tango T. Score tests for detecting excess risks around putative sources. Stat Med. 2002;21(4):497–514. doi: 10.1002/sim.1003. [DOI] [PubMed] [Google Scholar]
- Tango T, Takahashi K. A flexibly shaped spatial scan statistic for detecting clusters. Int J Health Geogr. 2005;4:11. doi: 10.1186/1476-072X-4-11. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Thomas A, Carlin BP. Late detection of breast and colorectal cancer in Minnesota counties: an application of spatial smoothing and clustering. Stat Med. 2003;22(1):113–127. doi: 10.1002/sim.1215. [DOI] [PubMed] [Google Scholar]
- Tunstall HV, Shaw M, Dorling D. Places and health. J Epidemiol Community Health. 2004;58(1):6–10. doi: 10.1136/jech.58.1.6. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Turnbull BW, Iwano EJ, Burnett WS, Howe HL, Clark LC. Monitoring for clusters of disease: application to leukemia incidence in upstate New York. Am J Epidemiol. 1990;132(1 Suppl):S136–143. doi: 10.1093/oxfordjournals.aje.a115775. [DOI] [PubMed] [Google Scholar]
- Vieira V, Webster T, Weinberg J, Aschengrau A, Ozonoff D. Spatial analysis of lung, colorectal, and breast cancer on Cape Cod: an application of generalized additive models to case-control data. Environ Health. 2005;4:11. doi: 10.1186/1476-069X-4-11. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Waller LA, Jacquez GM. Disease models implicit in statistical tests of disease clustering. Epidemiology. 1995;6(6):584–590. doi: 10.1097/00001648-199511000-00004. [DOI] [PubMed] [Google Scholar]
- Waller LA, Turnbull BW. The effects of scale on tests for disease clustering. Stat Med. 1993;12(19–20):1869–1884. doi: 10.1002/sim.4780121913. [DOI] [PubMed] [Google Scholar]
- Waller LA, Turnbull BW, Clark LC, Nasca P. Chronic disease surveillance and testing of clustering of disease and exposure: Application to leukemia incidence and TCE-contaminated dumpsites in upstate New York. Environmetrics. 1992;3:281–300. [Google Scholar]
- Wheeler David. A comparison of spatial clustering and cluster detection techniques for childhood leukemia incidence in Ohio, 1996 – 2003. International Journal of Health Geographics. 2007;6(1):13. doi: 10.1186/1476-072X-6-13. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Zhan FB. Are deaths from liver cancer, kidney cancer, and leukemia clustered in San Antonio? Tex Med. 2002;98(10):51–56. [PubMed] [Google Scholar]
- Zhan FB, Lin H. Geographic patterns of cancer mortality clusters in Texas, 1990 to 1997. Tex Med. 2003;99(8):58–64. [PubMed] [Google Scholar]