Skip to main content
NCBI home page
Environmental Health Perspectives logoLink to Environmental Health Perspectives
. 1998 Dec;106(Suppl 6):1541–1550. doi: 10.1289/ehp.98106s61541

Some useful statistical methods for model validation.

A H Marcus 1, R W Elias 1
PMCID: PMC1533433  PMID: 9860913

Abstract

Although formal hypothesis tests provide a convenient framework for displaying the statistical results of empirical comparisons, standard tests should not be used without consideration of underlying measurement error structure. As part of the validation process, predictions of individual blood lead concentrations from models with site-specific input parameters are often compared with blood lead concentrations measured in field studies that also report lead concentrations in environmental media (soil, dust, water, paint) as surrogates for exposure. Measurements of these environmental media are subject to several sources of variability, including temporal and spatial sampling, sample preparation and chemical analysis, and data entry or recording. Adjustments for measurement error must be made before statistical tests can be used to empirically compare environmental data with model predictions. This report illustrates the effect of measurement error correction using a real dataset of child blood lead concentrations for an undisclosed midwestern community. We illustrate both the apparent failure of some standard regression tests and the success of adjustment of such tests for measurement error using the SIMEX (simulation-extrapolation) procedure. This procedure adds simulated measurement error to model predictions and then subtracts the total measurement error, analogous to the method of standard additions used by analytical chemists.

Full text

PDF
1541

Images in this article

1543Figure 1
on p.1543
1546Figure 3
on p.1546

Selected References

These references are in PubMed. This may not be the complete list of references from this article.

  1. Bowers T. S., Beck B. D., Karam H. S. Assessing the relationship between environmental lead concentrations and adult blood lead levels. Risk Anal. 1994 Apr;14(2):183–189. doi: 10.1111/j.1539-6924.1994.tb00043.x. [DOI] [PubMed] [Google Scholar]
  2. Carroll R. J., Galindo C. D. Measurement error, biases, and the validation of complex models for blood lead levels in children. Environ Health Perspect. 1998 Dec;106 (Suppl 6):1535–1539. doi: 10.1289/ehp.98106s61535. [DOI] [PMC free article] [PubMed] [Google Scholar]
  3. Hogan K., Marcus A., Smith R., White P. Integrated exposure uptake biokinetic model for lead in children: empirical comparisons with epidemiologic data. Environ Health Perspect. 1998 Dec;106 (Suppl 6):1557–1567. doi: 10.1289/ehp.98106s61557. [DOI] [PMC free article] [PubMed] [Google Scholar]
  4. Mushak P. Uses and limits of empirical data in measuring and modeling human lead exposure. Environ Health Perspect. 1998 Dec;106 (Suppl 6):1467–1484. doi: 10.1289/ehp.98106s61467. [DOI] [PMC free article] [PubMed] [Google Scholar]
  5. Rabinowitz M. B., Wetherill G. W., Kopple J. D. Kinetic analysis of lead metabolism in healthy humans. J Clin Invest. 1976 Aug;58(2):260–270. doi: 10.1172/JCI108467. [DOI] [PMC free article] [PubMed] [Google Scholar]
  6. Rabinowitz M. B., Wetherill G. W., Kopple J. D. Lead metabolism in the normal human: stable isotope studies. Science. 1973 Nov 16;182(4113):725–727. doi: 10.1126/science.182.4113.725. [DOI] [PubMed] [Google Scholar]
  7. Rabinowitz M. B., Wetherill G. W., Kopple J. D. Magnitude of lead intake from respiration by normal man. J Lab Clin Med. 1977 Aug;90(2):238–248. [PubMed] [Google Scholar]
  8. Rabinowitz M., Wetherill G., Kopple J. Delayed appearance of tracer lead in facial hair. Arch Environ Health. 1976 Jul-Aug;31(4):220–223. doi: 10.1080/00039896.1976.10667223. [DOI] [PubMed] [Google Scholar]

Articles from Environmental Health Perspectives are provided here courtesy of American Chemical Society

RESOURCES