Skip to main content
PMC home page
American Journal of Public Health logoLink to American Journal of Public Health
. 1991 Sep;81(9):1166–1173. doi: 10.2105/ajph.81.9.1166

Epidemiologic studies utilizing surveys: accounting for the sampling design.

E L Korn 1, B I Graubard 1
PMCID: PMC1405642  PMID: 1951829

Abstract

BACKGROUND. Since large-scale health surveys usually have complicated sampling schemes, there is often a question as to whether the sampling design must be considered in the analysis of the data. A recent disagreement concerning the analysis of a body iron stores-cancer association found in the first National Health and Nutrition Examination Survey and its follow-up is used to highlight the issues. METHODS. We explain and illustrate the importance of two aspects of the sampling design: clustering and weighting of observations. The body iron stores-cancer data are reanalyzed by utilizing or ignoring various aspects of the sampling design. Simple formulas are given to describe how using the sampling design of a survey in the analysis will affect the conclusions of that analysis. RESULTS. The different analyses of the body iron stores-cancer data lead to very different conclusions. Application of the simple formulas suggests that utilization of the sample clustering in the analysis is appropriate, but that a standard utilization of the sample weights leads to an uninformative analysis. The recommended analysis incorporates the sampling weights in a nonstandard way and the sample clustering in the standard way. CONCLUSIONS. Which particular aspects of the sampling design to use in the analysis of complex survey data and how to use them depend on certain features of the design. We give some guidelines for when to use the sample clustering and sample weights in the analysis.

Full text

PDF
1166

Selected References

These references are in PubMed. This may not be the complete list of references from this article.

  1. Albanes D., Blair A., Taylor P. R. Physical activity and risk of cancer in the NHANES I population. Am J Public Health. 1989 Jun;79(6):744–750. doi: 10.2105/ajph.79.6.744. [DOI] [PMC free article] [PubMed] [Google Scholar]
  2. Albanes D., Jones D. Y., Micozzi M. S., Mattson M. E. Associations between smoking and body weight in the US population: analysis of NHANES II. Am J Public Health. 1987 Apr;77(4):439–444. doi: 10.2105/ajph.77.4.439. [DOI] [PMC free article] [PubMed] [Google Scholar]
  3. Anda R. F., Williamson D. F., Remington P. L. Alcohol and fatal injuries among US adults. Findings from the NHANES I Epidemiologic Follow-up Study. JAMA. 1988 Nov 4;260(17):2529–2532. [PubMed] [Google Scholar]
  4. Annest J. L., Pirkle J. L., Makuc D., Neese J. W., Bayse D. D., Kovar M. G. Chronological trend in blood lead levels between 1976 and 1980. N Engl J Med. 1983 Jun 9;308(23):1373–1377. doi: 10.1056/NEJM198306093082301. [DOI] [PubMed] [Google Scholar]
  5. Aspirin, heparin, or both to treat unstable angina. N Engl J Med. 1989 Apr 13;320(15):1014–1015. doi: 10.1056/NEJM198904133201515. [DOI] [PubMed] [Google Scholar]
  6. Blair D., Habicht J. P., Sims E. A., Sylwester D., Abraham S. Evidence for an increased risk for hypertension with centrally located body fat and the effect of race and sex on this risk. Am J Epidemiol. 1984 Apr;119(4):526–540. doi: 10.1093/oxfordjournals.aje.a113770. [DOI] [PubMed] [Google Scholar]
  7. Block G., Rosenberger W. F., Patterson B. H. Calories, fat and cholesterol: intake patterns in the US population by race, sex and age. Am J Public Health. 1988 Sep;78(9):1150–1155. doi: 10.2105/ajph.78.9.1150. [DOI] [PMC free article] [PubMed] [Google Scholar]
  8. Body iron stores and the risk of cancer. N Engl J Med. 1989 Apr 13;320(15):1012–1014. doi: 10.1056/NEJM198904133201514. [DOI] [PubMed] [Google Scholar]
  9. Cain K. C., Breslow N. E. Logistic regression analysis and efficient design for two-stage studies. Am J Epidemiol. 1988 Dec;128(6):1198–1206. doi: 10.1093/oxfordjournals.aje.a115074. [DOI] [PubMed] [Google Scholar]
  10. Cornfield J. Randomization by group: a formal analysis. Am J Epidemiol. 1978 Aug;108(2):100–102. doi: 10.1093/oxfordjournals.aje.a112592. [DOI] [PubMed] [Google Scholar]
  11. Costa P. T., Jr, Zonderman A. B., McCrae R. R., Cornoni-Huntley J., Locke B. Z., Barbano H. E. Longitudinal analyses of psychological well-being in a national sample: stability of mean levels. J Gerontol. 1987 Jan;42(1):50–55. doi: 10.1093/geronj/42.1.50. [DOI] [PubMed] [Google Scholar]
  12. Dallman P. R., Yip R., Johnson C. Prevalence and causes of anemia in the United States, 1976 to 1980. Am J Clin Nutr. 1984 Mar;39(3):437–445. doi: 10.1093/ajcn/39.3.437. [DOI] [PubMed] [Google Scholar]
  13. Dannenberg A. L., Drizd T., Horan M. J., Haynes S. G., Leaverton P. E. Progress in the battle against hypertension. Changes in blood pressure levels in the United States from 1960 to 1980. Hypertension. 1987 Aug;10(2):226–233. doi: 10.1161/01.hyp.10.2.226. [DOI] [PubMed] [Google Scholar]
  14. Eaton W. W., McLeod J. Consumption of coffee or tea and symptoms of anxiety. Am J Public Health. 1984 Jan;74(1):66–68. doi: 10.2105/ajph.74.1.66. [DOI] [PMC free article] [PubMed] [Google Scholar]
  15. Farmer M. E., Harris T., Madans J. H., Wallace R. B., Cornoni-Huntley J., White L. R. Anthropometric indicators and hip fracture. The NHANES I epidemiologic follow-up study. J Am Geriatr Soc. 1989 Jan;37(1):9–16. doi: 10.1111/j.1532-5415.1989.tb01562.x. [DOI] [PubMed] [Google Scholar]
  16. Farmer M. E., Locke B. Z., Mościcki E. K., Dannenberg A. L., Larson D. B., Radloff L. S. Physical activity and depressive symptoms: the NHANES I Epidemiologic Follow-up Study. Am J Epidemiol. 1988 Dec;128(6):1340–1351. doi: 10.1093/oxfordjournals.aje.a115087. [DOI] [PubMed] [Google Scholar]
  17. Flegal K. M., Harlan W. R., Landis J. R. Secular trends in body mass index and skinfold thickness with socioeconomic factors in young adult women. Am J Clin Nutr. 1988 Sep;48(3):535–543. doi: 10.1093/ajcn/48.3.535. [DOI] [PubMed] [Google Scholar]
  18. Frisancho A. R., Leonard W. R., Bollettino L. A. Blood pressure in blacks and whites and its relationship to dietary sodium and potassium intake. J Chronic Dis. 1984;37(7):515–519. doi: 10.1016/0021-9681(84)90002-x. [DOI] [PubMed] [Google Scholar]
  19. Gergen P. J., Mullally D. I., Evans R., 3rd National survey of prevalence of asthma among children in the United States, 1976 to 1980. Pediatrics. 1988 Jan;81(1):1–7. [PubMed] [Google Scholar]
  20. Graubard B. I., Fears T. R., Gail M. H. Effects of cluster sampling on epidemiologic analysis in population-based case-control studies. Biometrics. 1989 Dec;45(4):1053–1071. [PubMed] [Google Scholar]
  21. Gruchow H. W., Sobocinski K. A., Barboriak J. J. Alcohol, nutrient intake, and hypertension in US adults. JAMA. 1985 Mar 15;253(11):1567–1570. [PubMed] [Google Scholar]
  22. Harlan W. R., Hull A. L., Schmouder R. L., Landis J. R., Thompson F. E., Larkin F. A. Blood pressure and nutrition in adults. The National Health and Nutrition Examination Survey. Am J Epidemiol. 1984 Jul;120(1):17–28. doi: 10.1093/oxfordjournals.aje.a113870. [DOI] [PubMed] [Google Scholar]
  23. Harlan W. R., Landis J. R., Flegal K. M., Davis C. S., Miller M. E. Secular trends in body mass in the United States, 1960-1980. Am J Epidemiol. 1988 Nov;128(5):1065–1074. doi: 10.1093/aje/128.5.1065. [DOI] [PubMed] [Google Scholar]
  24. Harlan W. R., Landis J. R., Schmouder R. L., Goldstein N. G., Harlan L. C. Blood lead and blood pressure. Relationship in the adolescent and adult US population. JAMA. 1985 Jan 25;253(4):530–534. doi: 10.1001/jama.253.4.530. [DOI] [PubMed] [Google Scholar]
  25. Idler E. L., Angel R. J. Self-rated health and mortality in the NHANES-I Epidemiologic Follow-up Study. Am J Public Health. 1990 Apr;80(4):446–452. doi: 10.2105/ajph.80.4.446. [DOI] [PMC free article] [PubMed] [Google Scholar]
  26. Ismail A. I., Burt B. A., Eklund S. A. Relation between ascorbic acid intake and periodontal disease in the United States. J Am Dent Assoc. 1983 Dec;107(6):927–931. doi: 10.14219/jada.archive.1983.0365. [DOI] [PubMed] [Google Scholar]
  27. Ismail A. I., Burt B. A., Eklund S. A. The cariogenicity of soft drinks in the United States. J Am Dent Assoc. 1984 Aug;109(2):241–245. doi: 10.14219/jada.archive.1984.0346. [DOI] [PubMed] [Google Scholar]
  28. Jones D. Y., Schatzkin A., Green S. B., Block G., Brinton L. A., Ziegler R. G., Hoover R., Taylor P. R. Dietary fat and breast cancer in the National Health and Nutrition Examination Survey I Epidemiologic Follow-up Study. J Natl Cancer Inst. 1987 Sep;79(3):465–471. [PubMed] [Google Scholar]
  29. Karasek R. A., Theorell T., Schwartz J. E., Schnall P. L., Pieper C. F., Michela J. L. Job characteristics in relation to the prevalence of myocardial infarction in the US Health Examination Survey (HES) and the Health and Nutrition Examination Survey (HANES). Am J Public Health. 1988 Aug;78(8):910–918. doi: 10.2105/ajph.78.8.910. [DOI] [PMC free article] [PubMed] [Google Scholar]
  30. Kleinman J. C., Donahue R. P., Harris M. I., Finucane F. F., Madans J. H., Brock D. B. Mortality among diabetics in a national sample. Am J Epidemiol. 1988 Aug;128(2):389–401. doi: 10.1093/oxfordjournals.aje.a114979. [DOI] [PubMed] [Google Scholar]
  31. Koplan J. P., Annest J. L., Layde P. M., Rubin G. L. Nutrient intake and supplementation in the United States (NHANES II). Am J Public Health. 1986 Mar;76(3):287–289. doi: 10.2105/ajph.76.3.287. [DOI] [PMC free article] [PubMed] [Google Scholar]
  32. Korn E. L., Graubard B. I. Examining neighbourhood confounding in a survey: an example using the National Health and Nutrition Examination Survey II. Stat Med. 1988 Oct;7(10):1087–1098. doi: 10.1002/sim.4780071009. [DOI] [PubMed] [Google Scholar]
  33. Looker A. C., Johnson C. L., Underwood B. A. Serum retinol levels of persons aged 4-74 years from three Hispanic groups. Am J Clin Nutr. 1988 Dec;48(6):1490–1496. doi: 10.1093/ajcn/48.6.1490. [DOI] [PubMed] [Google Scholar]
  34. Looker A. C., Johnson C. L., Woteki C. E., Yetley E. A., Underwood B. A. Ethnic and racial differences in serum vitamin A levels of children aged 4-11 years. Am J Clin Nutr. 1988 Feb;47(2):247–252. doi: 10.1093/ajcn/47.2.247. [DOI] [PubMed] [Google Scholar]
  35. Looker A. C., Sempos C. T., Johnson C. L., Yetley E. A. Comparison of dietary intakes and iron status of vitamin-mineral supplement users and nonusers, aged 1-19 years. Am J Clin Nutr. 1987 Oct;46(4):665–672. doi: 10.1093/ajcn/46.4.665. [DOI] [PubMed] [Google Scholar]
  36. Looker A. C., Underwood B. A., Wiley J., Fulwood R., Sempos C. T. Serum alpha-tocopherol levels of Mexican Americans, Cubans, and Puerto Ricans aged 4-74 y. Am J Clin Nutr. 1989 Sep;50(3):491–496. doi: 10.1093/ajcn/50.3.491. [DOI] [PubMed] [Google Scholar]
  37. Mahaffey K. R., Annest J. L., Roberts J., Murphy R. S. National estimates of blood lead levels: United States, 1976-1980: association with selected demographic and socioeconomic factors. N Engl J Med. 1982 Sep 2;307(10):573–579. doi: 10.1056/NEJM198209023071001. [DOI] [PubMed] [Google Scholar]
  38. McCarron D. A., Morris C. D., Henry H. J., Stanton J. L. Blood pressure and nutrient intake in the United States. Science. 1984 Jun 29;224(4656):1392–1398. doi: 10.1126/science.6729459. [DOI] [PubMed] [Google Scholar]
  39. Meyers L. D., Habicht J. P., Johnson C. L. Components of the difference in hemoglobin concentrations in blood between black and white women in the United States. Am J Epidemiol. 1979 May;109(5):539–549. doi: 10.1093/oxfordjournals.aje.a112712. [DOI] [PubMed] [Google Scholar]
  40. Micozzi M. S., Carter C. L., Albanes D., Taylor P. R., Licitra L. M. Bowel function and breast cancer in US women. Am J Public Health. 1989 Jan;79(1):73–75. doi: 10.2105/ajph.79.1.73. [DOI] [PMC free article] [PubMed] [Google Scholar]
  41. Otten M. W., Jr, Teutsch S. M., Williamson D. F., Marks J. S. The effect of known risk factors on the excess mortality of black adults in the United States. JAMA. 1990 Feb 9;263(6):845–850. [PubMed] [Google Scholar]
  42. Rautaharju P. M., LaCroix A. Z., Savage D. D., Haynes S. G., Madans J. H., Wolf H. K., Hadden W., Keller J., Cornoni-Huntley J. Electrocardiographic estimate of left ventricular mass versus radiographic cardiac size and the risk of cardiovascular disease mortality in the epidemiologic follow-up study of the First National Health and Nutrition Examination Survey. Am J Cardiol. 1988 Jul 1;62(1):59–66. doi: 10.1016/0002-9149(88)91365-3. [DOI] [PubMed] [Google Scholar]
  43. Russell-Briefel R., Ezzati T. M., Fulwood R., Perlman J. A., Murphy R. S. Cardiovascular risk status and oral contraceptive use: United States, 1976-1980. Prev Med. 1986 Jul;15(4):352–362. doi: 10.1016/0091-7435(86)90003-4. [DOI] [PubMed] [Google Scholar]
  44. Russell-Briefel R., Ezzati T. M., Perlman J. A., Murphy R. S. Impaired glucose tolerance in women using oral contraceptives: United States, 1976-1980. J Chronic Dis. 1987;40(1):3–11. doi: 10.1016/0021-9681(87)90091-9. [DOI] [PubMed] [Google Scholar]
  45. Russell-Briefel R., Ezzati T., Perlman J. Prevalence and trends in oral contraceptive use in premenopausal females ages 12-54 years, United States, 1971-80. Am J Public Health. 1985 Oct;75(10):1173–1176. doi: 10.2105/ajph.75.10.1173. [DOI] [PMC free article] [PubMed] [Google Scholar]
  46. Sandler R. S., Jordan M. C., Shelton B. J. Demographic and dietary determinants of constipation in the US population. Am J Public Health. 1990 Feb;80(2):185–189. doi: 10.2105/ajph.80.2.185. [DOI] [PMC free article] [PubMed] [Google Scholar]
  47. Schatzkin A., Hoover R. N., Taylor P. R., Ziegler R. G., Carter C. L., Larson D. B., Licitra L. M. Serum cholesterol and cancer in the NHANES I epidemiologic followup study. National Health and Nutrition Examination Survey. Lancet. 1987 Aug 8;2(8554):298–301. doi: 10.1016/s0140-6736(87)90890-7. [DOI] [PubMed] [Google Scholar]
  48. Schatzkin A., Jones D. Y., Hoover R. N., Taylor P. R., Brinton L. A., Ziegler R. G., Harvey E. B., Carter C. L., Licitra L. M., Dufour M. C. Alcohol consumption and breast cancer in the epidemiologic follow-up study of the first National Health and Nutrition Examination Survey. N Engl J Med. 1987 May 7;316(19):1169–1173. doi: 10.1056/NEJM198705073161901. [DOI] [PubMed] [Google Scholar]
  49. Schwerin H. S., Stanton J. L., Riley A. M., Jr, Schaefer A. E., Leveille G. A., Elliott J. G., Warwick K. M., Brett B. E. Food eating patterns and health: a reexamination of the Ten-State and HANES I surveys. Am J Clin Nutr. 1981 Apr;34(4):568–580. doi: 10.1093/ajcn/34.4.568. [DOI] [PubMed] [Google Scholar]
  50. Scribner R., Dwyer J. H. Acculturation and low birthweight among Latinos in the Hispanic HANES. Am J Public Health. 1989 Sep;79(9):1263–1267. doi: 10.2105/ajph.79.9.1263. [DOI] [PMC free article] [PubMed] [Google Scholar]
  51. Sempos C., Cooper R., Kovar M. G., Johnson C., Drizd T., Yetley E. Dietary calcium and blood pressure in National Health and Nutrition Examination Surveys I and II. Hypertension. 1986 Nov;8(11):1067–1074. doi: 10.1161/01.hyp.8.11.1067. [DOI] [PubMed] [Google Scholar]
  52. Stevens R. G., Jones D. Y., Micozzi M. S., Taylor P. R. Body iron stores and the risk of cancer. N Engl J Med. 1988 Oct 20;319(16):1047–1052. doi: 10.1056/NEJM198810203191603. [DOI] [PubMed] [Google Scholar]
  53. Swanson C. A., Jones D. Y., Schatzkin A., Brinton L. A., Ziegler R. G. Breast cancer risk assessed by anthropometry in the NHANES I epidemiological follow-up study. Cancer Res. 1988 Sep 15;48(18):5363–5367. [PubMed] [Google Scholar]
  54. Williamson D. F., Forman M. R., Binkin N. J., Gentry E. M., Remington P. L., Trowbridge F. L. Alcohol and body weight in United States adults. Am J Public Health. 1987 Oct;77(10):1324–1330. doi: 10.2105/ajph.77.10.1324. [DOI] [PMC free article] [PubMed] [Google Scholar]
  55. Zonderman A. B., Costa P. T., Jr, McCrae R. R. Depression as a risk for cancer morbidity and mortality in a nationally representative sample. JAMA. 1989 Sep 1;262(9):1191–1195. [PubMed] [Google Scholar]

Articles from American Journal of Public Health are provided here courtesy of American Public Health Association

RESOURCES