Skip to main content
PMC home page
Public Health Reports logoLink to Public Health Reports
. 1992 Sep-Oct;107(5):576–584.

Factors influencing the effectiveness of mailed health surveys.

G H Gilbert 1, J Longmate 1, L G Branch 1
PMCID: PMC1403701  PMID: 1410240

Abstract

The authors investigated sources of bias in health surveys by examining responses to their 1989 questionnaire mailed to 1,255 Massachusetts men who were eligible for dental care provided by the Department of Veterans Affairs. After a maximum of three mailings and one telephone call to nonrespondents, a total of 1,049 veterans had responded out of 1,228 finally determined to be eligible, a response rate of 85 percent. The investigators found that small differences in univariate estimates would have occurred had the field phase been terminated after the first mailing, which had a response rate of 61 percent. To evaluate multivariate distributions, they duplicated their previously published logistic regression model for sources of dental care, using only those who responded to the first and second mailings. Although model fits would have been substantively the same had the field phase been terminated after the first or the second mailings, analysis of parameter estimates and their statistical significances suggested bias that would have led to different substantive conclusions, in some instances. Another potential source of bias in surveys was found to be item omission. Fifty-eight percent of respondents answered all 46 survey questions, and 90 percent answered at least 91 percent of the questions. Fewer questions were answered by those whose responses were received last, but trends regarding missing data by age or education were not statistically significant. Although the survey using this methodology met all objectives, subject nonresponses, the ineligibility of potential respondents, item nonresponses, and skewed distributions of outcome variables combined to reduce the statistical power to detect differences among groups or to alter the analysis of the differences.(ABSTRACT TRUNCATED AT 250 WORDS)

Full text

PDF
576

Selected References

These references are in PubMed. This may not be the complete list of references from this article.

  1. Barton J., Bain C., Hennekens C. H., Rosner B., Belanger C., Roth A., Speizer F. E. Characteristics of respondents and non-respondents to a mailed questionnaire. Am J Public Health. 1980 Aug;70(8):823–825. doi: 10.2105/ajph.70.8.823. [DOI] [PMC free article] [PubMed] [Google Scholar]
  2. Campbell M. J., Waters W. E. Does anonymity increase response rate in postal questionnaire surveys about sensitive subjects? A randomised trial. J Epidemiol Community Health. 1990 Mar;44(1):75–76. doi: 10.1136/jech.44.1.75. [DOI] [PMC free article] [PubMed] [Google Scholar]
  3. Colsher P. L., Wallace R. B. Data quality and age: health and psychobehavioral correlates of item nonresponse and inconsistent responses. J Gerontol. 1989 Mar;44(2):P45–P52. doi: 10.1093/geronj/44.2.p45. [DOI] [PubMed] [Google Scholar]
  4. Gilbert G. H., Branch L. G., Longmate J. Eligible veterans' choice between VA-covered and non-VA-covered dental care. J Public Health Dent. 1992 Fall;52(5):277–287. doi: 10.1111/j.1752-7325.1992.tb02289.x. [DOI] [PubMed] [Google Scholar]
  5. Heloë L. A. Comparison of dental health data obtained from questionnaires, interviews and clinical examination. Scand J Dent Res. 1972;80(6):495–499. [PubMed] [Google Scholar]
  6. Herzog A. R., Dielman L. Age differences in response accuracy for factual survey questions. J Gerontol. 1985 May;40(3):350–357. doi: 10.1093/geronj/40.3.350. [DOI] [PubMed] [Google Scholar]
  7. Kaplan S., Cole P. Factors affecting response to postal questionnaires. Br J Prev Soc Med. 1970 Nov;24(4):245–247. doi: 10.1136/jech.24.4.245. [DOI] [PMC free article] [PubMed] [Google Scholar]
  8. Kelsey J. L., O'Brien L. A., Grisso J. A., Hoffman S. Issues in carrying out epidemiologic research in the elderly. Am J Epidemiol. 1989 Nov;130(5):857–866. doi: 10.1093/oxfordjournals.aje.a115418. [DOI] [PubMed] [Google Scholar]
  9. Locker D., Grushka M. Response trends and nonresponse bias in a mail survey of oral and facial pain. J Public Health Dent. 1988 Winter;48(1):20–25. doi: 10.1111/j.1752-7325.1988.tb03156.x. [DOI] [PubMed] [Google Scholar]
  10. Locker D., Wiggins R., Sittampalam Y., Patrick D. L. Estimating the prevalence of disability in the community: the influence of sample design and response bias. J Epidemiol Community Health. 1981 Sep;35(3):208–212. doi: 10.1136/jech.35.3.208. [DOI] [PMC free article] [PubMed] [Google Scholar]
  11. Mathiowetz N. A., Groves R. M. The effects of respondent rules on health survey reports. Am J Public Health. 1985 Jun;75(6):639–644. doi: 10.2105/ajph.75.6.639. [DOI] [PMC free article] [PubMed] [Google Scholar]
  12. Metzner H. L., Lamphiear D. E., Thompson F. E., Oh M. S., Hawthorne V. M. Comparison of surrogate and subject reports of dietary practices, smoking habits and weight among married couples in the Tecumseh Diet Methodology Study. J Clin Epidemiol. 1989;42(4):367–375. doi: 10.1016/0895-4356(89)90041-3. [DOI] [PubMed] [Google Scholar]
  13. O'Toole B. I., Battistutta D., Long A., Crouch K. A comparison of costs and data quality of three health survey methods: mail, telephone and personal home interview. Am J Epidemiol. 1986 Aug;124(2):317–328. doi: 10.1093/oxfordjournals.aje.a114390. [DOI] [PubMed] [Google Scholar]
  14. Rimm E. B., Stampfer M. J., Colditz G. A., Giovannucci E., Willett W. C. Effectiveness of various mailing strategies among nonrespondents in a prospective cohort study. Am J Epidemiol. 1990 Jun;131(6):1068–1071. doi: 10.1093/oxfordjournals.aje.a115598. [DOI] [PubMed] [Google Scholar]
  15. Rodgers W. L., Herzog A. R. Interviewing older adults: the accuracy of factual information. J Gerontol. 1987 Jul;42(4):387–394. doi: 10.1093/geronj/42.4.387. [DOI] [PubMed] [Google Scholar]
  16. Spry V. M., Hovell M. F., Sallis J. G., Hofsteter C. R., Elder J. P., Molgaard C. A. Recruiting survey respondents to mailed surveys: controlled trials of incentives and prompts. Am J Epidemiol. 1989 Jul;130(1):166–172. doi: 10.1093/oxfordjournals.aje.a115309. [DOI] [PubMed] [Google Scholar]

Articles from Public Health Reports are provided here courtesy of SAGE Publications

RESOURCES