Skip to main content

Some NLM-NCBI services and products are experiencing heavy traffic, which may affect performance and availability. We apologize for the inconvenience and appreciate your patience. For assistance, please contact our Help Desk at info@ncbi.nlm.nih.gov.

Journal of Epidemiology and Community Health logoLink to Journal of Epidemiology and Community Health
. 2003 Jan;57(1):68–73. doi: 10.1136/jech.57.1.68

Collecting behavioural data using the world wide web: considerations for researchers

S Rhodes 1, D Bowie 1, K Hergenrather 1
PMCID: PMC1732282  PMID: 12490652

Abstract

Objective: To identify and describe advantages, challenges, and ethical considerations of web based behavioural data collection.

Methods: This discussion is based on the authors' experiences in survey development and study design, respondent recruitment, and internet research, and on the experiences of others as found in the literature.

Results: The advantages of using the world wide web to collect behavioural data include rapid access to numerous potential respondents and previously hidden populations, respondent openness and full participation, opportunities for student research, and reduced research costs. Challenges identified include issues related to sampling and sample representativeness, competition for the attention of respondents, and potential limitations resulting from the much cited "digital divide", literacy, and disability. Ethical considerations include anonymity and privacy, providing and substantiating informed consent, and potential risks of malfeasance.

Conclusions: Computer mediated communications, including electronic mail, the world wide web, and interactive programs will play an ever increasing part in the future of behavioural science research. Justifiable concerns regarding the use of the world wide web in research exist, but as access to, and use of, the internet becomes more widely and representatively distributed globally, the world wide web will become more applicable. In fact, the world wide web may be the only research tool able to reach some previously hidden population subgroups. Furthermore, many of the criticisms of online data collection are common to other survey research methodologies.

Full Text

The Full Text of this article is available as a PDF (107.8 KB).

Selected References

These references are in PubMed. This may not be the complete list of references from this article.

  1. Alexander R. B., Trissel D. Chronic prostatitis: results of an Internet survey. Urology. 1996 Oct;48(4):568–574. doi: 10.1016/s0090-4295(96)00234-8. [DOI] [PubMed] [Google Scholar]
  2. Baehring T. U., Schulze H., Bornstein S. R., Scherbaum W. A. Using the World Wide Web--a new approach to risk identification of diabetes mellitus. Int J Med Inform. 1997 Aug;46(1):31–39. doi: 10.1016/s1386-5056(97)00049-x. [DOI] [PubMed] [Google Scholar]
  3. Baujard O., Baujard V., Aurel S., Boyer C., Appel R. D. Trends in medical information retrieval on Internet. Comput Biol Med. 1998 Sep;28(5):589–601. doi: 10.1016/s0010-4825(98)00036-5. [DOI] [PubMed] [Google Scholar]
  4. Bennett S. J., Hays L. M., Embree J. L., Arnould M. Heart Messages: a tailored message intervention for improving heart failure outcomes. J Cardiovasc Nurs. 2000 Jul;14(4):94–105. doi: 10.1097/00005082-200007000-00007. [DOI] [PubMed] [Google Scholar]
  5. Bernhardt J. M. Health education and the digital divide: building bridges and filling chasms. Health Educ Res. 2000 Oct;15(5):527–531. doi: 10.1093/her/15.5.527. [DOI] [PubMed] [Google Scholar]
  6. Bier Melinda C., Sherblom Stephen A., Gallo Michael A. Ethical issues in a study of Internet use: uncertainty, responsibility, and the spirit of research relationships. Ethics Behav. 1996;6(2):141–151. doi: 10.1207/s15327019eb0602_5. [DOI] [PubMed] [Google Scholar]
  7. Budman S. H. Behavioral health care dot-com and beyond: computer-mediated communications in mental health and substance abuse treatment. Am Psychol. 2000 Nov;55(11):1290–1300. [PubMed] [Google Scholar]
  8. Bush N. E., Wooldridge J., Foster V., Shaw K., Brown P. Web site design and development issues: the Washington State Breast and Cervical Health Program Web Site Demonstration Project. Oncol Nurs Forum. 1999 Jun;26(5):857–865. [PubMed] [Google Scholar]
  9. Cassell M. M., Jackson C., Cheuvront B. Health communication on the Internet: an effective channel for health behavior change? J Health Commun. 1998 Jan-Mar;3(1):71–79. doi: 10.1080/108107398127517. [DOI] [PubMed] [Google Scholar]
  10. Clark T. J., Khan K. S., Gupta J. K. Provision of pen along with questionnaire does not increase the response rate to a postal survey: a randomised controlled trial. J Epidemiol Community Health. 2001 Aug;55(8):595–596. doi: 10.1136/jech.55.8.595. [DOI] [PMC free article] [PubMed] [Google Scholar]
  11. Coiera E. Information economics and the Internet. J Am Med Inform Assoc. 2000 May-Jun;7(3):215–221. doi: 10.1136/jamia.2000.0070215. [DOI] [PMC free article] [PubMed] [Google Scholar]
  12. Davis R. N. Web-based administration of a personality questionnaire: comparison with traditional methods. Behav Res Methods Instrum Comput. 1999 Nov;31(4):572–577. doi: 10.3758/bf03200737. [DOI] [PubMed] [Google Scholar]
  13. Etter J. F., Perneger T. V. A comparison of cigarette smokers recruited through the Internet or by mail. Int J Epidemiol. 2001 Jun;30(3):521–525. doi: 10.1093/ije/30.3.521. [DOI] [PubMed] [Google Scholar]
  14. Fawcett J., Buhle E. L., Jr Using the Internet for data collection. An innovative electronic strategy. Comput Nurs. 1995 Nov-Dec;13(6):273–279. [PubMed] [Google Scholar]
  15. Fishbein M., Pequegnat W. Evaluating AIDS prevention interventions using behavioral and biological outcome measures. Sex Transm Dis. 2000 Feb;27(2):101–110. doi: 10.1097/00007435-200002000-00008. [DOI] [PubMed] [Google Scholar]
  16. Fotheringham M. J., Wonnacott R. L., Owen N. Computer use and physical inactivity in young adults: public health perils and potentials of new information technologies. Ann Behav Med. 2000 Fall;22(4):269–275. doi: 10.1007/BF02895662. [DOI] [PubMed] [Google Scholar]
  17. Hardin P. C., Reis J. Interactive multimedia software design: concepts, process, and evaluation. Health Educ Behav. 1997 Feb;24(1):35–53. doi: 10.1177/109019819702400106. [DOI] [PubMed] [Google Scholar]
  18. Hilsden R. J., Scott C. M., Verhoef M. J. Research and the Internet. Am J Gastroenterol. 1998 Mar;93(3):484–485. doi: 10.1111/j.1572-0241.1998.481_6.x. [DOI] [PubMed] [Google Scholar]
  19. Houston J. D., Fiore D. C. Online medical surveys: using the Internet as a research tool. MD Comput. 1998 Mar-Apr;15(2):116–120. [PubMed] [Google Scholar]
  20. Houston T. K., Cooper L. A., Vu H. T., Kahn J., Toser J., Ford D. E. Screening the public for depression through the Internet. Psychiatr Serv. 2001 Mar;52(3):362–367. doi: 10.1176/appi.ps.52.3.362. [DOI] [PubMed] [Google Scholar]
  21. Humphreys K., Klaw E. Can targeting nondependent problem drinkers and providing internet-based services expand access to assistance for alcohol problems? A study of the moderation management self-help/mutual aid organization. J Stud Alcohol. 2001 Jul;62(4):528–532. doi: 10.15288/jsa.2001.62.528. [DOI] [PubMed] [Google Scholar]
  22. Johnson K. B., Ravert R. D., Everton A. Hopkins Teen Central: Assessment of an internet-based support system for children with cystic fibrosis. Pediatrics. 2001 Feb;107(2):E24–E24. doi: 10.1542/peds.107.2.e24. [DOI] [PubMed] [Google Scholar]
  23. Joinson A. Social desirability, anonymity, and Internet-based questionnaires. Behav Res Methods Instrum Comput. 1999 Aug;31(3):433–438. doi: 10.3758/bf03200723. [DOI] [PubMed] [Google Scholar]
  24. Kim H. S., Kim E., Kim J. W. Development of a breast self-examination program for the Internet: health information for Korean women. Cancer Nurs. 2001 Apr;24(2):156–161. doi: 10.1097/00002820-200104000-00012. [DOI] [PubMed] [Google Scholar]
  25. Klausner J. D., Wolf W., Fischer-Ponce L., Zolt I., Katz M. H. Tracing a syphilis outbreak through cyberspace. JAMA. 2000 Jul 26;284(4):447–449. doi: 10.1001/jama.284.4.447. [DOI] [PubMed] [Google Scholar]
  26. Kushi L. H., Finnegan J., Martinson B., Rightmyer J., Vachon C., Yochum L. Epidemiology and the Internet. Epidemiology. 1997 Nov;8(6):689–690. doi: 10.1097/00001648-199711000-00024. [DOI] [PubMed] [Google Scholar]
  27. Lakeman R. Using the Internet for data collection in nursing research. Comput Nurs. 1997 Sep-Oct;15(5):269–275. [PubMed] [Google Scholar]
  28. Malone R. E. Research, the Internet, and the way things are. Health Educ Behav. 2000 Dec;27(6):695–698. doi: 10.1177/109019810002700604. [DOI] [PubMed] [Google Scholar]
  29. Marcus B. H., Nigg C. R., Riebe D., Forsyth L. H. Interactive communication strategies: implications for population-based physical-activity promotion. Am J Prev Med. 2000 Aug;19(2):121–126. doi: 10.1016/s0749-3797(00)00186-0. [DOI] [PubMed] [Google Scholar]
  30. McAvoy B. R., Kaner E. F. General practice postal surveys: a questionnaire too far? BMJ. 1996 Sep 21;313(7059):732–734. doi: 10.1136/bmj.313.7059.732. [DOI] [PMC free article] [PubMed] [Google Scholar]
  31. Milio N. The internet, public health, and the globalisation of just about everything. J Epidemiol Community Health. 2001 Feb;55(2):74–76. doi: 10.1136/jech.55.2.74. [DOI] [PMC free article] [PubMed] [Google Scholar]
  32. Nicholson T., White J., Cline R., Minors P., Duncan D. Parents who report using illicit drugs: findings and implications from the DRUGNET study. Psychol Rep. 2001 Feb;88(1):245–251. doi: 10.2466/pr0.2001.88.1.245. [DOI] [PubMed] [Google Scholar]
  33. Paperny D. M. Computerized health assessment and education for adolescent HIV and STD prevention in health care settings and schools. Health Educ Behav. 1997 Feb;24(1):54–70. doi: 10.1177/109019819702400107. [DOI] [PubMed] [Google Scholar]
  34. Pequegnat W., Fishbein M., Celentano D., Ehrhardt A., Garnett G., Holtgrave D., Jaccard J., Schachter J., Zenilman J. NIMH/APPC workgroup on behavioral and biological outcomes in HIV/STD prevention studies: a position statement. Sex Transm Dis. 2000 Mar;27(3):127–132. doi: 10.1097/00007435-200003000-00001. [DOI] [PubMed] [Google Scholar]
  35. Reneau J, Nicholson T, White JB, Duncan D. The general well-being of recreational drug users: a survey on the WWW. Int J Drug Policy. 2000 Sep 1;11(5):315–323. doi: 10.1016/s0955-3959(00)00049-9. [DOI] [PubMed] [Google Scholar]
  36. Rhodes F., Fishbein M., Reis J. Using behavioral theory in computer-based health promotion and appraisal. Health Educ Behav. 1997 Feb;24(1):20–34. doi: 10.1177/109019819702400105. [DOI] [PubMed] [Google Scholar]
  37. Rhodes S. D., DiClemente R. J., Yee L. J., Hergenrather K. C. Correlates of hepatitis B vaccination in a high-risk population: an Internet sample. Am J Med. 2001 Jun 1;110(8):628–632. doi: 10.1016/s0002-9343(01)00706-9. [DOI] [PubMed] [Google Scholar]
  38. Rhodes S. D., Diclemente R. J., Yee L. J., Hergenrather K. C. Factors associated with testing for hepatitis C in an internet-recruited sample of men who have sex with men. Sex Transm Dis. 2001 Sep;28(9):515–520. doi: 10.1097/00007435-200109000-00007. [DOI] [PubMed] [Google Scholar]
  39. Rhodes S. D., Diclemente R. J., Yee L. J., Hergenrather K. C. Hepatitis B vaccination in a high risk MSM population: the need for vaccine education. Sex Transm Infect. 2000 Oct;76(5):408–409. doi: 10.1136/sti.76.5.408-a. [DOI] [PMC free article] [PubMed] [Google Scholar]
  40. Rhodes Scott D., DiClemente Ralph J., Cecil Heather, Hergenrather Kenneth C., Yee Leland J. Risk among men who have sex with men in the United States: a comparison of an Internet sample and a conventional outreach sample. AIDS Educ Prev. 2002 Feb;14(1):41–50. doi: 10.1521/aeap.14.1.41.24334. [DOI] [PubMed] [Google Scholar]
  41. Ross M. W., Tikkanen R., Månsson S. A. Differences between Internet samples and conventional samples of men who have sex with men: implications for research and HIV interventions. Soc Sci Med. 2000 Sep;51(5):749–758. doi: 10.1016/s0277-9536(99)00493-1. [DOI] [PubMed] [Google Scholar]
  42. Serraino D., Franceschi S., Dal Maso L., Lepri A. C., Tirelli U., Rezza G. The classification of AIDS cases: concordance between two AIDS surveillance systems in Italy. Am J Public Health. 1995 Aug;85(8 Pt 1):1112–1114. doi: 10.2105/ajph.85.8_pt_1.1112. [DOI] [PMC free article] [PubMed] [Google Scholar]
  43. Soetikno R. M., Provenzale D., Lenert L. A. Studying ulcerative colitis over the World Wide Web. Am J Gastroenterol. 1997 Mar;92(3):457–460. [PubMed] [Google Scholar]
  44. Sorensen A. A. Promoting public health through electronic media: a challenge for schools of public health. Am J Public Health. 2001 Aug;91(8):1183–1185. doi: 10.2105/ajph.91.8.1183. [DOI] [PMC free article] [PubMed] [Google Scholar]
  45. Sy F. S., Rhodes S. D., Choi S. T., Drociuk D., Laurent A. A., Naccash R. M., Kettinger L. D. The acceptability of oral fluid testing for HIV antibodies. A pilot study in gay bars in a predominantly rural state. Sex Transm Dis. 1998 Apr;25(4):211–215. doi: 10.1097/00007435-199804000-00006. [DOI] [PubMed] [Google Scholar]
  46. Tate D. F., Wing R. R., Winett R. A. Using Internet technology to deliver a behavioral weight loss program. JAMA. 2001 Mar 7;285(9):1172–1177. doi: 10.1001/jama.285.9.1172. [DOI] [PubMed] [Google Scholar]
  47. Yokley J. M., Coleman D. J., Yates B. T. Cost effectiveness of three child mental health assessment methods: computer-assisted assessment is effective and inexpensive. J Ment Health Adm. 1990 Spring;17(1):99–107. doi: 10.1007/BF02518584. [DOI] [PubMed] [Google Scholar]

Articles from Journal of Epidemiology and Community Health are provided here courtesy of BMJ Publishing Group

RESOURCES