Abstract
OBJECTIVE: There has been insufficient research on the influence of ethno-cultural and language differences in public health surveys. Using data from three independent studies, the authors examine methods to assess data quality and to identify causes of problematic survey questions. METHODS: Qualitative and quantitative methods were used in this exploratory study, including secondary analyses of data from three baseline surveys (conducted in English, Spanish, Cantonese, Mandarin, and Vietnamese). Collection of additional data included interviews with investigators and interviewers; observations of item development; focus groups; think-aloud interviews; a test-retest assessment survey; and a pilot test of alternatively worded questions. RESULTS: The authors identify underlying causes for the 12 most problematic variables in three multiethnic surveys and describe them in terms of ethnic differences in reliability, validity, and cognitive processes (interpretation, memory retrieval, judgment formation, and response editing), and differences with regard to cultural appropriateness and translation problems. CONCLUSIONS: Multiple complex elements affect measurement in a multiethnic survey, many of which are neither readily observed nor understood through standard tests of data quality. Multiethnic survey questions are best evaluated using a variety of quantitative and qualitative methods that reveal different types and causes of problems.
Full text
PDFSelected References
These references are in PubMed. This may not be the complete list of references from this article.
- Baker S. A., Morrison D. M., Carter W. B., Verdon M. S. Using the theory of reasoned action (TRA) to understand the decision to use condoms in an STD clinic population. Health Educ Q. 1996 Nov;23(4):528–542. doi: 10.1177/109019819602300411. [DOI] [PubMed] [Google Scholar]
- Chang R. H., Dodder R. A. The Modified Purpose in Life Scale: a Cross-National Validity Study. Int J Aging Hum Dev. 1983;18(3):207–217. doi: 10.2190/qkgn-e1hw-ca88-x6k3. [DOI] [PubMed] [Google Scholar]
- Devins G. M., Beiser M., Dion R., Pelletier L. G., Edwards R. G. Cross-cultural measurements of psychological well-being: the psychometric equivalence of Cantonese, Vietnamese, and Laotian translations of the Affect Balance Scale. Am J Public Health. 1997 May;87(5):794–799. doi: 10.2105/ajph.87.5.794. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Guillemin F., Bombardier C., Beaton D. Cross-cultural adaptation of health-related quality of life measures: literature review and proposed guidelines. J Clin Epidemiol. 1993 Dec;46(12):1417–1432. doi: 10.1016/0895-4356(93)90142-n. [DOI] [PubMed] [Google Scholar]
- Guillemin F., Briançon S., Pourel J. Validity and discriminant ability of the HAQ Functional Index in early rheumatoid arthritis. Disabil Rehabil. 1992 Apr-Jun;14(2):71–77. doi: 10.3109/09638289209167073. [DOI] [PubMed] [Google Scholar]
- Jenkins C. N., McPhee S. J., Bird J. A., Pham G. Q., Nguyen B. H., Nguyen T., Lai K. Q., Wong C., Davis T. B. Effect of a media-led education campaign on breast and cervical cancer screening among Vietnamese-American women. Prev Med. 1999 Apr;28(4):395–406. doi: 10.1006/pmed.1998.0444. [DOI] [PubMed] [Google Scholar]
- Karvonen S., Abel T., Calmonte R., Rimpelä A. Patterns of health-related behaviour and their cross-cultural validity--a comparative study on two populations of young people. Soz Praventivmed. 2000;45(1):35–45. doi: 10.1007/BF01358997. [DOI] [PubMed] [Google Scholar]
- McKenney N. R., Bennett C. E. Issues regarding data on race and ethnicity: the Census Bureau experience. Public Health Rep. 1994 Jan-Feb;109(1):16–25. [PMC free article] [PubMed] [Google Scholar]
- Warnecke R. B., Johnson T. P., Chávez N., Sudman S., O'Rourke D. P., Lacey L., Horm J. Improving question wording in surveys of culturally diverse populations. Ann Epidemiol. 1997 Jul;7(5):334–342. doi: 10.1016/s1047-2797(97)00030-6. [DOI] [PubMed] [Google Scholar]
- Warnecke R. B., Sudman S., Johnson T. P., O'Rourke D., Davis A. M., Jobe J. B. Cognitive aspects of recalling and reporting health-related events: Papanicolaou smears, clinical breast examinations, and mammograms. Am J Epidemiol. 1997 Dec 1;146(11):982–992. doi: 10.1093/oxfordjournals.aje.a009226. [DOI] [PubMed] [Google Scholar]