Skip to main content
Canadian Journal of Public Health = Revue Canadienne de Santé Publique logoLink to Canadian Journal of Public Health = Revue Canadienne de Santé Publique
. 1999 Jan 1;90(1):60–64. doi: 10.1007/BF03404102

How Reliable are Selected Scales from Population-based Health Surveys? An Analysis Among Seniors

Parminder Raina 113,, Brenda Bonnett 113, David Waltner-Toews 113, Christel Woodward 213, Tom Abernathy 213,313
PMCID: PMC6979892  PMID: 10910569

Abstract

The objective of the study was to assess the internal consistency and test-retest reliability of selected scales from four national and provincial surveys used to study the health status of community-dwelling seniors. Items on physical impairment, psychological well-being, activities of daily living, chronic health problems, social support, and stressful life events were selected from these surveys and administered in a group of 1,054 seniors, aged 65 and over, living in Wellington County, Ontario. Each scale exhibited high internal consistency (Cronbach’s alpha ≥ 0.70) except for the stressful life events and social support scales. The intra-class coefficients (ρ) for all scales were > 0.80. In addition, almost all single items measures used in this study also exhibited high test-retest reliability (kappa > 0.80) except for measures of perceived health status (kappa = 0.69) and availability of help in crisis situation (kappa = 0.48).

References

  • 1.McHorney CA. Measuring and monitoring general health status in elderly persons: Practical and methodological issues in using the SF-36 Health Survey. Gerontologist. 1996;36(5):571–83. doi: 10.1093/geront/36.5.571. [DOI] [PubMed] [Google Scholar]
  • 2.Streiner DL, Norman GR. Health Measurement Scales: A Practical Guide to Their Development and Use. New York: Oxford University Press; 1989. pp. 104–27. [Google Scholar]
  • 3.Statistics Canada, Canadian Centre for Health Information. National Population Health Survey. Ottawa: Ministry of Health Canada; 1992. [Google Scholar]
  • 4.Statistics Canada, Housing, FamilySocial Statistics Division. General Social Survey. Ottawa: Minister of Supply and Services Canada; 1991. [Google Scholar]
  • 5.Statistics Canada, Ministry of National HealthWelfare. Ageing and Independence. Ottawa: Minister of Supply and Services; 1991. [Google Scholar]
  • 6.Statistics Canada, Information, PlanningEvaluation Branch. Ontario Health Survey. Ottawa: Ministry of Health; 1989. [Google Scholar]
  • 7.Stewart AL, Kamberg CJ. Physical functioning measures. In: Stewart AL, Ware JE, editors. Measuring Functioning and Well-being: The Medical Outcomes Study Approach. Durham, NC: Duke University Press; 1992. pp. 86–101. [Google Scholar]
  • 8.Raina P, Waltner-Toews D, Bonnett B, et al. J Am Geriat Soc. 1999. Influence of companion animals on the physical and psychological health of seniors: An analysis of a one-year longitudinal study. [DOI] [PubMed] [Google Scholar]
  • 9.Patrick DL, Bergner M. Measurement of health status in the 1990s. Annu Rev Public Health. 1990;11:165–83. doi: 10.1146/annurev.pu.11.050190.001121. [DOI] [PubMed] [Google Scholar]
  • 10.Cronbach LJ. Co-efficient alpha in the internal structure of tests. Psychometrika. 1951;16:297–334. doi: 10.1007/BF02310555. [DOI] [Google Scholar]
  • 11.Fleiss JL. The Design and Analysis of Clinical Experiments. New York: John Wiley and Sons; 1986. pp. 1–32. [Google Scholar]
  • 12.Cohen J. A coefficient of agreement for nominal scales. Educational and Psychological Measurements. 1960;20:37–46. doi: 10.1177/001316446002000104. [DOI] [Google Scholar]
  • 13.Fleiss JL. Statistical Methods for Rates and Proportions. 2nd ed. New York: John Wiley and Sons; 1981. pp. 188–236. [Google Scholar]
  • 14.Fleiss JL, Cohen J. The equivalence of weighted kappa and the intraclass correlation coefficient as measures of reliability. Educational and Psychological Measurements. 1973;33:613–19. doi: 10.1177/001316447303300309. [DOI] [Google Scholar]
  • 15.Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics. 1977;33:159–74. doi: 10.2307/2529310. [DOI] [PubMed] [Google Scholar]
  • 16.Krause N. Stressful life events and physician utilization. J Gerontol. 1988;43(2):S53–S61. doi: 10.1093/geronj/43.2.S53. [DOI] [PubMed] [Google Scholar]
  • 17.Raina P. The Impact of Pet Ownership and Attachment on the Health and Health Care Use of the Elderly in Wellington County, Ontario [dissertation] Guelph, Ontario: University of Guelph; 1995. [Google Scholar]
  • 18.Boult L, Boult C, Pirie P, Pacala J. Test-retest reliability of a questionnaire that identifies elders at risk for hospital admission. J Am Geriatr Soc. 1994;42:707–11. doi: 10.1111/j.1532-5415.1994.tb06528.x. [DOI] [PubMed] [Google Scholar]
  • 19.Rubenstein L. Geriatric assessment: An overview of its impacts. Clin Geriatr Med. 1987;3:1–15. doi: 10.1016/S0749-0690(18)30823-1. [DOI] [PubMed] [Google Scholar]

Articles from Canadian Journal of Public Health = Revue Canadienne de Santé Publique are provided here courtesy of Springer

RESOURCES