Skip to main content
PMC home page
Canadian Journal of Public Health = Revue Canadienne de Santé Publique logoLink to Canadian Journal of Public Health = Revue Canadienne de Santé Publique
. 2016 Jan 1;107(1):e56–e61. doi: 10.17269/cjph.107.5244

Quality of administrative health databases in Canada: A scoping review

Aynslie Hinds 110, Lisa M Lix 110,✉, Mark Smith 210, Hude Quan 310, Claudia Sanmartin 410
PMCID: PMC6972121  PMID: 27348111

Abstract

OBJECTIVE: Administrative health databases are increasingly used to conduct population-based health research and surveillance; this has resulted in a corresponding growth in studies about their quality. Our objective was to describe the characteristics of published Canadian studies about administrative health database quality.

METHODS: PubMed, Scopus, and Google Advanced were searched, along with websites of relevant organizations. English-language studies that evaluated the quality of one or more Canadian administrative health databases between 2004 and 2014 were selected for inclusion. Extracted information included data quality concepts and measures, year and type of publication, type of database, and geographic origin.

SYNTHESIS: More than 3,000 publications were identified fromthe search. Twelve reports and 144 peer-reviewed papers were included. The majority (53.5%) of peer-review publications used databases from Ontario and Alberta, while 67% of the non-peer-review publications used data from multiple provinces/territories. Almost all peer-reviewed papers (97.2%) were validation studies. Hospital discharge abstracts and physician billing claims were the most frequently validated databases. Approximately half of the publications (53.0%) validated case definitions and 37.7% focused on a chronic physical health condition.

CONCLUSION: Gaps in the Canadian administrative data quality literature include a limited number of studies evaluating data from the Maritimes and across multiple jurisdictions, newer data sources, validating methods for identifying individuals with mental illness, and assessing the completeness and serviceability of the data. Data quality studies can aid researchers to understand the strengths and limitations of the data.

Key Words: Data linkage, administrative health database, diagnosis codes, validation studies, review study

Footnotes

Funding: LML is currently supported by a Manitoba Health Research Chair; she was supported by a University of Saskatchewan Centennial Research Chair at the time this research was initiated. HQ is supported by Alberta Innovate Health Solution.

Conflict of Interest: None to declare.

References

  • 1.Bailie L, Dufour J, Hamel M. Data Quality Assurance for the Canadian Community Health Survey (CCHS) Ottawa, ON: Statistics Canada; 2002. [Google Scholar]
  • 2.Das B, Clegg LX, Feuer EJ, Pickle LW. A new method to evaluate the completeness of case ascertainment by a cancer registry. Cancer Causes Control. 2008;19:515–25. doi: 10.1007/s10552-008-9114-0. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3.Quan H, Smith M, Bartlett-Esquilant G, Johansen H, Tu K, Lix L. Mining administrative health databases to advance medical science: Geographical considerations and untapped potential in Canada. Can J Cardiol. 2012;28:152–54. doi: 10.1016/j.cjca.2012.01.005. [DOI] [PubMed] [Google Scholar]
  • 4.Shah BR, Lipscombe LL. Clinical diabetes research using data mining: A Canadian perspective. Can J Diabetes. 2015;39:235–38. doi: 10.1016/j.jcjd.2015.02.005. [DOI] [PubMed] [Google Scholar]
  • 5.Iron K, Manuel DG. Quality Assessment of Administrative Data (QuAAD): An Opportunity for Enhancing Ontario’s Health Data. 2007. [Google Scholar]
  • 6.Wray NP, Ashton CM, Kuykendall DH, Hollingsworth JC. Using administrative databases to evaluate the quality of medical care: A conceptual framework. Soc Sci Med. 1995;40:1707–15. doi: 10.1016/0277-9536(94)00275-X. [DOI] [PubMed] [Google Scholar]
  • 7.Statistics Canada. Statistics Canada Quality Guidelines. 2009. [Google Scholar]
  • 8.Arts DGT, De Keizer NF, Scheffer G-J. Defining and improving data quality in medical registries: A literature review, case study, and generic framework. J Am Med Inform Assoc. 2002;9:600–11. doi: 10.1197/jamia.M1087. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9.Canadian Institute for Health Information. The CIHI Data Quality Framework. 2009. [Google Scholar]
  • 10.Statistics Canada. Statistics Canada’s Quality Assurance Framework. 2002. [Google Scholar]
  • 11.Azimaee M, Smith M, Lix L, Ostapyk T, Burchill C, Hong SP. MCHP Data Quality Framework. Winnipeg, MB: Manitoba Centre for Health Policy; 2013. [Google Scholar]
  • 12.Arksey H, O’Malley L. Scoping studies: Towards a methodological framework. Int J Soc Res Methodol. 2005;8:19–32. doi: 10.1080/1364557032000119616. [DOI] [Google Scholar]
  • 13.Roos LL, Gupta S, Soodeen R-A, Jebamani L. Data quality in an information-rich environment: Canada as an example. Can J Aging. 2005;24:153–70. doi: 10.1353/cja.2005.0055. [DOI] [PubMed] [Google Scholar]
  • 14.Spasoff R. Epidemiologic Methods for Health Policy. New York, NY: Oxford University Press; 1999. [Google Scholar]
  • 15.Spiegelman D V study I, Armitage P C T. Encyclopedia of Biostatistics. West Sussex: Wiley; 2005. pp. 5656–63. [Google Scholar]
  • 16.van Walraven C, Austin P. Administrative database research has unique characteristics that can risk biased results. J Clin Epidemiol. 2012;65:126–31. doi: 10.1016/j.jclinepi.2011.08.002. [DOI] [PubMed] [Google Scholar]
  • 17.Richards H. Ontario Health Information Management Association (OHIMA) 2006. Recent data quality initiatives at CIHI. [Google Scholar]
  • 18.Arnason T, Wells PS, van Walraven C, Forster AJ. Accuracy of coding for possible warfarin complications in hospital discharge abstracts. Thromb Res. 2006;118:253–62. doi: 10.1016/j.thromres.2005.06.015. [DOI] [PubMed] [Google Scholar]
  • 19.Quan H, Li B, Saunders LD, Parsons GA, Nilsson CI, Alibhai A, et al. Assessing validity of ICD-9-CM and ICD-10 administrative data in recording clinical conditions in a unique dually coded database. Health Serv Res. 2008;43:1424–41. doi: 10.1111/j.1475-6773.2007.00822.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20.Blackburn DF, Schnell G, Lamb DA, Tsuyuki RT, Stang MR, Wilson TW. Coding of heart failure diagnoses in Saskatchewan: A validation study of hospital discharge abstracts. J Popul Ther Clin Pharmacol. 2011;18:e407–15. [PubMed] [Google Scholar]
  • 21.Sears JM, Bowman SM, Hogg-Johnson S, Shorter ZA. Linkage and concordance of trauma registry and hospital discharge records. J Occup Environ Med. 2014;56:878–85. doi: 10.1097/JOM.0000000000000198. [DOI] [PubMed] [Google Scholar]
  • 22.Waikar SS, Wald R, Chertow GM, Curhan GC, Winkelmayer WC, Liangos O, et al. Validity of International Classification of Diseases, Ninth Revision, Clinical Modification Codes for Acute Renal Failure. J Am Soc Nephrol. 2006;17:1688–94. doi: 10.1681/ASN.2006010073. [DOI] [PubMed] [Google Scholar]
  • 23.Jutte DP, Roos LL, Brownell MD. Administrative record linkage as a tool for public health research. Annu Rev Public Health. 2011;32:91–108. doi: 10.1146/annurev-publhealth-031210-100700. [DOI] [PubMed] [Google Scholar]
  • 24.Quach S, Blais C, Quan H. Administrative data have high variation in validity for recording heart failure. Can J Cardiol. 2010;26:e306–12. doi: 10.1016/S0828-282X(10)70438-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 25.Lix L, Yogendran M, Burchill C, Metge C, Mckeen N, Moore D, et al. Defining and Validating Chronic Diseases: An Administrative Data Approach. Winnipeg, MB: Manitoba Centre for Health Policy; 2006. [Google Scholar]
  • 26.Marrie RA, Yu BN, Leung S, Elliott L, Caetano P, Warren S, et al. Rising prevalence of vascular comorbidities in multiple sclerosis: Validation of administrative definitions for diabetes, hypertension, and hyperlipidemia. Mult Scler J. 2012;18:1310–19. doi: 10.1177/1352458512437814. [DOI] [PubMed] [Google Scholar]
  • 27.Cadieux G, Tamblyn R. Accuracy of physician billing claims for identifying acute respiratory infections in primary care. Health Serv Res. 2008;43:2223–38. doi: 10.1111/j.1475-6773.2008.00873.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28.Monfared AAT, Lelorier J. Accuracy and validity of using medical claims data to identify episodes of hospitalizations in patients with COPD. Pharmacoepidemiol Drug Saf. 2006;15:19–29. doi: 10.1002/pds.1131. [DOI] [PubMed] [Google Scholar]
  • 29.De Coster C, Luis A, Taylor MC. Do administrative databases accurately measure waiting times for medical care? Evidence from general surgery. Can J Surgery. 2007;50:394–96. [PMC free article] [PubMed] [Google Scholar]
  • 30.Cunningham CT, Cai P, Topps D, Svenson L J N, Quan H. Mining rich health data from Canadian physician claims: Features and face validity. BMC Res Notes. 2014;7:682. doi: 10.1186/1756-0500-7-682. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 31.Alshammari AM, Hux J. The impact of non-fee-for-service reimbursement on chronic disease surveillance using administrative data. Can J Public Health. 2009;100:472–74. doi: 10.1007/BF03404347. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 32.Metcalfe A, Lyon A J J-A, Bernier F, Currie G, Lix LM, et al. Improving completeness of ascertainment and quality of information for pregnancies through linkage of administrative and clinical data records. Ann Epidemiol. 2013;23:444–47. doi: 10.1016/j.annepidem.2013.05.002. [DOI] [PubMed] [Google Scholar]
  • 33.Li B, Quan H, Fong A, Lu M. Assessing record linkage between health care and vital statistics databases using deterministic methods. BMC Health Serv Res. 2006;6:48. doi: 10.1186/1472-6963-6-48. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 34.Canadian Institute for Health Information. Data Quality Documentation for External Users: Discharge Abstract Database, 2010–2011. 2011. [Google Scholar]
  • 35.Benchimol EI, Manuel DG, To T, Griffiths AM, Rabeneck L, Guttmann A. Development and use of reporting guidelines for assessing the quality of validation studies of health administrative data. J Clin Epidemiol. 2011;64:821–29. doi: 10.1016/j.jclinepi.2010.10.006. [DOI] [PubMed] [Google Scholar]
  • 36.McCormick N, Lacaille D, Bhole V, Avina-Zubieta JA. Validity of myocardial infarction diagnoses in administrative databases: A systematic review. PLoS One. 2014;9:e92286. doi: 10.1371/journal.pone.0092286. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 37.Kephart G. Barriers to Accessing and Analyzing Health Information in Canada. 2002. [Google Scholar]
  • 38.Foebel AD, Hirdes JP, Heckman GA, Kergoat M-J, Patten S, Marrie RA. Diagnostic data for neurological conditions in interRAI assessments in home care, nursing home and mental health care settings: A validity study. BMC Health Serv Res. 2013;13:457. doi: 10.1186/1472-6963-13-457. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 39.Lix LM, Yan L, Blackburn D, Hu N, Schneider-Lindner V, Teare GF. Validity of the RAI-MDS for ascertaining diabetes and comorbid conditions in long-term care facility residents. BMC Health Serv Res. 2014;14:17. doi: 10.1186/1472-6963-14-17. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 40.Birtwhistle R, Williamson T. Primary care electronic medical records: A new data source for research in Canada. Can Med Assoc J. 2015;187:239–40. doi: 10.1503/cmaj.140473. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 41.Wasserman RC. Electronic medical records (EMRs), epidemiology, and epistemology: Reflections on EMRs and future pediatric clinical research. Acad Pediatr. 2011;11:280–87. doi: 10.1016/j.acap.2011.02.007. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 42.Hutchinson AM, Milke DL, Maisey S, Johnson C, Squires JE, Teare G, et al. The Resident Assessment Instrument-Minimum Data Set 2.0 quality indicators: A systematic review. BMC Health Serv Res. 2010;10:166. doi: 10.1186/1472-6963-10-166. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 43.Hudson M, Avina-Zubieta A, Lacaille D, Bernatsky S, Lix L, Jean S. The validity of administrative data to identify hip fractures is high — A systematic review. J Clin Epidemiol. 2013;66:278–85. doi: 10.1016/j.jclinepi.2012.10.004. [DOI] [PubMed] [Google Scholar]
  • 44.Jolley RJ, Sawka KJ, Yergens DW, Quan H J N, Doig CJ. Validity of administrative data in recording sepsis: A systematic review. Crit Care. 2015;19:139. doi: 10.1186/s13054-015-0847-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 45.Peabody JW, Luck J, Jain S, Bertenthal D, Glassman P. Assessing the accuracy of administrative data in health information systems. Med Care. 2004;42:1066–72. doi: 10.1097/00005650-200411000-00005. [DOI] [PubMed] [Google Scholar]

Articles from Canadian Journal of Public Health = Revue Canadienne de Santé Publique are provided here courtesy of Springer

RESOURCES