Skip to main content
NCBI home page
Injury Prevention logoLink to Injury Prevention
. 2005 Jun;11(3):186–190. doi: 10.1136/ip.2004.006585

Concordance between childhood injury diagnoses from two sources: an injury surveillance system and a physician billing claims database

A Kostylova 1, B Swaine 1, D Feldman 1
PMCID: PMC1730226  PMID: 15933413

Abstract

Objectives: (1) To determine the concordance between injury diagnoses (head injury (HI), probable HI, or orthopedic injury) for children visiting an emergency department for an injury using two data sources: an injury surveillance system (Canadian Hospitals Injury Research and Prevention Program, CHIRPP) and a physician billing claims database (Régie de l'assurance maladie de Québec, RAMQ), and (2) to determine the sensitivity and specificity of diagnostic and procedure codes in billing claims for identifying HI and orthopedic injury among children.

Design: In this cross sectional cohort, data for 3049 children who sought care for an injury (2000–01) were obtained from both sources and linked using the child's personal health insurance number.

Methods: The physician recorded diagnostic codes from CHIRPP were used to categorize the children into three groups (HI, probable HI, and orthopedic), while an algorithm, using ICD-9-CM diagnostic and procedures codes from the RAMQ, was used to classify children into the same three groups.

Results: Concordance between the data sources was "substantial" (weighted Kappa 0.66; 95% CI 0.63 to 0.69). The sensitivity of diagnostic and procedure codes in the RAMQ database for identifying HI and for orthopedic injury were 0.61 (95% CI 0.57 to 0.64) and 0.97 (95% CI 0.96 to 0.98), respectively. The specificity for identifying HI and for orthopedic injury were 0.97 (95% CI 0.96 to 0.98) and 0.58 (95% CI 0.56 to 0.63), respectively.

Conclusion: Combining diagnostic and procedures codes in a physician billing claims database (the RAMQ database) may be a valid method of estimating injury occurrence among children.

Full Text

The Full Text of this article is available as a PDF (69.8 KB).

Selected References

These references are in PubMed. This may not be the complete list of references from this article.

  1. Colditz G. A., Martin P., Stampfer M. J., Willett W. C., Sampson L., Rosner B., Hennekens C. H., Speizer F. E. Validation of questionnaire information on risk factors and disease outcomes in a prospective cohort study of women. Am J Epidemiol. 1986 May;123(5):894–900. doi: 10.1093/oxfordjournals.aje.a114319. [DOI] [PubMed] [Google Scholar]
  2. Demlo L. K., Campbell P. M., Brown S. S. Reliability of information abstracted from patients' medical records. Med Care. 1978 Dec;16(12):995–1005. doi: 10.1097/00005650-197812000-00003. [DOI] [PubMed] [Google Scholar]
  3. Fisher E. S., Whaley F. S., Krushat W. M., Malenka D. J., Fleming C., Baron J. A., Hsia D. C. The accuracy of Medicare's hospital claims data: progress has been made, but problems remain. Am J Public Health. 1992 Feb;82(2):243–248. doi: 10.2105/ajph.82.2.243. [DOI] [PMC free article] [PubMed] [Google Scholar]
  4. Hillman B. J., Joseph C. A., Mabry M. R., Sunshine J. H., Kennedy S. D., Noether M. Frequency and costs of diagnostic imaging in office practice--a comparison of self-referring and radiologist-referring physicians. N Engl J Med. 1990 Dec 6;323(23):1604–1608. doi: 10.1056/NEJM199012063232306. [DOI] [PubMed] [Google Scholar]
  5. Iezzoni L. I. Using administrative diagnostic data to assess the quality of hospital care. Pitfalls and potential of ICD-9-CM. Int J Technol Assess Health Care. 1990;6(2):272–281. doi: 10.1017/s0266462300000799. [DOI] [PubMed] [Google Scholar]
  6. Jollis J. G., Ancukiewicz M., DeLong E. R., Pryor D. B., Muhlbaier L. H., Mark D. B. Discordance of databases designed for claims payment versus clinical information systems. Implications for outcomes research. Ann Intern Med. 1993 Oct 15;119(8):844–850. doi: 10.7326/0003-4819-119-8-199310150-00011. [DOI] [PubMed] [Google Scholar]
  7. Kosecoff J., Chassin M. R., Fink A., Flynn M. F., McCloskey L., Genovese B. J., Oken C., Solomon D. H., Brook R. H. Obtaining clinical data on the appropriateness of medical care in community practice. JAMA. 1987 Nov 13;258(18):2538–2542. [PubMed] [Google Scholar]
  8. Landis J. R., Koch G. G. The measurement of observer agreement for categorical data. Biometrics. 1977 Mar;33(1):159–174. [PubMed] [Google Scholar]
  9. Levy A. R., Mayo N. E., Grimard G. Rates of transcervical and pertrochanteric hip fractures in the province of Quebec, Canada, 1981-1992. Am J Epidemiol. 1995 Aug 15;142(4):428–436. doi: 10.1093/oxfordjournals.aje.a117651. [DOI] [PubMed] [Google Scholar]
  10. Lohr K. N. Use of insurance claims data in measuring quality of care. Int J Technol Assess Health Care. 1990;6(2):263–271. doi: 10.1017/s0266462300000787. [DOI] [PubMed] [Google Scholar]
  11. Macarthur C., Pless I. B. Sensitivity and representativeness of a childhood injury surveillance system. Inj Prev. 1999 Sep;5(3):214–216. doi: 10.1136/ip.5.3.214. [DOI] [PMC free article] [PubMed] [Google Scholar]
  12. Mackenzie S. G., Pless I. B. CHIRPP: Canada's principal injury surveillance program. Canadian Hospitals Injury Reporting and Prevention Program. Inj Prev. 1999 Sep;5(3):208–213. doi: 10.1136/ip.5.3.208. [DOI] [PMC free article] [PubMed] [Google Scholar]
  13. Paganini-Hill A., Ross R. K. Reliability of recall of drug usage and other health-related information. Am J Epidemiol. 1982 Jul;116(1):114–122. doi: 10.1093/oxfordjournals.aje.a113386. [DOI] [PubMed] [Google Scholar]
  14. Pickett W., Brison R. J., Mackenzie S. G., Garner M., King M. A., Greenberg T. L., Boyce W. F. Youth injury data in the Canadian Hospitals Injury Reporting and Prevention Program: do they represent the Canadian experience? Inj Prev. 2000 Mar;6(1):9–15. doi: 10.1136/ip.6.1.9. [DOI] [PMC free article] [PubMed] [Google Scholar]
  15. Quam L., Ellis L. B., Venus P., Clouse J., Taylor C. G., Leatherman S. Using claims data for epidemiologic research. The concordance of claims-based criteria with the medical record and patient survey for identifying a hypertensive population. Med Care. 1993 Jun;31(6):498–507. [PubMed] [Google Scholar]
  16. Ray W. A., Griffin M. R., Fought R. L., Adams M. L. Identification of fractures from computerized Medicare files. J Clin Epidemiol. 1992 Jul;45(7):703–714. doi: 10.1016/0895-4356(92)90047-q. [DOI] [PubMed] [Google Scholar]
  17. Ray W. A., Griffin M. R. Use of Medicaid data for pharmacoepidemiology. Am J Epidemiol. 1989 Apr;129(4):837–849. doi: 10.1093/oxfordjournals.aje.a115198. [DOI] [PubMed] [Google Scholar]
  18. Roos L. L., Mustard C. A., Nicol J. P., McLerran D. F., Malenka D. J., Young T. K., Cohen M. M. Registries and administrative data: organization and accuracy. Med Care. 1993 Mar;31(3):201–212. doi: 10.1097/00005650-199303000-00002. [DOI] [PubMed] [Google Scholar]
  19. Roos N. P., Wennberg J. E., Malenka D. J., Fisher E. S., McPherson K., Andersen T. F., Cohen M. M., Ramsey E. Mortality and reoperation after open and transurethral resection of the prostate for benign prostatic hyperplasia. N Engl J Med. 1989 Apr 27;320(17):1120–1124. doi: 10.1056/NEJM198904273201705. [DOI] [PubMed] [Google Scholar]
  20. Steinberg E. P., Whittle J., Anderson G. F. Impact of claims data research on clinical practice. Int J Technol Assess Health Care. 1990;6(2):282–287. doi: 10.1017/s0266462300000805. [DOI] [PubMed] [Google Scholar]
  21. Stone D. H., Morrison A., Smith G. S. Emergency department injury surveillance systems: the best use of limited resources? Inj Prev. 1999 Sep;5(3):166–167. doi: 10.1136/ip.5.3.166. [DOI] [PMC free article] [PubMed] [Google Scholar]
  22. Tamblyn R., Reid T., Mayo N., McLeod P., Churchill-Smith M. Using medical services claims to assess injuries in the elderly: sensitivity of diagnostic and procedure codes for injury ascertainment. J Clin Epidemiol. 2000 Feb;53(2):183–194. doi: 10.1016/s0895-4356(99)00136-5. [DOI] [PubMed] [Google Scholar]
  23. Taylor B. W., MacIntyre J., Forgeron P. Trauma recurrence in the pediatric emergency population. J Trauma. 1999 Mar;46(3):479–482. doi: 10.1097/00005373-199903000-00024. [DOI] [PubMed] [Google Scholar]
  24. Weiner J. P., Powe N. R., Steinwachs D. M., Dent G. Applying insurance claims data to assess quality of care: a compilation of potential indicators. QRB Qual Rev Bull. 1990 Dec;16(12):424–438. doi: 10.1016/s0097-5990(16)30404-3. [DOI] [PubMed] [Google Scholar]
  25. Young T. K., Roos N. P., Hammerstrand K. M. Estimated burden of diabetes mellitus in Manitoba according to health insurance claims: a pilot study. CMAJ. 1991 Feb 1;144(3):318–324. [PMC free article] [PubMed] [Google Scholar]

Articles from Injury Prevention are provided here courtesy of BMJ Publishing Group

RESOURCES