Validation of diagnostic codes for Charcot–Marie–Tooth disease in the Danish National Patient Registry

Abstract

Purpose

To validate the diagnostic codes for Charcot–Marie–Tooth disease (CMT) in the Danish National Patient Registry (DNPR) using positive predictive value (PPV) as a measure of validity.

Patients and methods

We used the DNPR to identify all patients diagnosed with at least one primary CMT diagnosis at a specialized department in the Central Denmark Region during the period 1977–2012. From this population, we randomly selected 123 patients for the validation study. Medical files were reviewed and used as reference standard. We estimated the PPV of the CMT diagnoses and stratified the analysis according to age at diagnosis, gender, and calendar time.

Results

In the DNPR, 275 patients were identified. We were able to retrieve 96 medical files from the random sample of 123 patients, and 85 CMT diagnoses were confirmed. The average age at diagnosis was 42.5 years, and 34% were female. The PPV was 88.5% (95% confidence interval: 80.4–94.1).

Conclusion

The CMT diagnoses in the DNPR have high validity. The DNPR can be used as a data source for epidemiologic research on CMT.

Introduction

Charcot–Marie–Tooth disease (CMT) is a clinically and genetically heterogeneous group of neuropathies, and is also known as hereditary motor and sensory neuropathy. The classic CMT phenotype is characterized by slowly progressive distal muscle weakness and atrophy, mild-to-moderate sensory loss, foot deformities (pes cavus and hammer toes), and loss of deep tendon reflexes.¹ However, symptoms vary greatly between patients and sometimes overlap with other neurologic disorders. The severity of CMT varies from mild to severe, and the age at onset ranges from early childhood to late adulthood. Pathogenic variants in more than 70 genes are associated with CMT, and all types of Mendelian inheritance patterns are seen.² There is no golden standard for diagnosing CMT, and due to the heterogeneity of the disease, CMT can pose a great diagnostic challenge.

A recent review on epidemiologic studies of CMT worldwide underscored the lack of epidemiologic knowledge in CMT.³ The different epidemiologic studies vary in quality and methodology, and prevalence estimates vary greatly ranging from 9.7⁴ to 82.2⁵ per 100,000. Few studies were performed nationwide, and no study had used nationwide register-based data.³

For the purpose of conducting an epidemiologic study on CMT in Denmark, we aimed to identify patients diagnosed with CMT using the Danish National Patient Registry (DNPR). The DNPR is considered one of the finest national health registers worldwide,⁶ but the usability of secondary data in registries such as the DNPR is highly dependent on the validity of the data.⁷ This study aims to examine the quality of the CMT discharge diagnosis in the DNPR by estimating the positive predictive value (PPV), using medical record data as reference standard.

Materials and methods

Setting

Denmark has 5.6 million citizens and the country is divided into five regions. In 2012, there were 1,271,223 inhabitants in the Central Denmark Region (CDR), roughly 23% of the Danish population.⁸ The Danish National Health Service provides all inhabitants with tax-supported health care. Since 1968, all Danish citizens have been registered in the Civil Personal Registry and given a unique 10-digit civil registry number (CPR number). The CPR number contains information on birth date and gender, and enables unique identification and matching of data between databases.⁹

The study was approved by the Danish Data Protection Agency (record number 1-16-02-18-12) and the Regional Ethics Commitee for the Central Denmark Region (1-10-72-331-12). Study protocol can be accessed by contacting the authors.

The DNPR

The DNPR was established in 1977, and contains data on all somatic hospital admissions, including CPR number, admission and discharge dates, hospital department, primary discharge diagnosis code, and up to 19 supplementary diagnoses. Data on outpatient contacts were added in 1995. Data are recorded prospectively, independent of specific research questions. Medical diagnoses were registered in the DNPR using the International Classification of Disease, version 8 (ICD-8) until 1993 and the International Classification of Disease, version 10 (ICD-10) thereafter.⁶

Identification of study population

We chose to perform our validation study on cases diagnosed with CMT in the CDR. Using the DNPR, we identified all discharge diagnoses between 1977 and 2012 consistent with CMT: ICD-10 DG600 (hereditary motor and sensory neuropathy) and ICD-8 33009 (atrophia mm. neuropathica, Charcot–Marie–Tooth). In order to improve the validity of our study population, we included only cases that fulfilled the following criteria: 1) one or more primary CMT diagnoses, as they are considered more accurate than secondary diagnoses; and 2) only cases diagnosed at departments of neurology, neurophysiology, clinical genetics, or pediatrics in the CDR, as we consider these departments to be the ones most familiar with CMT diagnostics.¹⁰ From this study population, we produced a random sample of 20 patients for every 5 calendar years during the entire study period. However, for some of the earlier periods, less than 20 cases were diagnosed in the DNPR, and the final study population therefore included 123 patients. The validation process is described in Figure 1.

Figure 1.

Flowchart of the validation process

Notes: ^aSelection in the DNPR: at least one primary diagnosis given at a department of neurology, neurophysiology, clinical genetics, or pediatrics during 1977–2012; ^brandom sample: 20 cases for every 5 years from 1977 to 2012.

Abbreviations: CMT, Charcot-Marie-Tooth disease; CDR, Central Denmark Region; DNPR, Danish National Patient Registry; N, number of cases.

Validation

Validation was performed on the random sample, using medical record data as reference standard. Medical records were identified using CPR number and manually reviewed. Access to medical records without written informed consent from the patients was approved by the Regional Ethics Commitee for the Central Denmark Region and The Danish Data Protection Agency. All records were reviewed by the same physician (SV), and uncertain cases were reviewed together with another physician (HA). Cases were categorized as CMT or non-CMT according to a list of seven criteria, based on the European CMT Consortium criteria^11,12 and the classic CMT phenotype. The seven criteria are listed in Table 1. To validate a diagnosis, we determined that at least four of the seven criteria had to be fulfilled, and at least one of the fulfilled criteria had to be criteria number 1, 2, or 3 (Table 1). Genetically confirmed cases were all categorized as CMT regardless of the number of fulfilled criteria.

Table 1.

Criteria for validation^a and distribution of fulfilled criteria among the 87 cases without genetically confirmed diagnosis

Criteria for CMT validation	Fulfilled criteria
	N (% of group)
	CMT (N=76)	Non-CMT (N=11)	All cases (N=87)
1. Neurophysiological evaluation or nerve biopsy consistent with CMT	59 (77.6)	3 (27.3)	62 (71.2)
2. Muscle weakness of the lower limbs	66 (86.8)	1 (9.1)	67 (77.0)
3. Reduced or loss of tendon reflexes of the lower limbs	66 (86.8)	6 (54.5)	72 (82.8)
4. Muscle atrophy	57 (75.0)	3 (27.3)	60 (69.0)
5. Foot deformities	57 (75.0)	2 (18.2)	59 (67.8)
6. Family history of CMT	47 (61.8)	2 (18.2)	49 (56.3)
7. Disease onset before age of 35 years	57 (75.0)	6 (54.5)	63 (72.4)

Note:

^aIn order to validate a case as CMT, at least four out of the seven criteria had to be fulfilled, and at least one of the fulfilled criteria had to be criteria number 1, 2, or 3.

Abbreviations: CMT, Charcot-Marie-Tooth disease; N, number of cases.

Statistical analysis

PPV was used as a measure of diagnostic validity. The PPV was estimated as the proportion of CMT cases identified in the DNPR sample, which fulfilled our criteria for CMT according to the medical files. Exact 95% confidence intervals (CIs) based on the binomial distribution were also computed. The analysis was stratified by age at diagnosis, gender, and calendar time, to evaluate differences in PPV. A 5% level of significance was used for hypothesis testing. Data were analyzed using STATA version 13.1.

Results

At the departments described earlier in the CDR, a total of 275 cases had received a primary CMT diagnosis. The random sample consisted of 123 cases, whereof 96 medical files could be located. All but 3 of the 27 missing records were from the period before 1995 (data not shown).

The average age at diagnosis was 42.5 years, and 34.4% were female. In 85 cases (88.5%), the diagnosis had been made at a neurologic department, 9 cases (9.4%) were diagnosed at a neurophysiologic department, and 2 cases (2.1%) were diagnosed at a pediatric department. The diagnosis codes ICD-8 33009 and ICD-10 DG600 were observed in 21 and 75 cases, respectively. In 53 cases (55.2%), the diagnosis was made after the year 2000.

In 85 cases, the diagnosis was found to be CMT. Nine cases were genetically confirmed at the time of first diagnosis. Of the remaining 76 cases, 57 had a neurophysiologic evaluation consistent with CMT and in 2 cases, findings at nerve biopsy were consistent with CMT. Among the 17 cases without any neurophysiological evaluation or nerve biopsy supporting the diagnosis, all but one had both muscle weakness and reduced tendon reflexes of the lower limbs. The distribution of validation criteria in the cases without genetically confirmed diagnosis is shown in Table 1.

The PPV of the entire sample was 88.5% (95% CI: 80.4%–94.1%). When stratifying the data according to age at diagnosis, gender, and calendar time, we observed trends for a higher PPV (nonsignificant) in the following conditions: cases diagnosed between ages 30 and 49 years (PPV 96.9%), cases diagnosed after the year 2000 (PPV 90.6%), and among females (PPV 92.1%) (Table 2).

Table 2.

Validity of the Charcot-Marie-Tooth diagnosis in the DNPR

Category	Total no. of cases	No. of CMT cases	No. of non-CMT cases	PPV (%)	95% CI
All	96	85	11	88.5	80.4–94.1
Year of diagnosis
1977–1999	43	37	6	86.0	72.1–94.7
2000–2012	53	48	5	90.6	79.3–96.9
Age at diagnosis (years)
0–29	28	24	4	85.7	67.3–96.0
30–49	32	31	1	96.9	83.8–99.9
≥50	36	30	6	83.3	67.2–93.6
Gender
Males	33	27	6	81.8	64.5–93.0
Females	63	58	5	92.1	82.4–97.4

Abbreviations: DNPR, Danish National Patient Registry; CMT, Charcot-Marie-Tooth disease; PPV, positive predictive value; CI, confidence interval.

Discussion

In this validation study, a great majority of the CMT diagnoses could be confirmed by review of medical records, yielding a high PPV. Our data suggest a slightly higher PPV in the age group of 30–49 years, in cases diagnosed after the year 2000, and among females, although our study population is too small to reveal statistically significant differences. To our knowledge, this is the first validation study of the CMT diagnosis. The use of national registry-based data minimized self-selection bias, and allowed us to sample patients at date of first diagnosis, so length-time bias and other problems related to cross-sectional sampling were avoided.

Limitations

Our study has a number of limitations to be considered. First, our study was performed using data from only one of the five regions in Denmark. Regional differences in diagnostic tradition may affect the PPV, but due to the uniform nature of the Danish health care system and the structure of record keeping, we consider the results generalizable to the whole country. Second, our results do not apply to other registries. Third, the medical records were not perfect or uniform and some records could not be located. The missing cases were primarily from the earlier period before 1995; hence, it is most likely that they have been lost or destroyed. However, it is possible that the missing records were less thoroughly studied, and could have introduced bias. Fourth, there is no golden standard for the CMT diagnosis. Although a Charcot–Marie–Tooth neuropathy score has been developed to study the natural history and response to therapy in CMT,¹³ the data available in our study does not allow calculation of a score for each patient. Validation in our study was performed according to a list of criteria based on the classical CMT phenotype.^11,12 This may lead to an underestimation of the PPV, as atypical and mild cases may be classified as non-CMT. Finally, we did not include data on undiagnosed patients in this study, and therefore were unable to estimate the negative predictive value (NPV), sensitivity, and specificity of the CMT diagnosis. Due to the heterogeneous nature of CMT, it is reasonable to assume that many patients are undiagnosed or misdiagnosed in cases with mild symptoms or atypical clinical presentation. The proportion of false-negatives might thus be high, and would yield a low sensitivity. Due to the low prevalence of CMT, the a priori risk of having CMT is low, and the number of false-positives and false-negatives will therefore be low relative to the large population of undiagnosed people without CMT, resulting in a high specificity and a high NPV.^10,14

Conclusion

This study shows that registration of CMT in the DNPR has high validity, and supports the use of the DNPR as a data source for epidemiological research on CMT.