Skip to main content
NIHPA Author Manuscripts logoLink to NIHPA Author Manuscripts
. Author manuscript; available in PMC: 2023 Sep 1.
Published in final edited form as: Am J Med Genet A. 2022 Jun 9;188(9):2672–2683. doi: 10.1002/ajmg.a.62860

Understanding Barriers to Diagnosis in a Rare, Genetic Disease: Delays and Errors in Diagnosing Schwannomatosis

Vanessa L Merker 1, Bronwyn Slobogean 2, Justin T Jordan 1, Shannon Langmead 2, Mark Meterko 3,4, Martin P Charns 4,5, A Rani Elwy 6,7, Jaishri O Blakeley 2, Scott R Plotkin 1
PMCID: PMC9378587  NIHMSID: NIHMS1811001  PMID: 35678462

Abstract

Diagnosis of rare, genetic diseases is challenging, but conceptual frameworks of the diagnostic process can guide quality improvement initiatives. Using the National Academy of Medicine diagnostic framework, we assessed the extent of, and reasons for diagnostic delays and diagnostic errors in schwannomatosis, a neurogenetic syndrome characterized by nerve sheath tumors and chronic pain. We reviewed the medical records of 97 people with confirmed or probable schwannomatosis seen in two U.S. tertiary care clinics. Time-to-event analysis revealed a median time from first symptom to diagnosis of 16.7 years (95% CI, 7.5–26.0 years) and median time from first medical consultation to diagnosis of 9.8 years (95% CI, 3.5–16.2 years). Factors associated with longer times to diagnosis included initial signs/symptoms that were intermittent, non-specific, or occurred at younger ages (p<0.05). Thirty-six percent of patients were misdiagnosed; misdiagnoses were of underlying genetic condition (18.6%), pain etiology (16.5%) and nerve sheath tumor presence/pathology (11.3%) (non-mutually exclusive categories). One-fifth (19.6%) of patients had a clear missed opportunity for genetics workup that could have led to an earlier schwannomatosis diagnosis. These results suggest that interventions in clinician education, genetic testing availability, expert review of pathology findings, and automatic triggers for genetics referrals may improve diagnosis of schwannomatosis.

Keywords: schwannomatosis, rare disease, diagnostic errors, delayed diagnosis, missed diagnosis

Introduction

The diagnosis of rare, genetic disorders presents several unique challenges. With more than 9600 recognized rare disorders,1 general practice clinicians are unlikely to be familiar with most disorders and often have limited time to access clinical references to aid in diagnosis. Many genetic conditions are multi-system disorders with clinical manifestations that may be diagnosed and treated by different specialists without consideration of an underlying, unifying genetic diagnosis. Given these diagnostic challenges, it is unsurprising that diagnostic errors and delays are common for people with rare, genetic conditions. In a 2004 survey of approximately 6,000 European patients or caregivers with eight different rare diseases, 41% of respondents reported being previously misdiagnosed and 25% reported a time to diagnosis of ≥5 years.2 In a 2013 survey of 887 people with rare diseases and their caregivers in the United States and United Kingdom, respondents experienced an average time to diagnosis of 7.6 years in the U.S. and 5.6 years in the U.K.3 These diagnostic errors and delays can have a strong negative impact on patients’ health and quality of life,4,5 as well as the health and wellbeing of their family members. Lack of timely genetic counseling can hinder the identification of affected family members and limit patients’ access to family planning resources to reduce the risk of transmitting their disease to offspring.

Comprehensive assessment of the diagnostic process in rare, genetic disorders is thus needed to reduce diagnostic errors, shorten times to diagnosis, and improve health outcomes. In the 2015 landmark report on “Improving Diagnosis in Health Care”, the National Academy of Medicine (NAM) defined diagnostic error as “the failure to a) establish an accurate and timely explanation of the patient’s health problem(s) or b) communicate the explanation to the patient.”6 This definition foregrounds patients’ experience of diagnosis – whether and when diagnoses are communicated to the patient, and how delays or misdiagnoses affect patients’ lives. Diagnostic errors can emerge at any point in the cyclical process of gathering, integrating, and interpreting medical information that begins after patients engage in health care. The conceptual model depicted in Figure 1 can be used to highlight the challenges rare disease patients currently face in obtaining timely, accurate diagnoses while also identifying potential areas of clinical practice improvement to help prevent diagnostic errors in the future.

Figure 1.

Figure 1

Conceptual Model of the Diagnostic Process (Reprinted with Permission from the National Academy of Medicine)

In this paper, we apply the NAM definition of diagnostic error to study schwannomatosis, a rare, neurogenetic disease characterized by the development of multiple non-malignant nerve sheath tumors and severe, chronic pain.7 Multiple features of schwannomatosis make diagnosis challenging. The rarity8 and relatively new discovery of schwannomatosis as a distinct entity from other forms of neurofibromatosis (NF)9,10 means that many clinicians may be unaware of the condition.11 In addition, knowledge of the clinical and genetic features of schwannomatosis is rapidly evolving,1215 and concomitant changes have been made in schwannomatosis diagnostic criteria over the past two decades.1618 Providers may thus be unaware of the current standards for diagnostic ascertainment, newly available genetic testing options, and the full spectrum of symptoms indicative of schwannomatosis. Finally, even when patients are evaluated by expert NF clinicians, phenotypic overlap with other neurogenetic disorders can make diagnoses uncertain.19

Previous data on diagnostic delay and misdiagnosis in people with schwannomatosis is limited but suggests errors may occur frequently. In a single-center case series of 87 people with schwannomatosis, the median time from first symptom to diagnosis was 7 years, ranging as high as 39 years.20 This case series also reported four patients who had been previously misdiagnosed with malignant tumors. However, this case series did not test for any predictors of diagnostic delay, comprehensively search for prior misdiagnoses, or examine diagnostic communication. To address these limitations, we systematically reviewed the medical records of people with probable or confirmed schwannomatosis eventually seen at two specialized tertiary care clinics. Following the NAM definition of diagnostic error, we assessed the timeliness and accuracy of communication of a diagnosis of schwannomatosis in our cohort by 1) calculating time to diagnosis of schwannomatosis and identifying predictors of diagnostic delay; and 2) determining the rate and types of misdiagnoses of schwannomatosis-related signs and symptoms.

Methods

Editorial Policies and Ethical Considerations

All data collection and analysis were conducted in accordance with Institutional Review Board approvals (Partners Human Research Committee Protocol 2014P000633, Johns Hopkins Medicine Protocol 00136913, and Boston University Medical Center Protocol H-32975). A waiver of informed consent was granted for this retrospective medical record review.

Patient Sample

We performed a retrospective medical record review of people with confirmed or probable schwannomatosis seen at the neurofibromatoses (NF) specialty clinics at Massachusetts General Hospital (MGH) and Johns Hopkins Hospital (JHH). Patients were eligible for inclusion in the study if they 1) had a confirmed diagnosis of schwannomatosis according to the most recent diagnostic criteria18 or had a probable diagnosis of schwannomatosis (i.e. did not meet diagnostic criteria but schwannomatosis was considered the leading working diagnosis by their treating physician in the NF clinic), and 2) had at least one in-person visit to the MGH or JHH NF clinics between January 1, 2005 and January 31, 2016. As formal clinical diagnostic criteria for schwannomatosis were not published until 2005, patients diagnosed prior to this year were excluded from the study.16

Data Collection

For eligible patients, we reviewed all inpatient and outpatient records available in the electronic medical record systems of both hospitals through January 31, 2016; for patients seen at MGH, we also reviewed archived paper records when available. The review encompassed provider encounter notes; operative notes; discharge summaries; pathology and imaging reports; and patient communications (such as summaries of phone calls, emails, and patient questionnaires). Records included both internally generated documentation from providers within the MGH and JHH hospital networks as well as externally generated documentation from outside providers that were scanned into electronic patient files or filed into paper charts. Data were abstracted from the medical record by two team members (a researcher and clinician) using a standardized data spreadsheet including the following information:

Demographics and Clinical Information.

We collected descriptive data on patients’ sex, age, inheritance pattern (sporadic or familial), extent of disease (generalized vs. anatomically limited16), type and frequency of initial signs/symptoms of schwannomatosis, initial imaging results (single vs. multiple tumors present), and the specialties of healthcare professionals they consulted.

Key Diagnostic Timepoints:

We recorded dates for the following key timepoints in the diagnostic process shown in Figure 2: 1) when the patient first experienced a health problem (i.e. a bodily change, sign, or symptom)21 related to schwannomatosis, 2) when the patient first had a medical appointment for a health problem related to schwannomatosis; 3) when a diagnosis of schwannomatosis was confirmed (if at all), 4) when the confirmed diagnosis of schwannomatosis was communicated to the patient (if at all) and 5) last follow-up in NF clinic. As diagnostic criteria for schwannomatosis evolved over the study period,1618 a schwannomatosis diagnosis was considered confirmed on the date that patients first fulfilled the diagnostic criteria published at that time. Date of diagnosis communication was taken as the first time a clinician referenced a confirmed schwannomatosis diagnosis in a patient encounter note or other communication with the patient. If precise dates were not available for events prior to patients’ contact with the medical systems, (e.g., ‘Patient first developed pain last March’), we estimated dates using a modified version of the protocol developed for the Cancer Symptom Interval Measure project.22 If the medical record contained conflicting information about the timing/nature of medical events and primary source documentation was not available, we privileged data from the medical encounter closest to the original event when choosing which dates to abstract. Full protocols for date estimation and adjudication are available.23

Figure 2.

Figure 2.

Key Diagnostic Timepoints and Diagnostic Intervals

Diagnostic Errors:

We identified cases of misdiagnoses (when another diagnosis was given instead of schwannomatosis) and incomplete diagnoses (when schwannomatosis or another tumor suppressor syndrome should have been considered in the differential diagnosis but was not). Misdiagnoses were defined as “diagnoses that are wrong as judged from the eventual appreciation of more definitive information” (i.e. a clinician attributed a sign or symptom later found to be associated with schwannomatosis to another disease process).24 Diagnoses offered as one of multiple options in a differential were not counted as misdiagnoses. All cases of suspected misdiagnosis were reviewed by an expert NF clinician, who was asked to assess whether the preponderance of evidence available in the medical record suggested that the patient was misdiagnosed. This standard is similar to prior studies in which clinical reviewers retrospectively assessed the likelihood of adverse events, and any event with a certainty at or above “more likely than not” or “more than 50/50” was counted as an adverse event.25,26 Incomplete diagnoses were defined as situations in which patients received multiple diagnoses of sporadic tumors despite reasonable medical evidence suggesting they may have an underlying tumor suppressor syndrome. This was operationalized as situations in which a patient had two or more nerve sheath tumors (at least one pathologically proven to be a schwannoma), but the patient was not worked up for possible neurofibromatosis 2/schwannomatosis or referred to another provider for such workup.

Data Analysis

We present descriptive data on patient demographics, clinical characteristics, diagnostic delay, and rates/types of misdiagnosis and incomplete diagnosis. We calculated the time to diagnosis using two endpoints: the date a diagnosis of schwannomatosis was confirmed (i.e. when a patient objectively met diagnostic criteria) and the date a confirmed diagnosis was communicated to the patient (i.e. when the patient was told they had schwannomatosis). Since not all patients had a diagnosis confirmed and communicated to them (either due to lack of communication or because they had probable schwannomatosis that was never confirmed), we also performed a time to event analysis to describe the total time patients spent in the schwannomatosis diagnostic process. We used the date that a diagnosis of schwannomatosis was communicated to the patient as the event, and censored participants without diagnosis confirmation or diagnosis communication on the date of their last NF clinic visit. Finally, to benchmark progress towards the International Rare Diseases Research Consortium’s (IRDIRC) goal of diagnosing all rare disease patients within one year of presentation to medical care,27 we also calculated the total time patients spent in the healthcare system (i.e. time from first medical appointment for a sign/symptom of schwannomatosis until communication of confirmed diagnosis or last follow-up in clinic for a probable diagnosis).

We tested the associations between the length of diagnostic delay and clinicodemographic factors (i.e. sex, age at first symptom, inheritance, anatomical extent of disease, initial symptom type, initial symptom frequency, and initial imaging presentation). We grouped patients’ initial signs/symptoms by how specifically they indicated a possible tumor/tumor predisposition syndrome into three categories: asymptomatic (incidental finding or presymptomatic genetic testing); palpable mass with or without other symptoms; and other symptoms only (including pain and neurological symptoms). We used the Mann-Whitney U test (for dichotomous variables) or the Kruskal-Wallis H test with pairwise comparisons via the Dunn-Bonferroni test (for all other categorical variables) to assess for differences in diagnostic delay between patient subgroups. We used Spearman’s rho to assess the strength of associations between continuous variables and diagnostic interval length. All statistical analyses were performed using SPSS Version 24.0 (IBM Corp., Armonk, NY) and all reported p-values are two-tailed.

Results

Demographic and Clinical Characteristics

Ninety-seven patients (71 at MGH and 26 at JHH) with schwannomatosis were identified who met inclusion criteria for this study (Table 1). Sixty-four patients had a confirmed diagnosis of schwannomatosis by Plotkin et al. (2013) criteria; 33 patients were classified as having probable schwannomatosis. 70/97 patients (72.2%) experienced pain, alone (n=51) or in combination with a palpable mass (n=11) or other neurological symptoms (n=8), as their first symptom(s) of schwannomatosis. Ten patients were asymptomatic at the time their health problem was discovered: eight had an incidental imaging finding, one had an incidental finding on physical exam, and one elected to undergo presymptomatic genetic testing after a family member was diagnosed with schwannomatosis.

Table 1.

Patient Demographic and Clinical Characteristics

All Schwannomatosis Patients (n=97) Confirmed Schwannomatosis Patients (n=64) Probable Schwannomatosis Patients (n=33)
Female 49 (50.5%) 30 (46.9%) 19 (57.6%)
Familial Disease 15 (15.4%) 11 (17.2%) 4 (12%)
Anatomically Limited Disease 20 (20.6%) 14 (21.9%) 6 (18%)
Age at First Symptom, median (range) 32.9 years (5.1 – 68.3 years) 30.8 years (5.1 – 64.1 years) 39.7 years (12.5 – 68.3 years)
First Symptom Type
 Pain 51 (52.6%) 34 (53.1%) 17 (51.5%)
 Palpable Mass 10 (10.3%) 7 (10.9%) 3 (9.1%)
 Neurological Symptoms 4 (4.1%) 0 (0.0%) 4 (12.1%)
 Pain and Palpable Mass 11 (11.3%) 6 (9.4%) 5 (15.2%)
 Pain and Neurological Symptoms 8 (8.2%) 7 (10.9%) 1 (3.0%)
 Other 1 (1.0%) 1 (1.6%) 0 (0.0%)
 Unknown 2 (2.1%) 2 (3.1%) 0 (0.0%)
 N/A: Asymptomatic 10 (10.3%) 7 (10.9%) 3 (9.1%)
First Symptom Frequency
 Constant 33 (34.0%) 21 (32.8%) 12 (36.4%)
 Intermittent 29 (29.9%) 18 (28.1%) 11 (33.3%)
 Unknown 25(25.8%) 18 (28.1%) 7 (21.2%)
 N/A: Asymptomatic 10 (10.3%) 7 (10.9%) 3 (9.1%)
Initial Imaging Workup
 Single tumor discovered 54 (55.7%) 38 (59.4%) 16 (48.5%)
 Two or more tumors discovered 40 (41.2%) 25 (39.1%) 15 (45.4%)
 Unknown 2 (2.1%) 1 (1.6%) 1 (3.0%)
 N/A – no tumors discovered 1 (1.0%) 0 (0%) 1 (3.0%)

Footnotes:

Neurological symptoms included numbness, paresthesias, muscle weakness and hypophonia.

Other symptom was severe coughing spells due to a schwannoma compressing the esophagus.

Patients consulted a median of five different outpatient healthcare providers (range, 0–20) for diagnosis or treatment of schwannomatosis-related signs and symptoms prior to being diagnosed with confirmed schwannomatosis (or, for people with probable schwannomatosis, their most recent follow-up). There were 554 unique patient/provider pairings documented in the medical record; the specialty of the provider could be determined in 517 (93.3%) cases. Patients most commonly consulted neurosurgeons (n=65, 67%), primary care providers (n=62, 63.9%), orthopedic surgeons (n=42, 43.3%), neurologists (n=40, 41.2%), and general surgeons (n=28, 28.9%). Only three patients received genetic testing for schwannomatosis as part of their diagnostic workup during this time period.

Establishing and Communicating a Diagnosis

In the 64 people with confirmed schwannomatosis, median age at diagnosis confirmation was 41.7 years (range, 14.8–81.5 years). Fifty-four of these people (84.4%) had communication of their diagnosis documented in the medical record; median age at diagnosis communication was 41.0 years, range 15.1–81.6 years). Reasons for non-communication in ten patients were as follows. For five patients, the treating physician wanted additional diagnostic evidence beyond what was required by diagnostic criteria to confirm data originally obtained at outside institutions or to obtain additional data to more conclusively rule out possible alternative diagnoses of NF1 and NF2; these data were not obtained before the patients were lost to follow-up or the study period ended. For two patients initially seen prior to publication of the 2013 diagnostic criteria, the treating physician adhered to older diagnostic criteria which the patients did not meet and did not communicate the patient’s updated diagnosis status in subsequent visits after 2013. Finally, no communication was documented in the medical record for three patients who were lost to follow-up.

In the 64 people with confirmed schwannomatosis, the median time from patients’ first sign or symptom of schwannomatosis to the time their diagnosis was confirmed was 6.9 years (range, 0.05 to 47.8 years, 25th – 75th percentile: 3.8 – 16.5 years). At 5, 10, and 20 years from first experience of a health problem related to schwannomatosis, the percentage of people in this group without confirmation of the diagnosis was 67.2%, 37.5%, and 20.3%, respectively (Figure 3). Of note, for the subset of people with a confirmed diagnosis who were symptomatic at initial presentation (n=57), the median time from patients’ first symptom of schwannomatosis to the time their diagnosis was confirmed was 8.2 years (25th–75th percentile: 3.3 – 17.0 years). In the 54 people with confirmed schwannomatosis and documented communication of this diagnosis to the patient, median time to diagnosis communicated was 7.3 years (range, 0.2 to 48.0 years; 25th – 75th percentile: 4.5 – 15.8 years). At 5, 10, and 20 years from first experience of a health problem related to schwannomatosis, the percentage of people in this group without documented communication of the diagnosis was 68.5%, 35.2%, and 20.4%, respectively (Figure 3).

Figure 3.

Figure 3.

Timeliness of Schwannomatosis Diagnosis Probability of receiving a schwannomatosis diagnosis based on time to diagnosis of confirmed schwannomatosis patients (n=64, red); time to diagnosis communication in confirmed patients with documented communication (n=54, blue); and total time spent in the diagnostic process for all the entire cohort (n=97, green).

Since not all patients had a confirmed and communicated diagnosis of schwannomatosis, we also performed a time-to-event analysis of total time to diagnosis in all 97 patients, censoring people without a confirmed diagnosis or without documented communication of a confirmed diagnosis at the time of their last follow-up in NF clinic (Figure 3). Using this method, which accounts for the time spent in the diagnostic process by patients who have not yet had a diagnosis confirmed and/or communicated, the median total time spent in the diagnostic process was 16.7 years (95% CI, 7.5 – 26.0 years). At 5, 10, and 20 years from first symptom, the percentage of people without documented confirmation and communication of the diagnosis was 81.5%, 58.9%, and 45.4%, respectively. To isolate the proportion of this time that was spent in the healthcare system, we looked at the same hybrid endpoint (date of confirmed diagnosis communication or date of last follow-up in NF clinic), but beginning at the date of patients’ first medical appointment for a sign/symptom of schwannomatosis. The median time spent in the healthcare system seeking diagnosis for all 97 patients was 9.8 years (95% CI, 3.5 – 16.2 years). Only 7.3% of patients had documented diagnosis communication with one year of presenting to care.

Predictors of Diagnostic Delay

We examined the influence of various factors on the total time to diagnosis communicated (n=54) and total time spent in the diagnostic process (n=97), (Table 2). There was no statistically significant effect of patient sex, inheritance pattern, or anatomical extent of disease on either diagnostic time interval, although women trended towards shorter diagnostic intervals. People who experienced their first symptom at younger ages had significantly longer diagnostic intervals (Rho = −0.31, p=0.02 for time to diagnosis communicated; Rho = −0.39 p<0.001 for total time in the diagnostic process.)

Table 2.

Association between Clinical and Demographic Characteristics and Time to Schwannomatosis Diagnosis

Time to Diagnosis Communicated (n=54) Total Time in the Diagnostic Process (n=97)
Sex 5.77 vs. 9.87 6.29 vs 10.01
 Female vs. Male U=257, p=0.06 U=934.5, p=0.08
Inheritance Pattern 8.00 vs. 5.87 9.05 vs. 5.86
 Sporadic vs. Familial U=151, p=0.44 U=484.5, p=0.193
Extent of Disease 6.83 vs. 8.45 7.86 vs 9.23
 Full vs. Anatomically Limited U=198, p=0.41 U=704, p=0.56
Age at First Symptom Rho = −0.31
p=0.02
Rho = −0.39
p<0.001
Initial Symptom Type 4.77 vs. 3.46 vs. 8.32 4.64 vs. 5.86 vs. 9.87
 Asymptomatic vs. Palpable Mass vs. H(2)=8.44, p=0.02 H(2)=10.79, p=0.005
 Other Symptoms
Initial Symptom Frequency 4.77 vs. 4.00 vs. 8.58 vs. 10.98 4.64 vs. 5.84 vs. 9.74 vs. 11.95
 Asymptomatic vs. Constant vs. H(3)=14.69, p=0.002 H(3)=16.79, p=0.001
 Intermittent vs. Unknown
Initial Imaging Presentation § 8.32 vs. 5.63 9.19 vs. 6.61
 Single Tumor vs. Multiple Tumors U=810.5, p=0.04 U=229, p=0.04

For categorical variables, median diagnostic interval length is reported in years. Test statistics and p-values are reported using Mann Whitney U (for dichotomous variables), Kruskal-Wallis H test (for other categorical variables), and Spearman’s Rho (for continuous variables).

Time spent in the diagnostic process extends to the time a diagnosis was communicated, or if that did not occur, the time of the person’s last follow-up in NF clinic.

“Palpable mass” includes mass with or without additional symptoms; “other symptoms” includes pain, neurological symptoms or severe coughing spells only; and 2 people with unknown symptoms were excluded from analysis.

§

Three people with either zero or an unknown number of tumors were excluded from analysis.

There were significant differences in diagnostic interval length based on initial symptom type (Table 2, p=0.02 for diagnosis communicated and p=0.005 for total time in diagnostic process). Post-hoc pairwise Dunn-Bonferroni comparisons showed that patients with pain/neurological symptoms had significantly longer time to diagnosis communication than those with a palpable mass (p=0.03) and significantly longer time spent in the diagnostic process than asymptomatic patients (p=0.01). Initial symptom frequency was also significantly associated with the length of both diagnostic intervals (Table 2, p=0.002 for diagnosis communicated and p=0.001 for total time in diagnostic process). Post-hoc pairwise Dunn-Bonferroni tests indicated that patients with intermittent symptoms had significantly longer time to diagnosis communicated than patients with constant symptoms (p=0.02) and more time spent in the diagnostic process than asymptomatic patients (p=0.02). Finally, patients in whom initial imaging workup revealed multiple suspected nerve sheath tumors had significantly shorter diagnostic intervals than patients who had a single nerve sheath tumor (Table 2, p=0.04 for both time to diagnosis communicated and total time spend in the diagnostic process).

Diagnostic Errors

Misdiagnosis

Thirty-five patients (36.1%, 23 confirmed and 12 probable diagnoses) had one or more schwannomatosis-related signs/symptoms that were likely misdiagnosed based on subsequent expert clinical review (Table 3). None of the patients who were asymptomatic at baseline experienced a misdiagnosis (likely due to their disease being discovered through imaging or genetic testing that led to a more conclusive initial presentation); excluding these patients from analysis, we find that 40.2% (35/87) of patients with symptomatic presentations were likely misdiagnosed. Misdiagnoses fell into three, non-mutually exclusive categories: patients’ underlying genetic disorder being misdiagnosed as another genetic condition; tumors being mis-classified based on physical exam, imaging, or pathological characteristics; and pain etiology being misattributed to a more common disease process.

Table 3.

Prevalence of Diagnostic Errors Across Cohort (n=97)

Misdiagnosis 35 (36.1%)
 Genetic Condition 18 (18.6%)
  Neurofibromatosis 1 14 (14.4%)
  Neurofibromatosis 2 5 (5.2%)
 Nerve Sheath Tumor Presence/Pathology 11 (11.3%)
  Schwannomas/hybrid tumors initially classified as neurofibroma 6 (6.2%)
  Schwannomas initially classified as other neurofibromatosis 1-related lesion 2 (2.1%)
  Masses not identified as nerve sheath tumors on imaging/physical exam 5 (5.2%)
 Pain Etiology 16 (16.5%)
  Sciatica 3 (3.1%)
  Injury 3 (3.1%)
  Degenerative Disc Disease 2 (2.1%)
  Arthritis 2 (2.1%)
  Carpal Tunnel Syndrome 2 (2.1%)
  Mechanical back pain 2 (2.1%)
  Other 7 (7.2%)
Incomplete Diagnosis 19 (19.6%)
 Due to physician error 13 (13.4%)
 Due to physician or system error 6 (6.2%)

Subcategories are not mutually exclusive.

Only pain diagnoses applying to more than two people are listed. “Other” includes bursitis, synovitis, tendonitis, plantar fasciitis, reflex sympathetic dystrophy, bone spur, and unspecified hip socket problem.

Eighteen patients (18.6%) had their overall genetic condition misdiagnosed: 13 with NF1, four with NF2, and one with both NF1 and NF2 (by different providers). Eleven patients (11.3%) had a nerve sheath tumor misdiagnosed. Six patients had resected masses which were originally classified as neurofibromas by pathologists at outside hospitals, but were re-classified as schwannoma (five cases) or hybrid nerve sheath tumor (one case) upon review by an expert NF pathologist. Two of these patients also had additional, later schwannomas misdiagnosed as NF1-related lesions (malignant peripheral nerve sheath tumor in one case and gastrointestinal stromal tumor in one case). Five patients had masses that were diagnosed as enlarged lymph nodes, cysts, or vascular lesions based on the presence of radiological and/or physical exam characteristics alone, but were later resected with pathology of schwannoma. Sixteen patients (16.5%) had the etiology of their pain likely misdiagnosed. Pain was most commonly misattributed to neuromuscular or orthopedic issues and less commonly to an injury or psychological issues. For most patients, later identification and removal of a schwannoma led to pain reduction, lending credence to the idea that alternate diagnoses, even if they existed as comorbidities, were not the primary source of patients’ pain.

Incomplete diagnosis

We also observed 19 patients (19.6%, 13 confirmed and six probable) where an underlying genetic syndrome should have been investigated earlier as a potential diagnosis. In 13/19 cases, there was sufficient detail to suggest physician error (i.e. documentation showed that an individual physician had knowledge of the patient’s multiple schwannomas and neither began workup for potential NF2/schwannomatosis nor referred the patient to a specialist for further workup). In the remaining 6/19 cases, it was unknown whether a single physician had knowledge of the patient’s multiple schwannomas, and as such the error could have been due to system issues (for example, a failure to transmit documentation of patient’s prior schwannoma between hospitals, such that a physician was unaware the patient had multiple tumors and met criteria for further NF2/schwannomatosis workup).

Discussion

In this study, we reviewed the medical records of 97 people with confirmed or probable schwannomatosis to assess diagnostic accuracy and timeliness in patients eventually seen in specialized, tertiary care clinics. Our research shows that prolonged times to schwannomatosis diagnosis are common, with a median time to diagnosis communication of 7.3 years in confirmed patients, 20% of whom were not diagnosed until ≥20 years after their first symptom. These estimates are even greater when considering the large number of patients who have not yet received a confirmed diagnosis of schwannomatosis. In a time-to-event analysis accounting for the time patients with probable schwannomatosis have already spent undergoing diagnostic workup, we found that the median time spent in the diagnostic process for all patients was 16.7 years. While there is no clearly accepted dividing line between what constitutes a timely or delayed diagnosis of schwannomatosis, it is clear that a significant number of patients face extended diagnostic intervals and substantial room for improvement exists. Only 7.3% of patients met the IRDIRC goal of diagnosing all rare disease patients within one year of presentation to medical care.27

We identified several disease- and patient-related factors associated with time to diagnosis, which at least in part were related to patients’ initial symptom appraisal and help-seeking. Asymptomatic patients with incidentally found tumors or who electively underwent presymptomatic screening for schwannomatosis due to an established family history of the disorder were diagnosed more quickly. Conceptually, these patients were able to skip the typical delay associated with recognizing one has a health problem, deciding to seek care, and obtaining an appointment (Figure 1). Conversely, patients with intermittent or less specific tumor symptoms (i.e. pain and/or neurological symptoms only) had prolonged times to diagnosis. Possibly patients did not perceive these symptoms as sufficiently abnormal or as bothersome enough to warrant medical attention, leading to what Andersen, Cacioppo and Roberts (1995) called appraisal and illness delays in receiving care.28 Finally, younger patients also had delayed diagnoses. Previous research has shown that younger adults are more likely to avoid seeing a doctor even when they suspect medical care is necessary, perhaps due to increased belief that symptoms will improve on their own and/or lower likelihood of having an existing usual source of care.29,30 Given that adolescents and young adults with other tumor types have also been shown to experience longer diagnostic intervals than either older adults or young children,31,32 further efforts are needed to effectively diagnose schwannomatosis in young adults.

Misdiagnosis of schwannomatosis-related signs and symptoms were also common, with more than one-third of patients likely experiencing a misdiagnosis. Surprisingly, misdiagnoses of NF1 (in which patients are prone to multiple neurofibromas) were more common than misdiagnoses of NF2 (which like schwannomatosis, predisposes patients to develop multiple schwannomas). NF1 is much more prevalent than NF2 and schwannomatosis, so physicians may be more familiar with this disorder.8,33 NF1 misdiagnoses were also often related to prior pathological misdiagnoses of schwannomas or hybrid nerve sheath tumors as ‘neurofibromas’. Hybrid nerve sheath tumors, which display features of both neurofibroma and schwannoma,34,35 are common in schwannomatosis.36 Careful pathological review of these tumors, as well as the subtypes of schwannomas most likely to be misdiagnosed (e.g. cellular schwannomas and those with myxoid change), may help improve diagnostic accuracy.37 Clinically, expert pathologic re-review with newer molecular tests38 is likely indicated in people who have prior pathology findings of both neurofibromas and schwannoma (to appropriately classify them as either NF1 spectrum or NF2/Schwannomatosis spectrum), and in people with multiple ‘neurofibromas’ who do not display other clinical features of NF1 (as they may be misdiagnosed schwannomatosis patients).

Other NF1 and NF2 misdiagnoses point to the difficulty of diagnosing genetic conditions, which may present in a segmental pattern – that is, affecting only a portion of the body – or with different symptoms/signs based on one’s unique genetic mutation. Even when treating physicians noted that patients lacked the characteristic skin findings of NF1 (café au lait spots, skin fold freckling, and cutaneous neurofibromas), patients could still be misdiagnosed with mosaic NF1 or a variant of NF1 that primarily causes spinal tumors under the assumption that genetic features explained patients’ lack of skin findings. Similarly, even in patients without vestibular schwannoma (a defining characteristic of NF2), patients could be assumed to have mosaic NF2, which indeed displays extensive phenotypic overlap with schwannomatosis.8,19 More widespread use of genetic testing may be the only reliable way to distinguish these possibilities, supporting recent recommendations by international consensus panels for routine use of diagnostic genetic testing in NF2 and schwannomatosis.39,40

Finally, clinicians’ lack of familiarity with NF1, NF2 and schwannomatosis likely contributed to some incomplete diagnoses. One-fifth of people with multiple suspected tumors radiologically - at least one of which had been pathologically confirmed as a schwannoma - were not evaluated for possible genetic predispositions or referred to another provider for such workup. Given how rarely multiple nerve sheath tumors occur in the absence of a tumor predisposition syndrome, appearance of a second potential schwannoma should serve a trigger symptom to initiate neurogenetic consultation. To avoid solely relying on clinicians to remember and act on this trigger symptom, thoughtful use of electronic medical record alerts may be helpful. For example, patients with pathology records showing more than one nerve sheath tumor and/or patients with radiology reports mentioning multiple potential nerve sheath tumors could be flagged for neurogenetic workup. Similar electronic trigger algorithms have already been developed to improve delays in follow-up after abnormal lung CT and mammography findings41,42 and have been shown in randomized controlled trials to reduce diagnostic delay in colorectal and prostate cancer.43

Study Limitations

Completeness of medical documentation varied from patient to patient, particularly regarding documentation from providers outside the MGH and JHH hospital networks. This limited our ascertainment of precise dates for the first medical appointment for some patients, as well our ability to catch misdiagnoses or incomplete diagnoses that happened early in the diagnostic process. Retrospective ascertainment of misdiagnosis is inherently difficult; to make our assessment as robust as possible, we based our evidentiary standard on prior medical studies25,26 and explicitly excluded suspected misdiagnoses that could not be corroborated based on a “preponderance of evidence”. While prioritizing diagnostic communication as our primary endpoint aligned our analysis with the NAM model of diagnosis, there are also difficulties in assessing communication using medical records. Phone calls and electronic communications were less well documented than in-person visits, and questions remain regarding the degree to which clinicians’ verbal communication and patients’ understanding of their diagnosis match what is documented in medical records. Thus, our analysis may best be considered a proxy measure of true communication and understanding. Finally, our results may not be generalizable to all schwannomatosis patients, since our sample includes only those people who eventually attended dedicated NF clinics at large academic medical centers. While the delays and errors that patients at tertiary care clinics have experienced may not be identical to those of people who are still undiagnosed or managed outside specialty center, the common problems identified in the present study nonetheless represent important targets for process improvement.

Conclusions

Our study is the first comprehensive assessment of diagnostic performance in people with schwannomatosis seen at specialized, U.S.-based clinics. By assessing key dimensions of diagnostic error identified by the National Academy of Medicine — timeliness and accuracy in establishing a diagnosis and communicating it to the patient6 — we have established benchmarks for future quality improvement efforts in the areas most impactful to patient experience. Our work highlights several target areas for improving diagnosis of schwannomatosis, including increasing clinician awareness of schwannomatosis and how it differs from other types of NF; instituting more widespread genetic testing for potential schwannomatosis cases and expert review of selected pathology findings; and testing new methods to automatically flag patients for genetic evaluation based on imaging and/or pathology findings. Future research in schwannomatosis should prioritize piloting interventions with broad potential to improve diagnosis across rare disorders, including health IT interventions like electronic trigger algorithms, real-time diagnostic decision support, and health information exchanges.4447 These ambitious, systemwide efforts may be best poised to improve the clinical management of people with rare conditions and ensure that all patients and their family members have access to appropriate genetic and reproductive counseling.

Data Availability Statement:

The data that support the findings of this study are available on request from the corresponding author. The data are not publicly available due to privacy or ethical restrictions.

Acknowledgments:

Funding for this research was provided by a Children’s Tumor Foundation Young Investigator Award (2015-01-005) to VM and the Program in Cancer Outcomes Research Training (National Cancer Institute R25CA92203).

Grant Numbers:

Children’s Tumor Foundation Young Investigator Award 2015-01-005; National Cancer Institute R25CA92203

Footnotes

Conflicts of Interest: Vanessa Merker reports consulting income from the Neurofibromatosis Network. Justin Jordan reports consulting income from Navio Theragnostics, CereXis, Recursion, Health2047; <1% stock ownership in Navio Theragnostics; Royalties from Elsevier. Jaishri Blakeley has served as a paid consultant for Astella Pharma, Abbvie, TriAct/BiPar Sciences and has had research support from GlaxoSmithKlein, Bristol Meyer Squibb, and AstraZeneca. Scott Plotkin is co-founder of NFlection Therapeutics and NF2 Therapeutics; serves on the Scientific Advisory Board and has stock in SonALAsense; and consults for Akouos.

References:

  • 1.Ferreira CR. The burden of rare diseases. Am J Med Genet A 2019;179(6):885–892. (In eng). DOI: 10.1002/ajmg.a.61124. [DOI] [PubMed] [Google Scholar]
  • 2.EURORDIS. The Voice of 12,000 Patients: Experiences and Expectations of Rare Disease Patients on Diagnosis and Care in Europe. 2009. (http://www.eurordis.org/IMG/pdf/voice_12000_patients/EURORDISCARE_FULLBOOKr.pdf).
  • 3.Shire Genetic Therapies. Rare Disease Impact Report: Insights from patients and the medical community. April 2013. Available at https://globalgenes.org/wp-content/uploads/2013/04/ShireReport-1.pdf.
  • 4.Bogart KR, Irvin VL. Health-related quality of life among adults with diverse rare disorders. Orphanet J Rare Dis 2017;12(1):177. DOI: 10.1186/s13023-017-0730-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5.Bryson B, Bogart K, Atwood M, et al. Navigating the unknown: A content analysis of the unique challenges faced by adults with rare diseases. J Health Psychol 2019:1359105319828150. DOI: 10.1177/1359105319828150. [DOI] [PubMed] [Google Scholar]
  • 6.National Academies of Sciences Engineering and Medicine. Improving Diagnosis in Health Care. Washington, DC: The National Academies Press, 2015. [Google Scholar]
  • 7.Lu-Emerson C, Plotkin SR. The neurofibromatoses. Part 2: NF2 and schwannomatosis. Rev Neurol Dis 2009;6(3):E81–6. [PubMed] [Google Scholar]
  • 8.Evans DG, Bowers NL, Tobi S, et al. Schwannomatosis: a genetic and epidemiological study. J Neurol Neurosurg Psychiatry 2018;89(11):1215–1219. DOI: 10.1136/jnnp-2018-318538. [DOI] [PubMed] [Google Scholar]
  • 9.Purcell SM, Dixon SL. Schwannomatosis. An unusual variant of neurofibromatosis or a distinct clinical entity? Arch Dermatol 1989;125(3):390–3. [DOI] [PubMed] [Google Scholar]
  • 10.MacCollin M, Woodfin W, Kronn D, Short MP. Schwannomatosis: a clinical and pathologic study. Neurology 1996;46(4):1072–9. DOI: 10.1212/wnl.46.4.1072. [DOI] [PubMed] [Google Scholar]
  • 11.Koontz NA, Wiens AL, Agarwal A, Hingtgen CM, Emerson RE, Mosier KM. Schwannomatosis: the overlooked neurofibromatosis? AJR Am J Roentgenol 2013;200(6):W646–53. DOI: 10.2214/AJR.12.8577. [DOI] [PubMed] [Google Scholar]
  • 12.Hulsebos TJ, Plomp AS, Wolterman RA, Robanus-Maandag EC, Baas F, Wesseling P. Germline mutation of INI1/SMARCB1 in familial schwannomatosis. Am J Hum Genet 2007;80(4):805–10. DOI: 10.1086/513207. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13.Smith MJ, Kulkarni A, Rustad C, et al. Vestibular schwannomas occur in schwannomatosis and should not be considered an exclusion criterion for clinical diagnosis. Am J Med Genet A 2012;158A(1):215–9. DOI: 10.1002/ajmg.a.34376. [DOI] [PubMed] [Google Scholar]
  • 14.Piotrowski A, Xie J, Liu YF, et al. Germline loss-of-function mutations in LZTR1 predispose to an inherited disorder of multiple schwannomas. Nat Genet 2014;46(2):182–7. DOI: 10.1038/ng.2855. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15.Smith MJ, Isidor B, Beetz C, et al. Mutations in LZTR1 add to the complex heterogeneity of schwannomatosis. Neurology 2015;84(2):141–7. DOI: 10.1212/WNL.0000000000001129. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16.MacCollin M, Chiocca EA, Evans DG, et al. Diagnostic criteria for schwannomatosis. Neurology 2005;64(11):1838–45. DOI: 10.1212/01.WNL.0000163982.78900.AD. [DOI] [PubMed] [Google Scholar]
  • 17.Baser ME, Friedman JM, Evans DG. Increasing the specificity of diagnostic criteria for schwannomatosis. Neurology 2006;66(5):730–2. DOI: 10.1212/01.wnl.0000201190.89751.41. [DOI] [PubMed] [Google Scholar]
  • 18.Plotkin SR, Blakeley JO, Evans DG, et al. Update from the 2011 International Schwannomatosis Workshop: From genetics to diagnostic criteria. Am J Med Genet A 2013;161A(3):405–16. DOI: 10.1002/ajmg.a.35760. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19.Kehrer-Sawatzki H, Kluwe L, Friedrich RE, et al. Phenotypic and genotypic overlap between mosaic NF2 and schwannomatosis in patients with multiple non-intradermal schwannomas. Hum Genet 2018;137(6–7):543–552. DOI: 10.1007/s00439-018-1909-9. [DOI] [PubMed] [Google Scholar]
  • 20.Merker VL, Esparza S, Smith MJ, Stemmer-Rachamimov A, Plotkin SR. Clinical features of schwannomatosis: a retrospective analysis of 87 patients. Oncologist 2012;17(10):1317–22. DOI: 10.1634/theoncologist.2012-0162. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21.Weller D, Vedsted P, Rubin G, et al. The Aarhus statement: improving design and reporting of studies on early cancer diagnosis. Br J Cancer 2012;106(7):1262–7. DOI: 10.1038/bjc.2012.68. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22.Neal RD, Nafees S, Pasterfield D, et al. Patient-reported measurement of time to diagnosis in cancer: development of the Cancer Symptom Interval Measure (C-SIM) and randomised controlled trial of method of delivery. BMC Health Services Research 2014;14(1):3. DOI: 10.1186/1472-6963-14-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 23.Merker VL. Understanding the diagnostic process in a rare, genetic disease: a mixed methods study of schwannomatosis. 2019. https://hdl.handle.net/2144/34802.
  • 24.Graber ML, Franklin N, Gordon R. Diagnostic error in internal medicine. Arch Intern Med 2005;165(13):1493–9. DOI: 10.1001/archinte.165.13.1493. [DOI] [PubMed] [Google Scholar]
  • 25.Brennan TA, Leape LL, Laird NM, et al. Incidence of adverse events and negligence in hospitalized patients. Results of the Harvard Medical Practice Study I. N Engl J Med 1991;324(6):370–6. DOI: 10.1056/NEJM199102073240604. [DOI] [PubMed] [Google Scholar]
  • 26.Zwaan L, Singh H. The challenges in defining and measuring diagnostic error. Diagnosis (Berlin, Germany) 2015;2(2):97–103. (In eng). DOI: 10.1515/dx-2014-0069. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 27.Austin CP, Cutillo CM, Lau LPL, et al. Future of Rare Diseases Research 2017–2027: An IRDiRC Perspective. Clinical and Translational Science 2018;11(1):21–27. DOI: 10.1111/cts.12500. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28.Andersen BL, Cacioppo JT. Delay in seeking a cancer diagnosis: delay stages and psychophysiological comparison processes. Br J Soc Psychol 1995;34 (Pt 1):33–52. [DOI] [PubMed] [Google Scholar]
  • 29.Kannan VD, Veazie PJ. Predictors of avoiding medical care and reasons for avoidance behavior. Med Care 2014;52(4):336–45. DOI: 10.1097/MLR.0000000000000100. [DOI] [PubMed] [Google Scholar]
  • 30.Taber JM, Leyva B, Persoskie A. Why do people avoid medical care? A qualitative study using national data. J Gen Intern Med 2015;30(3):290–7. (In eng). DOI: 10.1007/s11606-014-3089-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 31.Veneroni L, Mariani L, Lo Vullo S, et al. Symptom interval in pediatric patients with solid tumors: adolescents are at greater risk of late diagnosis. Pediatr Blood Cancer 2013;60(4):605–10. (In eng). DOI: 10.1002/pbc.24312. [DOI] [PubMed] [Google Scholar]
  • 32.Lyratzopoulos G, Saunders CL, Abel GA, et al. The relative length of the patient and the primary care interval in patients with 28 common and rarer cancers. Br J Cancer 2015;112 Suppl1: S35–40. DOI: 10.1038/bjc.2015.40. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 33.Evans DG, Howard E, Giblin C, et al. Birth incidence and prevalence of tumor-prone syndromes: estimates from a UK family genetic register service. Am J Med Genet A 2010;152A(2):327–32. DOI: 10.1002/ajmg.a.33139. [DOI] [PubMed] [Google Scholar]
  • 34.Feany MB, Anthony DC, Fletcher CD. Nerve sheath tumours with hybrid features of neurofibroma and schwannoma: a conceptual challenge. Histopathology 1998;32(5):405–10. [DOI] [PubMed] [Google Scholar]
  • 35.Rodriguez FJ, Folpe AL, Giannini C, Perry A. Pathology of peripheral nerve sheath tumors: diagnostic overview and update on selected diagnostic problems. Acta Neuropathol 2012;123(3):295–319. (In eng). DOI: 10.1007/s00401-012-0954-z. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 36.Harder A, Wesemann M, Hagel C, et al. Hybrid neurofibroma/schwannoma is overrepresented among schwannomatosis and neurofibromatosis patients. Am J Surg Pathol 2012;36(5):702–9. DOI: 10.1097/PAS.0b013e31824d3155. [DOI] [PubMed] [Google Scholar]
  • 37.Kurtkaya-Yapicier O, Scheithauer B, Woodruff JM. The pathobiologic spectrum of Schwannomas. Histol Histopathol 2003;18(3):925–34. DOI: 10.14670/HH-18.925. [DOI] [PubMed] [Google Scholar]
  • 38.Mansouri S, Suppiah S, Mamatjan Y, et al. Epigenomic, genomic, and transcriptomic landscape of schwannomatosis. Acta Neuropathologica 2021;141(1):101–116. DOI: 10.1007/s00401-020-02230-x. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 39.Evans G, Legius E, Messiaen L, Plotkin S, Wolkenstein P. Revision of Diagnostic Criteria for Neurofibromatosis. Children’s Tumor Foundation Annual Neurofibromatosis Conference. San Francsisco, CA: 2019. [Google Scholar]
  • 40.Evans DG, Mostaccioli S, Pang D, et al. ERN GENTURIS clinical practice guidelines for the diagnosis, treatment, management and surveillance of people with schwannomatosis. European Journal of Human Genetics 2022. DOI: 10.1038/s41431-022-01086-x. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 41.Murphy DR, Meyer AND, Vaghani V, et al. Development and Validation of Trigger Algorithms to Identify Delays in Diagnostic Evaluation of Gastroenterological Cancer. Clin Gastroenterol Hepatol 2018;16(1):90–98. (In eng). DOI: 10.1016/j.cgh.2017.08.007. [DOI] [PubMed] [Google Scholar]
  • 42.Murphy DR, Meyer AND, Vaghani V, et al. Electronic Triggers to Identify Delays in Follow-Up of Mammography: Harnessing the Power of Big Data in Health Care. J Am Coll Radiol 2018;15(2):287–295. (In eng). DOI: 10.1016/j.jacr.2017.10.001. [DOI] [PubMed] [Google Scholar]
  • 43.Murphy DR, Wu L, Thomas EJ, Forjuoh SN, Meyer AN, Singh H. Electronic Trigger-Based Intervention to Reduce Delays in Diagnostic Evaluation for Cancer: A Cluster Randomized Controlled Trial. J Clin Oncol 2015;33(31):3560–7. (In eng). DOI: 10.1200/JCO.2015.61.1301. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 44.El-Kareh R, Hasan O, Schiff GD. Use of health information technology to reduce diagnostic errors. BMJ Qual Saf 2013;22 Suppl 2:ii40–ii51. DOI: 10.1136/bmjqs-2013-001884. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 45.Murphy DR, Meyer AN, Sittig DF, Meeks DW, Thomas EJ, Singh H. Application of electronic trigger tools to identify targets for improving diagnostic safety. BMJ Qual Saf 2019;28(2):151–159. (In eng). DOI: 10.1136/bmjqs-2018-008086. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 46.Bates DW, Gawande AA. Improving safety with information technology. N Engl J Med 2003;348(25):2526–34. DOI: 10.1056/NEJMsa020847. [DOI] [PubMed] [Google Scholar]
  • 47.Graber ML, Byrne C, Johnston D. The impact of electronic health records on diagnosis. Diagnosis (Berl) 2017;4(4):211–223. (In eng). DOI: 10.1515/dx-2017-0012. [DOI] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Data Availability Statement

The data that support the findings of this study are available on request from the corresponding author. The data are not publicly available due to privacy or ethical restrictions.

RESOURCES