Skip to main content
PLOS ONE logoLink to PLOS ONE
. 2022 Mar 18;17(3):e0265847. doi: 10.1371/journal.pone.0265847

Why does it take so long for rare disease patients to get an accurate diagnosis?—A qualitative investigation of patient experiences of hereditary angioedema

Moeko Isono 1, Minori Kokado 1,2, Kazuto Kato 1,*
Editor: Girijesh Kumar Patel3
PMCID: PMC8932585  PMID: 35303740

Abstract

Introduction

Many patients with rare diseases experience a diagnostic delay. Although several quantitative studies have been reported, few studies have used a qualitative approach to directly examine how patients with rare disease obtain a diagnosis and why it takes many years. In this study, we focused on hereditary angioedema (HAE), which has been reported to have long diagnostic delays, despite the knowledge that not having an accurate diagnosis can cause life-threatening problems.

Objective

The objective of this study was to analyze patients’ experiences and elucidate why it takes a long time to reach a diagnosis of HAE. We also aimed to propose possible solutions for the problem.

Methods

A qualitative study using semi-structured interviews was conducted. Nine patients who took over 5 years from the presentation of initial symptoms to an HAE diagnosis participated. The contents of the interviews were subjected to an inductive contents analysis.

Results

By analyzing the patients’ struggles that were experienced during the undiagnosed period, three themes were generated: (1) acceptance and resignation towards their conditions, (2) proactive search for a cause, and (3) independent efforts outside of the hospital. While a few patients continued to seek out a diagnosis during the undiagnosed period, many had become accustomed to their health condition without suspecting a rare disease.

Conclusions

We found that one of the most important factors related to the prolonged undiagnosed period is the lack of suspicion of a rare disease by patients and their medical professionals. While current policies tend to focus on the period from suspecting rare diseases to the time of a clear diagnosis, our results strongly suggest that measures are needed to facilitate patients and clinicians to become aware of rare diseases.

Introduction

Many patients with rare diseases (RDs) worldwide are struggling to find a diagnosis. Currently, there are approximately 10,000 types of RDs, and 473 million people are affected by RDs worldwide [1]. For these RD patients, one of the most pertinent issues is the time required to reach a correct diagnosis. RD patients can be divided into two groups: (1) ‘not yet diagnosed’ refers to patients with an undiagnosed status that should be diagnosed for known diseases but have not been because the patients have not been referred to the appropriate clinician; and (2) ‘undiagnosed’ refers to patients for whom diagnostic tests are not yet available since the diseases have not been characterized and the cause(s) has not been identified [2]. Even if a patient belongs to group (1), it takes an average of 4–9 years to reach a correct diagnosis [36]. In low- and middle-income countries, where resources and specialized services are known to be very limited, the undiagnosed period is estimated to be probably even longer [7].

While many quantitative studies have been reported, comparatively fewer qualitative studies were conducted regarding the undiagnosed period of patients. Several patient organizations have conducted questionnaire surveys and reported cross-disease data [46, 8]. Moreover, many specialists and patient groups have conducted disease-specific quantitative surveys [9]. These quantitative surveys showed the means or medians of time to diagnosis and a list of misdiagnoses. A few other studies describe stories of diagnostic delay of individual patients by a qualitative approach [5, 1012]. Thus, it is difficult to concretely grasp the commonality of diagnostic delay.

Recently, national projects have been launched in several countries based on genetic analysis, using next-generation sequencing (NGS), to shorten the diagnostic delays for RDs. These include the Undiagnosed Diseases Program/Network (UDP/UDN) in the United States [13, 14], the Finding of Rare Disease Genes (FORGE) program in Canada [15] and Deciphering Developmental Disorders (DDD) in the United Kingdom [16]. These are projects driven by national policy, whereas the North-West University’s Centre for Human Metabolomics (CHM) of South Africa is in the process of establishing the first RD biobank that will facilitate early diagnosis [7].

In Japan, the Initiative on Rare and Undiagnosed Disease (IRUD) was launched in 2015 [17]. Additionally, the Ministry of Health, Labour, and Welfare issued a notification in 2018 to achieve early diagnosis of rare and intractable diseases. This notification requests every prefectural government to develop its own medical care delivery system. The medical care delivery system must connect patients whose conditions are difficult to diagnose by standard medical practices to a higher-order medical facility and national networks, including IRUD [18].

In this context, the following question has arisen: Are the government efforts enough to solve the problem of patients being undiagnosed? We believe that experiences of the patients before they reach a correct diagnosis are not adequately understood. Given the expected diversity and complexity of the experience, it is likely that they are not grasped by medical professionals, policy makers, and other stakeholders. Therefore, it was expected that we could obtain insights into workable solutions for this problem by deepening our understanding of the experiences of individual patients and elucidating common features among them. Thus, we studied patients’ paths to diagnosis, why the diagnosis took so many years, and whether the current measures are appropriate.

Among the RDs, we decided to focus on hereditary angioedema (HAE) and tried to understand the patients’ experience of being undiagnosed. There were three reasons for this: (1) the average length (years) of the undiagnosed period in HAE is longer than in many other RDs; (2) HAE symptoms are diverse; and (3) not having diagnosis of HAE is a life-threatening issue (see below). We believed that reasons (1) and (2) could justify the diversity of HAE patients’ experiences during the undiagnosed period. Consequently, our results may help clarify some of the common features, experienced by other RD patients during the undiagnosed period. Furthermore, bearing in mind reason (3), we considered that HAE needs to be adressed most urgently among all RDs.

HAE is a rare, potentially life-threatening genetic condition. It can be categorized into 3 different types, including HAE with deficit C1-inhibitor (C1-INH) levels (type 1), HAE with dysfunctional C1-INH (type 2), and HAE with normal C1-INH function (HAE-nC1-INH). Most patients belong to type 1 or 2, but within these two categories 85% are type 1. HAE-nC1-INH is very rare and not reported enough.

Type 1 and type 2 are autosomal dominant conditions (although approximately 25% of patients have no history). The estimated combined prevalence is approximately 1:50000, with no reported differences among different ethnic groups [19]. The percentage of female patients has been reported to range from 55% to 69% [2023]. HAE needs to be differentiated from acquired angioedema (AAE), which is suspected if there is no family history of the disease and if the onset is after the age of 30 years [19].

Clinically, all forms of HAE are characterized by recurrent episodes of swelling or edema that target different regions of the body. The most commonly involved organs include the skin, upper respiratory tract, oropharynx, and gastrointestinal tract. Severe edema in the airways may become life-threatening. Acute attacks may be treated by a bradykinin B2 receptor antagonist, icatibant, and/or plasma-derived C1-INH concentrate.

Early diagnosis of HAE is essential. Mortality is estimated to be three times higher in patients who are undiagnosed than in those who are diagnosed [24]. In addition, at least two recent fatal cases of undiagnosed patients have been reported in Japan [25, 26]. However, it was reported that the average undiagnosed period among HAE patients in Japan was 13.8 years as per 2014 survey [20] and 15.6 years as per 2020 survey [27].

The objective of this study was to grasp and analyze HAE patients’ experiences, focusing on two points: (1) what actions they took to relieve or ameliorate their symptoms and what medical care they received during the undiagnosed period, and (2) how their current diagnosis was reached. Based on these results, we also aimed to understand why there is such a protracted period before an accurate diagnosis of HAE is reached. Then, we discuss the factors contributing to the prolonged undiagnosed period. The findings of this study will help us understand why patients with RDs experience such a long delay before they are accurately diagnosed and find solutions to shorten the undiagnosed period.

Material and methods

To understand experiences of HAE patients during their undiagnosed period, a qualitative research approach using semi-structured interviews was employed.

Recruitment

Patients were eligible to participate if they were 20 years or older and met the following two criteria: (1) patients who were diagnosed with HAE type 1 or 2 (characterized by C1-INH deficiency/dysfunction); and (2) >5 years had elapsed from the initial appearance of symptoms to an HAE diagnosis. Patients who met the above criteria were invited to participate in this study from April 2019 to October 2019. We advertised the study (information dissemination) in the following three ways: (1) notice posted on the online rare disease research platform RUDY JAPAN [28], (2) notice distributed via e-mail from the HAE patient organizations, and (3) notice given to patients from HAE specialists. In addition to information dissemination, we conducted snowball sampling. A 3,000-yen (approximately 29 USD) voucher was offered as compensation to all the participants (two of them declined).

Since the purpose of this study was to understand the phenomenon, and not to construct a theory, we did not aim for data saturation. By 6 months after the beginning of information dissemination, we obtained nine participants and stopped recruitment. This is because we had already used all the recruitment methods possible and had sent out information to the same group several times. We considered that most patients who wanted to voluntarily participate had already contacted us and sending out more information could hinder benefit of patients who were not willing to participate in this study.

Data collection

An interview guide was developed based on the aim of this study. The main topics covered were patients’ experiences from their initial symptoms until diagnosis (especially whether they had visited hospitals or not; if yes, the diagnosis/explanation and treatment at the hospital) and changes in their perceptions about their physical problems.

One-to-one semi-structured interviews were conducted for approximately 90 minutes. Interviews were conducted either face-to-face or using a web conferencing system (Zoom). All interviews were audio-recorded and transcribed verbatim with the permission of the participants.

Data management and analysis

We analyzed the data using content analysis [29]. The approach used was mainly inductive and manifest analysis, involving coding and grouping excerpts, describing the same phenomena to produce descriptive summaries of the data. However, given the purpose of the study, in a relatively early stage, we separated the data into two major categories: "patient struggles during the undiagnosed period,” and "how they were able to reach a diagnosis of HAE.” Subsequently, all analyses were conducted inductively. Coding and initial grouping into categories were performed by one researcher. Two researchers with experience in qualitative research, ensured that the analysis was appropriate for the objective of the study.

In this content analysis, we counted and described the frequencies of statements of each theme and sub-theme. This transparent reporting allows us to present to the readers with substantial evidence for each of the descriptive summaries. We intended to make our reporting more precise, rigorous, and scientific by describing the frequency of statements [30].

Ethical approval and consent to participate

Approval to conduct this research was granted by the Osaka University Clinical Research Review Committee (18534–5). Written informed consent for research participation was obtained from all interviewees.

Results

Characteristics of the participants

Nine patients participated in this study (hereafter, we call them participants). The average length of their undiagnosed period was approximately 23 years. As shown in Table 1, most participants (8/9) visited a hospital within a year from the initial appearance of symptoms. However, it took many years for the diagnosis of HAE from their first visit to the hospital. Most participants (8/9) visited the hospital repeatedly without knowledge of HAE. The only exception was Participant F; he was aware of HAE before initial symptoms appeared, but had a hard time before getting an official diagnosis of HAE (see below for further description).

Table 1. Participant characteristics.

Participant Generation Sex The time between the initial symptoms and the first visit to the hospital (years) The time between the first visit to the hospital and the diagnosis of HAE (years) Year when he/she got the diagnosis of HAE HAE symptoms that patients experienced in the undiagnosed period
Visible swelling*1 Abdominal symptoms*2 Laryngeal swelling *3 Other symptoms
A 50s Female Less than 1 39–40 2012 + ++ ++
B 30s Female Less than 1 13 2008 + ++ +
C 50s Female Less than 1 26 1994 ++ ++ Joint pain+
D 50s Female Less than 1 20 2017 +
E 40s Female Less than 1 20 2012 ++ ++ +
F 60s Male 31–32 1–2 2015 + + Nasal congestion++
G 20s Female Less than 1 8 2016 + +
H 30s Female Less than 1 17 2003 ++ + ++
I 50s Female Less than 1 28 2017 + ++

+ Indicates the topics mentioned by the participants

++ Indicates the topics that specifically highlight the severity of their symptoms; − Indicates the topics not mentioned by the participants.

*1 "Visible swelling" includes swelling of the extremities, finger, wrist, feet, and face, among others.

*2 "Abdominal symptoms" include abdominal pain, nausea/vomiting, and constipation.

*3 "Laryngeal swelling" includes dyspnea/breathlessness.

HAE, hereditary angioedema.

“Past HAE symptoms” described in the interview

The symptoms experienced by the nine participants in the undiagnosed period were diverse (Table 1). During the interviews patients were asked to retrospectively discuss the symptoms they experienced during this undiagnosed period. Many remarked that they were not always sure, in the case of abdominal attacks, whether they were caused by HAE or something else. Particularly, they lacked confidence to clearly suggest “past symptoms” as definitively caused by HAE when there was no visible swelling. Since this study aims to understand patients’ experience, we describe “experience of HAE symptoms” based on participants’ perspectives.

Consequently, many participants experienced visible swelling and abdominal symptoms (9/9 and 8/9, respectively). Almost all participants clearly talked about visible swelling as a symptom of HAE. However, they were not confident when they talked about their abdominal symptoms. They made comment such as, "I don’t know if it was due to HAE or not," explaining that they could not always confidently distinguish HAE from other possibilities such as Cyclic Vomiting Syndrome, stomach flu, or menstrual pain. Moreover, several participants reported experiencing a variety of health problems as a child, including frequent colds or getting a positive urine test during a routine check-up. In this context, they found it difficult to distinguish between what might have been symptoms of an RD and those related to being an “unhealthy child”. Regarding these episodes, one of them added a comment that "the current doctor said that these past problems and episodes would not be related to HAE, but I am not certain about it."

“Aside from the limbs, I finally understand the other symptoms [of HAE]–namely, the vomiting, diarrhea, and nausea. It became clear that they were part of my attack this year. The reason I understood this was because I tried treating them with FIRAZYR®* every time [any problems occurred]. I finally understood that this was an attack!” (Participant I)

* FIRAZYR® is a brand name of icatibant, bradykinin B2 receptor antagonist to be injected, licensed for acute attack treatment.

Alternative diagnoses

Before the final diagnosis of HAE, participants were given various alternative diagnoses to explain their symptoms (Table 2). Visible swelling of several participants had been diagnosed as an allergy. Abdominal symptoms were diagnosed with various diseases or symptoms, such as stomach flu or appendicitis. Laryngeal symptoms were attributed to asthma and colds. Several participants had received alternative diagnoses, while others did not have clear diagnoses or explanations.

Table 2. Alternative diagnoses in the undiagnosed period.

Visible swelling Abdominal symptoms Laryngeal swelling
• Insect bite • Food poisoning • Asthma
• Allergy (egg, dust, or tick)
• Irritable bowel syndrome (IBS)
• Erythema annulare centrifugum
• Endometriosis
• Cyclic Vomiting Syndrome
• Appendicitis
• Gastric and duodenal ulcers
• Intestinal obstruction (adhesion of the surgical scars of appendicitis)
• Cold
• Constipation
• Stomach flu
• Acute abdomen

Analysis of participants’ experiences (A) ― struggles during the undiagnosed period

In the following sections, we present results of the analysis of participants’ experiences. It consists of two sections: (A) their struggles during the undiagnosed period and (B) how they were able to reach a diagnosis of HAE.

During their long undiagnosed period, patients suffered from symptoms and faced various challenges. We describe these experiences according to three themes: (A-1) acceptance and resignation towards their condition, (A-2) proactive search for a cause, and (A-3) independent efforts outside of the hospital. Table 3 shows the subthemes contained within each theme.

Table 3. Themes and sub-themes of participant experiences (A).

Themes Sub-themes
(A-1) Acceptance and resignation towards their condition [Visible swelling] Getting used to lack of explanation or diagnosis
[Abdominal symptoms] Repetition of their usual coping methods
(A-2) Proactive search for a cause Proactive search for a cause by a patient
Suggestion to search for a cause by a doctor
(A-3) Independent efforts outside of the hospital

(A-1) Acceptance and resignation towards their conditions

In this theme, participants’ experiences were divided into two sub-themes depending on the site and manifestation of the symptoms. One was visible swelling, and the other was abdominal symptoms. It was revealed that participants went through various experiences and thoughts, and they finally accepted their conditions that was, in a way, characteristic of each symptom (Table 3).

For visible swelling, seven participants visited hospitals (e.g., department of dermatology). Five participants described the motivation as being "because I hadn’t the slightest idea what the reason was" or "because people around me recommended it." However, only little or no clear diagnosis or explanation was provided in the hospital, without being referred to a higher-level hospital. Only one participant was given another diagnosis. Two episodes of referral to more specialized hospitals were reported, but neither of them resulted in a correct diagnosis. Regardless of the diagnosis, participants were left with questions about the cause of their symptoms and visited several different hospitals.

“When I was 16- and 17-year-old, I had swelling in my limbs about once a year. I didn’t know what caused it but I decided to go to a dermatologist. The doctor said it might be an allergic reaction. They often said “maybe”, or “I don’t really know why”. They said, “It might be an insect bite, or an allergic reaction, or something like that.” I didn’t get any clearer diagnosis than that and I didn’t receive any medication.” (Participant E)

After several visits to hospitals, five participants stopped visiting the hospital. The reasons for this were that there was nothing unusual in the test results, which led doctors and participants to think that it was not a serious problem; they became accustomed to the fact that they could not get a clear diagnosis and medication when they went to the hospital; they learned from their experiences that this swelling would disappear without treatment after several days.

Although they did not receive any clear diagnosis, some participants thought that symptoms were due to something more. For example, Participant H considered her symptoms to be abnormal and thought it was a "weird disease" in her heart. However, she became accustomed to not being diagnosed in a neighboring hospital and stopped seeing a doctor. She said, "I had given up and put up with having to deal with this weak constitution for the rest of my life."

“I always thought that I had an allergic constitution which I have to live with throughout my life. […]. Since no medical department that I had found could give me an answer, I started to endure the swelling at home. […]. No abnormality in general blood tests relieved me and made me think that it could not be a serious disease.” (Participant H)

For abdominal symptoms, seven participants visited hospitals (mainly the general medicine departments). Six mentioned their motivation as "wanting to do something about this pain," that is, indicating that they were mainly seeking treatment. Many participants emphasized very severe pain and suffering, such as, "I collapsed," and "I felt like I was dying." Two of them described multiple visits to the emergency room, and one participant had undergone an abdominal operation.

Regarding abdominal symptoms, two participants (Participant A and E) underwent treatments for diagnoses other than HAE administered by their doctors. For example, Participant E was always admitted to the same hospital when she had severe abdominal symptoms. She was treated for the diagnosis of gastric and duodenal ulcers, but the medication did not work. The doctor expressed doubts about the treatment and, after several tests, changed the medication; even then, it did not work. Participant E also wondered why the treatment did not work but believed in the diagnosis because of the doctor’s diligence.

Four participants had never been diagnosed by doctors with a specific disease name. They were provided explanations, such as symptoms being "stress-related" or the result of the "stomach flu," and prescribed palliative drugs for the symptoms. A few participants actively sought a diagnosis and treatment, while the others did not. However, participants with severe symptoms were repeatedly hospitalized for several days when a symptom occurred, regardless of their activity for seeking proper diagnosis.

“One of the doctors saw me and said, “You should be hospitalized,” and when I got better, they said, “You can leave the hospital”. When the symptoms re-appeared, they said, “You should be hospitalized”. I didn’t have an attending doctor, and the doctors would say, “Hmm, I wonder why this is happening” and so on. […]. “It happened again!” I really blamed myself, psychologically. […]. I thought that it was happening because I had a weak constitution, or that I was stressed… basically that I lacked self-control.” (Participant B)

Two participants described that they stopped visiting hospital, despite symptoms such as severe abdominal pain. These participants were affected by what a doctor or people around them explained as, “It’s a psychosomatic disorder.”

“My friend told me that “If they didn’t find anything during the check-up, the vomiting must be stress-related.” I thought they might be right, and I didn’t visit the hospitals so frequently.” (Participant I)

As mentioned above, Participant I was told that it was a psychiatric problem by her friend after a test at the hospital, while Participant A was repeatedly told that it was weak constitution or psychiatric problem by doctors after medical consultations only; tests were not conducted in detail. After that, Participant A experienced a detailed checkup and received a diagnosis of irritable bowel syndrome (IBS) and took a drug for IBS. However, the drug made her health condition worse. After this episode, Participant A gave up on visiting hospitals, thinking that it would not help, and came to endure the symptoms at home for about 20 years. Participant A finally revisited a hospital after vomiting for 36 hours and falling into a state of shock.

(A-2) Proactive search for a cause

While many participants came to accept their strange health condition and were accustomed to coping with it, a few participants and their doctors proactively searched for a disease name.

Three participants suspected that their physical problems might have occurred due to an underlying and unrecognized cause. Two of them had been actively visiting hospitals to look for a correct diagnosis. Participant C had visited all the large hospitals in the neighboring regions, searching for a diagnosis for two reasons: (1) the doctors questioned and were concerned about her condition upon seeing her visible swelling and abdominal pain, but none of them could give her a diagnosis, and (2) she recognized that her condition clearly differed from that of other people. Participant I underwent regular gastroscopy in search of the cause. Moreover, when she visited the doctor with concerns about another health issue (high risk of blood clots), she asked the doctor about a connection between it and her visible swelling. She sought an underlying and unrecognized cause for various reasons. One was that she suspected a possibility of genetic disorder because her blood relatives had similar abdominal problems. She was also concerned about her many physical problems, such as visible swelling, abdominal symptoms, back pain, and fatigue.

Two participants (Participant A and G) were advised to undergo tests and were admitted to hospitals because their doctors thought they had unexplained symptoms. However, this suggestion was not received well. One reason was that participants were reluctant to be hospitalized. They felt that it was costly and time-consuming, considering that the doctor did not have a specific disease in mind and that the symptoms had already subsided. For this reason, Participant G did not undergo hospitalization for tests. In contrast, despite not wanting to be hospitalized, Participant A underwent multiple hospitalizations for tests that took an average of 10 days. A serious disease was suspected, and she underwent various tests, repeatedly, most of which were quite invasive. However, the doctors did not come up with HAE as a possibility. She lost hope in medicine and thought that it was just time-consuming. Thus, she chose not to visit the hospital unless the symptoms were unbearable, and she felt that she would go into shock again. Despite this choice, she was still hospitalized approximately twice a year for 5 years, prior to being diagnosed.

(A-3) Independent efforts outside of the hospital

Participants whose conditions were not improved by medical treatments attempted to cope for themselves outside hospital. Their medical professionals in those days did not know their behaviors.

One of the most frequent behaviors was trying to understand the triggers of the symptoms. Three participants attempted to determine the relationship between their diet or lifestyle and the occurrence of symptoms. The most severe example was the case of Participant A. She avoided a particular ingredient (e.g., wheat) to control her health condition. However, this effort resulted in severe weight loss so much so that she developed amenorrhea and anemia.

Another behavior was seeking out information or people having similar problems. Three participants did this. Those include examples of searching for similar patients via a paid site on the Internet and of asking for any idea regarding the symptoms by showing a picture of the swelling to her friends.

Analysis of participants’ experiences (B) ― how they were able to reach a diagnosis of HAE

As described above, participants experienced various struggles including repeated visits to hospitals, endurance of symptoms at home, and performing activities to cope with problems without visiting hospitals. Finally, HAE diagnosis was reached in various ways.

(B-1) Obtaining a diagnosis just after knowing about HAE

Seven participants suffered from their health condition for a long time, because they were unaware about HAE. Contrastingly, despite knowing about HAE, two participants experienced a period in which they did not receive an HAE diagnosis (see the further description below). Table 4 lists how participants were able to reach a diagnosis of HAE.

Table 4. How participants reached a diagnosis of HAE.
Patient’s effort to seek a diagnosis paid off [Visible swelling] The patient finally found a doctor who knew about HAE by continuing visits to larger hospitals.
[Visible swelling] A friend who knew of the symptoms of the participant found an advertisement of HAE and mentioned it to the participant.
The diagnosis was made as an indirect result of seeking a way to deal with symptoms [Abdominal symptoms] During emergency transport, a patient showed a doctor a picture of a swollen limb and asked if it is related.
[Abdominal symptoms] Another HAE patient who was diagnosed before in the other area relocated and saw the hospital where the participant often visited.
[Abdominal symptoms and laryngeal swelling] The emergency department that the patient used to visit was notified of the HAE awareness campaign.
[Laryngeal swelling] At the hospital where the patient was brought for emergency treatment, doctors from all departments came together to examine the patient and made a diagnosis.
The patients were aware of the existence of HAE from a blood relative Blood relatives were suspected or diagnosed with HAE (2 cases).
The patient knew about HAE by himself Participant made a diagnosis for himself after when symptoms became typical for HAE.

[] indicates which symptoms specifically contributed to the episode that led to reaching an HAE diagnosis. HAE, hereditary angioedema.

Participants generally expressed positive feelings about receiving a diagnosis of HAE. First, they mostly felt delighted and relieved that a cause was found and that a treatment was available. Second, they felt concerns about their future life and their family (especially their children). They also experienced disappointment that they had not been given a correct diagnosis sooner. However, one participant said, “I am glad to have a correct diagnosis, but the diagnosis also increased my anxiety about the possibility of life-threatening HAE attacks. For me, it was probably a good thing to reach the diagnosis in that the treatment was recently established.”

(B-2) The undiagnosed periods after knowing about HAE

As special cases, two participants had learned of HAE but did not receive a diagnosis on their own soon. The experience of Participant F, an extreme exception among all participants, is described below.

In the case of Participant F, he learned the name of the disease before the onset of his own HAE symptoms, but it took approximately 35 years for him to be diagnosed. Participant F learned about HAE in a lecture when he was a student. At that time, he suspected that his father’s symptoms were caused by HAE and asked the professor a question; however, the professor denied the possibility that he had the disease, saying that HAE only affected women, which is not the case for HAE type 1 and 2. Later, Participant F himself became troubled by the symptoms of nasal congestion to the extent that he considered surgery when he was in his 50s, at which time, due to his profession, he saw a pharmaceutical company’s campaign to raise awareness about HAE. After that, he actively suspected that he had HAE and asked his doctor to test him for HAE before being prepped for surgery; however, because his symptoms were mainly nasal congestion, which is atypical for HAE, the doctor did not understand the urgency and importance of the test and did not proceed to perform the actual test. He went to several hospitals and departments to seek a doctor who understood HAE. He then experienced swelling in his face (this was his first swelling on the face), showed pictures of them to his doctor, and eventually received a diagnosis for HAE.

Discussion

Principal findings

This study revealed the details of experiences of patients with HAE during the undiagnosed period from various perspectives, such as their encounters with medical care and psychological conflicts. As a result, we identified two major factors that contributed to prolonged undiagnosed periods: (1) patients and medical professionals did not suspect an RD, and (2) patients and medical professionals failed to access the accurate information when they did suspect an RD (Fig 1). Among these factors, we consider the first factor to be of particular importance. As described in the Results section, many of the participants had been living with symptoms for years without being aware of the possibility of RD and then one day they suddenly learned about HAE and were diagnosed. However, a small number of participants continued to seek a diagnosis during the undiagnosed period.

Fig 1. Diagram illustrating problems leading to delayed diagnosis of rare diseases.

Fig 1

This finding (1) is consistent with the description of the EURODIS report. It pointed out that arriving at a correct diagnosis requires a crucial, but often difficult, step: a recognition that their disease is not one frequently encountered, but possibly an RD [8]. Also, based on our results, we reviewed other literature and found patient narratives from qualitative reports of Fabry’s disease and epidermolysis bullosa that described similar experiences. During the undiagnosed period, some patients were not suspected with the possibility of RDs when they visited the hospital, and they gradually became accustomed to the treatment they received and stopped going to the hospital [10, 31, 32]. However, these reports did not describe the detailed reasons regarding why it is difficult to suspect an RD. To better understand what happens during the undiagnosed period, careful analysis of the physical and psychological states of patients is required; to the best of our knowledge, our study is one of the internationally significant efforts in this direction and has revealed the details of patients’ experiences, struggles, and events during the undiagnosed period.

In Japan, the policy for medical research, such as the IRUD, has been launched for several years. IRUD claims that it has an established national network for rare and undiagnosed diseases diagnosis covering the entire geographic areas and specialty/subspecialty medical fields [33]. However, it would seem that this project and policy has focused on diagnosing patients who are “suspected” of having rare and intractable diseases. Thus, our study is significant in that it highlights the need to look at the stage that precedes “a suspicion of an RD.”

Why did HAE patients and their medical professionals not suspect an RD?

Why did neither the patients nor their medical professionals suspect an RD during the undiagnosed period? Our results show the following three obstacles: (1) medical professionals were not fully aware of the patient’s overall condition, (2) insufficient knowledge about RDs and lack of good partnership between medical professionals and patients, and (3) patients got used to the condition and stopped visiting the hospital. Below, we describe these obstacles in this order.

Medical professionals were not fully aware of the patient’s overall condition

This study showed that the consultation behavior of patients with HAE differs depending on the site of symptom’s onset. For visible swellings, patients questioned the cause and repeatedly visited hospitals (e.g., dermatology) until they eventually stopped their visits due to the belief that they would not get a clear answer. For abdominal symptoms, patients mainly expect treatments and continued visiting their usual hospitals depending on the extent of severity of the symptoms. This finding is consistent with a recent quantitative study of HAE which revealed that patients visited various department specialties depending on the site of swelling [27].

Considering this, we believe that there is a difference between the problems perceived by patients and the problems understood by medical professionals. Even if patients have questions about recurring physical problems, they may not think of the association of symptoms in different parts of the body. They may accept such symptoms as due to vague "physical weaknesses". Therefore, they visit hospitals mainly for problems in their daily lives. In medicine, diagnosis and treatment are made mostly based on symptoms in specific parts of the body and cared for by specialists in different departments. However, in the case of systemic RDs that develop symptoms in various parts of the body, the situation may be different. The diagnosis may be delayed if medical professionals do not take a systematic and comprehensive look at abnormalities with proper knowledge and suspicions of such diseases. This situation has been pointed out in previous articles about RDs; i.e., “seemingly unrelated symptoms” and “a lack of integrative provider education” are challenges that result in a diagnostic delay [34, 35].

This obstacle may be particularly noticeable in HAE. This is because HAE is characterized by large individual differences in symptoms, the possibility of symptoms occurring in multiple locations, and the fact that these symptoms overlap very closely with other common life symptoms.

Insufficient knowledge about RDs and lack of good partnership between medical professionals and patients

The results of this study also showed that patients often did not receive referrals to higher-order hospitals, even after several visits to the hospitals wondering about the cause of unexplained visible swelling or repeated visits to hospitals seeking treatment for abdominal symptoms.

One reason for these experiences may be a lack of knowledge among medical professionals, particularly in primary care. It has been demonstrated that there is a lack of awareness among physicians regarding HAE [36], and RDs in general [6, 37, 38].

Another reason is the problem of communication between medical professionals and patients [10]. For example, patients may have too much trust in the doctor’s judgment to actively question the diagnosis, even if their symptoms do not improve. It is also known that misdiagnoses were associated with delays that were twice as long as those reported by patients who were correctly diagnosed at the first instance [8].

Patients got used to the condition and stopped going to the hospital

This study also clarified that some HAE participants had stopped visiting the hospital after repeated visits. Our study presented several reasons for this: the participants either thought their physical problem was a small matter or stress-related, or they lost hope in the hospital. These experiences have been observed for other RDs as well. Many RD patients undergo psychological and psychiatric explanations or treatments [8, 39, 40]. In addition, previous research showed that some patients without a diagnosis experienced mistrust for the medical profession [12]. These reasons prevented patients from seeking another diagnosis. The less patients seek out medical consultations, the less of an opportunity there is for medical professionals to suspect an RD. This can also be considered as a cause of the prolonged undiagnosed period.

How can we shorten the diagnostic delay?

The difficulty in suspecting RD found in HAE may be a problem in the case of other RDs as well. Therefore, one key solution should be to establish a system with various stakeholders to appropriately suspect RDs in general. In this section, we will propose two concrete measures that would be necessary to achieve this: (1) improving awareness of RDs, and (2) establishing an improved medical system for diagnosis.

Improving awareness of RDs

As mentioned above, one factor that prevents patients and their medical professionals from suspecting RDs is the lack of recognition. However, it is difficult to make a correct diagnosis for the 10,000 RDs in all of the hospitals. Therefore, it is necessary to educate all medical professionals about the existence rather than precise diagnosis of "rare diseases" or diseases that are difficult to diagnose [10, 35, 41, 42]. Especially, all clinicians should be trained to be able to realize the possibility of RDs.

The results of this study also indicate the importance of raising awareness of RDs among patients and the public. It is because medical professionals may not be fully aware of their patient’s overall condition, and they may not be able to think of the possibility of RD. If patients understand these issues and act themselves, the possibility of suspecting an RD will increase. To raise awareness, other stakeholders such as mass media and pharmaceutical companies can play a key role.

Awareness of RDs will encourage patients and medical professionals to recall the suspicions regarding RDs at appropriate times. In this phase, collaboration between patients and medical professionals has been expected to contribute to the prevention of misdiagnoses [43]. If treatments are not effective, or if the cause of an abnormality is not explained at all, medical professionals must check if the patient has had such an experience before, or if the patient has any abnormalities in the body other than the symptom they are complaining of at the time [44]. Patients should also ask their doctors their question, for example, by using the checklist [35] to suspect if they have an RD.

Establishing an improved medical system for diagnosis

The improvement of medical systems is also an important issue. In this area, we expect to strengthen the coordination of the diagnostic processes. There are various ways to do this such as utilizing digital tools.

First, it is necessary to strengthen the coordination of diagnosis through policies and institution. Especially, coordination between local clinics and higher-order hospitals should be strengthened. It may be difficult for doctors at local clinics to determine which department to refer patients to even if they suspect the possibility of an RD. We need to establish centers that specialize in the diagnosis of RDs and consolidate patients suspected of having RDs.

Second, we can expect digital tools to facilitate the coordination process. For example, a questionnaire for differentiating patients with RDs from those of other disease groups, such as non-rare chronic or psychiatric diseases has been developed [45]. Also, AI tools for diagnostic support have already been developed to present possible RDs to patients who input their symptoms. These could be used to assist in arriving at a specific diagnosis [34, 46, 47].

Methodological limitations

This study has methodological limitations. Participant bias existed in the following two aspects. First, most of the participants in this study were in their 40s to 60s. With HAE, it is known that the average year of undiagnosed period differs by generation [22], due to the increased awareness in recent decades. When considering the circumstances surrounding the diagnosis of patients with HAE, the age at which the participants experienced the undiagnosed period is important. Therefore, this study may not capture the experiences of a younger generation of HAE patients. Second, many patients reported that their symptoms were worse than what is average for HAE patients. Among patients with relatively mild symptoms, the factors of prolonged undiagnosed period may differ from the findings of this study.

Conclusions

In this study, we explored the experiences of patients with HAE who had remained undiagnosed for a long period of time. We found that during the undiagnosed period of HAE, only a small number of participants continued to seek a diagnosis. Many of the participants had been living with symptoms for years without being aware of the possibility of RD. This led to a long undiagnosed delay.

Concerning the activities to shorten the undiagnosed period, the current policy tends to focus on the period from suspecting RDs to a clear diagnosis. However, this study suggested that it is also necessary to focus on how to suspect RDs.

In future research, the experiences of other RD patients need to be explored. If we conduct an interview survey on more diseases with long undiagnosed periods, we may be able to elucidate common characteristics of the diseases with long delay of diagnosis. Furthermore, since factors related to the prolonged undiagnosed period are influenced by the social and cultural backgrounds as well as the medical system of the country of residence [48], it may be necessary to conduct a more detailed analysis of social factors regarding the reasons as to why patients are unable to suspect an RD.

Supporting information

S1 File. Interview guide.

(PDF)

Acknowledgments

We thank all the interviewees who have participated in this study. We also thank the patients with HAE and specialists who helped with the recruitment. We gratefully acknowledge Dr. Michihiro Hide and Ms. Kate Nakasato for giving valuable feedback for a draft of this manuscript. Dr. Madison from Editage Group and Mr. Joshua Wittig are acknowledged for language editing a draft of this manuscript. A part of the result has been orally presented at the 32th Annual meeting of the Japan Association for Bioethics in Japanese in December 2020.

Data Availability

Data are not publicly available due to concerns of participant confidentiality. To allow public access to the data is in contradiction to the ethical agreement signed by participants and approved by the Osaka University Clinical Research Review Committee. Some of the aggregated data may be available with an approval of the Review Committee. The Osaka University Clinical Research Review Committee can be contacted at: rinri@hp-crc.med.osaka-u.ac.jp.

Funding Statement

KK: JP17K19812 Japan Society for the Promotion of Science Grants-in-Aid for Scientific Research (KAKENHI) https://www.jsps.go.jp/. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

References

  • 1.Ferreira CR. The burden of rare diseases. Am J Med Genet A. 2019;179: 885–892. doi: 10.1002/ajmg.a.61124 [DOI] [PubMed] [Google Scholar]
  • 2.Genetic Alliance UK; the Wilhelm Foundation; EURORDIS (Rare Diseases Europe); Rare Voices Australia (RVA); the Canadian Organization for Rare Disorders (CORD); the Advocacy Service for Rare and Intractable Diseases’ Stakeholders in Japan (ASrid); et al. Internet International joint recommendations to address specific needs of undiagnosed rare disease patients; 2016. International Joint Recommendations. [Cited 2022 Jan 26]. Available from: http://www.udninternational.org/documenti/schede/international_joint_recommendations.PDF. [Google Scholar]
  • 3.Zurynski Y, Deverell M, Dalkeith T, Johnson S, Christodoulou J, Leonard H, et al. Australian children living with rare diseases: Experiences of diagnosis and perceived consequences of diagnostic delays. Orphanet J Rare Dis. 2017;12: 68. doi: 10.1186/s13023-017-0622-4 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4.Shire. Internet. Rare Disease Impact Report: Insights from patients and the medical community. 2013. [Cited 2022 Jan 26]. Available from: https://globalgenes.org/wp-content/uploads/2013/04/ShireReport-1.pdf.
  • 5.Rare Disease UK. Internet. The Rare Reality–an insight into the patient and family experience of rare disease. [Cited 2022 Jan 26]. Available from: https://www.raredisease.org.uk/media/1588/the-rare-reality-an-insight-into-the-patient-and-family-experience-of-rare-disease.pdf.
  • 6.Engel PA, Bagal S, Broback M, Boice N. Physician and patient perceptions regarding physician training in rare diseases: The need for stronger educational initiatives for physicians. J Rare Disord. 2013;1: 1–15. [Google Scholar]
  • 7.Conradie EH, Malherbe H, Hendriksz CJ, Dercksen M, Vorster BC. An overview of benefits and challenges of rare disease biobanking in Africa, focusing on South Africa. Biopreserv Biobank. 2021;19: 143–150. doi: 10.1089/bio.2020.0108 [DOI] [PubMed] [Google Scholar]
  • 8.EURORDIS. Internet.The Voice of 12,000 Patients. 2009. [Cited 2022 Jan 26]. Available from: https://www.eurordis.org/IMG/pdf/voice_12000_patients/EURORDISCARE_FULLBOOKr.pdf.
  • 9.Black N, Martineau F, Manacorda T. Internet. Diagnostic odyssey for rare diseases: Exploration of potential indicators; 2015. [Cited 2022 Jan 26]. Available from: https://piru.ac.uk/assets/files/Rare%20diseases%20Final%20report.pdf PIRU: Policy Innovation Research Unit. [Google Scholar]
  • 10.Raremark. Internet. A new approach to shortening the diagnostic odyssey. 2017. [Cited 2022 Jan 26]. Available from: https://raremark.com/static/media/Raremark_Diagnostic+odyssey.d993c6bc.pdf.
  • 11.Wong SH, McClaren BJ, Archibald AD, Weeks A, Langmaid T, Ryan MM, et al. A mixed methods study of age at diagnosis and diagnostic odyssey for Duchenne muscular dystrophy. Eur J Hum Genet. 2015;23: 1294–1300. doi: 10.1038/ejhg.2014.301 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12.Kharrazi M, Kharrazi LD. Delayed diagnosis of cystic fibrosis and the family perspective. J Pediatr. 2005;147 Supplement: S21–S25. doi: 10.1016/j.jpeds.2005.08.011 [DOI] [PubMed] [Google Scholar]
  • 13.Gahl WA, Mulvihill JJ, Toro C, Markello TC, Wise AL, Ramoni RB, et al. The NIH Undiagnosed Diseases Program and Network: Applications to modern medicine. Mol Genet Metab. 2016;117: 393–400. doi: 10.1016/j.ymgme.2016.01.007 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.Taruscio D, Groft SC, Cederroth H, Melegh B, Lasko P, Kosaki K, et al. Undiagnosed Diseases Network International (UDNI): White paper for global actions to meet patient needs. Mol Genet Metab. 2015;116: 223–225. doi: 10.1016/j.ymgme.2015.11.003 [DOI] [PubMed] [Google Scholar]
  • 15.Beaulieu CL, Majewski J, Schwartzentruber J, Samuels ME, Fernandez BA, Bernier FP, et al. FORGE Canada consortium: Outcomes of a 2-year national rare-disease gene-discovery project. Am J Hum Genet. 2014;94: 809–817. doi: 10.1016/j.ajhg.2014.05.003 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16.Wright CF, Fitzgerald TW, Jones WD, Clayton S, McRae JF, Van Kogelenberg M, et al. Genetic diagnosis of developmental disorders in the DDD study: A scalable analysis of genome-wide research data. Lancet. 2015;385: 1305–1314. doi: 10.1016/S0140-6736(14)61705-0 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.Adachi T, Kawamura K, Furusawa Y, Nishizaki Y, Imanishi N, Umehara S, et al. Japan’s initiative on rare and undiagnosed diseases (IRUD): Towards an end to the diagnostic odyssey. Eur J Hum Genet. 2017;25: 1025–1028. doi: 10.1038/ejhg.2017.106 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18.Ministry of Health, Labour and Welfare, Health Service Bureau. Intractable/Rare Disease Control Division, Notification no. 0414–3; 2017 (Japanese). [Cited 2022 Jan 26]. Available from: https://www.mhlw.go.jp/file/05-Shingikai-10601000-Daijinkanboukouseikagakuka-Kouseikagakuka/0000170350.pdf.
  • 19.Maurer M, Magerl M, Betschel S, Aberer W, Ansotegui I, Aygören-Pürsün E, et al. The international WAO/EAACI guideline for the management of hereditary angioedema—the 2021 revision and update [published online ahead of print, 2022 Jan 10]. Allergy. 2022;10.1111/all.15214. doi: 10.1111/all.15214 [DOI] [PubMed] [Google Scholar]
  • 20.Ohsawa I, Honda D, Nagamachi S, Hisada A, Shimamoto M, Inoshita H, et al. Clinical manifestations, diagnosis, and treatment of hereditary angioedema: Survey data from 94 physicians in Japan. Ann Allergy Asthma Immunol. 2015;114: 492–498. doi: 10.1016/j.anai.2015.03.010 [DOI] [PubMed] [Google Scholar]
  • 21.Roche O, Blanch A, Caballero T, Sastre N, Callejo D, López-Trascasa M. Hereditary angioedema due to C1 inhibitor deficiency: Patient registry and approach to the prevalence in Spain. Ann Allergy Asthma Immunol. 2005;94: 498–503. doi: 10.1016/S1081-1206(10)61121-0 [DOI] [PubMed] [Google Scholar]
  • 22.Jolles S, Williams P, Carne E, Mian H, Huissoon A, Wong G, et al. A UK national audit of hereditary and acquired angioedema. Clin Exp Immunol. 2014;175: 59–67. doi: 10.1111/cei.12159 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 23.Zanichelli A, Magerl M, Longhurst H, Fabien V, Maurer M. Hereditary angioedema with C1 inhibitor deficiency: Delay in diagnosis in Europe. Allergy Asthma Clin Immunol. 2013;9: 29. doi: 10.1186/1710-1492-9-29 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24.Bork K, Hardt J, Witzke G. Fatal laryngeal attacks and mortality in hereditary angioedema due to C1-INH deficiency. J Allergy Clin Immunol. 2012;130: 692–697. doi: 10.1016/j.jaci.2012.05.055 [DOI] [PubMed] [Google Scholar]
  • 25.Nagata I, Yoshida A, Tanaka K, Ono F. [A case of hereditary angioedema causing cardiopulmonary arrest arising from asphyxia because of laryngeal edema]. Nihon Kyukyu Igakukai Zasshi [Journal of Japanese Association for Acute Medicine]. 2012;23: 21.e5. in Japanese. [Google Scholar]
  • 26.Shibuya M, Takahashi N, Yabe M, Iwamoto K, Hide M. Hereditary angioedema as the cause of death from asphyxia: Postmortem computed tomography study. Allergol Int. 2014;63: 493–494. doi: 10.2332/allergolint.13-LE-0655 [DOI] [PubMed] [Google Scholar]
  • 27.Iwamoto K, Yamamoto B, Ohsawa I, Honda D, Horiuchi T, Tanaka A, et al. The diagnosis and treatment of hereditary angioedema patients in Japan: A patient reported outcome survey. Allergol Int. 2021;70: 235–243. doi: 10.1016/j.alit.2020.09.008 [DOI] [PubMed] [Google Scholar]
  • 28.Hamakawa N, Kogetsu A, Isono M, Yamasaki C, Manabe S, Takeda T, et al. The practice of active patient involvement in rare disease research using ICT: Experiences and lessons from the RUDY JAPAN project. Res Involv Engagem. 2021;7: 9. doi: 10.1186/s40900-021-00253-6 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 29.Bengtsson M. How to plan and perform a qualitative study using content analysis. NursingPlus Open. 2016;2: 8–14. doi: 10.1016/j.npls.2016.01.001 [DOI] [Google Scholar]
  • 30.Maxwell JA. Using numbers in qualitative research. Qual Inq. 2010;16: 475–482. doi: 10.1177/1077800410364740 [DOI] [Google Scholar]
  • 31.Bouwman MG, de Ru MH, Linthorst GE, Hollak CEM, Wijburg FA, van Zwieten MCB. Fabry patients’ experiences with the timing of diagnosis relevant for the discussion on newborn screening. Mol Genet Metab. 2013;109: 201–207. doi: 10.1016/j.ymgme.2013.03.008 [DOI] [PubMed] [Google Scholar]
  • 32.Toda M. [The period without a diagnosis of 44 years experienced by an epidermolysis bullosa patient Home Health Care for the People with Intractable Diseases]. Nanbyo to Zaitakukea [Home Health Care for the People with Intractable Diseases] 2020;25(12);20–3. in Japanese. [Google Scholar]
  • 33.Takahashi Y, Mizusawa H. Initiative on Rare and Undiagnosed Disease in Japan. JMA J. 2021;4: 112–118. doi: 10.31662/jmaj.2021-0003 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 34.Brenna CTA. The journey to ancient ithaca: Addressing the diagnostic odyssey of rare disease through systems-level interventions. UTMJ. 2020;97: 37–39. [Google Scholar]
  • 35.GLOBAL COMMISSION. Ending the Diagnostic Odyssey. [Cited 2022 Jan 26]. Available from: https://www.globalrarediseasecommission.com/Report/.
  • 36.Ohsawa I, Nagamachi S, Kusaba G, Ishii M, Sato N, Onda K, et al. Tomino Y. Hereditary angioedema recognition survey in Japan. Pharm Med. 2011;29: 109–118. in Japanese. [Google Scholar]
  • 37.Domaradzki J, Walkowiak D. Medical students’ knowledge and opinions about rare diseases: A case study from Poland. Intractable Rare Dis Res. 2019;8: 252–259. doi: 10.5582/irdr.2019.01099 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 38.Ts Miteva, Jordanova R, Iskrov G, Stefanov R. General knowledge and awareness on rare diseases among general practitioners in Bulgaria. Georgian Med News. 2011;(193): 16–19. [PubMed] [Google Scholar]
  • 39.Blöß S, Klemann C, Rother AK, Mehmecke S, Schumacher U, Mücke U, et al. Diagnostic needs for rare diseases and shared prediagnostic phenomena: Results of a German-wide expert Delphi survey. PLOS ONE. 2017;12: e0172532. doi: 10.1371/journal.pone.0172532 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 40.Nunn R. “it’s not all in my head!”—The complex relationship between rare diseases and mental health problems. Orphanet J Rare Dis. 2017;12: 29. doi: 10.1186/s13023-017-0591-7 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 41.Department of Health and Social Care Publication. The UK Strategy for Rare Diseases. Department of Health and Social Care Publication; 2013. [Google Scholar]
  • 42.Research Science and Directorate Evidence, Department of Health and Social Care. The UK Rare Diseases Framework (January); 2021. [Google Scholar]
  • 43.McDonald KM, Bryce CL, Graber ML. The patient is in: patient involvement strategies for diagnostic error mitigation. BMJ Qual Saf. 2013;22 Supplement 2: ii33–ii39. doi: 10.1136/bmjqs-2012-001623 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 44.Evans WRH, Rafi I. Rare diseases in general practice: Recognising the zebras among the horses. Br J Gen Pract. 2016;66: 550–551. doi: 10.3399/bjgp16X687625 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 45.Grigull L, Mehmecke S, Rother AK, Blöß S, Klemann C, Schumacher U, et al. Common pre-diagnostic features in individuals with different rare diseases represent a key for diagnostic support with computerized pattern recognition? PLOS ONE. 2019;14: e0222637. doi: 10.1371/journal.pone.0222637 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 46.Ronicke S, Hirsch MC, Türk E, Larionov K, Tientcheu D, Wagner AD. Can a decision support system accelerate rare disease diagnosis? Evaluating the potential impact of Ada DX in a retrospective study. Orphanet J Rare Dis. 2019;14: 69. doi: 10.1186/s13023-019-1040-6 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 47.Svenstrup D, Jørgensen HL, Winther O. Rare disease diagnosis: A review of web search, social media and large-scale data-mining approaches. Rare Dis. 2015;3: e1083145. doi: 10.1080/21675511.2015.1083145 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 48.Dong D, Chung RY-N, Chan RHW, Gong S, Xu RH. Why is misdiagnosis more likely among some people with rare diseases than others? Insights from a population-based cross-sectional study in China. Orphanet J Rare Dis. 2020;15: 307. doi: 10.1186/s13023-020-01587-2 [DOI] [PMC free article] [PubMed] [Google Scholar]

Decision Letter 0

Girijesh Kumar Patel

13 Dec 2021

PONE-D-21-28571Why does it take so long for rare disease patients to get an accurate diagnosis? - A qualitative investigation of patient experiences of hereditary angioedemaPLOS ONE

Dear Dr. Kato,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

Based on the reviewer's comments and careful evaluation, this manuscript need minor revision.

Please submit your revised manuscript by Jan 27 2022 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: https://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols.

We look forward to receiving your revised manuscript.

Kind regards,

Girijesh Kumar Patel, PhD

Academic Editor

PLOS ONE

Journal requirements:

1. When submitting your revision, we need you to address these additional requirements.

Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at

https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and

https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf

2. Pease provide the interview guide used as a Supplementary File.

3. We note that the grant information you provided in the ‘Funding Information’ and ‘Financial Disclosure’ sections do not match. When you resubmit, please ensure that you provide the correct grant numbers for the awards you received for your study in the ‘Funding Information’ section.

4. In your Data Availability statement, you have not specified where the minimal data set underlying the results described in your manuscript can be found. PLOS defines a study's minimal data set as the underlying data used to reach the conclusions drawn in the manuscript and any additional data required to replicate the reported study findings in their entirety. All PLOS journals require that the minimal data set be made fully available. For more information about our data policy, please see http://journals.plos.org/plosone/s/data-availability.

Upon re-submitting your revised manuscript, please upload your study’s minimal underlying data set as either Supporting Information files or to a stable, public repository and include the relevant URLs, DOIs, or accession numbers within your revised cover letter. For a list of acceptable repositories, please see http://journals.plos.org/plosone/s/data-availability#loc-recommended-repositories. Any potentially identifying patient information must be fully anonymized.

Important: If there are ethical or legal restrictions to sharing your data publicly, please explain these restrictions in detail. Please see our guidelines for more information on what we consider unacceptable restrictions to publicly sharing data: http://journals.plos.org/plosone/s/data-availability#loc-unacceptable-data-access-restrictions. Note that it is not acceptable for the authors to be the sole named individuals responsible for ensuring data access

We will update your Data Availability statement to reflect the information you provide in your cover letter.

5. Please include your full ethics statement in the ‘Methods’ section of your manuscript file. In your statement, please include the full name of the IRB or ethics committee who approved or waived your study, as well as whether or not you obtained informed written or verbal consent. If consent was waived for your study, please include this information in your statement as well.

Please review your reference list to ensure that it is complete and correct. If you have cited papers that have been retracted, please include the rationale for doing so in the manuscript text, or remove these references and replace them with relevant current references. Any changes to the reference list should be mentioned in the rebuttal letter that accompanies your revised manuscript. If you need to cite a retracted article, indicate the article’s retracted status in the References list and also include a citation and full reference for the retraction notice.

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

Reviewer #2: Yes

**********

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: N/A

Reviewer #2: N/A

**********

3. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

**********

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

**********

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: Dear Authors,

First of all, I would like to congratulate and thank you for addressing the problem of such a complex and heterogeneous subject. The language of the manuscript is scientific, unambiguous, and explicit. The whole manuscript is highly engaging for me as a reviewer and an ordinary person from the masses. I am sure this information would add some new knowledge to the scientific field as well as this manuscript may guide some readers who may have HAE.

Here, there are some suggestions from my side:

1-Authors may add a table of the rare diseases which are hard to diagnose and and have no specific symptoms.

2-It would be great if the authors put a little bit of emphasis on diagnosing rare diseases in low and middle-income countries, too, as they face different challenges like socio-economic, limited resources, lack of data services, and competing for health priorities.

3-In this manuscript, a paragraph describes the recent and current projects and policies in different developed countries (from lines 66 to 77) to address this issue. Some developing countries where rare diseases are mishandled because of the diagnostic issues have started taking the initiative to address this problem. Ministry of Health and Family Welfare, Government of India formulated a National Policy for Treatment of Rare Diseases (NPTRD) in July 2017. A group of volunteers created a not-for-profit organization named Organization for Rare Diseases India (ORDI; www.ordindia.org). The North-West University's Centre for Human Metabolomics (CHM) establishes the first rare disease (RD) biobank in South Africa and Africa. The author may add information about some of these policies.

Specific suggestions about HAE:

1-There should be a little more description about the HAE, mainly different types of HAE (type I, II, and III), the possible genetic and molecular alteration and damage mechanism, and symptoms of each type.

2-Authors may add the information about the difference between acquired angioedema and HAE to clear the confusion between the two.

5-Authors may add some information if HAE is specific to any ethnicity or race.

6-The methodologies are excellent, but I found the sample size very small; I know it is a rare disease, so collecting many samples is challenging. My suggestion for the authors (for the future) is to collaborate with other countries like India, Iran, and South Africa, where many patients are diagnosed with HAE and information is available. I am not sure if it is possible or not.

6-Authors may add some of the clinical reports of the interviewees

7-Authors may add the information about specific blood tests to confirm Hereditary Angioedema Type I, II, or III.

General minor concerns:

1-There are some space issues, which may be formatted very quickly, for example, line 627.

2-The heading in line 542 needs to be corrected.

Reviewer #2: Working in the field of rare diseases is a challenge due to low sample number and delayed diagnosis. In this aspect, authors have made good and repeated effort in collecting/enrolling the hereditary angioedema rare disease patients in the survey. The overall findings of this qualitative study are interesting, especially the possible reasons for delay in the diagnosis of rare diseases. The approaches reported by patients in this study could be followed by other rare disease patients with challenges of diagnosis.

That being said, I would have been more favorable for this article if the authors included similar studies on at least another one rare disease to see the generality of findings of this study. I believe, even though this is only a qualitative study, the interpretations from patient survey in this study will provide important directions to other patients with rare diseases.

**********

6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: Yes: sabiha khatoon

Reviewer #2: Yes: Subash Kairamkonda

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

PLoS One. 2022 Mar 18;17(3):e0265847. doi: 10.1371/journal.pone.0265847.r002

Author response to Decision Letter 0


6 Feb 2022

Dear Dr. Patel:

Thank you for inviting us to submit a revised draft of our manuscript. We also appreciate the time and effort you and the reviewers have dedicated to providing insightful feedback on ways to strengthen our paper.

We have responded to all the individual comments by the reviewers in a point-by-point fashion. Responses are indicated with blue colored font. In addition, we found two errors in the expressions in Table 4 and have corrected them. The article has undergone a round of proof-reading by a professional language editing service to improve the language, grammar, and overall tone of the manuscript. We apologize for the inconvenience caused as a result of us making corrections after the peer review.

We hope that the manuscript is positively received by the reviewers and editors.

Thank you very much for your consideration.

Sincerely,

Kazuto Kato

(Please note that the page and line numbers in our response correspond to those shown in the manuscript in our computer. They may slightly change depending on the computer environment.)

Reviewer #1

1. Authors may add a table of the rare diseases which are hard to diagnose and have no specific symptoms.

Thank you for your suggestion. It would have been interesting to explore this aspect, but, unfortunately, after considering the possibility of preparing a table of rare diseases that are hard to diagnose and have no specific symptoms, we reached a conclusion that it would not be possible to tabulate this information, due to two reasons. First, it is difficult to define ‘rare diseases which are hard to diagnose’. It is known that most rare diseases are difficult to diagnose. Even if we understand it as ‘rare diseases with long reported periods of not being diagnosed’, we are faced with the problem that there is no uniform definition of the undiagnosed days (i.e.,. the definition of start and end points, whether the time period is calculated using the mean or median). Second, we also think that it is difficult to select rare diseases that have no specific, identifying symptoms. Many rare diseases are said to share symptoms with ‘common’ diseases. In addition, each patient suffering from the same rare disease can have a multitude of different signs and symptoms. We believe it is important to clarify which diseases are difficult to diagnose so that more attention is given to them. Consequently, we hope we will be able to tackle these issues in the future work.

2. It would be great if the authors put a little bit of emphasis on diagnosing rare diseases in low and middle-income countries, too, as they face different challenges like socio-economic, limited resources, lack of data services, and competing for health priorities.

Thank you for highlighting this important point. We have added this information about developing countries and regions in the revised manuscript (lines 57–59).

3. In this manuscript, a paragraph describes the recent and current projects and policies in different developed countries (from lines 66 to 77) to address this issue. Some developing countries where rare diseases are mishandled because of the diagnostic issues have started taking the initiative to address this problem. Ministry of Health and Family Welfare, Government of India formulated a National Policy for Treatment of Rare Diseases (NPTRD) in July 2017. A group of volunteers created a not-for-profit organization named Organization for Rare Diseases India (ORDI; www.ordindia.org). The North-West University's Centre for Human Metabolomics (CHM) establishes the first rare disease (RD) biobank in South Africa and Africa. The author may add information about some of these policies.

We appreciate your comment on this point. We have accordingly added the description to the revised manuscript (lines 68–75).

Specific suggestions about HAE

1. There should be a little more description about the HAE, mainly different types of HAE (type I, II, and III), the possible genetic and molecular alteration and damage mechanism, and symptoms of each type.

We thank you for this comment. We agree that this point requires additional clarification and have consequently added the information to the revised manuscript (lines 102–112, 115–116). However, we have kept the description of type 3 (i.e., HAE with normal C1-INH function) to a minimum. Type 3 is a very rare form of hereditary angioedema and is not diagnosed by C1-INH activity, so our study does not cover it.

2. Authors may add the information about the difference between acquired angioedema and HAE to clear the confusion between the two.

We appreciate your comment. We have accordingly added an explanation about acquired angioedema in the section describing HAE. (lines 110–112).

3. Authors may add some information if HAE is specific to any ethnicity or race.

Thank you for the valid query. We have added the relevant information to the revised manuscript (108–109).

4. The methodologies are excellent, but I found the sample size very small; I know it is a rare disease, so collecting many samples is challenging. My suggestion for the authors (for the future) is to collaborate with other countries like India, Iran, and South Africa, where many patients are diagnosed with HAE and information is available. I am not sure if it is possible or not.

We agree that gathering additional information, as you suggested, would be valuable. It would be a very good idea to carry out collaborations with medical professionals and patients in those countries. For our present work, however, we do not think that it is possible to carry out these collaborations in a short time, particularly, because we do not have any connections with HAE specialists and patients with HAE in other countries. We would definitely like to consider this as a direction for future research.

5. Authors may add some of the clinical reports of the interviewees.

We appreciate your suggestion. We would like to point out is that in this study the interviewees were patients who self-reported their HAE, and we did not collect detailed clinical information. However, we have added some additional information about the severity of the symptoms experienced by each patient (Table 1).

6. Authors may add the information about specific blood tests to confirm Hereditary Angioedema Type I, II, or III.

Thank you for the comment. We agree with you and recognize the importance of describing the information about the diagnostic tests for HAE. However, we believe it is important to point out that some of the diagnostic criteria set out in Japan do not necessarily correspond to those set out by the World Allergy Organization (WAO) in collaboration with the European Academy of Allergy and Clinical Immunology (EAACI). In other words, it is our humble opinion and belief that incorporating the precise and detailed information on this aspect is not feasible because it is not directly relevant to the main purpose and scope of this study. Therefore, we decided not to include the information about blood tests. We hope that you can understand our viewpoint.

General minor concerns

1. There are some space issues, which may be formatted very quickly, for example, line 627.

Thank you for pointing it out. We have made the necessary change.

2. The heading in line 542 needs to be corrected.

This error has been corrected in accordance with your comment (line 565).

Reviewer #2

Working in the field of rare diseases is a challenge due to low sample number and delayed diagnosis. In this aspect, authors have made good and repeated effort in collecting/enrolling the hereditary angioedema rare disease patients in the survey. The overall findings of this qualitative study are interesting, especially the possible reasons for delay in the diagnosis of rare diseases. The approaches reported by patients in this study could be followed by other rare disease patients with challenges of diagnosis.

That being said, I would have been more favorable for this article if the authors included similar studies on at least another one rare disease to see the generality of findings of this study. I believe, even though this is only a qualitative study, the interpretations from patient survey in this study will provide important directions to other patients with rare diseases.

You have raised a crucial point. We agree that there is a need to demonstrate whether the results can be generalized to other diseases. As one of our future research works, we think that we should plan a research project on this issue, but unfortunately, for our current work, it would be difficult to conduct an additional research in a short time. We therefore reviewed the previous literature based on the results of our study. As a result, we found patient narratives from qualitative reports of Fabry's disease and epidermolysis bullosa that described similar experiences. Based on this, the description in the Discussion section has been modified (lines 453–457 of the revised manuscript). In a future study, we would like to investigate the generalizability of our findings to other diseases. Thank you for your valuable comment.

There has been substantial modification to the paper in line with the reviewers’ suggestions, and I hope that the paper will benefit from these revisions. Once again, we thank you for the time you put in reviewing our paper and look forward to meeting your expectations.

Attachment

Submitted filename: Response to Reviewers.docx

Decision Letter 1

Girijesh Kumar Patel

9 Mar 2022

Why does it take so long for rare disease patients to get an accurate diagnosis? - A qualitative investigation of patient experiences of hereditary angioedema

PONE-D-21-28571R1

Dear Dr. Kato,

We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements.

Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication.

An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at http://www.editorialmanager.com/pone/, click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org.

If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

Kind regards,

Girijesh Kumar Patel, PhD

Academic Editor

PLOS ONE

Additional Editor Comments (optional):

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation.

Reviewer #1: All comments have been addressed

Reviewer #2: All comments have been addressed

**********

2. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

Reviewer #2: Yes

**********

3. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

Reviewer #2: N/A

**********

4. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

**********

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

**********

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: Dear Authors.

Thank you all for addressing all suggestions and concerns specified by me. I want to congratulate and thank you all for writing such an informative report after reading the current version of the manuscript. According to my view your manuscript is of very highly importance and ready to publish.

Reviewer #2: The authors have addressed all the comments and concerns of reviewers to satisfaction. The language edits have improved the manuscript's readability and made it easy to understand for the readers.

**********

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: Yes: Sabiha Khatoon

Reviewer #2: Yes: Subash Kairamkonda

Acceptance letter

Girijesh Kumar Patel

11 Mar 2022

PONE-D-21-28571R1

Why does it take so long for rare disease patients to get an accurate diagnosis? - A qualitative investigation of patient experiences of hereditary angioedema

Dear Dr. Kato:

I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department.

If your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org.

If we can help with anything else, please email us at plosone@plos.org.

Thank you for submitting your work to PLOS ONE and supporting open access.

Kind regards,

PLOS ONE Editorial Office Staff

on behalf of

Dr. Girijesh Kumar Patel

Academic Editor

PLOS ONE

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Supplementary Materials

    S1 File. Interview guide.

    (PDF)

    Attachment

    Submitted filename: Response to Reviewers.docx

    Data Availability Statement

    Data are not publicly available due to concerns of participant confidentiality. To allow public access to the data is in contradiction to the ethical agreement signed by participants and approved by the Osaka University Clinical Research Review Committee. Some of the aggregated data may be available with an approval of the Review Committee. The Osaka University Clinical Research Review Committee can be contacted at: rinri@hp-crc.med.osaka-u.ac.jp.


    Articles from PLoS ONE are provided here courtesy of PLOS

    RESOURCES