Skip to main content
PLOS One logoLink to PLOS One
. 2023 Feb 9;18(2):e0281686. doi: 10.1371/journal.pone.0281686

Ear, Nose and Throat (ENT) disease diagnostic error in low-resource health care: Observations from a hospital-based cross-sectional study

Lufunda Lukama 1,2,*, Colleen Aldous 2, Charles Michelo 3,4, Chester Kalinda 5,6
Editor: Jorge Spratley7
PMCID: PMC9910637  PMID: 36758061

Abstract

Although the global burden of ear, nose and throat (ENT) diseases is high, data relating to ENT disease epidemiology and diagnostic error in resource-limited settings remain scarce. We conducted a retrospective cross-sectional review of ENT patients’ clinical records at a resource-limited tertiary hospital. We determined the diagnostic accuracy and appropriateness of patient referrals for ENT specialist care using descriptive statistics. Cohens kappa coefficient (κ) was calculated to determine the diagnostic agreement between non-ENT clinicians and the ENT specialist, and logistic regression applied to establish the likelihood of patient misdiagnosis by non-ENT clinicians. Of the 1543 patients studied [age 0–87 years, mean age 25(21) years (mean(SD)], non-ENT clinicians misdiagnosed 67.4% and inappropriately referred 50.4%. Compared to those aged 0–5 years, patients aged 51–87 years were 1.77 (95%CI: 1.03–3.04) fold more likely to have a referral misdiagnosis for specialist care. Patients with ear (aOR: 1.63; 95% CI: 1.14–2.33) and those with sinonasal diseases (aOR: 1.80; 95% CI: 1.14–2.45) had greater likelihood of referral misdiagnosis than those with head and neck diseases. Agreement in diagnosis between the ENT specialist and non-ENT clinicians was poor (κ = 0.0001). More effective, accelerated training of clinicians may improve diagnostic accuracy in low-resource settings.

Introduction

Diseases affecting the ear, nose and throat (ENT) constitute 20–50% of disorders treated at health facilities [1]. In most resource-limited settings, they are associated with poor outcomes [2]. Despite their high prevalence, ENT diseases have been disregarded in global health [3]. In Zambia and other developing countries, ENT health care is poorly funded and has inadequate infrastructure, equipment, medication, human resources and training facilities [4, 5]. The few available ENT specialists are distributed to limited overwhelmed urban units. Thus, most ENT patients are treated by clinicians not trained in ENT disease management [4]. Although these clinicians must be competent in the basic management of ENT conditions, many countries have deemed them inadequately trained to treat ENT diseases [6]. As a result, the true incidence of diagnostic error (delayed, missed or wrong diagnosis) [7] and inappropriate or late ENT patient referrals for treatment among non-ENT clinicians is likely high.

Diagnostic error contributes up to 70% of all medical errors [8]. In well-resourced countries, the incidence of diagnostic error varies between 0.7 to 15%, of which half is harmful [9, 10]. However, in low-resource settings, data relating to harmful diagnostic error remains sparse due to limited access to diagnostic resources, shortage of qualified medical professionals and poverty of electronic record-keeping systems [11]. While inappropriate referral of patients can undermine the quality of patient care [12], misdiagnosis increases the risk of death, elevates the financial strain on the already stretched health systems and may result in significant litigation [13]. In Zambia, there has not been an investigation into the prevalence and impact of diagnostic errors in health facilities.

In this study, we determined the diagnostic accuracy and estimated the appropriateness of referrals among patients treated at Zambia’s highest ENT treatment facility. In addition, we determined the level of agreement of ENT diagnoses between the ENT specialist and referring clinicians.

Methods

Design and setting

We conducted a retrospective cross-sectional review of clinical case records of patients presenting to the University Teaching Hospitals (UTH) ENT outpatient clinic in Zambia between 1 July 2019 and 30 October 2019. Patients were referred by non-ENT clinicians from different health facilities in other regions of the country. A more comprehensive retrospective review was not practical as most of the patients’ records that were supposed to be filed before July 2019 and later than October 2019 could not be traced due to poor record-keeping, a general problem noted in Zambia [14]. The trial filing system used between July 2019 and October 2019 improved patient record-keeping in the absence of an electronic filing system.

The UTH complex of hospitals is Zambia’s highest referral health facility, with its only ENT clinic receiving referrals from the country’s 10 provinces of 18.5 million people [15]. Until August 2019, it was the country’s only public health facility with an ENT specialist. In Zambia, the patient referral pathway ascends from health centres, clinics, level 1 (first level) hospitals, level 2 (second level) hospitals and level 3 (third level) hospitals. Level 1 hospitals manage the most basic, level 2 hospitals intermediate-level and level 3 hospitals the most complex medical conditions [16]. Clinics and level 1 hospitals have basic laboratory and imaging equipment (ultrasound, x-ray) while higher-level hospitals have advanced diagnostic facilities.

Participant selection and sampling

Initially, using hardcopy registers, we identified and retrieved files of all 1,873 patients presenting to the facility within the study period. A two-phase screening process followed, in which records to be included in the final analysis were isolated. Phase 1 excluded all duplicates, leaving 1,701 files. In phase 2, we screened the 1,701 medical records for completeness, including the dates of presentation and referral information (referral centre, diagnosis, and reason for referral). We excluded records with missing referral information and used the remaining 1,543 records for analysis.

Measurements and outcomes

Our study outcome measures were the patient’s non-ENT clinician (referral) diagnosis and that of the ENT specialist. The considered ENT specialist diagnosis was that made after investigating the patient as applicable (definitive or final diagnosis). We considered similar diagnoses ‘matching’ and marked missing diagnoses ‘unknown’ because we assumed that the clinician did not know it by not assigning a diagnosis to the patient. Queried diagnoses made by the referring clinicians and the ENT specialist were assumed definite because they often fall within the broad category of the actual patient pathology, as has been the principal researcher’s experience. With further assumption that the ENT specialist diagnoses were correct, patient referral diagnoses which did not match the ENT specialists’ were classified ‘misdiagnoses’. The International Classification of Disease 11th Revision (ICD11) was used for ENT diagnoses whenever appropriate. For this study, we defined ‘inappropriate referral’ according to Blundel et al. [17]. A referral was inappropriate if it was either unnecessary (all available primary care options had not been exhausted), and/or had a wrong referral destination (patient referred to ENT instead of another medical speciality), and/or was of poor quality (necessary tests and investigations were not performed considering the available resources of the referring facility).

Data collection and statistical considerations

For data abstraction and collection, we utilized Microsoft excel soft copies of a standardized data collection tool (S1 Appendix). We recorded the patient’s demographic and clinical characteristics, including the patient’s date of the hospital visit, age, sex, town, and province of residence and that referred from, referring facility and its level of care, referral diagnosis, the reason for referral, ENT specialist diagnosis and whether the patient was a first attendant, had new pathology or was for review.

We analysed the data using STATA version 15.0 (STATA Corp, Texas, USA). Descriptive statistics (frequencies, percentages) were used to summarise categorical data and describe patient socio-demographic characteristics, referral and ENT specialist diagnoses, epidemiological disease profiles and prevalence of misdiagnosis and inappropriate patient referrals. Using bivariate analysis, we explored the association between socio-demographic characteristics and referral hospital characteristics with the diagnosis made and the appropriateness of the referral. We used univariate and multivariate logistic regression to determine factors that influenced the clinician diagnosis and appropriateness of referral. Statistical significance was defined by p < 0.05. In addition, we determined the level of agreement of the referring facility diagnosis and that made by the ENT specialist at UTH using the Cohens kappa coefficient (κ). This manuscript was written using the STROBE checklist for cross-sectional studies [18] (S2 Appendix).

Ethics

The protocol and procedures of this study were approved by the University of KwaZulu-Natal Biomedical Research Ethics Committee (Ref: BREC/00001984/2020) following the South African national guidelines on Biomedical Research. In addition, ethics approval was obtained from the University of Zambia Biomedical Research Ethics Committee (Ref: REF. NO. 1380–2020) and the Zambia National Health Research Authority (Ref: NHRA00007/15/03/2021). Informed consent was waived by the Ethics Boards as the research was of minimal risk to the patients. Gatekeeper permission to conduct the study was obtained from UTH [no Reference number]. All data was fully anonymised following completion of the study. The study was cleared for publication by the Zambia National Health Research Authority (NHRA).

Results and analysis

Patient demographics

1543 patients of age 0–87 years (mean age 25 ± 21 years [mean ± SD]) were included in the study, comprising 47.3% (n = 729) children (≤18 years of age) and 52.7% (n = 814) adults. The male: female patient ratio was 1:1.1 (725 males and 818 females). 88.9% (n = 1372) were health facility referrals while 11.1% (n = 171) were self-referrals.

ENT disease epidemiology

Head and neck diseases (34.8%, n = 537) were the most predominant, followed by sinonasal (34.4%, n = 530), and ear (25.7%, n = 397) diseases (S1 Table). The most frequently treated diseases were acute pharyngotonsillitis (9.5%, n = 146), allergic rhinitis (9.1%, n = 140), chronic/recurrent pharyngotonsillitis (7.8%, n = 121), adenoid hypertrophy (6.4%, n = 99) and chronic otitis media (COM) [6.3%, n = 97].

Diagnosis accuracy and mismatch

Overall, 67.4% (n = 916) of all referral diagnoses did not match the ENT specialists’. Most (36.5%, n = 333) of the misdiagnosed patients had sinonasal diseases and the least (26.2%, n = 239) had ear diseases. Further, the majority (25.1%, n = 230) of misdiagnosed patients were aged 0–5 years, while the minority (4.4%, n = 40) were aged 13–18 years. Most (74.1%, n = 80) misdiagnoses were from level 1 hospitals (S2 Table). Despite non-ENT clinicians correctly diagnosing 72.0% (n = 18) of nasal polyps and 51.5% (n = 35) of acute tonsillitis in patients referred for specialist care, only 3.3% (n = 4) of them correctly diagnosed allergic rhinitis. Table 1 outlines the common diagnoses made by the ENT specialist at UTH ENT clinic, and proportions of their corresponding referring (non-ENT) clinician diagnoses.

Table 1. Disease diagnosis comparison between ENT specialist and non-ENT clinicians.

ENT specialist diagnosis Non-ENT clinician diagnosis of the disease
Disease, n (%)
n*
Allergic rhinitis 120 No diagnosis indicated 38 (31.7) Sinusitis 19 (15.8) Nasal polyps# 15 (12.5) Adenoid hypertrophy 9 (7.5) Nasal tumour 5 (4.2) Allergic rhinitis 4 (3.3)
Adenoid hypertrophy 90 No diagnosis indicated 34 (37.7) Adenoid hypertrophy 17 (18.9) Tonsillitis 17 (18.9) Nasal polyps 6 (6.7) palatine tonsillar hypertrophy 4 (4.4) Sinusitis 3 (3.3)
Chronic otitis media 87 Chronic otitis media 37 (42.5) No diagnosis indicated 22 (25.3) Hearing loss, unspecified cause 11 (12.6) Acute otitis media 7 (8.0) Others 10 (11.5) (each with n = 1, 1.1%) -
Acute tonsillitis 68 Acute tonsillitis 35 (51.5) Adenoid or tonsillar hypertrophy 8 (11.8) Chronic tonsillitis 7 (10.3) No diagnosis indicated 6 (8.8) Acute pharyngitis 4 (5.9) Others 8 (11.8) (each with n = 1, 1.5%)
Laryngo-pharyngeal reflux 47 No diagnosis indicated 17 (36.2) Chronic pharyngo-tonsillitis 7 (14.9) Acute pharyngo-tonsillitis 7 (14.9) Laryngo-pharyngeal reflux 2 (4.3) Laryngeal tumour 2 (4.3) Laryngeal tumour 2 (4.3)
Ear wax occlusion 46 Hearing loss, unspecified cause 18 (39.1) No diagnosis indicated 11 (23.9) Otitis media 8 (17.4) Ear wax impaction 6 (13.0) Foreign body ear 2 (4.3) Sinusitis 1 (2.3)
Laryngeal papilloma 42 No diagnosis indicated 23 (54.8) Laryngeal papilloma 5 (11.9) Chronic laryngitis 3 (7.1) Tracheal tumour 2 (4.8) Others 9 (21.4) (each with n = 1, 2.4%) -
Acute otitis media 34 No diagnosis indicated 15 (44.1) Acute otitis media 12 (35.3) Others 7 (20.6) (each with n = 1, 2.9%) - - -
Chronic rhinosinusitis without nasal polyps 32 No diagnosis indicated 9 (28.1) Chronic rhinosinusitis 9 (28.1) Nasal polyps 4 (12.5) Recurrent tonsillitis 2 (6.3) Others 8 (25.0) (each with n = 1, 3.1%) -
Chronic rhinosinusitis with nasal polyps 25 Nasal polyps 18 (72.0) No diagnosis indicated 3 (12.0) Chronic rhinosinusitis 2 (8.0) Nasal tumour 1 (4.0) Acute sinusitis 1 (4.0) -

* Total count (n) excludes the number of patients who referred themselves for ENT specialist care (self-referrals) and therefore, did not have a pre-referral non-ENT clinician diagnosis

# Patients had no nasal polyps on clinical evaluation by the ENT specialist

In the multivariate logistic regression model, patients aged 51–87 years were 1.77 (aOR: 1.03–3.04) fold more likely to be misdiagnosed by the referring clinician than those aged 0–5 years. Patients with ear diseases (aOR: 1.63; 95% CI: 1.14–2.33), those with sinonasal diseases (aOR: 1.80; 95% CI: 1.14–2.45) and those with no ENT pathology (aOR: 3.08; 95% CI: 2.58–4.48) were more likely to have a wrong pre-ENT referral diagnosis compared to those with head and neck diseases (Table 2).

Table 2. Univariate and multivariate logistic regression of the pre-ENT referral misdiagnosis among the different patient groups.

Univariate Analysis Multivariate Analysis
Variable OR p-value 95% CI aOR p-value 95% CI
0–5 years Reference
6–12 years 0.98 0.887 0.69–1.38
13–18 years 0.73 0.218 0.44–1.21
19–35 years 1.34 0.071 0.98–1.84
36–50 years 1.79 0.003 1.22–2.62
51–87 years 2.02 0.001 1.34–3.02 1.77 0.039 1.03–3.04
Departments: Medicine Reference
Paediatric 0.38 0.001 0.25–0.57 0.53 0.012 0.3–0.87
Surgery 0.60 0.013 0.41–0.89
Women and Newborn 0.14 0.115 0.01–1.61
ENT subspecialty
Head and Neck Reference
Otology 1.802 0.001 1.34–2.43 1.63 0.008 1.14–2.33
Rhinology 1.691 0.001 1.29–2.21 1.80 0.001 1.32–2.45
Medical problem 0.537 0.419 0.12–2.43
No ENT pathology 1.396 0.001 1.17–1.67 1.78 0.025 1.08–2.95

OR: Odds ratio; aOR: adjusted odds ratio; 95% CI: 95% Confidence interval

Note: multivariate logistic regression data omitted from the table were not significant at p < 0.05

Appropriateness of referrals

Of the total 1372 non-ENT specialist clinician referrals, 56.6% (n = 777) were inappropriate. Of these, 67.3% (n = 523) could have been treated by non-ENT clinicians at lower-level hospitals, 23.9% (n = 186) required trial of medical treatment before referral to UTH and 7.2% (n = 56) had no indication for ENT treatment. Patients aged 0–5 years were the most (27.4%, n = 213), while those aged 13–18 years were the least (4.6%, n = 36) inappropriately referred. The majority (39.1%, n = 302) of inappropriate referrals had head and neck diseases, while the minority (0.4%, n = 3) had an ENT-unrelated medical problem (S3 Table). Univariate and multivariate logistic regression showed that referrals from within the UTH complex of hospitals were 1.35 (95% CI: 1.03–1.75) and 1.34 (95% CI: 1.03–1.75) more likely to be inappropriate than those from other facilities (Table 3).

Table 3. Univariate and multivariate logistic regression of inappropriate referrals among the different patient groups.

Univariate Analysis Multivariate Analysis
Variable OR p-value 95% CI aOR p-value 95% CI
Attendance status
Review Reference
First attendance 1.36 0.006 1.09–1.68 1.35 0.005 1.09–1.68
Attendance not stated 0.91 0.946 0. 06–1.46
Referral within UTH No Reference
Yes 1.35 0.027 1.04–1.75 1.34 0.028 1.03–1.75

OR: Odds ratio; aOR: adjusted odds ratio; 95% CI: 95% Confidence interval

Note: multivariate logistic regression data omitted from the table were not significant at p < 0.05

Diagnosis agreement

The overall agreement between the diagnoses made by the referring clinicians and those of the ENT specialist was low (κ = 0.0001) [p = 0.473], as were those between Level 1 hospital referring clinicians and ENT specialist (κ = 0.0201) [p = 0.046], between Level 2 hospital referring clinicians and ENT specialist (κ = -0.0214) [p = 0.870] and between Level 3 hospital referring clinicians and ENT specialist (κ = 0.0020) [p = 0.869]

Discussion

In this study, we determined that the diagnostic error and inappropriate patient referrals for specialist ENT care in our resource-limited setting were high. Our findings provide evidence of and highlight the need to improve the diagnostic accuracy among medical doctors to improve the quality of ENT patient care. Although ENT is a surgical speciality, the skills it encompasses are relevant to all medical and surgical disciplines [19]. Therefore, all doctors are required to be competent to diagnose and treat basic ENT diseases and refer patients appropriately [19].

Worldwide, most health-care visits by patients are due to ENT diseases, most of which relate to the ear [20]. In contrast, this study determined that the majority (34.8%) of patients attending the UTH ENT clinic had diseases affecting the head and neck and the minority (25.7%) had those affecting the ear. This finding was inconsistent with evidence from the developing world, including India [21] and Nigeria [22], where ear diseases form the majority of ENT diseases treated in health facilities. While bigger multi-centre studies may be required to verify this finding, a possible explanation could be that many people with ear diseases (e.g., hearing loss, chronic otitis media) in Zambia do not readily access ENT services due to poor socioeconomic conditions, unavailable ENT services in health care facilities and poor health-seeking behaviour [4, 5, 23]. Considering the high (77.9%) poverty levels and large (56.4%) population of rural Zambia [15], and that ENT services are only found in few urban hospital units [4], many ear disease-affected patients in rural areas may not have insight into the potential adverse outcomes of these diseases to warrant long-distance travel to access an ENT service [24, 25]. Therefore, more effective universal health education, improved socioeconomic conditions and disadvantaged communities’ improved access to ENT services may result in a different epidemiological outlook of ENT diseases from what has been observed in the current study.

Our results suggest a high prevalence of diagnostic error among non-ENT trained health workers in low-resource settings. While data comparing diagnostic error between medical and surgical subspecialties is scarce, available evidence suggests a lower prevalence of diagnostic error among physicians and paediatricians. For instance, a survey conducted on 583 physicians across the United States of America found diagnostic error of 4.5% [26]. Similarly, diagnostic error of 3.6% among primary care physicians was observed in Malaysia [27]. In another study, more than half of paediatricians reported diagnostic error at least once or twice a month, and they made harmful errors at least once or twice a year [28]. Further, a study in the Netherlands reported diagnostic accuracy of 0.42 among medical residents, scored as either 0 (incorrect), 0.5 (partially correct) or 1 (correct) [29]. With 96.7% of allergic rhinitis, 95.7% of laryngopharyngeal reflux and 87.0% of ear wax impaction missed by non-ENT clinicians in our study, most of the patients with ENT conditions are likely inappropriately treated with the wrong medication and surgery. Further, some patients may not be referred early for management of life-threatening conditions like cancer. This may worsen the disease prognosis and increase the ultimate cost of patient care due to prolonged hospital stay and more advanced, costly treatment. In addition, delayed diagnosis of benign ENT conditions may result in life-threatening complications (airway obstruction in laryngeal papilloma, intracranial sepsis in acute otitis media and rhinosinusitis).

The poor agreement between the referring clinicians and ENT specialist (κ = 0.0001) and the high rate (56.6%) of inappropriate referrals for ENT specialist care may indicate inadequate training and poor knowledge of basic ENT disease management among most clinicians. In Zambia and the rest of the world, ENT is given little weight in medical school curricula, with most ENT undergraduate curricula offering a 1–2 week predominantly observational rotation [30]. As such, most clinicians lack the necessary skills to confidently manage ENT diseases upon completion of their undergraduate medical training [31]. Even if some literature emphasizes the superiority of adequate undergraduate ENT medical training over the duration spent as a general practitioner in the acquisition of competence to treat ENT conditions [32], the majority of clinicians often do require additional training to improve their competence following their undergraduate medical education [31]. Therefore, improving ENT medical education and clinical exposure at undergraduate, graduate and in-service training in Zambia would give clinicians better knowledge and skill to handle ENT conditions [32, 33]. A study assessing the knowledge, attitudes, and current practices of health workers with regard to the basic management of ENT diseases in Zambia is ongoing. We hope that the study will provide more insight into why some uncomplicated and correctly diagnosed conditions (i.e., acute tonsillitis, allergic rhinitis) are sent for ENT specialist treatment.

Literature has conflicting evidence on the rate of disease misdiagnosis in different age groups, with some reporting higher rates in older age groups [34] and some in younger ones [35]. In our study, patients aged 51–87 years were 1.8 times more likely to be misdiagnosed by the non-ENT specialist than those aged between 0–5 years. While we cannot provide a reason for this finding, it is worth exploring further with a more robust study with more participants. However, the widespread shortage of ENT diagnostic instruments across Zambia may explain the higher likelihood of misdiagnosis of patients with ear and those with sinonasal diseases. As nasal specula, otoscopes and endoscopes are seldom available in health facilities [5], clinicians seldomly perform complete ear and nasal examinations for diagnostic purposes. Except that of the larynx, much of the head and neck pathology requires no instrumentation to complete. In addition to the lack of sufficient skills and equipment at lower-level hospitals, patient referral networks in Zambia and many other low-income nations are undermined by poor coordination between lower and upper-level hospitals [36]. This may, in part, explain the high rate of inappropriate referrals noted in this study.

Even though debatable, available evidence shows that the knowledge and experience gained from regular practice of the clinician matters in reducing diagnostic errors, with more experienced clinicians likely making fewer diagnostic errors [37]. In our study, however, this trend was not apparent as patients referred from level 3 hospitals were not the least misdiagnosed (66.8%) [even though those referred from level 1 hospitals were the most misdiagnosed (74.1%)]. This finding supports the evidence that doctors’ medical knowledge stagnates after completing undergraduate training, but we suggest gathering better evidence with a more robust review of the literature. Our study also suggests that the referral practices in high-level hospitals (level 3) ought to be audited to ascertain whether junior doctors do some referrals to ENT without more experienced senior input, a practice that may elevate the rate of diagnostic error and inappropriate referral. In Zambia, level 1 hospitals are manned by Senior Resident Medical Officers (doctors who have completed at least 1.5 years of consultant-supervised practice following completion of undergraduate medical training but not yet commenced specialist training), while level 3 hospitals are training sites for medical students, Junior Resident Medical Officers (newly qualified doctors undergoing consult supervision and not fully registered as medical practitioners with the Health Professions Council of Zambia), as well as specialist trainees.

To make quality ENT services more available to the Zambian public, non-ENT specialist cadres can be trained to diagnose and manage basic ENT diseases, a strategy that has been successful in other countries within the region, such as Malawi [38]. Some literature from the developing world suggests that health workers can be trained to reliably diagnose and treat ENT diseases [39], with one study in Malawi [40] reporting good (κ = 0.7) and moderate (κ = 0.5) agreements in ear pathology diagnosis between the ENT specialist and the ENT clinical officer (mid-level health care providers with less training and more restricted scope of practice than medical doctors) and nurse respectively. The investigators noted the potential for non-specialist health workers to be involved in the patient assessment of ENT disease. Accordingly, training these non-specialist health workers in the use of basic ENT equipment (otoscopes, tuning forks, nasal specula), performance of basic procedures (ear syringing, indirect laryngoscopy) and non-expert interpretation head and neck x-rays would improve the quality of patient care in many places lacking an ENT specialist. In addition to training non-ENT specialists in ENT disease management, establishing international partnerships to train specialists locally would be successful in steadily increasing the pool of ENT specialists in Zambia. Such initiatives have been effective in advancing ENT in Africa, including The CBM International assistance in the establishment of ENT units in Central Africa, The University of Cape Town Karl Storz Head, Neck and Paediatric ENT Fellowships training African head, neck and paediatric ENT Fellows, and Operation Ear Drop Kenya equipping the temporal bone laboratory in Nairobi. Further, the introduction of ENT telemedicine to Zambia may improve patients’ access to quality health care. While telemedicine has been successfully implemented in other medical subspecialties in Zambia [41], it is yet to be used in ENT health care. However, to ensure success of telemedicine, the government must develop its implementation strategies that are tandem with Zambia’s needs [42].

The World Health Organisation (WHO) recognizes the importance of errors in diagnosis in its prioritization of safety errors in primary health care [43]. With up to 50% of GP consultations due to ENT conditions, the accuracy of diagnosis of ENT diseases remains a vital component of quality health care [43]. As serious harm rates of misdiagnosis per incident disease can be as high as 36% [44], all efforts to increase the ENT workforce in Zambia must be accompanied by effective mechanisms to guarantee knowledgeable and competent clinicians for ENT health care. While Cannon et al. (2004) estimated that one otolaryngologist for every 40,000 population is sufficient to provide comprehensive patient care [45], Zambia’s 0.007/40,000 ENT specialist/population ratio is well below the proposed minimum requirement [4]. Considering that diagnostic errors are the largest proportion of medical errors (up to 70%) [8], lowering ENT clinicians’ quality would be additional harm to the Zambian health system. While doctors often work towards correcting health-care system factors that lead to medical error, they are reluctant to acknowledge their diagnostic errors because mistakes may be perceived as professional lapses or personal failings [46]. This practice may be one of the largest compromises of good health-care delivery.

Study limitations

We could not conduct a more comprehensive retrospective review study because most hospital records of patients treated at the facility before July 2019 and beyond October 2019 could not be traced due to poor record-keeping, which requires improvement. Our results could be skewed by the large variations in the number of patients referred from the different provinces. ‘Queried’ diagnoses assumed ‘definite’ may have skewed the results of this study as in some cases, the final diagnosis may be different from the queried one. Also, since we only considered the primary diagnoses for our analysis, there might have been secondary referral diagnoses or complications that might have been correct but not considered. In addition, pre-referral medical treatment and possible delays in patients reaching the specialist ENT facility might have altered the disease process and resulted in perceived misdiagnoses. Further, the proportions of some of the diseases described in this study may vary with changing seasons. For instance, in Zambia, viral rhinopharyngitis and otitis media peak in the cold season. However, in our study, the prevalence of viral rhinopharyngitis and otitis media likely represented the annual incidence because the study period included both cold and hot months.

We acknowledge that our interpretation of ‘inappropriate referral’, even though according to Blundel et al. [17], was subjective and prone to bias as we relied on patient clinical files and referral documents for categorisation as appropriate or inappropriate. While it is a requirement in Zambia for clinicians to record investigations done and treatment instituted on the referral letter, some referring clinicians may not have inputted this information for the ENT specialist to note. Possibly, some of the reasons for not performing tests (i.e., non-functioning equipment, lack of reagents, unavailable expertise) at the referring facilities may not have been recorded on the referral letters, which may have increased the proportion of inappropriate referrals observed in our study. Another major limitation was that our utilisation of one ENT specialist to classify ENT diagnoses as matching or different was prone to bias.

Additional limitation to this study was the uncontrolled increase in familywise error rate across our statistical analyses. Overall, we consider this investigation relatively preliminary and encourage replication on an improved hospital record-keeping system that will achieve a longer study.

Conclusions

In low-resource settings, more effective, accelerated ENT training of clinicians may improve the diagnostic accuracy and reduce the high non-specialist clinician diagnostic error and inappropriate patient referrals. Findings of this study may be used to guide policy aimed to improve ENT health care in Zambia.

Supporting information

S1 Appendix. Data collecting tool.

(DOCX)

S2 Appendix. The STROBE checklist for cross sectional studies.

(DOCX)

S1 Table. Proportional representation of ENT diseases treated at UTH ENT clinic.

(DOCX)

S2 Table. Misdiagnosis across age groups, ENT subspecialties, referral facilities level of care and provinces.

(DOCX)

S3 Table. Appropriateness of referral across age groups, ENT subspecialties, referral facilities level of care and provinces.

(DOCX)

Acknowledgments

We would like to thank the management of the University Teaching Hospitals (UTH) for their permission to conduct the research. Our gratitude also goes to Kasoka Lukama and Chabota Mungambata for transferring the patient information hard copies to the excel spreadsheet. Further, we would like to thank all members of staff at the UTH ENT clinic for helping to retrieve the patient records for the study. In addition, we would like to thank the EDCTP-TESA II/UTH Project in Zambia for sponsoring Lufunda Lukama to their 2019 Data Analysis and Manuscript Writing Bootcamp in Livingstone, Zambia.

Data Availability

The data used in this study can be accessed here: Lukama, Lufunda; Aldous, Colleen; Michelo, Charles; Kalinda, Chester (2022), “Dataset on diagnostic errors of Ear, Nose and Throat (ENT) diseases ”, Mendeley Data, v1 (http://dx.doi.org/10.17632/6tgz2db7yn.1).

Funding Statement

The authors received no specific funding for this work. However, during the course of this study, Lufunda Lukama received a tuition fee waiver from the University of KwaZulu-Natal (https://ukzn.ac.za) and a scholarship (tuition fees, living cost stipend) from the Canon Collins Educational and Legal Assistance Trust (https://canoncollins.org/) for his Doctor of Philosophy studies at the University of KwaZulu-Natal College of Health Sciences in South Africa [no grant numbers available]. There was no additional external funding received for this study. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

References

  • 1.Lloyd S, Tan ZE, Taube MA, Doshi J. Development of an ENT undergraduate curriculum using a Delphi survey. Clin Otolaryngol. 2014. Oct;39(5):281–8. doi: 10.1111/coa.12293 [DOI] [PubMed] [Google Scholar]
  • 2.Du E, Mazul AL, Farquhar D, Brennan P, Anantharaman D, Abedi-Ardekani B, et al. Long-term Survival in Head and Neck Cancer: Impact of Site, Stage, Smoking, and Human Papillomavirus Status. Laryngoscope. 2019. Nov;129(11):2506–13. doi: 10.1002/lary.27807 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3.Ta NH. ENT in the context of global health. The Annals of The Royal College of Surgeons of England. 2019;101(2):93–6. doi: 10.1308/rcsann.2018.0138 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4.Lukama L, Kalinda C, Aldous C. Africa’s challenged ENT services: highlighting challenges in Zambia. BMC health services research. 2019. Jul 2;19(1):443. doi: 10.1186/s12913-019-4267-y [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5.Lukama L, Kalinda C, Kuhn W, Aldous C. Availability of ENT Surgical Procedures and Medication in Low-Income Nation Hospitals: Cause for Concern in Zambia. BioMed research international. 2020;2020. doi: 10.1155/2020/1980123 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6.Farooq M, Ghani S, Hussain S. Prevalence of ear, nose & throat diseases and adequacy of ent training among general physicians. International Journal of Pathology. 2018;113–5. [Google Scholar]
  • 7.Graber ML, Franklin N, Gordon R. Diagnostic Error in Internal Medicine. Arch Intern Med. 2005. Jul 11;165(13):1493. doi: 10.1001/archinte.165.13.1493 [DOI] [PubMed] [Google Scholar]
  • 8.Royce CS, Hayes MM, Schwartzstein RM. Teaching Critical Thinking: A Case for Instruction in Cognitive Biases to Reduce Diagnostic Errors and Improve Patient Safety. Academic Medicine. 2019. Feb;94(2):187–94. doi: 10.1097/ACM.0000000000002518 [DOI] [PubMed] [Google Scholar]
  • 9.Singh H, Meyer AND, Thomas EJ. The frequency of diagnostic errors in outpatient care: estimations from three large observational studies involving US adult populations. BMJ Qual Saf. 2014. Sep;23(9):727–31. doi: 10.1136/bmjqs-2013-002627 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10.Gunderson CG, Bilan VP, Holleck JL, Nickerson P, Cherry BM, Chui P, et al. Prevalence of harmful diagnostic errors in hospitalised adults: a systematic review and meta-analysis. BMJ Qual Saf. 2020. Dec 1;29(12):1008–18. doi: 10.1136/bmjqs-2019-010822 [DOI] [PubMed] [Google Scholar]
  • 11.Singh H, Schiff GD, Graber ML, Onakpoya I, Thompson MJ. The global burden of diagnostic errors in primary care. BMJ Qual Saf. 2017. Jun 1;26(6):484–94. doi: 10.1136/bmjqs-2016-005401 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12.Tzartzas K, Oberhauser PN, Marion-Veyron R, Bourquin C, Senn N, Stiefel F. General practitioners referring patients to specialists in tertiary healthcare: a qualitative study. BMC Family Practice. 2019. Dec 1;20(1):165. doi: 10.1186/s12875-019-1053-1 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13.Gupta A, Snyder A, Kachalia A, Flanders S, Saint S, Chopra V. Malpractice claims related to diagnostic errors in the hospital. BMJ Qual Saf. 2018. Jan 1;27(1):53–60. [DOI] [PubMed] [Google Scholar]
  • 14.Mumba JM, Kasonka L, Owiti OB, Andrew J, Lubeya MK, Lukama L, et al. Cervical cancer diagnosis and treatment delays in the developing world: Evidence from a hospital-based study in Zambia. Gynecologic Oncology Reports. 2021. Aug 1;37:100784. doi: 10.1016/j.gore.2021.100784 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15.Population and Demographic Projections, 2011–2035—Zambia Data Portal [Internet]. [cited 2021 Sep 7]. Available from: https://zambia.opendataforafrica.org/ZMPHC2015/population-and-demographic-projections-2011-2035?country=1000000-zambia.
  • 16.Health Mi of. The 2012 List of Health Facilities. Preliminary Report [Internet]. 2012 [cited 2022 Jul 26]; Available from: http://dspace.unza.zm/handle/123456789/5127.
  • 17.Blundell N, Clarke A, Mays N. Interpretations of referral appropriateness by senior health managers in five PCT areas in England: a qualitative investigation. BMJ Quality & Safety. 2010. Jun 1;19(3):182–6. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18.Checklists–STROBE [Internet]. [cited 2021 Sep 25]. Available from: https://www.strobe-statement.org/checklists/.
  • 19.The Intercollegiate Surgical Curriculum Educating the surgeons of the future [Internet]. [cited 2021 Jul 31]. Available from: https://www.google.com/search?q=The+Intercollegiate+Surgical+Curriculum+Educating+the+surgeons+of+the+future&oq=The+Intercollegiate+Surgical+Curriculum+Educating+the+surgeons+of+the+future&aqs=chrome..69i57.507j0j7&sourceid=chrome&ie=UTF-8.
  • 20.Saunders JE, Rankin Z, Noonan KY. Otolaryngology and the global burden of disease. Otolaryngologic Clinics of North America. 2018;51(3):515–34. doi: 10.1016/j.otc.2018.01.016 [DOI] [PubMed] [Google Scholar]
  • 21.Emerson LP, Job A, Abraham V. A model for provision of ENT health care service at primary and secondary hospital level in a developing country. BioMed Research International. 2013;2013. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22.Mbalaso OC. Pattern of paediatric ear, nose and throat diseases in Port Harcourt, South-South, Nigeria. Nigerian Health Journal. 2015;15(2):48–54. [Google Scholar]
  • 23.Akinyemi JO, Banda P, De Wet N, Akosile AE, Odimegwu CO. Household relationships and healthcare seeking behaviour for common childhood illnesses in sub-Saharan Africa: a cross-national mixed effects analysis. BMC Health Services Research. 2019. May 14;19(1):308. doi: 10.1186/s12913-019-4142-x [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24.Mukara KB, Lilford RJ, Tucci DL, Waiswa P. Prevalence of middle ear infections and associated risk factors in children under 5 years in gasabo district of Kigali City, Rwanda. International journal of pediatrics. 2017;2017. doi: 10.1155/2017/4280583 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 25.Mukara KB, Waiswa P, Lilford R, Tucci DL. Knowledge and care seeking practices for ear infections among parents of under five children in Kigali, Rwanda: a cross-sectional study. BMC Ear, Nose and Throat Disorders. 2017. Oct 10;17(1):7. doi: 10.1186/s12901-017-0040-1 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 26.Schiff GD, Hasan O, Kim S, Abrams R, Cosby K, Lambert BL, et al. Diagnostic Error in Medicine: Analysis of 583 Physician-Reported Errors. Archives of Internal Medicine. 2009. Nov 9;169(20):1881–7. doi: 10.1001/archinternmed.2009.333 [DOI] [PubMed] [Google Scholar]
  • 27.Khoo EM, Lee WK, Sararaks S, Abdul Samad A, Liew SM, Cheong AT, et al. Medical errors in primary care clinics–a cross sectional study. BMC Family Practice. 2012. Dec 26;13(1):127. doi: 10.1186/1471-2296-13-127 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28.Singh H, Thomas EJ, Wilson L, Kelly PA, Pietz K, Elkeeb D, et al. Errors of diagnosis in pediatric practice: a multisite survey. Pediatrics. 2010. Jul;126(1):70–9. doi: 10.1542/peds.2009-3218 Epub 2010 Jun 21. ; PMCID: PMC2921702. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 29.Kuhn J., van den Berg P., Mamede S. et al. Improving medical residents’ self-assessment of their diagnostic accuracy: does feedback help?. Adv in Health Sci Educ 27, 189–200 (2022). doi: 10.1007/s10459-021-10080-9 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 30.Arwyn-Jones J, Bhalla S, Acharya V, Beegun I, Awad Z, Tolley N. Specialty Showcase Days: Can Specialist Careers Workshops Improve The Consideration Of ENT For Medical Students? Adv Med Educ Pract. 2019;10:877–84. doi: 10.2147/AMEP.S224925 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 31.Hogg ES, Kinshuck AJ, Littley N, Lau A, Tandon S, Lancaster J. A high-fidelity, fully immersive simulation course to replicate ENT and head and neck emergencies. J Laryngol Otol. 2019. Feb;133(2):115–8. doi: 10.1017/S0022215118002347 [DOI] [PubMed] [Google Scholar]
  • 32.O’Brien DC, Squires LD, Robinson AD, Ramadan H, Diaz R. A Multicenter, Cross-Sectional Assessment of Otolaryngology Knowledge Among Primary Care Trainees. Ann Otol Rhinol Laryngol. 2018. Sep;127(9):631–6. doi: 10.1177/0003489418784615 [DOI] [PubMed] [Google Scholar]
  • 33.Aryasomayajula S, Raithatha A, Haywood M, Jobanputra R, Roplekar R, Acharya V. Hands-on teaching, shadowing, and supported learning through acute clinics to help improve the confidence of and meet training needs for junior doctors working in ear, nose, and throat surgery. Advances in medical education and practice. 2018;9:827. doi: 10.2147/AMEP.S161187 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 34.Mahajan P, Basu T, Pai CW, Singh H, Petersen N, Bellolio MF, et al. Factors Associated With Potentially Missed Diagnosis of Appendicitis in the Emergency Department. JAMA Network Open. 2020. Mar 9;3(3):e200612. doi: 10.1001/jamanetworkopen.2020.0612 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 35.Goldman-Yassen AE, Mony VK, Arguin PM, Daily JP. Higher Rates of Misdiagnosis in Pediatric Patients versus Adults Hospitalized with Imported Malaria. Pediatr Emerg Care. 2016. Apr;32(4):227–31. doi: 10.1097/PEC.0000000000000251 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 36.Pittalis C, Brugha R, Gajewski J. Surgical referral systems in low- and middle-income countries: A review of the evidence. PLOS ONE. 2019. Sep 27;14(9):e0223328. doi: 10.1371/journal.pone.0223328 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 37.Norman GR, Monteiro SD, Sherbino J, Ilgen JS, Schmidt HG, Mamede S. The Causes of Errors in Clinical Reasoning: Cognitive Biases, Knowledge Deficits, and Dual Process Thinking. Acad Med. 2017. Jan;92(1):23–30. doi: 10.1097/ACM.0000000000001421 [DOI] [PubMed] [Google Scholar]
  • 38.Mulwafu W, Ensink R, Kuper H, Fagan J. Survey of ENT services in sub-Saharan Africa: little progress between 2009 and 2015. Global Health Action. 2017;10(1):1289736. doi: 10.1080/16549716.2017.1289736 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 39.Mulwafu W, Kuper H, Viste A, Goplen FK. Feasibility and acceptability of training community health workers in ear and hearing care in Malawi: a cluster randomised controlled trial. BMJ Open. 2017. Oct 11;7(10):e016457. doi: 10.1136/bmjopen-2017-016457 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 40.Bright T, Mulwafu W, Phiri M, Ensink RJ, Smith A, Yip J, et al. Diagnostic accuracy of non-specialist versus specialist health workers in diagnosing hearing loss and ear disease in Malawi. Tropical Medicine & International Health. 2019;24(7):817–28. doi: 10.1111/tmi.13238 [DOI] [PubMed] [Google Scholar]
  • 41.Asukile M., Chishimba L., Chomba M., Mataa M., Mutete F., Mwendaweli N., et al. Implementation of a Teleneurology Clinic in Zambia during the COVID-19 Pandemic. Ann Neurol. 2022; 91: 445–454. doi: 10.1002/ana.26323 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 42.Joana Eva Dodoo Hosam Al-Samarraie, Ahmed Ibrahim Alzahrani, Telemedicine use in Sub-Saharan Africa: Barriers and policy recommendations for Covid-19 and beyond, International Journal of Medical Informatics. 2021;151:104467, ISSN 1386-5056, 10.1016/j.ijmedinf.2021.104467. (https://www.sciencedirect.com/science/article/pii/S1386505621000939). [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 43.Cresswell KM, Panesar SS, Salvilla SA, Carson-Stevens A, Larizgoitia I, Donaldson LJ, et al. Global Research Priorities to Better Understand the Burden of Iatrogenic Harm in Primary Care: An International Delphi Exercise. PLOS Medicine. 2013. Nov 19;10(11):e1001554. doi: 10.1371/journal.pmed.1001554 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 44.Newman-Toker DE, Wang Z, Zhu Y, Nassery N, Saber Tehrani AS, Schaffer AC, et al. Rate of diagnostic errors and serious misdiagnosis-related harms for major vascular events, infections, and cancers: toward a national incidence estimate using the “Big Three.” Diagnosis (Berl). 2021. Feb 23;8(1):67–84. [DOI] [PubMed] [Google Scholar]
  • 45.Cannon CR, Giaimo EM, Lee TL, Chalian A. Special report: reassessment of the ORL-HNS workforce: perceptions and realities. Otolaryngol Head Neck Surg. 2004. Jul;131(1):1–15. doi: 10.1016/j.otohns.2004.02.032 [DOI] [PubMed] [Google Scholar]
  • 46.Reilly JB, Myers JS, Salvador D, Trowbridge RL. Use of a novel, modified fishbone diagram to analyze diagnostic errors. Diagnosis. 2014. Jun 1;1(2):167–71. doi: 10.1515/dx-2013-0040 [DOI] [PubMed] [Google Scholar]

Decision Letter 0

Jorge Spratley

6 Nov 2022

PONE-D-22-27161Ear, Nose and Throat (ENT) disease diagnostic error in low-resource health care: observations from a hospital-based cross-sectional studyPLOS ONE

Dear Dr. Lukama,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

Please submit your revised manuscript by Dec 21 2022 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: https://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols.

We look forward to receiving your revised manuscript.

Kind regards,

Jorge Spratley, MD, PhD

Academic Editor

PLOS ONE

Journal Requirements:

When submitting your revision, we need you to address these additional requirements.

1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at 

https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and 

https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf

2. Please provide additional details regarding participant consent. In the ethics statement in the Methods and online submission information, please ensure that you have specified (1) whether consent was informed and (2) what type you obtained (for instance, written or verbal, and if verbal, how it was documented and witnessed). If your study included minors, state whether you obtained consent from parents or guardians. If the need for consent was waived by the ethics committee, please include this information.

If you are reporting a retrospective study of medical records or archived samples, please ensure that you have discussed whether all data were fully anonymized before you accessed them and/or whether the IRB or ethics committee waived the requirement for informed consent. If patients provided informed written consent to have data from their medical records used in research, please include this information.

3. We note that the grant information you provided in the ‘Funding Information’ and ‘Financial Disclosure’ sections do not match. When you resubmit, please ensure that you provide the correct grant numbers for the awards you received for your study in the ‘Funding Information’ section.

4. Thank you for stating in your Funding Statement: 

"The authors received no specific funding for this work. However, Lufunda Lukama received financial support from the University of KwaZulu-Natal through his university tuition fee waiver and from the Canon Collins Educational and Legal Assistance Trust through the scholarship offered to him to study his Doctor of Philosophy in Medicine."

Please provide an amended statement that declares *all* the funding or sources of support (whether external or internal to your organization) received during this study, as detailed online in our guide for authors at http://journals.plos.org/plosone/s/submit-now.  Please also include the statement “There was no additional external funding received for this study.” in your updated Funding Statement. 

Please include your amended Funding Statement within your cover letter. We will change the online submission form on your behalf.

5. We note that you have indicated that data from this study are available upon request. PLOS only allows data to be available upon request if there are legal or ethical restrictions on sharing data publicly. For more information on unacceptable data access restrictions, please see http://journals.plos.org/plosone/s/data-availability#loc-unacceptable-data-access-restrictions. 

In your revised cover letter, please address the following prompts:

a) If there are ethical or legal restrictions on sharing a de-identified data set, please explain them in detail (e.g., data contain potentially sensitive information, data are owned by a third-party organization, etc.) and who has imposed them (e.g., an ethics committee). Please also provide contact information for a data access committee, ethics committee, or other institutional body to which data requests may be sent.

b) If there are no restrictions, please upload the minimal anonymized data set necessary to replicate your study findings as either Supporting Information files or to a stable, public repository and provide us with the relevant URLs, DOIs, or accession numbers. For a list of acceptable repositories, please see http://journals.plos.org/plosone/s/data-availability#loc-recommended-repositories.

We will update your Data Availability statement on your behalf to reflect the information you provide.

Additional Editor Comments:

Dear Authors,

The topic of your research is interesting. Please address carefully all the constructive questions/comments posed by the referees.

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Partly

Reviewer #2: Yes

Reviewer #3: Yes

**********

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

Reviewer #2: Yes

Reviewer #3: Yes

**********

3. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

Reviewer #3: Yes

**********

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

Reviewer #3: Yes

**********

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: It’s a well written manuscript, on a fluent English. It addresses a verry acute problem in Africa – the lack of specialists. Therefore, it merits our full attention.

The author pretends to demonstrate a high rate of diagnosis mismatch between the referring practitioner and the otolaryngologist, as well as high rate of inappropriate referral. However, we must point some critical biases that are not discussed and that might lower these rates.

L 74 The authors claim that “a more comprehensive retrospective review was not practical as most of the patients’ records from July 2019 and beyond October 2019 could not be traced due to poor record-keeping” and says it’s common in Zambia, citing another paper. This other paper’s authors managed however to collect data from earlier years, and so we don’t find it credible that only 4 months could be used. And a short period of 4 winter months is surely introducing biases. (And please review the confusing phrase – “prior to” and “more recent than”.

L84 “in the absence of…” this is a limitation in the author’s Hospital, or in the referring Hospitals? (If it’s in the referring Hospital, we would consider it acceptable, for as pointed before, only the UTH has ENT specialists. Also, it is a very specific issue: why mention this one limitation, and in relation to the pharynx alone? Why not mention laryngeal endoscopy? Or list all other limitations… I suggest you clarify why this issue is specifically relevant, or else remove it.

L99 Was the considered ENT diagnosis the first impression diagnosis or the diagnosis after tests? Would you consider a misdiagnose a diagnose that was not possible because of lack of access to tests? (For instance, a diagnosis of tracheal tumor instead of laryngeal papilloma in a Hospital with no endoscopy).

L104 would mean “all available primary care options had not been exhausted”?

112 “referral reason” is “referral diagnosis”?

L132 The author state that “Informed consent from the patients was not necessary and, therefore, was not obtained”. Consent is always needed, but under certain circumstances may be dismissed. So please address this issue here, admit it was not obtained because of some relevant reason (suggest e.g the research is of minimal risk, methods for protecting confidentiality are well outlined, and identifiers are destroyed as soon as possible…) and this was known to the Ethics Committee when presented for approval.

L 143 If 11% were self-referrals, who made the referral diagnosis? If the self-referred were self-diagnosed too, they shouldn’t be included. It seems you considered this latter in L172 but not here.

L153 “most misdiagnosis were from level 3 hospitals” may lead to incorrect interpretation, for these hospitals were the ones referring the most in total. In fact, they were in proportion more accurate than level 1, and we can assume that they are even leveled with the other two levels. So, the authors construction is misleading.

L171 the total number (591) does not match the number of included participants

L186 1374 referrals does not agree to L138 1543 referrals. Please correct it.

L330 Limitations’ discussion: you might discuss that some referral diagnosis might be a misdiagnosis because of time delay after referral? (e.g., tonsillar hypertrophy that got better) or just upgraded or downgraded (sinusitis to allergic rhinitis, or vice versa – allergic rhinitis often has sinusitis). We are never told how long it took from referral to ENT consulting, and neither if treatment was done in the meantime while waiting. The patient might have been referred for allergic rhinitis in the spring and was observed by the ENT in August presenting with a cold with sinusitis, for instance.

Also, the patient might have more than one diagnosis and at the time of referral - the most relevant one might not be that same when seen by the ENT surgeon (we must consider this when chronic sinusitis is mislabeled as recurrent tonsillitis, would you agree it’s hard to confuse on with the other?).

Lack of endoscopy or other tests might also be responsible (tracheal tumor in a case of laryngeal papilloma is a fair mistake, one might say, and in any case deserving referral). And finally, treatment (as you state in L188 for 25%) may have changed the initial diagnosis.

Also, referral appropriateness limitations are not discussed. The tools used to classify appropriateness pointed by the authors (as much as by Blundel) are highly subjective, and prone to misjudgment. For instance, were the authors able to retrospectively verify that all the needed tests were indeed available (and wrongly not used) at the time of referral? Was this done for every hospital? Can we confirm that all the primary care options were indeed available at that time, on a retrospective study? I know (having myself worked in Africa) that such availability varies a lot, and machines that are supposed to be working, sometimes have malfunctions that take a very long time to fix.

And finally, how do referral appropriateness and misdiagnosis relate to each other? Inappropriate referrals are often misdiagnosis too?

The authors write a long discussion text that leans on political and economy options and suggestions. I find that this part of the discussion is too long, and in part grows far from the studied subject, drawing some assumptions that are not supported or not related to the presented results. However, they leave out one suggestion that has been working very well in solving the referral issues in some other African countries, that is telemedicine.

In conclusion, I consider this manuscript a relevant one, but I urge the authors to reconsider some of the labeled misdiagnosis, and to address and solve the pointed biases, namely extend the studied records for the rest of the year.

Reviewer #2: Manuscript Number PONE-D-22-27161

This study is of interest for publication in this journal. The study presents an analysis of the diagnostic accuracy in patients with ENT pathology and referred to a tertiary hospital.

Major revisions

1. Authors performed an evaluation of the diagnostic accuracy of the patients refereed to another hospital and identified the existence of misdiagnosis cases. However, the authors should not indicate that the objective is the evaluation of misdiagnosis because the real number of misdiagnosis will be much higher. This analysis does not allow the identification of patients who initially had a wrong diagnosis and a wrong treatment but improved without the need to be referred to another hospital. Patients who received a curative treatment, despite the wrong diagnosis, are also not included (example: patient with bacterial tonsillitis with otalgia and medicated with antibiotic therapy for the otitis (wrong diagnosis) but improves with treatment because antibiotics cured the tonsillitis. Thus, this work does not assess misdiagnosis but assesses diagnostic accuracy in patients referred to another hospital. Thus, the objective of the study should be changed.

Minor revisions

1. ENT is a medical and surgical specialty. Thus, "ENT surgeon" should be replaced by "ENT doctor", "ENT specialist" or “ENT clinician”.

2. Authors performed an evaluation between 1 July 2019 and 30 October 2019 because poor record-keeping. However the authors do not explain why there were good clinical records in this period. If these records were more detailed due to the existence of the study, the choice of this time period must be explained, and related to the seasonality of some ENT pathologies;

3. Line 153 - “Despite non-ENT clinicians correctly diagnosing 72.0% (n=18)….” Authors don’t know the percentage of correct diagnosis, the authors only know the number of patients referred with a correct diagnosis and don’t know the correct diagnosis non-refereed.

4. Table 1 – I don’t understand the reason to refer an acute tonsillitis to a tertiary hospital (recurrent tonsillitis to surgery or tonsillitis resistant to treatment?). The same to allergic rhinitis and acute otitis media. This should be explained in the methods and could be important in understanding the diagnostic accuracy in the discussion.

5. The author should reinforce the comparison with developed countries (add comparison with a European country) in percentage of diagnostic accuracy.

Reviewer #3: After reviewing manuscript number PONE-D-22-27161 Research Article, with Title Ear, Nose and Throat (ENT) disease diagnostic error in low-resource health care: observations from a hospital-based cross-sectional study, we found it to have a technically acceptable scientific basis. The presentation of the document is intelligible, clear and unequivocal scientific language was used, and the conclusions presented are based on the data collected. It is also understood that you have made the data underlying the manuscript, which is important not only for the readers but also for its scientific character, available without restrictions. For ethical reasons, it is important to avoid duplication of this publication

**********

6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: Yes: Joao Subtil

Reviewer #2: Yes: Jorge Rodrigues

Reviewer #3: Yes: Palmira Essenje Pintar Kuatoko, my name should appear as Kuatoko, Palmira, MD, MsC; Faculty of Medicin Agostinho Neto University Angola; Josina Machel Hospital Angola

**********

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

PLoS One. 2023 Feb 9;18(2):e0281686. doi: 10.1371/journal.pone.0281686.r002

Author response to Decision Letter 0


21 Dec 2022

Editor Comments

Editor comment:

1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at

https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and

https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf

Authors' response/action:

We thank the editors for reviewing the manuscript. We have reviewed PLOS ONE’s style requirements and submitted our manuscript accordingly.

Editor comment:

2. Please provide additional details regarding participant consent. In the ethics statement in the Methods and online submission information, please ensure that you have specified (1) whether consent was informed and (2) what type you obtained (for instance, written or verbal, and if verbal, how it was documented and witnessed).

If your study included minors, state whether you obtained consent from parents or guardians. If the need for consent was waived by the ethics committee, please include this information

If you are reporting a retrospective study of medical records or archived samples, please ensure that you have discussed whether all data were fully anonymized before you accessed them and/or whether the IRB or ethics committee waived the requirement for informed consent. If patients provided informed written consent to have data from their medical records used in research, please include this information.

Authors' response/action:

Thank you for this important comment. The study was a retrospective cross-sectional review of clinical case records of patients. To include all the requested detail, we amended our Ethics statement to read:

‘The protocol and procedures of this study were approved by the University of KwaZulu-Natal Biomedical Research Ethics Committee (Ref: BREC/00001984/2020) following the South African national guidelines on Biomedical Research. In addition, ethics approval was obtained from the University of Zambia Biomedical Research Ethics Committee (Ref: REF. NO. 1380-2020) and the Zambia National Health Research Authority (Ref: NHRA00007/15/03/2021). Informed consent was waived by the Ethics Boards as the research was of minimal risk to the patient. Gatekeeper permission to conduct the study was obtained from UTH [no Reference number]. All data was fully anonymised following completion of the study. The study was cleared for publication by the Zambia National Health Research Authority (NHRA).’

Edited sections [Page/Line]

Methods section, Ethics subsection, Page 6, Lines 130-139

Editor comment:

3. We note that the grant information you provided in the ‘Funding Information’ and ‘Financial Disclosure’ sections do not match. When you resubmit, please ensure that you provide the correct grant numbers for the awards you received for your study in the ‘Funding Information’ section.

Authors' response/action:

We are grateful for this comment and acknowledge the importance of providing grant numbers In the manuscript. Unfortunately, we are unable to provide the grant numbers as both the University of KwaZulu-Natal (UKZN) and Canon Collins Educational and Legal Assistance Trust do not assign grant numbers to their tuition waivers and scholarships respectively. We have, however, provided websites for both institutions. For any clarifications, please contact the University of KwaZulu-Natal and Canon Collins on the following emails:

Lushenthree Konar, UKZN, Konar@ukzn.ac.za Eva Lenica, Canon Collins Trust, Eva@canoncollins.org

We have also amended our funding information to read:

‘The authors received no specific funding for this work. However, during the course of this study, Lufunda Lukama received a tuition fee waiver from the University of KwaZulu-Natal (https://ukzn.ac.za) and a scholarship (tuition fees, living cost stipend) from the Canon Collins Educational and Legal Assistance Trust (https://canoncollins.org/) for his Doctor of Philosophy studies at the University of KwaZulu-Natal College of Health Sciences in South Africa [no grant numbers available]. There was no additional external funding received for this study. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.’

Edited sections [Page/Line]

Funding Statement included in the cover as instructed by the editor

Editor comment:

4. Thank you for stating in your Funding Statement:

"The authors received no specific funding for this work. However, Lufunda Lukama received financial support from the University of KwaZulu-Natal through his university tuition fee waiver and from the Canon Collins Educational and Legal Assistance Trust through the scholarship offered to him to study his Doctor of Philosophy in Medicine."

Please provide an amended statement that declares *all* the funding or sources of support (whether external or internal to your organization) received during this study, as detailed online in our guide for authors at http://journals.plos.org/plosone/s/submit-now. Please also include the statement “There was no additional external funding received for this study.” in your updated Funding Statement.

Authors' response/action:

We are grateful for this guidance. We have amended our financial statement to read:

‘The authors received no specific funding for this work. However, during the course of this study, Lufunda Lukama received a tuition fee waiver from the University of KwaZulu-Natal (https://ukzn.ac.za) and a scholarship (tuition fees, living cost stipend) from the Canon Collins Educational and Legal Assistance Trust (https://canoncollins.org/) for his Doctor of Philosophy studies at the University of KwaZulu-Natal College of Health Sciences in South Africa [no grant numbers available]. There was no additional external funding received for this study. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.’

Unfortunately, we are unable to provide the grant numbers as both the University of KwaZulu-Natal (UKZN) and Canon Collins Educational and Legal Assistance Trust do not assign grant numbers to their tuition waivers and scholarships respectively. We have, however, provided websites for both institutions. For any clarifications, please contact the University and Canon Collins on the following emails:

Lushenthree Konar, UKZN, Konar@ukzn.ac.za Eva Lenica, Canon Collins Trust, Eva@canoncollins.org

Editor comment:

Please include your amended Funding Statement within your cover letter. We will change the online submission form on your behalf.

Authors' response/action:

Thank you for the guidance. We have included the amended financial statement in our cover letter.

Editor comment:

5. We note that you have indicated that data from this study are available upon request. PLOS only allows data to be available upon request if there are legal or ethical restrictions on sharing data publicly. For more information on unacceptable data access restrictions, please see http://journals.plos.org/plosone/s/data-availability#loc-unacceptable-data-access-restrictions.

In your revised cover letter, please address the following prompts:

a) If there are ethical or legal restrictions on sharing a de-identified data set, please explain them in detail (e.g., data contain potentially sensitive information, data are owned by a third-party organization, etc.) and who has imposed them (e.g., an ethics committee). Please also provide contact information for a data access committee, ethics committee, or other institutional body to which data requests may be sent.

b) If there are no restrictions, please upload the minimal anonymized data set necessary to replicate your study findings as either Supporting Information files or to a stable, public repository and provide us with the relevant URLs, DOIs, or accession numbers. For a list of acceptable repositories, please see http://journals.plos.org/plosone/s/data-availability#loc-recommended-repositories.

We will update your Data Availability statement on your behalf to reflect the information you provide.

Authors' response/action:

We are grateful for this guidance and have read through http://journals.plos.org/plosone/s/data-availability#loc-unacceptable-data-access-restrictions for more information on unacceptable data access restrictions

a) There are no ethical or legal restrictions on sharing our de-identified data set

b) The data used in this study has been uploaded to a public site and can be accessed at Lukama, Lufunda; Aldous, Colleen; Michelo, Charles; Kalinda, Chester (2022), “Dataset on diagnostic errors of Ear, Nose and Throat (ENT) diseases ”, Mendeley Data, v1 http://dx.doi.org/10.17632/6tgz2db7yn.1

Additional Editor Comments:

Dear Authors,

The topic of your research is interesting. Please address carefully all the constructive questions/comments posed by the referees.

[Note: HTML markup is below. Please do not edit.]

Authors' response/action:

We are grateful to the Editor and all the reviewers for their valuable constructive review of the manuscript and positive commentary. We have carefully addressed all their comments as reflecting below:

Editor comments:

Reviewer's comments:

Reviewer's Responses to Questions

Comments to the Author

Comment to author:

1. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Partly

Reviewer #2: Yes

Reviewer #3: Yes

Authors' response/action:

We are grateful for this assessment of our manuscript

Comment to author:

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

Reviewer #2: Yes

Reviewer #3: Yes

Authors' response/action:

We are grateful for this assessment of our manuscript

Comment to author:

3. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

Reviewer #3: Yes

Authors' response/action:

We are grateful for this assessment of our manuscript

Comment to author:

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

Reviewer #3: Yes

Authors' response/action:

We are grateful for this assessment of our manuscript

5. Review Comments to the Author

Reviewer #1

Reviewer comment:

It’s a well written manuscript, on a fluent English. It addresses a verry acute problem in Africa – the lack of specialists. Therefore, it merits our full attention.

Authors' response/action:

We are glad the reviewer found it useful

Reviewer comment:

The author pretends to demonstrate a high rate of diagnosis mismatch between the referring practitioner and the otolaryngologist, as well as high rate of inappropriate referral. However, we must point some critical biases that are not discussed and that might lower these rates.

Authors' response/action:

We thank the reviewer for his observations

Reviewer comment:

L 74 The authors claim that “a more comprehensive retrospective review was not practical as most of the patients’ records from July 2019 and beyond October 2019 could not be traced due to poor record-keeping” and says it’s common in Zambia, citing another paper. This other paper’s authors managed however to collect data from earlier years, and so we don’t find it credible that only 4 months could be used.

Authors' response/action:

We are glad that the reviewer observed that in the cited paper, the authors managed to trace a larger proportion of records from the Cancer Diseases Hospital (CDH), Zambia’s only Oncology Centre. The fundamental difference between CDH and the University Teaching Hospitals (UTH), where our study was done is that CDH has a patient electronic data-base which makes retrieval of patient records easier, as opposed to the manual record keeping at UTH. Due to the lack of electronic record keeping at UTH, some patients are not entered into the manual registers; others even carry their files home. This is a general problem in the country which many hospitals are seeking solutions to.

The ENT Specialist who replaced the one that left UTH in July 2019 introduced an efficient patient record filing system that was abandoned when he was transferred to another tertiary facility in October 2019. After he left, the ENT clinic reverted to its default filing system, with some patients taking their medical files home and some not entered into the book. Even when these patients were manually registered into a book, there was frequently critical identifying data that was missing. This is fundamentally the reason why it was difficult to trace files of patients that were treated before July 2019 and after October 2019. Unfortunately, this was something we could not do anything about, but we note it creates an opportunity to design better filing systems at the facility. In making this clearer, we added the following statement to the Methods section of the manuscript:

‘The trial filing system used between July 2019 and October 2019 had improved patient record keeping in the absence of an electronic filing system’

Edited sections [Page/Line]

Methods section, Design and setting subsection, Page 4, Lines 75-77

In addition, under the Limitations section, we have added the words ‘which requires improvement’ to the sentence ‘We could not conduct a more comprehensive retrospective review study because most hospital records of patients treated at the facility before July 2019 and beyond October 2019 could not be traced due to poor record-keeping’. The sentence now reads ‘We could not conduct a more comprehensive retrospective review study because most hospital records of patients treated at the facility before July 2019 and beyond October 2019 could not be traced due to poor record-keeping, which requires improvement.’

Edited sections [Page/Line]

Discussion section, Study limitations subsection, Page 16, Line 341

Reviewer comment:

And a short period of 4 winter months is surely introducing biases.

Authors' response/action:

Absolutely. We acknowledged this as a limitation in our originally submitted manuscript as ‘Further, the proportions of some of the diseases described in this study may vary with changing seasons. For instance, in Zambia, viral rhinopharyngitis and otitis media peaks in the cold season. However, in our study, the prevalence of viral rhinopharyngitis and otitis media likely represented the annual incidence because the study period included both cold and hot months’ [Discussion section, Study limitations subsection, Page 16, Lines 349-353]. We have gone further to state:

‘Overall, we consider this investigation relatively preliminary and encourage replication on an improved hospital record keeping system that will achieve a longer study.’

Edited sections [Page/Line]

Discussion section, Study limitations subsection, Page 17, Lines 366-368

Reviewer comment:

(And please review the confusing phrase – “prior to” and “more recent than”.

Authors response/action:

Thank you for this suggestion. We have amended the statement to read:

‘A more comprehensive retrospective review was not practical as most of the patients’ records that were supposed to be filed before July 2019 and later than October 2019 could not be traced due to poor record-keeping, a general problem noted in Zambia [14]. The trial filing system used between July 2019 and October 2019 improved patient record keeping in the absence of an electronic filing system.’

Edited section [Page/Line]

Methods section, Design and setting subsection, Pages 3-4, Lines 72-77

Reviewer comment:

L84 “in the absence of…” this is a limitation in the author’s Hospital, or in the referring Hospitals? (If it’s in the referring Hospital, we would consider it acceptable, for as pointed before, only the UTH has ENT specialists. Also, it is a very specific issue: why mention this one limitation, and in relation to the pharynx alone? Why not mention laryngeal endoscopy? Or list all other limitations… I suggest you clarify why this issue is specifically relevant, or else remove it.

Authors' response/action:

We are grateful for this comment and thank the reviewer for their guidance.

This limitation is in the referring hospitals. We do agree with the suggestion that we either list all the limitations or remove the one we have reported. As listing the limitations would significantly lengthen the manuscript, we have gone with the option of removing it. Accordingly, the sentence ‘In the absence of endoscopes, lateral soft tissue x-rays are utilised in the diagnosis of postnasal space masses (including enlarged adenoids)’ has been deleted from the Methods section

Edited section [Page/Line]

Sentence deleted from the Methods section

Reviewer comment:

L99 Was the considered ENT diagnosis the first impression diagnosis or the diagnosis after tests? Would you consider a misdiagnose a diagnose that was not possible because of lack of access to tests? (For instance, a diagnosis of tracheal tumor instead of laryngeal papilloma in a Hospital with no endoscopy).

Author response/action:

We are grateful that the reviewer picked up this ambiguity.

The considered ENT diagnosis was the final diagnosis, that arrived at after investigations (tests, imaging, endoscopy, etc). The occasional definitive diagnoses that remained elusive after investigations (queried diagnoses) were assumed definite, as already stated in the Methods section as ‘Queried diagnoses made by the referring clinicians and the specialist ENT surgeon were assumed definite because they often fall within the broad category of the actual patient pathology, as has been the principal researcher’s experience.’ [Methods section, Measurements and outcomes subsection, Page 5, Lines 99-101]

For clarity, we have added the sentence ‘The considered specialist ENT surgeon diagnosis was that made after investigating the patient as applicable (definitive or final diagnosis)’ to the methods section of the manuscript.

Edited sections [Page/Line]

Methods section, Measurements and outcomes subsection, Pages 4-5, Lines 95-97

Reviewer comment:

L104 would mean “all available primary care options had not been exhausted”?

Authors' response/action:

Correct. Thank you for picking that up. We had omitted the word ‘not’, which has now been inserted.

Edited section [page/Line]

Methods section, Measurements and outcomes subsection, Page 5, Line 107

Reviewer comment:

112 “referral reason” is “referral diagnosis”?

Authors' response/action:

The two terms are different.

The referral diagnosis is the disease (e.g., ear wax impaction) and the reason for referral would be why the patient is being referred to the ENT surgeon and not managed at the local facility (e.g., for ear irrigation because of lack of ear syringe). Another example would be for the diagnosis of complicated sinusitis (referral diagnosis) sent to the specialist for cross-sectional imaging and sinus surgery (referral reason)

Reviewer comment:

L132 The author state that “Informed consent from the patients was not necessary and, therefore, was not obtained”. Consent is always needed, but under certain circumstances may be dismissed. So please address this issue here, admit it was not obtained because of some relevant reason (suggest e.g. the research is of minimal risk, methods for protecting confidentiality are well outlined, and identifiers are destroyed as soon as possible…) and this was known to the Ethics Committee when presented for approval.

Authors' response/action:

We thank the reviewer for this critical observation. We in fact did apply for an ethics waiver as the risk of the research to the patient was minimal, which was granted by the Ethics Boards. We have since amended our Ethics section of the manuscript to read:

‘The protocol and procedures of this study were approved by the University of KwaZulu-Natal Biomedical Research Ethics Committee (Ref: BREC/00001984/2020) following the South African national guidelines on Biomedical Research. In addition, ethics approval was obtained from the University of Zambia Biomedical Research Ethics Committee (Ref: REF. NO. 1380-2020) and the Zambia National Health Research Authority (Ref: NHRA00007/15/03/2021). Informed consent was waived by the Ethics Boards as the research was of minimal risk to the patient. Gatekeeper permission to conduct the study was obtained from UTH [no Reference number]. All data was fully anonymised following completion of the study. The study was cleared for publication by the Zambia National Health Research Authority (NHRA).’

Edited section [Page/Line]

Methods section, Ethics subsection, Page 6, Lines 130-139

Reviewer comment:

L 143 If 11% were self-referrals, who made the referral diagnosis? If the self-referred were self-diagnosed too, they shouldn’t be included. It seems you considered this latter in L172 but not here

Authors' response/action:

Thank you for this enquiry.

Self-referrals did not have a referral diagnosis and, as the reviewer has rightly pointed out, were therefore not included in analysis of diagnosis mismatch, appropriateness of referrals and diagnosis agreement (Results and analysis section, Pages 7-10, Lines 152-204). The ENT disease epidemiology was determined from the diagnoses made by the ENT specialist, because it reflected the true incidence treated at the specialist centre (Results and analysis section, Page 7, Lines 147-151), Self-referrals were also given a diagnosis by the ENT specialist and excluding them from the determination of disease epidemiology would have been erroneous.

Therefore, we did not act on this comment.

Reviewer comment:

L153 “most misdiagnosis were from level 3 hospitals” may lead to incorrect interpretation, for these hospitals were the ones referring the most in total. In fact, they were in proportion more accurate than level 1, and we can assume that they are even leveled with the other two levels. So, the authors construction is misleading

Authors' response/action:

We are grateful the reviewer noticed this error. We have corrected that statement to read ‘Most (74.1%, n=80) misdiagnoses were from level 1 hospitals (S2 Table).’

The discussion section relating to this correction has not been altered as the facts recorded in that section are accurate.

Edited section [Page/Line]

Results and analysis section, Diagnostic accuracy and mismatch subsection, Page 7, Lines 156-157

Reviewer comment:

L171 the total number (591) does not match the number of included participants

Authors' response/action:

The number in Table 1 does not match the number of included participants because, for the purpose of this manuscript, we only included the 10 most common diagnoses made at the specialist facility, and noted it in our statement ‘Table 1 outlines the common diagnoses made by the ENT specialist at UTH ENT clinic, and proportions of their corresponding referring (non-ENT) clinician diagnoses’ contained in the Results and analysis section, Diagnosis accuracy and mismatch subsection, Page 7, Lines 160-161. We felt including all the many diagnoses made would make the table unnecessarily long and add little value to the manuscript.

We therefore did not act on this suggestion.

Reviewer comment:

L186 1374 referrals does not agree to L138 1543 referrals. Please correct it.

Authors' response/action:

We acknowledge this suggestion and apologise for not making this clear enough, and for the erroneous figure 1374 instead of 1372.

1543 were all patients included in the study, stated as ‘1543 patients of age 0-87 years (mean age 25 � 21 years [mean �SD]) were included in the study, comprising 47.3% (n = 729) children (�18 years of age) and 52.7% (n=814) adults’ in our submitted manuscript [Results and analysis section, Patient demographics subsection, Page 6, Lines 142-143]. The 1372 referrals were those from non-ENT specialist clinicians (1543 total patients less 171 self-referrals).

To remove the ambiguity, under the Results and analysis section, we have amended the sentence ‘Of the total 1374 referrals, 56.6% (n=777) were inappropriate’ to read ‘Of the total 1372 non-ENT specialist clinician referrals, 56.6% (n=777) were inappropriate’.

Edited section [Page/Line]

Results and analysis section, Appropriateness of referrals subsection, Page 9, Line 185

Reviewer comment:

L330 Limitations’ discussion: you might discuss that some referral diagnosis might be a misdiagnosis because of time delay after referral? (e.g., tonsillar hypertrophy that got better) or just upgraded or downgraded (sinusitis to allergic rhinitis, or vice versa – allergic rhinitis often has sinusitis). We are never told how long it took from referral to ENT consulting, and neither if treatment was done in the meantime while waiting. The patient might have been referred for allergic rhinitis in the spring and was observed by the ENT in August presenting with a cold with sinusitis, for instance.

Authors response/action:

Thank you for this important suggestion.

We do acknowledge that delays in patients reaching the specialist are not uncommon in Zambia. However, it is very rare to get a patient referral letter without the date of referral (the date the letter was written) and unusual to have the treatment instituted not recorded on the referral letter. Therefore, the reviewers’ view that ‘We are never told how long it took from referral to ENT consulting, and neither if treatment was done in the meantime while waiting’ may be inaccurate if applied to the Zambian setting. The date of referral and treatment started is nearly always reflected on the referral letter, so delays would be extrapolated from that information.

We have acted on this suggestion by adding the sentence ‘In addition, pre-referral medical treatment and possible delays in patients reaching the specialist ENT facility might have altered the disease process and resulted in perceived misdiagnoses’ to our Study limitations section of the discussion.

Edited section [Page/Line]

Discussions section, Study limitations subsection, Page 16, Lines 346-348

Reviewer comment:

Also, the patient might have more than one diagnosis and at the time of referral - the most relevant one might not be that same when seen by the ENT surgeon (we must consider this when chronic sinusitis is mislabeled as recurrent tonsillitis, would you agree it’s hard to confuse on with the other?).

Authors' response/action:

A valid observation, thank you. We already acknowledged this fact in our Study limitations subsection of the Discussion section as ‘Also, since we only considered the primary diagnoses for our analysis, there might have been secondary referral diagnoses or complications that might have been correct but not considered’ [Lines 344-346]. In dealing with this further, we have added the sentence ‘In addition, pre-referral medical treatment and possible delays in patients reaching the specialist ENT facility might have altered the disease process and resulted in perceived misdiagnoses’ to our limitations section of the discussion’.

It is indeed hard to confuse chronic sinusitis with recurrent tonsillitis, and part of the explanation could be what the reviewer has suggested (addressed as above). However, this explanation may not apply to all cases, and we do see some surprising misdiagnoses, as in this case!

Edited section [Page/Line]

Discussions section, Study limitations subsection, Page 16, Lines 346-348

Reviewer comment:

Lack of endoscopy or other tests might also be responsible (tracheal tumor in a case of laryngeal papilloma is a fair mistake, one might say, and in any case deserving referral).

Authors' response/action:

True. The lack of endoscopy or other tests as a cause of misdiagnosis was acknowledged in our submitted manuscript, stated as:

‘However, the widespread shortage of ENT diagnostic instruments across Zambia may explain the higher likelihood of misdiagnosis of patients with ear and those with sinonasal diseases. As nasal specula, otoscopes and endoscopes are seldom available in health facilities [5], clinicians seldomly perform complete ear and nasal examinations for diagnostic purposes. Except that of the larynx, much of the head and neck pathology requires no instrumentation to complete. In addition to the lack of sufficient skills and equipment at lower-level hospitals, patient referral networks in Zambia and many other low-income nations are undermined by poor coordination between lower and upper-level hospitals [36]. This may, in part, explain the high rate of inappropriate referrals noted in this study’ (Discussion section, Page 13, Lines 273-281).

We also note that, while a referral for a tracheal tumour confused for laryngeal papilloma is a misdiagnosis, it is certainly an appropriate and deserving referral and was treated as such in our analysis. We are also of the view that, in the absence of endoscopic equipment, simple imaging e.g., x-ray may be successfully employed to make the diagnosis of tracheal or laryngeal tumours, coupled with good history taking and clinical examination.

Reviewer comment:

And finally, treatment (as you state in L188 for 25%) may have changed the initial diagnosis.

Authors 'response/action:

The 25% of inappropriate referrals referred to here are those that required trial of treatment before referral to ENT but did not get it. The patients sent for specialist care after treatment were those who did not respond to treatment, or partially responded to it, and it would be unlikely for the patient to present to the ENT with a different diagnosis.

However, we acknowledge this possibility and added ‘In addition, pre-referral medical treatment and possible delays in patients reaching the specialist ENT facility might have altered the disease process and resulted in perceived misdiagnoses’ to our limitations section of the discussion.

Edited section [[Page/Line]

Discussion section, Study limitations subsection, Page 16, Lines 346-348

Reviewer comment:

Also, referral appropriateness limitations are not discussed. The tools used to classify appropriateness pointed by the authors (as much as by Blundel) are highly subjective, and prone to misjudgment. For instance, were the authors able to retrospectively verify that all the needed tests were indeed available (and wrongly not used) at the time of referral? Was this done for every hospital? Can we confirm that all the primary care options were indeed available at that time, on a retrospective study? I know (having myself worked in Africa) that such availability varies a lot, and machines that are supposed to be working, sometimes have malfunctions that take a very long time to fix.

Authors' response/action

We thank the author for this critical observation. We have addressed this concern by adding the following section to the limitations section of the manuscript:

‘We acknowledge that our interpretation of ‘inappropriate referral’, even though according to Blundel et al. [17], was subjective and prone to bias as we relied on patient clinical files and referral documents for categorisation as appropriate or inappropriate. While it is a requirement in Zambia for clinicians to record investigations done and treatment instituted on the referral letter, some referring clinicians may not have inputted this information for the ENT specialist to note. Possibly, some of the reasons for not performing tests (i.e., non-functioning equipment, lack of reagents, unavailable expertise) at the referring facilities may not have been recorded on the referral letters, which may have increased the proportion of inappropriate referrals observed in our study. Another major limitation was that our utilisation of one ENT specialist to classify ENT diagnoses as matching or different was prone to bias.’

Edited section [Page/Line]

Discussion section, Limitations subsection, Pages 16-17, Lines 354-364

Reviewer comment:

And finally, how do referral appropriateness and misdiagnosis relate to each other? Inappropriate referrals are often misdiagnosis too?

Authors' response/action:

For this study, we defined ‘inappropriate referral’ according to Blundel et al. [17]. A referral was inappropriate if it was either unnecessary (all available primary care options had not been exhausted), and/or had a wrong referral destination (patient referred to ENT instead of another medical speciality), and/or was of poor quality (necessary tests and investigations were not performed considering the available resources of the referring facility). Misdiagnosis is an ‘erroneous diagnosis’ [1]; the patient receives an incorrect diagnosis. While misdiagnoses may lead to inappropriate referrals, inappropriate referrals may not result in misdiagnosis.

1. Dong, D., Chung, R.YN., Chan, R.H.W. et al. Why is misdiagnosis more likely among some people with rare diseases than others? Insights from a population-based cross-sectional study in China. Orphanet J Rare Dis 15, 307 (2020). https://doi.org/10.1186/s13023-020-01587-

Reviewer comment:

The authors write a long discussion text that leans on political and economy options and suggestions. I find that this part of the discussion is too long, and in part grows far from the studied subject, drawing some assumptions that are not supported or not related to the presented results. However, they leave out one suggestion that has been working very well in solving the referral issues in some other African countries, that is telemedicine

Authors' response/action:

We thank the reviewer for this excellent suggestion and note their concern. We recognise, too, that while telemedicine offers a great practical solution in the improvement of health services, it requires political will and funding for its establishment and sustainability, especially in developing countries like Zambia. In addressing the concern raised , we have added the following section to the discussion of our manuscript:

‘Further, the introduction of ENT telemedicine to Zambia may improve patients’ access to quality health care. While telemedicine has been successfully implemented in other medical subspecialties in Zambia [41], it is yet to be used in ENT health care. However, to ensure success of telemedicine, the government must develop its own implementation strategies that are tandem with Zambia’s needs [42].

Edited section [Page/Line]

Discussion section, Page 15, Lines 318-322

Reviewer comment:

In conclusion, I consider this manuscript a relevant one, but I urge the authors to reconsider some of the labeled misdiagnosis, and to address and solve the pointed biases, namely extend the studied records for the rest of the year.

Authors' response/action

We are glad the reviewer considered our manuscript relevant. We have addressed the issue of some of the labelled misdiagnoses and biases in our responses above. Unfortunately, we are unable to extend our retrospective study due the poor record keeping at the facility. The explanation is as below:

We are also appreciative of the fact that the reviewer observed that in the cited paper, the authors managed to trace more records from the Cancer Diseases Hospital (CDH), Zambia’s only Oncology Centre. The fundamental difference between CDH and the University Teaching Hospitals (UTH), where our study was done is that CDH has a patient electronic data base which makes retrieval of patient records easier, as opposed to the manual record keeping at UTH. Due to the lack of electronic record keeping at UTH, some patients are not entered into the manual registers, others carry their files home. This is a general problem in Zambia and other resource-limited nations. The lack of electronic record keeping systems as a reason for the sparsity of data relating to diagnostic error in poor countries was referenced in our manuscript’s introduction as ’However, in low-resource settings, data relating to harmful diagnostic error remains sparse due to limited access to diagnostic resources, shortage of qualified medical professionals and poverty of electronic record-keeping systems [11]’ [Introduction section, page 3, Lines 56-59]

(Reference 11: Singh H, Schiff GD, Graber ML, Onakpoya I, Thompson MJ. The global burden of diagnostic errors in primary care. BMJ Qual Saf. 2017 Jun 1;26(6):484–94. )

The ENT Surgeon who replaced the one that left UTH in July 2019 introduced an efficient patient record filing system that was abandoned when he was transferred to another tertiary facility in October 2019. After he left, the ENT clinic reverted to its default filing system, with some patients taking their medical files home and some not entered into the book. Even when these patients were manually registered into a book, there was frequently critical identifying data that was missing. This is fundamentally the reason why it was difficult to trace files of patients that were treated before July 2019 and after October 2019. Unfortunately, this was something we could not do anything about, but creates an opportunity to design better filing systems at the facility. In making this clearer, we added the statement ‘The trial filing system used between July 2019 and October 2019 had improved patient record keeping in the absence of an electronic filing system’ to the Methods section of the manuscript [Methods section, Design and setting subsection, Pages 4, Lines 75-77]. In addition, under the Limitations section, we have added the words ‘, which requires improvement’ to the sentence ‘We could not conduct a more comprehensive retrospective review study because most hospital records of patients treated at the facility before July 2019 and beyond October 2019 could not be traced due to poor record-keeping.’ [Discussion section, Study Limitations subsection, Page 16, Line 341]

In acknowledging that a longer, more robust study is required, we included the section ‘Overall, we consider this investigation relatively preliminary and encourage replication on an improved hospital record keeping system that will achieve a longer study’ to our limitations section of the manuscript. [Discussion section, Study Limitations subsection, Page 17, Lines 366-368]

Edited section [Page/Line]

Methods section, Design and setting subsection, Page 4, Lines 75-77

Discussion section, Study Limitations subsection, Page 16, Line 341

Discussion section, Study Limitations subsection, Page 17, Lines 366-368

Reviewer #2: Manuscript Number PONE-D-22-27161

Reviewer comment:

This study is of interest for publication in this journal. The study presents an analysis of the diagnostic accuracy in patients with ENT pathology and referred to a tertiary hospital.

Authors' response/action:

We thank the reviewer for their accurate assessment of our manuscript.

Major revisions

Reviewer comment:

1. Authors performed an evaluation of the diagnostic accuracy of the patients refereed to another hospital and identified the existence of misdiagnosis cases. However, the authors should not indicate that the objective is the evaluation of misdiagnosis because the real number of misdiagnosis will be much higher. This analysis does not allow the identification of patients who initially had a wrong diagnosis and a wrong treatment but improved without the need to be referred to another hospital. Patients who received a curative treatment, despite the wrong diagnosis, are also not included (example: patient with bacterial tonsillitis with otalgia and medicated with antibiotic therapy for the otitis (wrong diagnosis) but improves with treatment because antibiotics cured the tonsillitis. Thus, this work does not assess misdiagnosis but assesses diagnostic accuracy in patients referred to another hospital. Thus, the objective of the study should be changed.

Authors' response/action:

An excellent observation. In addressing this concern, our initial objective ‘In this study, we estimated the prevalence of misdiagnosis and inappropriate referrals among patients treated at Zambia’s highest ENT treatment facility. In addition, we determined the level of agreement of ENT diagnosis between the specialist ENT surgeon and referring clinicians’ was restated:

‘In this study, we determined the diagnostic accuracy and estimated the appropriateness of referrals among patients treated at Zambia’s highest ENT treatment facility. In addition, we determined the level of agreement of ENT diagnosis between the ENT specialist and referring clinicians.’

Edited section [Page/Line]

Introduction section, Page 3, Lines 64-67

Minor revisions

Reviewer comment:

1. ENT is a medical and surgical specialty. Thus, "ENT surgeon" should be replaced by "ENT doctor", "ENT specialist" or “ENT clinician”.

Authors' response/action:

We have replaced ‘ENT surgeon’ with ‘ENT specialist’ throughout the manuscript

Edited section [Page/Line]

Lines 32, 66, 80, 95, 100, 102, 103, 115, 119, 126, 153, 160, 170, 173, 201, 202, 203, 204, 251, 312

Reviewer comment:

2. Authors performed an evaluation between 1 July 2019 and 30 October 2019 because poor record-keeping. However the authors do not explain why there were good clinical records in this period. If these records were more detailed due to the existence of the study, the choice of this time period must be explained, and related to the seasonality of some ENT pathologies;

Authors' response/action:

We are grateful for this comment and acknowledge the need to elaborate this further.

In our manuscript we cited a paper by Mumba et al. [1] that had similar difficulties in retrieving patient records. The study was done at Cancer Diseases Hospital (CDH), Zambia’s only Oncology Centre. In that study, however, the authors managed to trace more records because the hospital uses an electronic record keeping system. The fundamental difference between CDH and the University Teaching Hospitals (UTH), where our study was done is that CDH has a patient electronic data base which makes retrieval of patient records easier, as opposed to the manual record keeping at UTH. Due to the lack of electronic record keeping at UTH, some patients are not entered into the manual registers, others carry their files home. This is a general problem in Zambia and other resource-limited nations. The lack of electronic record keeping systems as a reason for the sparsity of data relating to diagnostic error in poor countries was referenced in our manuscript’s introduction as ’However, in low-resource settings, data relating to harmful diagnostic error remains sparse due to limited access to diagnostic resources, shortage of qualified medical professionals and poverty of electronic record-keeping systems [11]’ [Introduction section, page 3, Lines 57-59]

(Reference 11: Singh H, Schiff GD, Graber ML, Onakpoya I, Thompson MJ. The global burden of diagnostic errors in primary care. BMJ Qual Saf. 2017 Jun 1;26(6):484–94.)

The ENT Surgeon who replaced the one that left UTH in July 2019 introduced an efficient patient record filing system that was abandoned when he was transferred to another tertiary facility in October 2019. After he left, the ENT clinic slid right back into its default filing system, with some patients taking their medical files home and some not entered into the book. Even when these patients were manually registered into a book, there was frequently critical identifying data that was missing. This is fundamentally the reason why it was difficult to trace files of patients that were treated before July 2019 and after October 2019. Unfortunately, this was something we could not do anything about, but creates an opportunity to design better filing systems at the facility. In making this clearer, we added the statement ‘The trial filing system used between July 2019 and October 2019 had improved patient record keeping in the absence of an electronic filing system’to the Methods section of the manuscript [Methods section, Design and setting subsection, Pages 4, Lines 75-77]. In addition, we have rephrased part of the limitations section to read ‘We could not conduct a more comprehensive retrospective review study because most hospital records of patients treated at the facility before July 2019 and beyond October 2019 could not be traced due to poor record-keeping, which requires improvement’ [Discussion section, Study Limitations subsection, Page 16, Line 339-341]

The limitation relating to the seasonality of some of the ENT diseases was acknowledged in our manuscript as ‘Further, the proportions of some of the diseases described in this study may vary with changing seasons. For instance, in Zambia, viral rhinopharyngitis and otitis media peaks in the cold season. However, in our study, the prevalence of viral rhinopharyngitis and otitis media likely represented the annual incidence because the study period included both cold and hot months.’ [Discussion section, Study limitations subsection, page 16, Lines 349-353].

In acknowledging that a longer, more robust study is required, we included the section ‘Overall, we consider this investigation relatively preliminary and encourage replication on an improved hospital record keeping system that will achieve a longer study’ to our limitations section of the manuscript. [Discussion section, Study limitations subsection, page 17, Lines 366-368]

1. Mumba JM, Kasonka L, Owiti OB, Andrew J, Lubeya MK, Lukama L, et al. Cervical cancer diagnosis and treatment delays in the developing world: Evidence from a hospital-based study in Zambia. Gynecologic Oncology Reports. 2021 Aug 1;37:100784.

Edited sections [Page/Line]

Methods section, Design and setting subsection, Page 4, Lines 75-77

Discussion section, Study Limitations subsection, Page 16, Line 339-341

Discussion section, Study limitations subsection, page 17, Lines 366-368

Reviewer comment:

3. Line 153 - “Despite non-ENT clinicians correctly diagnosing 72.0% (n=18)….” Authors don’t know the percentage of correct diagnosis, the authors only know the number of patients referred with a correct diagnosis and don’t know the correct diagnosis non-refereed

Authors' response/action:

We are glad the author picked this up. To make certain that the readers know that these figures apply to patients referred for specialist care and not to all patients (referred and non-referred) seen at the referring facility, we amended the applicable statement to read:

‘Despite non-ENT clinicians correctly diagnosing 72.0% (n=18) of nasal polyps and 51.5% (n=35) of acute tonsillitis in patients referred for specialist care, only 3.3% (n=4) of them correctly diagnosed allergic rhinitis.’

Edited section [Page/Line]

Results and analysis section, diagnostic accuracy and mismatch subsection, Page 7, Lines 157-159

Reviewer comment:

4. Table 1 – I don’t understand the reason to refer an acute tonsillitis to a tertiary hospital (recurrent tonsillitis to surgery or tonsillitis resistant to treatment?). The same to allergic rhinitis and acute otitis media. This should be explained in the methods and could be important in understanding the diagnostic accuracy in the discussion.

Authors' response/action:

We do agree with the author that some of the ENT conditions referred to the tertiary hospital should have been handled by the referring facilities. The ‘Reason for referral’ was captured in our data collection (see Methods section, Participant selection and sampling subsection, Page 4, Lines 90-92) and considered it for classifying the referral as appropriate or inappropriate according to Blundel et al. The discussion section below partly explained the possible reasons why patients with allergic rhinitis or acute tonsillitis may be referred to a tertiary hospital:

‘The poor agreement between the referring clinicians and ENT specialist (k=0.0001) and the high rate (56.6%) of inappropriate referrals for ENT specialist care may indicate inadequate training and poor knowledge of basic ENT disease management among most clinicians. In Zambia and the rest of the world, ENT is given little weight in medical school curricula, with most ENT undergraduate curricula offering a 1-2 week predominantly observational rotation [30]. As such, most clinicians lack the necessary skills to confidently manage ENT diseases upon completion of their undergraduate medical training [31]. Even if some literature emphasizes the superiority of adequate undergraduate ENT medical training over the duration spent as a general practitioner in the acquisition of competence to treat ENT conditions [32], the majority of clinicians often do require additional training to improve their competence following their undergraduate medical education [31]. Therefore, improving ENT medical education and clinical exposure at undergraduate, graduate and in-service training in Zambia would give clinicians better knowledge and skill to handle ENT conditions [33,32]. [Discussion section, Pages 12-13, Lines 251-263]

We are glad to report that we are currently conducting a study to gain more insight into why such referrals are prevalent. To show this, we have added the sentences:

‘A study assessing the knowledge, attitudes and current practices of health workers with regards to the basic management of ENT diseases in Zambia is ongoing.' [Discussion section, Page13, Lines 263-267] We hope that the study will provide more insight into why some uncomplicated and correctly diagnosed conditions (i.e., acute tonsillitis, allergic rhinitis) are sent for ENT specialist treatment.’

Edited sections [Page/Line]

Discussion section, Page13, Lines 263-267

Reviewer comment:

5. The author should reinforce the comparison with developed countries (add comparison with a European country) in percentage of diagnostic accuracy.

Authors' response/action:

We acknowledge this important suggestion. In response, we have added the sentence ‘Further, a study in the Netherlands reported diagnostic accuracy of 0.42 among medical residents, scored as either 0 (incorrect), 0.5 (partially correct) or 1 (correct)’ to the discussion section of the manuscript. The referenced paper has been inserted [reference 29]

Edited section [Page/Line]

Discussion section, Page 10, Lines 240-242

Reviewer #3

Reviewer comment:

After reviewing manuscript number PONE-D-22-27161 Research Article, with Title Ear, Nose and Throat (ENT) disease diagnostic error in low-resource health care: observations from a hospital-based cross-sectional study, we found it to have a technically acceptable scientific basis. The presentation of the document is intelligible, clear and unequivocal scientific language was used, and the conclusions presented are based on the data collected. It is also understood that you have made the data underlying the manuscript, which is important not only for the readers but also for its scientific character, available without restrictions. For ethical reasons, it is important to avoid duplication of this publication

Authors' response/action:

We are glad that the reviewer found that our manuscript had a technically acceptable scientific basis. We are also encouraged by their complements.

We have made our data available without restrictions. We will not duplicate the publication.

Additional Changes to the manuscript

The STROBE checklist for cross sectional studies (Supplementary file 2) has been adjusted accordingly, with all changed page numbers highlighted in red. Also, with the addition of new references, we have updated the order of our references.

Attachment

Submitted filename: Response to Reviewers.pdf

Decision Letter 1

Jorge Spratley

30 Jan 2023

Ear, Nose and Throat (ENT) disease diagnostic error in low-resource health care: observations from a hospital-based cross-sectional study

PONE-D-22-27161R1

Dear Dr. Lukama,

We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements.

Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication.

An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at http://www.editorialmanager.com/pone/, click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org.

If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

Kind regards,

Jorge Spratley, MD, PhD

Academic Editor

PLOS ONE

Additional Editor Comments (optional):

Reviewers' comments:

Acceptance letter

Jorge Spratley

1 Feb 2023

PONE-D-22-27161R1

Ear, Nose and Throat (ENT) disease diagnostic error in low-resource health care: observations from a hospital-based cross-sectional study

Dear Dr. Lukama:

I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department.

If your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org.

If we can help with anything else, please email us at plosone@plos.org.

Thank you for submitting your work to PLOS ONE and supporting open access.

Kind regards,

PLOS ONE Editorial Office Staff

on behalf of

Professor Jorge Spratley

Academic Editor

PLOS ONE

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Supplementary Materials

    S1 Appendix. Data collecting tool.

    (DOCX)

    S2 Appendix. The STROBE checklist for cross sectional studies.

    (DOCX)

    S1 Table. Proportional representation of ENT diseases treated at UTH ENT clinic.

    (DOCX)

    S2 Table. Misdiagnosis across age groups, ENT subspecialties, referral facilities level of care and provinces.

    (DOCX)

    S3 Table. Appropriateness of referral across age groups, ENT subspecialties, referral facilities level of care and provinces.

    (DOCX)

    Attachment

    Submitted filename: Response to Reviewers.pdf

    Data Availability Statement

    The data used in this study can be accessed here: Lukama, Lufunda; Aldous, Colleen; Michelo, Charles; Kalinda, Chester (2022), “Dataset on diagnostic errors of Ear, Nose and Throat (ENT) diseases ”, Mendeley Data, v1 (http://dx.doi.org/10.17632/6tgz2db7yn.1).


    Articles from PLOS ONE are provided here courtesy of PLOS

    RESOURCES