Abstract
Introduction:
Otolaryngology is a field with a high referral rate; however, there is a dearth of research on the quality of referral letters written in this field. This study was carried out to explicitly assess the quality of referral letters, more specifically in the field of otology.
Materials and Methods:
Two otologists assessed referral letters written by general practitioners or primary care physicians working as family physicians. They were asked to make independent assessment on different variables related to the quality of referral letters and their appropriateness. A “qualified referral letter” in the current study is defined as a letter with standard items, including, description of chief complaint, description of associated symptoms, relevant physical findings, past medical history, drug history, family history, and reasons for referral.
Results:
A total of 1000 referral letters written by 652 primary care physicians were investigated in the current study. The obtained results indicated that 74% of referral letters to otologists contained inadequate information regarding various items in the referral letters. Symptoms, diagnosis, and signs were only reported in 28.3%, 28.9%, and 3.6% of the letters, respectively. The findings showed that most common reasons for referrals were uncertainty in diagnosis (52.4%), persistence of the patient (32.6%), and failed therapy (32%). With regards to case-specific conditions, the highest referral rates were related to external otitis, otitis media with effusion, and acute otitis media.
Conclusion:
According to the obtained results of the current study, the content of referral letters were insufficient or inappropriate. Therefore, it is recommended to improve otolaryngology syllabus and provide suitable courses for undergraduate students in order to become familiar with the importance of referral letter writing.
Key Words: Family physicians, Otolaryngology, Otology
Introduction
Health care quality is a global problem with substantial economic and political burden. The development and implementation of the family physician program in some countries, including Iran, have positively affected healthcare services, especially in rural areas (1). Due to the workload of specialists and expenses of healthcare services in Iran, the Ministry of Health and Medical Education of Iran similar to its counterparts in other countries has executed the family physician program, which acts as a gatekeeper. In this regard, there should be a qualified channel of connection between specialists and referral loop.
Although there is an Academic residency program to become a family physician in Iran, most family physicians are general practitioners who act as primary care physicians (PCPs). Otolaryngology is a medical field with high referral rate, accounting for approximately 50% of child referrals (2). It has been shown that otolaryngology is the third or fifth most common specialty involving the referral process (3-5).Currently, referral letters are the most common means of communication between the PCPs and specialists worldwide. Despite the importance of the referral process, little is known about qualified referral letters in the field of otology. For instance, Dupont evaluated the quality of 600 referral letters from family physicians to dermatologists. He found that only less than 50% of the letters provided the necessary information about the treatments (11).
The essential elements of structural referral letters include reason for referral, medical history including important co-morbidities, clinical signs and symptoms, para-clinical examination results, current medication, and diagnosis (6). Although the main items of referral letters have been standardized by the Ministry of Health and Medical Education in Iran to enhance the quality of referral letters, it seems that the content of referral letters is substandard and unsatisfactory (7-10).
With this background in mind, the current study was motivated to conduct a peer assessment of the quality of referral letters as the means of communication between PCPs and otologists. In order words, the present study aimed to detect the problems in this type of letters. Therefore, the obtained results could be beneficial not only for healthcare providers but also for program directors in the field of medical education.
Materials and Methods
This cross-sectional study was approved by the Local Institutional Review Board of Shiraz University of Medical Sciences (approval no. 6007), Shiraz, Iran. Shiraz is the largest city in the south of Iran with a population of 1.8 million. All referral letters that were included without any specific inclusion criteria for selection of letters. All of them were Witten by PCPs working as family physicians in Shiraz. All PCPs are medical university graduates from Iran. Two academic otologists independently visited the patients in Motahari Outpatient Clinic affiliated with Shiraz University of Medical Sciences. This clinic as a tertiary referral center is the largest outpatient university-affiliated clinic in south of Iran. Each of otologists were independently asked to make decisions on the 14 items in the checklist. The investigated variables related to the quality of referral letters included errors or inattentiveness in referral letters, current chief complaint, description of associated symptoms, relevant physical findings, past medical history, drug history, family history, reason for referral, appropriate para-clinical investigations and their results, as well as provisional diagnosis or clinical impression. Moreover, the otologists asked the investigated patients if the cause for referral was PCPs’ decision or patients’ persistence. In addition, there was a question asking otologists whether the referral letter contents contained sufficient data for decision making. Another questions dealt with otologists’ opinions about the reasons for referrals including uncertainty in PCPs’ diagnosis, failed therapy, and inaccessibility to specialized diagnostic tools or special tests (e.g., imaging investigation). Additional items in the checklist addressed the demographic characteristics of PCPs, such as age, gender, and years of practice. P-value less than 0.05 was considered statistically significant. Although the sample size was calculated at 382 referral letters in the current study, the researchers enhanced the research accuracy by analyzing 1000 referral letters. The reason for this was that a larger number of patients and referral letters were available at Motahari Outpatient Clinic of Shiraz University. The collected data during March 2017 to December 2017 were analyzed using SPSS software (version 15 for Windows; SPSS Inc., Chicago, III., USA) for descriptive statistics. The obtained results were reported as mean±SD or frequency and percentage.
Results
A total of 1000 referral letters in the current study were written by 652 PCPs. The mean age of PCPs was 32.6 years (range: 25-57 years). Regarding gender distribution, 58% of PCPs were male. The mean duration of their practices was 12 years (range: 4-396 months). The referral letters were for 606 female (60.6%) and 394 male (39.4%) patients with the age range of 8 months to 82 years (mean±SD: 40.03±16.76 years).The errors and inattentiveness of PCPs regarding the past medical history and drug history of patients were observed in 354 (35.4%) and 396 (39.6%) of referral letters. Out of 280 (28%) illegible or poorly written letters, 170 (60.7%) and 110 (39.3%) ones were English and Persian, respectively. The findings also showed that 740 (74%) of referral letters contained insufficient amount of data in order to make an appropriate decision. Detected signs were only written in 36 letters (3.6%) out of which 19 (52.8%) were written correctly. The most common signs in referral letters were otorrhea, inflammation of external ear canal, and tympanic membrane perforation (Table.1).
Table 1.
Signs | N | % |
---|---|---|
Otorrhea | 12 | 63.2 |
Inflammation of External Canal | 9 | 47.4 |
Tympanic Membrane Perforation | 8 | 42.1 |
Congested Tympanic Membrane | 6 | 31.6 |
Fungal Infection | 5 | 26.3 |
Compact Wax | 5 | 26.3 |
Facial Nerve Paralysis | 2 | 10.5 |
Tympanosclerotic Plaque | 1 | 5.3 |
Middle Ear Cholesteatoma | 1 | 5.3 |
Middle Ear Granulation tissue | 1 | 5.3 |
Note: Total percentage is more than 100% due to multiple reasons for referral.
Symptoms were indicated in 283 (28.3%) letters out of which 58 (20.5%) were correctly reported. The most common symptoms were hearing loss, earache, and ear secretion (Table.2).
Table 2.
Symptoms | N | % |
---|---|---|
Hearing Loss | 21 | 36.2 |
Pain | 14 | 24.1 |
Ear Secretion | 13 | 22.4 |
Itching | 11 | 19.0 |
Dizziness | 9 | 15.5 |
Tinnitus | 4 | 6.9 |
Facial Asymmetry | 2 | 3.4 |
Note: Total percentage is more than 100%, due to multiple reasons for referral.
As can be seen in Table 3, the most common reasons for referrals were related to the uncertainty in diagnosis (52.4%), patients’ persistent (32.6%), and failed therapy (32%).
Table 3.
Reasons | N | % |
---|---|---|
Uncertainty in Diagnosis | 524 | 52.4 |
Patients' persistent | 326 | 32.6 |
Failed Therapy | 320 | 32.0 |
Advice for Management | 287 | 28.7 |
Requiring Special Tests or Services | 169 | 16.9 |
Note: Total percentage is more than 100% due to multiple reasons for referral
The analysis of 1000 referral letters indicated that diagnosis were written in 289 (28.9%) letters out of which 51 (17.6%) were right diagnoses. As presented in Table 4, otologists considered external otitis, otitis media with effusion, and acute otitis media as the three most common ear problems (14.5%, 12.8%, and 11.7%, respectively).
Table 4.
Diagnosis | N | % |
---|---|---|
External Otitis | 145 | 14.5 |
Otitis Media with Effusion | 128 | 12.8 |
Acute Otitis Media | 117 | 11.7 |
Sensory Neural Hearing Loss | 114 | 11.4 |
Inactive Chronic Otitis Media | 101 | 10.1 |
Normal | 92 | 9.2 |
Active Chronic Otitis Media without Cholesteatoma | 83 | 8.3 |
External Canal Wax | 76 | 7.6 |
Benign Positional Vertigo | 58 | 5.8 |
Active Chronic Otitis Media with Cholesteatoma | 34 | 3.4 |
Otosclerosis | 31 | 3.1 |
Menier's Disease | 18 | 1.8 |
Bell's Palsy | 2 | 0.2 |
Glomus Tumor | 1 | 0.1 |
Discussion
Currently, referral letter itself is a principal means through which an effective professional relationship is established between PCPs and specialists. The content of referral letters is the pivotal aspect of referral process. The findings of the current study indicated that 74% of referral letters contained insufficient data for decision making. In the same vein, many studies mostly in western countries have revealed that referral letters do not convey relevant and adequate information. For example, in a study performed by Jenkins on the quality of general practitioner referrals, it was indicated that errors and omissions regarding past medical history and drug history were in 28% and 26% of referral letters (9). In a study conducted by Forrest et al., the analysis of referrals by 122 pediatricians revealed that no information was transferred to the specialist in 49% of cases (7). In another study, Forrest et al. concluded that family physicians reported only a sign or symptom for one in five referrals (3). In the present study, the obtained results indicated that the 3.6% and 28.3% of referral letters contained information about signs and symptoms, respectively. Moreover, it was found that only 52.7% and 20.5% of the reported signs and symptoms were correct, respectively. In another study conducted by Dupont on the quality of 600 referral letters from family physicians to dermatologists, he mentioned that less than 50% of letters conveyed information about previous treatments (11).
In the present study, the most common reasons for referrals were related to uncertainty in diagnosis (52.4%), persistence of the patient (32.6%), failed therapy (32%), advice seeking for disease management (28.7%), and inaccessibility to specialized diagnostic tools or special tests, such as imaging investigation (16.9%). In addition, the three most common documented symptoms in referral letters were hearing loss, otalgia, and otorrhea.
Regarding case-specific conditions, the highest referral rates were accounted for external otitis, otitis media with effusion, and acute otitis media. Moreover, uncertainty in diagnosis was the most common cause of referrals to otolaryngologists in the current study.
It is commonly believed that PCPs can manage most patients suffering from earache or diagnose the common causes of hearing loss in their community. However, it is worth mentioning that some therapeutic or surgical interventions (e.g., sensory neural hearing loss, management of chronic otitis media with cholesteatoma, complicated chronic otitis media) are beyond the realm of PCP’s knowledge and skills. Some studies showed that family physicians can manage 95% of patients in outpatient centers (3). However, a study of 100 patients suffering from earache by Worrall indicated that rural family physicians could not diagnose the causes of earache in 94 cases (16). It was reported that parents whose children suffered from recurrent acute otitis media or otitis media with effusion affect the decisions made by family physicians. Moreover, family physicians appear to have lower thresholds than pediatricians for the referral of those patients (17). It is generally confirmed that the PCPs’ referral thresholds are based on their values, clinical abilities, and experiences (18). Therefore, the obtained results of the current study highlights the importance of community-based education and mastery of otolaryngology in a properly designed course during undergraduate period. In addition, it has been suggested that both PCPs and consultants develop a program by the integration of clinical guidelines and educational curriculum in order to effectively process the referrals (19-21).
On the other hand, the second most common cause of referral was the persistence of patients, which counts for about one-third of referrals. Similar to other studies, the findings of the current study revealed that the common causes of high referral rate or seemingly inappropriate referrals are patients’ expectation and their insistence (22,23). This rate was reported at 12.2-56% for different regions of Iran (24-26). In a study conducted by Jenkins on 705 referrals, he noted that 13% of the referrals were inappropriate, which this rate was significantly higher in medical specialties than the referral rate to surgeons (19.6% versus 8.6%,( 9).
According to Fertig et al., specialists believe that 9.6% of all referrals by general practitioners are inappropriate. Also otolaryngologists considered that 1.11% of them are inappropriate (27). However, in some countries including Iran, the Ministry of Health has recommended that a 10% referral rate is reasonable (28,29). However, some PCPs believe that their strict roles can act as gatekeepers and refusal of referrals can have detrimental effect on the physician-patient relationship (30). On the other hand, a high rate of referrals can result in a higher level of satisfaction among patients (31). As a fundamental issue in medical professionalism, physicians should be concerned about the cultural dimension of their patients’ needs and expectations (32). On the other hand, paternalistic clinical setting is no longer acceptable, and it is essential to follow a patient-centered care approach (33).
With this background in mind, it is important to ask if the high rate of referral is the main problem in the referral loop. High referral rate is sometimes perceived as an inappropriate issue, whereas it is highly appropriate since it reassures PCPs and patients. However, this threshold of reassurance can vary among PCPs and patients (34). Barnett et al. identified during 1999-2009 there was a 94% surge of ambulatory referrals from 4.8% to 9.3% (35). In addition, over two-thirds of patients (68%) who were visited by a specialist were referred by a family physician (6). In the United States, more than a third of patients are annually referred to specialist for consultation, and specialist visits are more than half of outpatient visits (36). A review of literature showed that the referral rate to specialists was approximately 4.5-20.0%(3,4,28,29,35,37-39). In fact, the number of referral rate itself is not an appropriate indicator of the quality and effectiveness of the referral process (27,40-42). In other words, the effectiveness of a referral system should be assessed based on its outcomes. Bertakis et al. mentioned that older patients, severity of physical condition, and a significant number of previous visits by PCPs were referral predictive factors to specialists (43). On the other hand, under-referral is the main problem rather than over-referral. It has been shown that 26% of malpractice assertions are related to an overlooked or delayed diagnosis as a result of restrictive policy on referrals by PCPs (41,42). Accordingly, it has been suggested that it is not appropriate to impose severe restrictions on referrals to specialists (31).
It should be noted that the current research may have some limitations. At first, it focused on a single clinical field of otology, which constitutes a limited source of information. In order to produce a general concept, it is essential to study other fields of medicine, as well. Moreover, the obtained data regarding patients’ persistent rate could be biased since that data were collected from PCPs’ point of view not based on patients’ clear and original conception.
Conclusion
One of the major findings of the current study was related to the most common diseases a PCPs may encounter in the field of otology. The obtained results of the current study confirmed that the written referral letters by PCPs were poorly written and contained insufficient and inappropriate information in the field of otology. In this regard, it is suggested that program directors design and conduct a proper writing course in medical education. Finally, in order to improve the quality of the referral process, further studies should be carried out to address PCPs’ opinion about the feedback letters from specialists in the referral loop. Generally, these issues in referral process seem to be essential requirements to enhance health care quality as a global concern.
References
- 1.Khayatzadeh-Mahani A, Takian A. Family physician program in Iran: considerations for adapting the policy in urban settings. Archives of Iranian medicine. 2014;17(11):776–8. [PubMed] [Google Scholar]
- 2.Donnelly MJ, Quraishi MS, McShane DP. ENT and general practice: a study of paediatric ENT problems seen in general practice and recommendations for general practitioner training in ENT in Ireland. Irish journal of medical science. 1995;164(3):209–11. doi: 10.1007/BF02967831. [DOI] [PubMed] [Google Scholar]
- 3.Forrest CB, Nutting PA, Starfield B, von Schrader S. Family physicians' referral decisions: results from the ASPN referral study. The Journal of family practice. 2002;51(3):215–22. [PubMed] [Google Scholar]
- 4.Piterman L, Koritsas S. Part II General practitioner-specialist referral process. Internal medicine journal. 2005;35(8):491–6. doi: 10.1111/j.1445-5994.2005.00860.x. [DOI] [PubMed] [Google Scholar]
- 5.Bourguet C, Gilchrist V, McCord G. The consultation and referral process A report from NEON Northeastern Ohio Network Research Group. The Journal of family practice. 1998;46(1):47–53. [PubMed] [Google Scholar]
- 6.Grol R, Rooijackers-Lemmers N, van Kaathoven L, Wollersheim H, Mokkink H. Communication at the interface: do better referral letters produce better consultant replies? The British journal of general practice : the journal of the Royal College of General Practitioners. 2003;53(488):217–9. [PMC free article] [PubMed] [Google Scholar]
- 7.Forrest CB, Glade GB, Baker AE, Bocian A, von Schrader S, Starfield B. Coordination of specialty referrals and physician satisfaction with referral care. Archives of pediatrics & adolescent medicine. 2000;154(5):499–506. doi: 10.1001/archpedi.154.5.499. [DOI] [PubMed] [Google Scholar]
- 8.Lee T, Pappius EM, Goldman L. Impact of inter-physician communication on the effectiveness of medical consultations. The American journal of medicine. 1983;74(1):106–12. doi: 10.1016/0002-9343(83)91126-9. [DOI] [PubMed] [Google Scholar]
- 9.Jenkins RM. Quality of general practitioner referrals to outpatient departments: assessment by specialists and a general practitioner. The British journal of general practice : the journal of the Royal College of General Practitioners1993. 43(368):111–3. [PMC free article] [PubMed] [Google Scholar]
- 10.Williams PT, Peet G. Differences in the value of clinical information: referring physicians versus consulting specialists. The Journal of the American Board of Family Practice/ American Board of Family Practice. 1994;7(4):292–302. [PubMed] [Google Scholar]
- 11.Dupont C. Quality of referral letters. Lancet. 2002;359(9318) doi: 10.1016/S0140-6736(02)08583-5. [DOI] [PubMed] [Google Scholar]
- 12.Francois J. Tool to assess the quality of consultation and referral request letters in family medicine. Canadian family physician Medecin de famille canadien. 2011;57(5):574–5. [PMC free article] [PubMed] [Google Scholar]
- 13.O'Malley AS, Reschovsky JD. Referral and consultation communication between primary care and specialist physicians: finding common ground. Archives of internal medicine. 2011;171(1):56–65. doi: 10.1001/archinternmed.2010.480. [DOI] [PubMed] [Google Scholar]
- 14.Bowling A, Redfern J. The process of outpatient referral and care: the experiences and views of patients, their general practitioners, and specialists. The British journal of general practice : the journal of the Royal College of General Practitioners. 2000;50(451):116–20. [PMC free article] [PubMed] [Google Scholar]
- 15.Webb JB, Khanna A. Can we rely on a general practitioner's referral letter to a skin lesion clinic to prioritize appointments and does it make a difference to the patient's prognosis? Annals of the Royal College of Surgeons of England.2006. 88(1):40–5. doi: 10.1308/003588406X82970. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Worrall G. One hundred earaches. Family practice case series. Canadian family physician Medecin de famille canadien. 2000;46:1081–4. [PMC free article] [PubMed] [Google Scholar]
- 17.McIsaac WJ, Coyte P, Croxford R, Harji S, Feldman W. Referral of children with otitis media Do family physicians and pediatricians agree? Canadian family physician Medecin de famille canadien. 2000;46:1780–2,5-8. [PMC free article] [PubMed] [Google Scholar]
- 18.Newton J, Hayes V, Hutchinson A. Factors influencing general practitioners' referral decisions. Family practice. 1991;8(4):308–13. doi: 10.1093/fampra/8.4.308. [DOI] [PubMed] [Google Scholar]
- 19.Akl EA, Mustafa R, Wilson MC, Symons A, Moheet A, Rosenthal T, et al. Curricula for teaching the content of clinical practice guidelines to family medicine and internal medicine residents in the US: a survey study. Implementation science: IS. 2009;4:59. doi: 10.1186/1748-5908-4-59. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Mostert MC, Richardus JH, de Man RA. Referral of chronic hepatitis B patients from primary to specialist care: making a simple guideline work. Journal of hepatology. 2004;41(6):1026–30. doi: 10.1016/j.jhep.2004.08.012. [DOI] [PubMed] [Google Scholar]
- 21.Murray M. Reducing waits and delays in the referral process. Family practice management. 2002;9(3):39–42. [PubMed] [Google Scholar]
- 22.Webb S, Lloyd M. Prescribing and referral in general practice: a study of patients' expectations and doctors' actions. The British journal of general practice: the journal of the Royal College of General Practitioners. 1994;44(381):165–9. [PMC free article] [PubMed] [Google Scholar]
- 23.Armstrong D, Fry J, Armstrong P. Doctors' perceptions of pressure from patients for referral. BMJ(Clinical research ed) 1991;302(6786):1186–8. doi: 10.1136/bmj.302.6786.1186. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.Hosseini Faraji H. Performance evaluation of family physician program in Imam Khomeini's Relief Committee Yazd province [dissertation]. Yazd. Azad Islamic University ; 2005. [Google Scholar]
- 25.Nasrollahpour Shirvani D, Ashrafian Amiri H, Motlagh ME, Kabir MJ, Maleki MR, Shabestani Monfared A, et al. Evaluation of the function of referral system in family physician program in northern provinces of Iran. Journal of Babol University of Medical Sciences. 2008;11(6):46–52. [Google Scholar]
- 26.Chaman R, Amiri M, Raei M. National family physician plan and referral system. Paiesh. 2012;6:785–90. [Google Scholar]
- 27.Fertig A, Roland M, King H, Moore T. Understanding variation in rates of referral among general practitioners: are inappropriate referrals important and would guidelines help to reduce rates? BMJ (Clinical research ed) 1993;307(6917):1467–70. doi: 10.1136/bmj.307.6917.1467. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.Steinmann P, Baimatova M, Wyss K. Patient referral patterns by family doctors and to selected specialists in Tajikistan. International health. 2012;4(4):268–76. doi: 10.1016/j.inhe.2012.09.003. [DOI] [PubMed] [Google Scholar]
- 29.Eshrati b, Hosseini SS, Farahani M, Azimi M, Zamanian M. Assessing the referral rate of Family Medicine Program from the first level to the second level using funnel plot in Markazi province (Iran) in 2011. Arak University of Medical Sciences Journal. 2013;16(4):0. [Google Scholar]
- 30.Baker R, Lecouturier J, Bond S. Explaining variation in GP referral rates for x-rays for back pain. Implementation science : IS. 2006;1:15. doi: 10.1186/1748-5908-1-15. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.Franks P, Mooney C, Sorbero M. Physician referral rates: style without much substance? Medical care. 2000;38(8):836–46. doi: 10.1097/00005650-200008000-00007. [DOI] [PubMed] [Google Scholar]
- 32.Walsh K. Professionalism in medical education: could an academy play a role? Medical teacher. 2007;29(5):425–6. doi: 10.1080/01421590701452798. [DOI] [PubMed] [Google Scholar]
- 33.Maguire P, Pitceathly C. Key communication skills and how to acquire them. BMJ (Clinical research ed). 2002;325(7366):697–700. doi: 10.1136/bmj.325.7366.697. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34.Blundell N, Clarke A, Mays N. Interpretations of referral appropriateness by senior health managers in five PCT areas in England: a qualitative investigation. Quality & safety in health care. 2010;19(3):182–6. doi: 10.1136/qshc.2007.025684. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 35.Barnett ML, Song Z, Landon BE. Trends in physician referrals in the United States, 1999-2009. Archives of internal medicine. 2012;172(2):163–70. doi: 10.1001/archinternmed.2011.722. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 36.Machlin SR. In: Expenses for office-based physician visits by specialty, 2004. Carper K, Medical Expenditure Panel S, editors. Rockville, Md: Md.: Medical Expenditure Panel Survey, Agency for Healthcare Research and Quality; 2007. [Google Scholar]
- 37.Franks P, Clancy CM. Referrals of adult patients from primary care: demographic disparities and their relationship to HMO insurance. The Journal of family practice. 1997;45(1):47–53. [PubMed] [Google Scholar]
- 38.Mayer TR. Family practice referral patterns in a health maintenance organization. The Journal of family practice. 1982;14(2):315–9. [PubMed] [Google Scholar]
- 39.Brock C. Consultation and referral patterns of family physicians. The Journal of family practice. 1977;4(6):1129–37. [PubMed] [Google Scholar]
- 40.Anthony D. Changing the nature of physician referral relationships in the US: the impact of managed care. Social science & medicine. 2003;56(10):2033–44. doi: 10.1016/s0277-9536(02)00198-3. [DOI] [PubMed] [Google Scholar]
- 41.Knottnerus JA, Joosten J, Daams J. Comparing the quality of referrals of general practitioners with high and average referral rates: an independent panel review. The British journal of general practice: the journal of the Royal College of General Practitioners. 1990;40(334):178–81. [PMC free article] [PubMed] [Google Scholar]
- 42.Reynolds GA, Chitnis JG, Roland MO. General practitioner outpatient referrals: do good doctors refer more patients to hospital? BMJ (Clinical research ed). 1991;302(6787):1250–2. doi: 10.1136/bmj.302.6787.1250. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 43.Bertakis KD, Callahan EJ, Azari R, Robbins JA. Predictors of patient referrals by primary care residents to specialty care clinics. Family medicine. 2001;33(3):203–9. [PubMed] [Google Scholar]