Abstract
Objectives
To investigate whether sending patients a copy of their referral letter can reduce non-attendance at outpatient departments.
Design
Blinded randomised controlled trial.
Setting
13 general practices in Exeter, Devon.
Subjects
2078 new consultant referrals from 26 doctors.
Main outcome measures
Non-attendance at outpatient departments.
Results
The doctors excluded 117 (5.6%) referrals, and 100 (4.8%) received no appointment. Attendance data were available for 1857 of the 1861 patients sent an appointment (99.8%). The receipt of a copy letter had no effect on the non-attendance rate: copy 50/912 (5.5%) versus control 50/945 (5.3%).
Conclusion
Copy letters are ineffective in reducing non-attendance at outpatient departments.
Key messages
Copy letters to the patient do not decrease non-attendance at hospital outpatients
The concept of copying letters to patients is acceptable to doctors and patients
It may be possible to apply interventions from primary care to reduce non-attendance
Introduction
Non-attendance for hospital outpatient appointments, both new and follow up, is about 12% nationally.1 The cost per lost appointment during 1984 ranged from £20 to £50.2 In 1997 it had risen to £65.3 An estimated total cost to the NHS is £300 million annually.1 Non-attendance increases waiting lists.4 Non-attendance is unrelated to the seriousness of the illness,5 and patients who do not attend may have treatable morbidity.6 The duration of new appointments is usually longer than follow up appointments7 making non-attendance for new appointments more wasteful.
There are several reasons for non-attendance including illness and work commitments.8,9 Patients may forget their appointment,10,11 but others make a conscious decision to miss it, balancing perceived benefits and costs.12,13 The main hospital factor is inadequate communication.10,11,14 Two studies looked at the provision of information to the patient by the referrer, and showed increased attendance of informed patients.5,15 Another study suggested non-attendance might be an indicator of inadequate communication between the patient and the referring doctor.9
Strategies to reduce non-attendance have previously been hospital based. Reminders alone can reduce non-attendance by 23%.16 Letting the patient make the outpatient appointment can reduce non-attendance by 30% to 50%.17 Larger reductions of 60%18 and 82%19 have been achieved by requesting that patients confirm their attendance by reply paid letter, and then telephoning those that do not reply. Non-attendance can be partially compensated for by overbooking but, if all patients attend, the clinic staff are pressurised. The increased waiting time is also unpopular with patients.20
Extending the concept of sharing information between referrer and patient, we hypothesised that sending patients a copy of their referral letter might reduce non-attendance. A pilot study21 established the acceptability of the process and showed a non-significant reduction in non-attendance.
Subjects and methods
We conducted a blinded randomised controlled study, with randomisation at the level of the individual patient. Our sample size was calculated with 750 referrals in the intervention group and 750 controls: assuming a non-attendance rate of 6% in controls (as shown by the pilot study and from reviewing available data for Exeter) and 3% in the intervention group, this provided 80% power of detecting a significant difference at the 5% level. The study was approved by the local research ethics committee.
All 71 general practitioners in Exeter city, except one on sabbatical and one of the authors (WH), were invited to participate. Overall, 44 showed an interest of whom 26, representing 13 of the 19 practices, were selected using a random numbers table. Data on their fundholding status, hours worked, sex, and qualifications were available from the North and East Devon Health Authority.
Enrolment of patients
All patients referred to consultants in the two local trusts between January and May 1997 were eligible. Exclusion criteria were: termination of pregnancy; referral letters which might distress the patient; and inability to read. We recorded the reasons for exclusion. The doctors dictated the referral letters, stating if the referral was to be excluded. After typing the letter, the secretary was permitted, before randomisation, to check with the doctor that the referral was included. The randomisation was computer generated, and a numbered sealed envelope allocated the patient to receive a copy of their referral letter (copy group) or not (control group). The secretaries were instructed to enter all referral letters, other than those excluded by the doctors, to ensure all eligible referrals were included. This resulted in some letters being entered into the randomisation process which were ineligible as they were not referrals to local NHS consultants. We did not allow exclusions after randomisation in the study—that is, where a doctor decided not to send a copy after allocation to the copy group. Those that did occur were identified by retrieving envelopes after the study, and were added to the copy group for analysis by intention to treat.
Copy letters were sent with a compliments slip marked “For your interest.” The doctors were not involved in the randomisation and remained blinded to the allocation of patients.
Outcome measures
The main outcome measure was the number of non-attendances at new outpatient appointments, either as a first time non-attendance or non-attendance at a rearranged appointment. We monitored attendances by two methods.
The doctors' records were examined by WH for written replies from the hospital team, while blinded to the group to which the patient was allocated. Deaths and hospital admissions were documented. Notes of patients who died (8 cases) were obtained from the North and East Devon Health Authority, who also provided details of new doctors when patients had changed practices (28 cases). The new doctor extracted attendance data from their records.
The doctor is not routinely notified of cancellations, and some departments do not notify the general practitioner of a first non-attendance. For these we used hospital data. The large majority of consultant referrals from Exeter doctors are to the Royal Devon and Exeter Healthcare Trust. All outcomes of outpatient appointments are coded in the hospital’s patient activity system as attendance, cancellation, or non-attendance. In addition to finding cancellations and unnotified non-attendances, this dataset was compared with attendance data from the doctors’ notes. To assess the representativeness of our doctors, we calculated non-attendance rates for those included in the study and those not included in the study before, during, and after the trial, from the hospital dataset.
We sent participating practices a questionnaire after enrolment, enquiring about perceived acceptability of sending out copy letters routinely and about any patients' comments.
Statistical methods
We used a χ2 test to compare attendance outcomes, Student's t tests to compare the means of continuous variables, and a Mann-Whitney U test for non-parametric data.
Results
Recruitment of doctors and enrolment of referrals
The 26 doctors included in our study were representative of the 71 Exeter doctors for fundholding status, hours worked, sex, and membership of the Royal College of General Practitioners. Overall, 2329 referral letters were dictated of which 251 were ineligible (not local NHS consultant referrals) leaving 2078 eligible (see website). The doctors excluded 117 (5.6%) before randomisation owing to termination of pregnancy,17 inability to read,8 potentially serious illness,37 sensitive conditions,29 previous suboptimal care,3 or the patient’s attitude or lifestyle.30 Some had more than one reason.
Therefore, we analysed 1961 eligible referrals; 961 in the copy group (including 12 exclusions after randomisation) and 1000 controls. No appointment was made for 100 referrals: advice letters,33 direct additions to the waiting list,17 rereferral privately,14 hospital admission or death,9 specialist investigation,11 or no apparent reason.16 A total of 1861 outpatient appointments were made. No patients were lost to follow up. Four were still awaiting their appointment at the end of the study in July 1998, making a total of 1857 for whom outcome data were available. Table 1 shows the number referred to each specialty and table 2 shows the demographic details. The small number of psychiatric referrals probably reflects the involvement of community psychiatric nurses, who may arrange consultant referral without direct doctor involvement. There were no significant differences between the copy and control groups for these variables.
Table 1.
Specialty | Copy group | Controls | Total |
---|---|---|---|
Surgery | 208 (22.8) | 205 (21.8) | 413 (22.3) |
Medicine | 130 (14.3) | 123 (13.1) | 253 (13.7) |
Ear, nose, and throat, and oral surgery | 114 (12.5) | 131 (14.0) | 245 (13.2) |
Obstetrics and gynaecology | 108 (11.8) | 120 (12.8) | 228 (12.3) |
Dermatology | 99 (10.7) | 110 (11.7) | 209 (11.3) |
Orthopaedics | 100 (11.0) | 109 (11.6) | 209 (11.3) |
Ophthalmology | 109 (12.0) | 91 (9.7) | 200 (10.8) |
Other | 44 (4.8) | 50 (5.3) | 94 (5.1) |
Psychiatry | 0 (0) | 6 (0.5) | 6 (0.3) |
Total | 912 | 945 | 1857 |
χ2=4.6, df=8, P= 0.71.
Appointments before study closure only.
Table 2.
Characteristic | Copy (n=912) | Control (n=945) | Total (n=1857) | Significance of difference between groups |
---|---|---|---|---|
Mean age in years (SD) | 48.9 (22.1) | 48.5 (23.2) | 48.7 (22.7) | t=0.37, P=0.71 |
No (%) female | 538 (59.0) | 551 (58.3) | 1118 (58.6) | χ2=0.09, P=0.8 |
No (%) from fundholding doctor | 213 (23.4) | 229 (24.2) | 442 (23.8) | χ2=0.20, P=0.70 |
Interval to appointment in days (interquartile range) | 71 (28-94) | 70 (27-94) | 70 (28-94) | P=0.99 (Mann-Whitney U test) |
Attendance rates
The doctors' records contained attendance data for all 1857 patients given an appointment. Corroborating hospital data were available for 1487 (80%). In seven instances a letter in the records described the outpatient consultation, of whom three were recorded by the hospital as non-attenders and four as having cancelled. These patients were classified as attenders. Table 3 shows the attendance data. There was no difference in non-attendance rates between the copy and control groups: 5.5% and 5.3% respectively (β2=3.2, P=0.36). Overall, four of the 111 patients (3.6%) excluded from randomisation failed to attend. Non-attendance rates for patients of all Exeter doctors, from the hospital dataset, remained stable throughout the study with no difference between study and non-study doctors (data not shown).
Table 3.
Outcome | Copy (n=912) | Controls (n=945) | Total (n=1857) |
---|---|---|---|
Total attendances | 836 (91.7) | 856 (90.6) | 1692 (91.1) |
Cancelled and no further appointment requested | 26 (2.9) | 39 (4.1) | 65 (3.5) |
Total non-attendances | 50 (5.5) | 50 (5.3) | 100 (5.4) |
χ2=3.2, df=2, P=0.36.
All practices replied to the questionnaire. All were prepared to consider sending a copy letter routinely, provided it was shown to be beneficial and that the additional cost could be offset. Ten practices had received positive comments from patients. Three patients had telephoned concerned that the copy had been sent to them in error, and three patients had consulted with their doctor to correct inaccuracies in the letter.
Discussion
This is the largest prospective study of non-attendance at outpatient departments. The results do not support the hypothesis that sending patients a copy of their referral letter reduces non-attendance, despite earlier work suggesting that this might be so.5,15,21 The suggestion that non-attendance reflects inadequate communication between doctor and patient9 is not supported by the results. The study shows the importance of performing a full randomised controlled trial rather than relying on impressions from underpowered pilot studies. The non-attendance rate of 5.3% is low compared with previous studies,5,7,10,11,22 but was similar to non-study doctors concurrently. The patients excluded from the randomisation cannot explain this; there were few, and they had a low non-attendance rate, probably reflecting the conditions that led to their exclusion from randomisation. Nor can the seven mismatches between the attendance record in the doctor notes and the hospital data fully explain the low recorded non-attendance rate. The doctor record was used as the gold standard, in that a consultant's reply letter is unequivocal evidence of attendance, whereas other studies quote hospital data,1,17 which will contain these small inaccuracies.
Possible effects of a copy letter
A referral letter may not contain the information that a patient needs to decide if attendance is worthwhile; conversely, it may inform some patients such that they consider attendance unnecessary. In the case of a referral made primarily for reassurance, the copy letter alone may provide this. Although such reassurance might decrease attendance, this effect should increase cancellations rather than non-attendances. It is possible two effects are operating, in different directions: increased attendance (in those whose understanding of their condition—and thus the need for an appointment—is improved) and increased non-attendance (in those reassured by the letter who decide not to attend). On the other hand, it may simply be that any effect of the copy letter is lost by the time of the appointment, on average 10 weeks later. A copy may have to be sent nearer to the time of the appointment to be effective.
The copy letter is not without value, however. Theoretically it empowers patients; it was certainly not seen as undesirable by patients, given the lack of adverse comments. This supports the findings of the pilot study,21 which showed that patients find copy letters helpful. Previous studies have shown the acceptability of sending patients a copy of the consultant's reply to their general practitioner,23,24 but none has studied a copy of the general practitioner's letter to the consultant. The low rate of excluded patients and the doctors' replies to the questionnaire show that they also accept the concept. Several saw provision of a copy as a logical extension of patients' access to their records. The discipline of knowing that the patient may receive a copy could have improved the letter's accuracy, as only three patients sought to have inaccuracies corrected. This can be compared with accuracy levels of 63%-95% when letters are assessed by doctors,25 and 43% when assessed by patients.21
Non-attendance remains an important issue for doctors and their patients. Despite the negative results of this study, the possibility of applying interventions in primary care to reduce non-attendance still exists. Primary care groups will be well placed to advise on which interventions are likely to be best for their populations.
Supplementary Material
Acknowledgments
We thank the general practitioners and their secretaries for their dedication and support; Jim Gooding at the Royal Devon and Exeter Hospital, and Sandra Budd in the North and East Devon Health Authority for their help. Participating general practitioners: RJ Anderson, NCA Bradley, JM Campling, KL Dick, PH Evans, SA Ewings, EA Foster, RS Gopal, JGM Harrill, DCW Hilton, AG Hughes, JR Keith, DP Kernick, AK Midgley, RH Moody, RFE Orrell, BJ Pepper, MD Ramell, CS Reaves, ACD Renouf, DJ Russell, GM Stowell, KG Sweeney, S Vercoe, MB Watson, and A Williams.
Footnotes
Funding: National research and development programme: primary and secondary care interface (grant No. A-63).
Competing interests: None declared.
website extra: A profile of the trial appears on the BMJ’s website www.bmj.com
References
- 1.Committee of Public Accounts 42nd Report. National health service outpatients services in England and Wales. London: Stationery Office; 1995. [Google Scholar]
- 2.Deitch R. Broken NHS appointments: millions wasted? Lancet. 1984;i:1419. doi: 10.1016/s0140-6736(84)91924-x. [DOI] [PubMed] [Google Scholar]
- 3.Stone CA, Palmer JH, Saxby PJ, Devaraj VS. Reducing non-attendance at outpatient clinics. J R Soc Med. 1999;92:114–118. doi: 10.1177/014107689909200304. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Turner AG, Cooke H. Are patients' attitudes the cause of long waiting lists? Br J Clin Pract. 1991;45:97–98. [PubMed] [Google Scholar]
- 5.Lloyd M, Bradford C, Webb S. Non-attendance at outpatient clinics: is it related to the referral process? Fam Pract. 1993;10:111–117. doi: 10.1093/fampra/10.2.111. [DOI] [PubMed] [Google Scholar]
- 6.Hillman JG. Audit of elderly peoples' eye problems and non-attendance at hospital eye service. BMJ. 1994;308:953. doi: 10.1136/bmj.308.6934.953. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Partridge JW. Consultation time, workload, and problems for audit in outpatient clinics. Arch Dis Child. 1992;67:206–210. doi: 10.1136/adc.67.2.206. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Pal B, Taberner D, Readman L, Jones P. Why do outpatients fail to keep their clinic appointments? Results from a survey and recommended remedial actions. Int J Clin Pract. 1998;52:436–437. [PubMed] [Google Scholar]
- 9.Frankel S, Farrow A, West R. Non-attendance or non-invitation? A case-control study of failed outpatient appointments. BMJ. 1989;298:1343–1345. doi: 10.1136/bmj.298.6684.1343. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Bottomley WW, Cotterill JA. An audit of the factors involved in new patient non-attendance in a dermatology out-patient department. Clin Exp Dermatol. 1994;19:399–400. doi: 10.1111/j.1365-2230.1994.tb02691.x. [DOI] [PubMed] [Google Scholar]
- 11.Potamitis T, Chell PB, Jones HS, Murray PI. Non-attendance at ophthalmology outpatient clinics. J R Soc Med. 1994;87:591–593. doi: 10.1177/014107689408701007. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Andrews R, Morgan JD, Addy DP, McNeish AS. Understanding non-attendance in outpatient paediatric clinics. Arch Dis Child. 1990;65:192–195. doi: 10.1136/adc.65.2.192. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Cottrell D, Hill P, Walk D, Dearnaley J, Ierotheou A. Factors influencing non-attendance at child psychiatry out-patient appointments. Br J Psychiatry. 1988;152:201–204. doi: 10.1192/bjp.152.2.201. [DOI] [PubMed] [Google Scholar]
- 14.Herrick J, Gilhooly ML, Geddes DA. Non-attendance at periodontal clinics: forgetting and administrative failure. J Dent. 1994;22:307–309. doi: 10.1016/0300-5712(94)90068-x. [DOI] [PubMed] [Google Scholar]
- 15.Koch A, Gillis LS. Non-attendance of psychiatric outpatients. S Afr Med J. 1991;80:289–291. [PubMed] [Google Scholar]
- 16.Campbell J, Szilagyi P, Rolewald L, Doane C, Roghmann K. Patient-specific reminder letters and pediatric well-child-care show rates. Clin Paediatr. 1994;33:268–272. doi: 10.1177/000992289403300503. [DOI] [PubMed] [Google Scholar]
- 17.Read M, Byrne P, Walsh A. Dial a clinic—a new approach to reducing the number of defaulters. Br J Healthcare Management. 1997;3:307–310. [Google Scholar]
- 18.Royal Mail. Promotional literature. NHS Magazine; 1997:34.
- 19.Sims J. How missing patients can be urged to attend. Healthcare Management June;1995:16.
- 20.Ward R. Outpatients: a ringside view. BMJ. 1998;316:1541–1542. doi: 10.1136/bmj.316.7143.1541a. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Hamilton W, Round A, Taylor P. Dictating clinic letters in front of the patient. BMJ. 1997;314:1416. [PMC free article] [PubMed] [Google Scholar]
- 22.King A, David D, Jones HS, O'Brien C. Factors affecting non-attendance in an ophthalmic outpatient department. J R Soc Med. 1995;88:88–90. [PMC free article] [PubMed] [Google Scholar]
- 23.Waterston T, Lazaro C. Sending parents outpatient letters about their children: parents' and general practitioners' views. Qual Health Care. 1994;3:142–146. doi: 10.1136/qshc.3.3.142. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.Humfress H, Schmidt U. Effect of sending clients a personalised summary letter is being studied. BMJ. 1997;314:1416–1417. [PMC free article] [PubMed] [Google Scholar]
- 25.Jenkins R. Quality of general practitioner referrals to outpatient departments: assessment by specialists and a general practitioner. Br J Gen Pract. 1993;43:111–113. [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.