Abstract
Background
Continuity of care in neurological surgery includes preoperative planning, technical and cognitive operative experience, and postoperative follow-up. Determining the extent of continuity of care with duty hour limits is problematic.
Objective
We used electronic health record data to track continuity of care in a neurological surgery program and to assess changes in rotation requirements.
Methods
The electronic health record was surveyed for all dictated resident–neurological surgery patient encounters (excluding progress notes), discharge summaries, and bedside procedures (July 2009–November 2011). Encounters were designated as preoperative, operative, or postoperative and were grouped by postgraduate year (PGY)–1 through PGY-6.
Results
A total of 6382 dictations were reviewed, with 5231 (82.0%) pertinent to neurological surgery. Of the 1469 operative notes, 303 (20.6%) had a record of an encounter with the operating resident in either a postoperative or preoperative setting. Preoperative encounters totaled 10.1% (148 of 1469); postoperative, 5.1% (75 of 1469); and encounters with both were 5.4% (80 of 1469). Continuity of care was as follows: PGY-1, 13.8% (4 of 29); PGY-2, 17.4% (26 of 149); PGY-3, 29.0% (36 of 124); PGY-4, 24.8% (73 of 294); PGY-5, 28.8% (109 of 379); and PGY-6, 11.1% (55 of 494). One of the highest continuity rates was observed in a rotation specifically constructed to enhance continuity of care.
Conclusions
The electronic health record can be used to track resident continuity of care in neurological surgery. The primary operating resident saw the patient in nonoperative settings, such as general admission, clinic visitation, or consultation in 20.6% (303 of 1469) of cases.
What was known
Determining the extent of continuity of care in an era of duty hour limits is problematic.
What is new
Study uses electronic health record data to track continuity of care in a neurological surgery program and to assess changes in rotation requirements.
Limitations
Small sample and single institution study limit generalizability.
Bottom line
Electronic health record data was effective in tracking continuity of care and indicated that the primary operating resident saw the patient in nonoperative settings in 21% of cases.
Introduction
Continuity of care, an “informational, longitudinal, and interpersonal” relationship between patient and physician, is an important concept in medicine and medical education.1 Nonsurgical specialties provide longitudinal care experiences with a panel of patients.2–4 In surgical training programs, the components of continuity of care include participating in preoperative care by deriving diagnoses and planning operative procedures, performing operative procedures, and providing postoperative care.5,6 Resident continuity of care has a positive effect on the care of surgical patients, with research showing patients are more knowledgeable, have better satisfaction, and have improved compliance.5
Despite its importance, providing residents with appropriate continuity of care experiences is difficult. Multiple rotation sites, short rotation time, haphazard clinic scheduling, seeing new patients rather than follow-up patients,7 and work restrictions reducing outpatient clinic experiences limit continuity.8–12 These issues are complicated by other changes in medical education and clinical care, including duty hour restrictions and enhanced supervision requirements.13–16 Complex resident schedules and limited clinic time had an added negative effect on continuity.17 Resident and faculty satisfaction with continuity of care learning experiences has declined since initiation of duty hour limits.18 Clinical rotations may require adjustments to enhance continuity of care experiences to achieve resident educational and patient care benefits. Tracking continuity of care experiences is essential to ensuring that adjustments are meaningful.
However, efforts to assess continuity of care may suffer from methodological flaws. Past efforts, including resident participation questionnaires for limited periods5,19,20 and retrospective medical record reviews,21 were time consuming, labor intensive, and incomplete, capturing only a glimpse of the overall experiences. With the advent (and requirement) of electronic health records (EHRs), there are new opportunities for acquisition of data on residents' educational experiences. We hypothesized that the EHR could be used to track continuity of care in residency programs and to provide data to assess changes in rotations to enhance continuity.
Methods
The University of Missouri Hospital and Clinics (UMHC) uses Powerchart (Cerner) as the software for its EHR. For dictated records, providers, including residents, are identified by a unique 4-digit dictation number entered along with a 9-digit patient visit number and 3-digit type of dictation code at the beginning of dictation. In this way, each dictation can be traced to a specific provider. During rotations at UMHC, neurological surgery residents dictate all admission notes, outpatient encounters, and operative notes for procedures in which they are involved. These dictations are entered into the EHR, categorized as “clinic visits,” “admission notes,” or “operative notes.” These dictations are identified for retrieval by dictation number.
For the purposes of this study, components of continuity of care were defined as preoperative notes (admission notes, consult notes, or preoperative outpatient clinic notes), operative procedure notes, and postoperative clinic notes. We defined continuity of care as the resident participating in the operative procedure and at least the preoperative evaluation or the postoperative evaluation of the patient. Resident evaluations in the preoperative holding area were not included because they did not include participating in the decision for surgery. Daily hospital progress notes during the surgical admission were not included because those notes were entered into the EHR by hand and not dictated and they could not be linked to other encounters. The EHR at UMHC was surveyed for all dictated neurological surgery patient encounters by residents between July 2009 and November 2011, with the exception of progress notes, discharge summaries, and bedside procedures. Encounters were designated as preoperative, operative, or postoperative. Data were initially sorted by resident dictation number. If a resident was involved in a preoperative clinic visit or dictated the hospital admission note and then participated in the surgery, the patient continuity was designated as “preoperative.” Similarly, if a resident saw the patient in a postoperative clinic visit after participating in the patient's operative procedure, the encounters were designated as “postoperative.” Lastly, if the resident participated in a preoperative evaluation and a postoperative clinic visit and participated in the operative procedure, the encounters were designated as “both.” Data were grouped by postgraduate year (PGY)–1 through 6, as well as by specific resident.
During core neurological surgery rotations, residents were expected to attend clinic 2 half-days per week, except the chief resident (PGY-6), who was expected to attend clinic 1 half-day per week. Rotations were similar for residents during each specific year of training, as shown in table 1. Outpatient experiences varied on each rotation. Of note, the PGY-5 rotation was designed specifically to enhance continuity of care with the resident functioning as the liaison to the Harry S. Truman Memorial Veterans' Hospital, among other responsibilities. During this rotation, residents saw all Veterans Health Administration patients in clinics specially designed for them at UMHC, participated in the patients' operative procedures, and saw them for follow-up in the UMHC Veterans Health Administration clinics.
TABLE 1.
Residency Rotations
This project was reviewed by the University of Missouri Health Sciences Institutional Review Board and approved as a Quality Improvement Project.
Results
Between July 2009 and November 2011, 6382 dictations were recorded for residents in the neurological surgery program; of those, 5231 (82.0%) were pertinent to neurological surgery patient evaluation (clinic visits, consultations, admission notes) or surgical procedures (operative notes). Of the 5231 dictations, 1469 (28.1%) were operative notes dictated by residents. Preoperative and postoperative experiences, which form the basis of the continuity of care experiences, and continuity of care by PGY level, are summarized in table 2. Continuity of care was highest for PGY-3 through PGY-5. In PGY-3, the overall operative volume was relatively low (124 of 1469 cases, 8.4%), whereas operative participation was more robust in PGY-4 (294 of 1469 cases, 20.0%) and PGY-5 (379 of 1469 cases, 25.8%). One of the highest continuity rates was observed during the year that included the rotation constructed to enhance continuity of care (PGY-5).
TABLE 2.
Continuity of Care by Postgraduate Year (PGY) Level
Continuity of care was also measured for each individual resident during the study period (table 3). Resident D, who had been in PGY-3, PGY-4, and PGY-5 during the study period, had the highest percentage of continuity of care experience (26.8%, 30 of 112).
TABLE 3.
Continuity of Care by Individual Resident
Discussion
The findings provided the proof-in-principle that the EHR could be used to track the continuity of care by neurological surgery residents. We found that the primary operating resident saw the patient in nonoperative settings, such as admission, clinic visitation, or consultation, in 20.6% (303 of 1469) of cases. Furthermore, a rotation designed with the intent to enhance continuity of care had 1 of the highest rates of continuity of care among rotations. At the same time, the percentage of patients seen preoperatively, intraoperatively, and postoperatively was a disappointing 9.8% (37 of 379). That low percentage relates, in part, to other operative and patient care responsibilities in which residents are involved.
Data such as these presented can be used to guide individual resident education to optimize available experiences or to guide rotation development to enhance continuity of care for this rotation and others. Because medical institutions are required to use EHR for patient care, residency programs have potential access to data to track resident continuity of care. The approach to be used is to retrieve and sort data for each individual resident. In our study, resident dictation number effectively assigned patient encounters to specific residents. Additional effort was needed to sort patient encounters into preoperative, postoperative, operative, and grouped experiences by PGY training. Once data on continuity of care are collected, each program can evaluate rotation structure for appropriate levels of continuity. Mechanisms suggested for improving resident continuity experiences in surgical and nonsurgical specialties have included increasing rotation length13,22,23; mandatory ambulatory clinic19; other means of increasing clinic time13 without increasing panel size3; “resident-return model” of outpatient clinic, in which residents were able to see postoperative patients in clinic, even if they were on a different rotation23; a “one-on-one mentor model,” in which each resident was assigned to a specific faculty member to see all of that faculty member's patient preoperatively, postoperatively, and intraoperatively24; and variable-day clinic schedule for residents' returning patients.2 Some have been more successful than others.
Interestingly, continuity of care was comparable for our PGY-3 residents (29.0%) and PGY-5 residents (28.8%). The PGY-3 residents had lower operative volumes because half of their rotations were nonclinical. In 1 rotation, the PGY-3 resident was assigned to specific faculty members and participated in those faculty members' operative procedures, similar to the one-on-one mentor model of Chung et al.24 Although improvement is possible, the models we have adopted to enhance resident continuity of care include a combination of required clinic experiences and a rotation designed to enhance continuity of care as a stepping stone to independent practice. Required clinics are essentially hit-or-miss; by being in an ambulatory clinic, the resident may see some preoperative patients and then participate in their operative procedures and see some postoperative patients after participating in their operative procedures. This model is illustrated best by the data for residents in PGY-4, who had a 24.8% (73 of 294) continuity rate with a reasonable level of operative experience. Continuity of care rate was highest at 28.8% (109 of 379) for PGY-5 residents in the rotation designed to maximize continuity of care experiences. The rate is not 100% because PGY-5 residents have other operative responsibilities not associated with outpatient clinic responsibilities. To be able to participate in all operative procedures for patients in the Veterans Health Administration, the resident would not be able to attend other pediatric or adult neurological surgery clinics and would not have continuity for pediatric or on-call procedures. Our current data collection method does not permit sorting the operative procedures into those different experiences.
Our study had a number of limitations. It involved a few residents, and residents were not followed for their entire training period. At the same time, all UMHC rotations were included during the study. Another limitation was the loss of information by using unique dictation numbers. Important components of continuity of care, such as involvement in care of patient complications, daily in-hospital care, and fielding outpatient phone calls, cannot be captured by our methodology, and higher levels of continuity of care than what can be tracked may actually be present. Using unique dictation numbers can also be problematic if notes are entered into the EHR without dictation or when dictation aids, such as Dragon (Nuance Communications Inc), which does not use numerical identifiers, are used. We have no metric for what constitutes an appropriate level of continuity of care for clinical care, patient satisfaction, or resident education. In addition, we do not report any specific interventions to improve continuity of care for our residents. Finally, our study was performed at a single institution, and the results may not be generalizable to other institutions.
Conclusion
Our study showed the EHR can provide data to understand the continuity of care experience for neurological surgery residents. The primary operating residents saw patients in nonoperative settings in 20.6% (303 of 1469) of cases, with the most robust experience occurring in a rotation designed to enhance continuity of care. Information of this type can be used to optimize continuity of care experiences and to improve resident education, patient care outcome, and patient satisfaction.
Footnotes
N. Scott Litofsky, MD, FAANS, is Professor, Program Director, and Chief, Division of Neurological Surgery, University of Missouri-Columbia School of Medicine; at the time of the study, Ali Farooqui, MD, was a Resident, Division of Neurological Surgery, University of Missouri-Columbia School of Medicine, and is now unaffiliated; Tomoko Tanaka, MD, is Assistant Professor, Division of Neurological Surgery, University of Missouri-Columbia School of Medicine; and Thor Norregaard, MD, is Assistant Professor, Division of Neurological Surgery, University of Missouri-Columbia School of Medicine.
Funding: The authors report no external funding source for this study.
Conflict of Interest: The authors declare they have no competing interests.
This study was presented in part at the American Association of Neurological Surgeons Annual Meeting in New Orleans, LA, April 28–May 1, 2013.
The authors would like to thank Becky Morton and the staff of the Department of Medical Records at University of Missouri Hospital and Clinics for their assistance in collecting the data for this study.
References
- 1.Saultz JW. Defining and measuring interpersonal continuity of care. Ann Fam Med. 2003;1(3):134–143. doi: 10.1370/afm.23. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Lerner CF, Chung PJ. Continuity of care in fixed-day versus variable-day resident continuity clinics. Acad Pediatr. 2010;10(2):119–123. doi: 10.1016/j.acap.2009.11.002. [DOI] [PubMed] [Google Scholar]
- 3.Francis MD, Zahnd WE, Varney A, Scaife SL, Francis ML. Effect of number of clinics and panel size on patient continuity for medical residents. J Grad Med Educ. 2009;1(2):310–315. doi: 10.4300/JGME-D-09-00017.1. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Steinbook RM. Continuity clinic in psychiatric residency training. Acad Psychiatry. 2007;31(1):15–18. doi: 10.1176/appi.ap.31.1.15. [DOI] [PubMed] [Google Scholar]
- 5.Meick AL, Weber EM, Sidhu RS. Resident continuity of care experience: a casualty of ambulatory surgery and current patient admission practices. Am J Surg. 2007;193(2):243–247. doi: 10.1016/j.amjsurg.2006.11.002. [DOI] [PubMed] [Google Scholar]
- 6.Grady MS, Batjer HH, Dacey RG. Resident duty hour regulation and patient safety: establishing a balance between concerns about resident fatigue and adequate training in neurosurgery. J Neurosurg. 2009;110(5):828–836. doi: 10.3171/2009.2.JNS081583. [DOI] [PubMed] [Google Scholar]
- 7.Wong RW, Lochnan HA. A web-based simulation of a longitudinal clinic used in a 4-week ambulatory rotation: a cohort study. BMC Med Educ. 2009;9:8. doi: 10.1186/1472-6920-9-8. doi:10.1186/1472-6920-9-8. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Cohel-Gadol AA, Piepgras DG, Krishnamurthy S, Fessler RD. Resident duty hours reform: results of a national survey of the program directors and residents in neurosurgery training programs. Neurosurgery. 2005;56(2):398–403. doi: 10.1227/01.neu.0000147999.64356.57. [DOI] [PubMed] [Google Scholar]
- 9.Feanny MA, Scott BG, Mattox KL, Hirshberg A. Impact of the 80-hour work week on resident emergency operative experience. Am J Surg. 2005;190(6):947–949. doi: 10.1016/j.amjsurg.2005.08.025. [DOI] [PubMed] [Google Scholar]
- 10.Hutter MM, Kellogg KC, Ferguson CM, Abbott VM, Warshaw AL. The impact of the 80-hour resident workweek on surgical residents and attending surgeons. Ann Surg. 2006;243(6):864–871. doi: 10.1097/01.sla.0000220042.48310.66. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.McBurney PG, Gustafson KK, Darden PM. Effect of 80-hour workweek on continuity of care. Clin Pediatr (Phila) 2008;47(8):803–808. doi: 10.1177/0009922808318341. [DOI] [PubMed] [Google Scholar]
- 12.Schenarts PJ, Anderson Schenarts KD, Rotondo WF. Myths and realities of the 80-hour work week. Curr Surg. 2006;63(4):269–274. doi: 10.1016/j.cursur.2006.04.004. [DOI] [PubMed] [Google Scholar]
- 13.Antiel RM, Thompson SM, Hafferty FW, James KM, Tilburt JC, Bannon MP, et al. Duty hour recommendations and implications for meeting ACGME core competencies: views of residency directors. Mayo Clin Proc. 2011;86(3):185–191. doi: 10.4065/mcp.2010.0635. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Antiel RM, Van Arendonk KJ, Reed DA, Terhune KP, Tarpley JL, Porterfield JR, et al. Surgical training, duty-hour restrictions, and implications for meeting the Accreditation Council for Graduate Medical Education core competencies: views of surgical interns compared with program directors. Arch Surg. 2012;147(6):536–541. doi: 10.1001/archsurg.2012.89. [DOI] [PubMed] [Google Scholar]
- 15.Maxwell AJ, Crocker M, Jones TL, Bhagawati D, Papadopoulos MC, Bell BA. Implementation of the European Working Time Directive in neurosurgery reduces continuity of care and training opportunities. Acta Neurochir (Wien) 2010;152(7):1207–1210. doi: 10.1007/s00701-010-0648-z. [DOI] [PubMed] [Google Scholar]
- 16.Shea JA, Willett LL, Bowman KR, Itani KM, McDonald FS, Call SA, et al. Anticipated consequences of the 2011 duty hours standards: views of internal medicine and surgery program directors. Acad Med. 2012;87(7):895–903. doi: 10.1097/ACM.0b013e3182584118. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Dowdy DW, Horton CK, Lau B, Ferrer R, Chen AH. Patient follow-up in an urban resident continuity clinic: an initiative to improve scheduling practices. J Grad Med Educ. 2011;3(2):256–260. doi: 10.4300/JGME-D-10-00196.1. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Schuh LA, Khan MA, Harle H, Southerland AM, Hicks WJ, Falchook A, et al. Pilot trial of IOM duty hour recommendations in neurology residency programs: unintended consequences. Neurology. 2011;77(9):883–887. doi: 10.1212/WNL.0b013e31822c61c3. [DOI] [PubMed] [Google Scholar]
- 19.Gagnon J, Meick A, Kamal D, Al-Assiri M, Chen J, Sidhu RS. Continuity of care experience of residents in an academic vascular department: are trainees learning complete surgical care. J Vasc Surg. 2006;43(5):999–1003. doi: 10.1016/j.jvs.2006.01.027. [DOI] [PubMed] [Google Scholar]
- 20.Sidhu RS, Walker GR. Resident continuity of care experience in a Canadian general surgery training program. Can J Surg. 1999;42(5):353–357. [PMC free article] [PubMed] [Google Scholar]
- 21.Anderson CI, Albrecht RR, Anderson KD, Dean RE. Can continuity-of-care requirements for surgery residents be demonstrated in the current teaching environment. Arch Surg. 1996;131(9):915–921. doi: 10.1001/archsurg.1996.01430210013002. [DOI] [PubMed] [Google Scholar]
- 22.Rodriguez H, Turner JP, Speicher P, Daskin MS, Darosa D. A model for evaluating resident education with a focus on continuity of care and educational quality. J Surg Educ. 2010;67(6):352–358. doi: 10.1016/j.jsurg.2010.09.004. [DOI] [PubMed] [Google Scholar]
- 23.Turner JP, Rodriguez HE, Daskin MS, Mehrotra S, Speicher P, DaRosa DA. Overcoming obstacles to resident-patient continuity of care. Ann Surg. 2012;255(4):618–622. doi: 10.1097/SLA.0b013e3182468dcf. [DOI] [PubMed] [Google Scholar]
- 24.Chung RS, Verghese J, Diaz J, Eisenstat M. One-on-one mentor-resident rotation for improving continuity of care in a surgical training program. J Surg Res. 1997;69(2):359–361. doi: 10.1006/jsre.1997.5081. [DOI] [PubMed] [Google Scholar]