Abstract
Background
Specialty consultation is a critical aspect of emergency department (ED) practice, and a delay in providing consultation might have a significant clinical effect and worsen ED overcrowding. Although mobile electronic medical records (EMR) are being increasingly used and are known to improve the workflow of health care providers, limited studies have evaluated their effectiveness in real-life clinical scenarios.
Objective
For this study, we aimed to determine the association between response duration to an ED specialty consultation request and the frequency of mobile EMR use.
Methods
This retrospective study was conducted in an academic ED in Seoul, South Korea. We analyzed EMR and mobile EMR data from May 2018 to December 2018. Timestamps of ED consultation requests were retrieved from a PC-based EMR, and the response interval was calculated. Doctors’ log frequencies were obtained from the mobile EMR, and we merged data using doctors’ deidentification numbers. Pearson’s product-moment correlation was performed to identify this association. The primary outcome was the relationship between the frequency of mobile EMR usage and the time interval from ED request to consultation completion by specialty doctors. The secondary outcome was the relationship between the frequency of specialty doctors’ mobile EMR usage and the response time to consultation requests.
Results
A total of 25,454 consultations requests were made for 15,555 patients, and 252 specialty doctors provided ED specialty consultations. Of the 742 doctors who used the mobile EMR, 208 doctors used it for the specialty consultation process. After excluding the cases lacking essential information, 21,885 consultations with 208 doctors were included for analysis. According to the mobile EMR usage pattern, the average usage frequency of all users was 13.3 logs/day, and the average duration of the completion of the specialty consultation was 51.7 minutes. There was a significant inverse relationship between the frequency of mobile EMR usage and time interval from ED request to consultation completion by specialty doctors (coefficient=–0.19; 95% CI –0.32 to –0.06; P=.005). Secondary analysis with the response time was done. There was also a significant inverse relationship between the frequency of specialty doctors’ mobile EMR usage and the response time to consultation requests (coefficient=–0.18; 95% CI –0.30 to –0.04; P=.009).
Conclusions
Our findings suggest that frequent mobile EMR usage is associated with quicker response time to ED consultation requests.
Keywords: electronic medical record, emergency department, mobile health, time efficiency
Introduction
Background
Specialty consultation is a critical aspect of emergency department (ED) practice [1]. Specialty consultation occurs when an ED doctor contacts a specialty doctor to decide the disposition of patients who require care beyond the scope of ED services. There are five types of specialty consultations: admission, seeking opinion, special procedures, transfer of care, and outpatient referrals [2].
A delayed response from the specialty doctor can cause disposition delay and contribute to ED crowding, which has been a critical public health concern [1,3-6]. It can also result in conflicts and misunderstanding among doctors, which can even lead to life-threatening outcomes for the patients and legal problems for the doctors [1]. Although many studies have suggested ways to manage consultation delays [2,7,8], consultation is still a laborious task. Strategies to reduce consultation delay should be considered and implemented.
Mobile Technology
Mobile electronic medical records (EMR) are being increasingly used by health care providers [9-11]. Several studies have reported that ubiquitous access to patient data through mobile EMRs and their portability in real-time can help doctors work more efficiently [12,13]. Studies conducted in EDs with mobile devices or mobile EMRs showed positive results for the improvement of clinical flow and efficiency [14-16]. However, given that mobile EMR usage has been generally low and varies among doctors [10,17,18], most studies evaluated the impact of mobile EMR using surveys or simulation methods [12,14-16]. To the best of our knowledge, none of the previous studies evaluated time efficiency in a real clinical setting for the frequency of mobile EMR usage.
Study Objectives
In this study, we aimed to determine the association between doctor’s response duration to ED consultation requests and their frequency of mobile EMR use.
Methods
Study Setting
This retrospective study was conducted in the ED of Samsung Medical Center, Seoul, South Korea. The ED is part of a tertiary academic teaching hospital with 2000 inpatient beds and daily average outpatient visits of more than 9000 in 2018. The ED consists of 69 treatment beds and admits an average of 200 patients daily. The total number of ED cases in 2018 was approximately 79,000. The study protocol was reviewed and approved by the Samsung Medical Center Institutional Review Board (IRB #2019-01-113-001).
Mobile Electronic Medical Records
The hospital’s EMR system, known as DARWIN (Data Analysis & Research Window for Integrated kNowledge), was launched in July 2016 with both PC and mobile versions. The mobile DARWIN (mDARWIN) is based on Android 2.3 Gingerbread (Google Inc, Mountain View, California, United States) and has Wi-Fi and 3G capabilities. It consists of the main menu, list-level features, and patient-level features. After logging in to the system using their identification number and password, users can select from the main menu to view a list-level feature or select a function. From each list-level feature, users can select patient-level features for more activities or leave and move to other list-level features. Each session closes either when a user logs out or after no activity has taken place for a certain amount of time. The mDARWIN also supports fingerprint log in and near-field communication.
Specialty Consultation Process
A specialty consultation involves three necessary steps: (1) sending a request; (2) responding to the request; and (3) answering the request (Figure 1). All consultations are requested through EMR except for the radiology department’s interpretations of imaging findings, which is done via a PC messenger. When an ED doctor makes a specialty consultation request to a specific specialty department in the “Specialty consultation administration” window in the EMR, the written request is immediately sent via a mobile EMR notification and mobile text message to the on-call doctor in the department at the time of consultation request (Figure 2).
Figure 1.
The specialty consultation process flow and outcome measurement of the study. The primary outcome was a measurement of the interval between consultation request and draft consultation note, while the secondary outcome used the interval between consultation request and response. ED: emergency department; EMR: electronic medical record.
Figure 2.
Screenshots of a consultation request made via mobile electronic medical record popup (left, middle) or text message (right).
The specialty doctor acknowledges the consultation, which is verified by opening the mobile EMR notification or using the nearest PC EMR at that time. Either of these two actions is recorded as a response in the “Specialty consultation administration,” and the ED doctor is notified of the delivery of their consultation to the specialty doctor. The specialty doctor then goes to the ED and sees the patients. After examining the patients, the consultation note from the specialty doctor can be written only via PC-based EMR and not mobile EMR. The timestamp of drafting and completing the consultation note is recorded, and a completed consultation note by the specialty doctor is considered the closing of the consultation. The ED doctor can then make decisions on patient disposition according to the note.
Study Subjects
We analyzed specialty consultations for patients presented to the ED from May 2018 to December 2018. Patients who left without being examined or patients who were transferred directly to another location, like the delivery room, were excluded. Specialty consultations of radiology, pediatric, and emergency departments, which have different consultation processes, were also excluded. Doctors were categorized based on occupation (staff, fellows, and residents) and specialty (physician, surgeon, or another hospital-based group). The physician group consisted of internal medicine, the surgeon group was comprised of general surgery, neurosurgery, thoracic surgery, otolaryngology, ophthalmology, obstetrics/gynecology, orthopedic surgery, plastic surgery, and the urology department. The other hospital-based groups included critical-care medicine, dentistry, neurology, psychiatry, radio-oncology, and rehabilitation medicine. Consultations lacking time information due to missing consultation notes, or consulting without responses, were excluded.
Data Collection and Processing
Timestamp data on emergency consultations were retrieved from the EMR of the patients admitted to the ED during the study period. Data on three types of timestamps were collected: (1) time of consultation request by the ED doctor, which is recorded in the PC EMR by the requesting ED physician; (2) time of response made by the specialty doctor, which is recorded in the EMR or mobile EMR by the requested specialty physician; and (3) time of drafting the consultation note by the specialty doctor, which is recorded when the specialty doctor selects “draft consultation note.” Then, the time intervals were calculated, with time interval (1) to (3) defined as the consultation completion interval, and time interval (1) to (2) defined as the consultation response interval.
The frequency of mDARWIN usage was extracted from the log data. Frequency was defined as the sum of all event logs such as log in, selecting an option, log out, and other actions on the mDARWIN. The overall usage of individual features in the mDARWIN was examined by summarizing the usage frequencies of features from the log data. Timestamp data were merged with doctors’ log frequency data using doctors’ deidentification numbers. The merged data were then analyzed.
Outcome Measures and Sensitivity Analysis
The primary outcome was the relationship between the frequency of mDARWIN usage and the consultation completion interval. The drafting of the consultation note is considered to be the completion of the request. The ED physician then discharges the patients according to the consultation note. If the consultation note by the specialty physician advises further examinations, such as laboratory tests or additional radiological tests, the disposition decision will be delayed until the advised tests have been completed. The interval time from drafting the consultation note to finalizing the consultation note is determined by patient factors rather than workflow. Without a conclusion, answer of disposition, or additional examination of the consulted patient, the specialty physician cannot write a consultation note; the drafting of the consultation note, therefore, indicates the end of the consultation process.
Subanalysis was performed with the group of specialty doctors who had left log records between the timestamp of the ED consultation request and the timestamp for drafting the consultation note. We calculated the median mobile log frequency for this group and compared the median interval time between the high-frequency group (higher than the median frequency) and the low-frequency group (lower than the median frequency).
The secondary outcome was the relationship between the frequency of mDARWIN usage and the consultation response interval. The primary and secondary outcomes are depicted in Figure 1.
Statistical Analysis
Continuous variables are expressed in terms of averages and standard deviations, and categorical variables are expressed in frequencies and percentages. To identify a correlation between frequency and time intervals, we performed Pearson’s product-moment correlation and analyzed the summary of the linear model. The differences between the groups were examined using a one-tailed Student’s t test for categorical variables. P values <.05 were considered significant. Data analyses were performed using R software version 3.4.2 (The R Project for Statistical Computing, Vienna, Austria).
Results
Characteristics of the Subjects
A total of 54,200 patients visited the ED during the study period. After excluding patients based on the exclusion criteria, 25,454 emergency consultations of 15,555 ED patients were included in the analysis. After excluding consultations lacking time information, 21,885 consultations were included in the analysis. Figure 3 presents the flowchart of subject inclusion. Multimedia Appendix 1 presents the demographics of the included subjects. Severity was assessed using the Korean Triage and Acuity Scale (KTAS), which was developed based on the Canadian Triage and Acuity Scale and is used across all Korean EDs. KTAS Level 1 indicates the highest acuity or severity of distress, and level 5 indicates the lowest [19].
Figure 3.
Flowchart of patient inclusion in the specialty consultation process. ED: emergency department; NA: No information about consultation department.
A total of 21,885 consultations were done, and 252 specialty doctors responded to these ED consultation requests. The specific departments of consultations are shown in Multimedia Appendix 2. The demographic characteristics of the doctors who provided consultations are shown in Table 1. Figure 4 provides mDARWIN usage patterns by group.
Table 1.
Demographics of doctors related to specialty consultations.
| Department | Position, n (%) | |
|
|
Staff and fellows | Resident |
| Physician group (n=86) | 45 (52) | 41 (48) |
| Surgeon group (n=120) | 13 (11) | 107 (89) |
| OHBPa group (n=46) | 19 (41) | 27 (59) |
aOHBP: other hospital-based physician.
Figure 4.
Median consultation completion interval and log frequency of doctors who used mobile electronic medical records in specialty consultation.
Log Data
During the study period, a total of 2,170,625 mobile EMR logs were created by 742 doctors of 39 specialty departments. Doctors included 218 professors (29%), 140 clinical fellows (19%), and 384 residents (52%). Of the 742 doctors, 208 used mobile EMR in the consultation process, and the following distribution was observed: physician group=34.6% (72/208), surgeon group=51.9% (108/208), and other hospital-based physician groups=13.5% (28/208). According to the mDARWIN usage pattern, the average log frequency of all users per day was 13.3, and the average time to complete the specialty consultation was 51.7 minutes. Among the three doctor groups, the physician group used mobile EMR more frequently (average usage=19.4) than the other groups, and the average period to complete the specialty consultation was the fastest at 45.3 minutes.
Pearson’s Product-Moment Correlation
The results of the Pearson’s product-moment correlation (Figure 5) showed that consultation completion interval time had a significant inverse relationship with mobile EMR usage frequency (coefficient=–0.19; 95% CI –0.32 to –0.06; P=.005). Subgroup analysis classified specialty doctors who had left mobile logs in the consultation completion interval by frequency using the median. The median frequency was 2834, and completion time for the specialty doctors with high frequency (over 2834) was 78 minutes, while the completion time was 84 minutes for specialty doctors with low frequency. The difference was not statistically significant (Multimedia Appendix 3).
Figure 5.
The correlation between consultation completion interval and mobile electronic medical record frequency. EMR: electronic medical record.
The same analysis with different response interval times was performed to analyze the secondary outcome. There was a significant inverse relationship between the response interval time and mDARWIN usage frequency (coefficient=–0.18; 95% CI –0.30 to –0.04; P=.009) (Figure 6).
Figure 6.
The correlation between consultation response interval and mobile electronic medical record frequency. EMR: electronic medical record.
Discussion
Principal Findings
This study aimed to explore the association between mobile EMR usage and specialty consultation time based on mobile EMR log data and EMR timestamp data. Our findings indicate that specialty doctors using mobile EMR frequently responded to ED consultation requests quicker and answered ED consultations with less time than the less frequent users (Figure 5 and Figure 6). This result implies that mobile EMR might be helpful in effectively managing consultation delays.
To ensure consistency in the results, we performed the subanalysis with specialty doctors who left log records between receiving the request and drafting the consultation note. Our findings showed consistent results on the association between time interval and mobile EMR usage frequency, for both primary and secondary outcome measures, without statistical insignificance (Appendix 3).
Because ED consultations are unpredictable, the specialty physician’s actions after recognizing a consultation request vary from immediate to delayed, due to the demands of their daily jobs. Some specialty physicians could respond immediately and concentrate only on the ED consultation, while others inevitably dealt with ED consultations and other jobs simultaneously. In the analysis of real-world retrospective data, it is difficult to know whether all log data are related to ED consultation, even if log data appears in the interval between consultation requests and drafting consultation notes. Instead of cutting log data, we analyzed the total log data frequency. Nevertheless, the steps “response to request” and “drafting consultation note” after concluding the consultation process are unchangeable. For this reason, we analyzed the intervals between steps.
Mobile Electronic Medical Records in Real Emergency Department Flow
ED crowding is generally estimated by length of stay [20], and length of stay is affected by three factors: input, throughput, and output factors [21]. Delayed response to ED consultation is a crucial independent variable of throughput and output factors of ED overcrowding conceptualization [1,22]. In the initial stages of the implementation of computerized EMR, text messaging and the use of a consultation management application were suggested, both of which were efficient [7,8]. Considering the accelerated use of mobile EMR in the present times, this study suggests the effectiveness of ED consultations.
The adoption of a mobile device in health care practice has generally contributed to improvement in clinical workflow, timeliness of communication, and patient safety [15,23-25]. A previous study reported that mobile communication using WhatsApp messenger could reduce consultation delays [26]. However, to the best of our knowledge, this study is the first to reveal that workflow efficiency and mobile EMR usability, represented by response interval and log frequency, are positively related to real-life ED settings. The improvement might be attributable to the features of mobile technology, such as the immediate alarm function in the mobile device and ubiquitous accessibility to mobile EMR. Before the mobile EMR alarm system, most of the communication about ED consultation was done via text message and phone calls. Notification of consultation via mobile EMR has helped eliminate redundant communication and deliver the patient information in the mobile EMR itself. While communication through mobile messenger has a potential risk to the security of the patient’s information when using personal devices [27,28], mobile EMR with access restriction is a much safer alternative for preventing confidentiality breaches.
As the contents of the mobile EMR to cover patient information is narrower than that of the EMR, it is important to consider the information covered in the mobile EMR. Different doctors and tasks require different contents [29]. Heavy information might result in fatigue, and light information might make the notification useless. Summarized patient information should be emphasized.
A previous study pointed out that doctors tended to underestimate mobile EMR objective improvement in response time, which resulted in its lower usability [15]. Of the 252 doctors included in this study, 17.4% of doctors (44/252) never used mobile EMR to manage consultations. There were several reasons for using only PC, such as not using an Android phone, unfamiliarity with the device, or not being aware of mobile EMR. It is difficult to determine the reasons for doctors not using mobile devices in this study. Surveying the nonuser group is a key to enhancing the usability of mobile EMR.
Limitations
This study has some limitations. First, as this study was a single-center and single-department study of its system, the findings have limited generalizability. However, consultation delay remains a challenge, with many limitations that need to be addressed [8,30]; the use of the mobile EMR system has been shown to be valuable in terms of evidence.
Second, because the results of this study were based on an analysis of mobile log data, the reasons for usage patterns were not considered. An additional mixed-methods analysis, such as a user interview or survey, might better explain the usefulness of a mobile EMR system in the consultation process [31], and further evaluation of its usability might provide a clearer picture.
Third, we could not determine the causality of log data because we analyzed the entire log dataset. Although the entire log sufficed to achieve the study aim, an observational study using the small cut log of mobile EMR would be needed to demonstrate the association between behavior and mobile EMR usage.
Conclusion
Our findings suggest that frequent usage of mobile EMR is associated with improvement in ED consultation delays.
Acknowledgments
This research was supported by the Basic Science Research Program through the National Research Foundation of Korea and funded by the Ministry of Education (grant number 2018R1C1B6002877).
Abbreviations
- DARWIN
Data Analysis & Research Window for Integrated kNowledge
- ED
emergency department
- EMR
electronic medical record
- KTAS
Korean Triage and Acuity Scale
- mDARWIN
mobile Data Analysis & Research Window for Integrated kNowledge
Demographic characteristics of the patients receiving specialty consultations.
Number of consultation cases by department.
Comparison between high and low frequency users among specialty doctors who had left log records during the consultation completion interval.
Footnotes
Conflicts of Interest: None declared.
References
- 1.Lee RS, Woods R, Bullard M, Holroyd BR, Rowe BH. Consultations in the emergency department: a systematic review of the literature. Emerg Med J. 2008 Jan 01;25(1):4–9. doi: 10.1136/emj.2007.051631.25/1/4 [DOI] [PubMed] [Google Scholar]
- 2.Woods RA, Lee R, Ospina MB, Blitz S, Lari H, Bullard MJ, Rowe BH. Consultation outcomes in the emergency department: exploring rates and complexity. CJEM. 2008 Jan;10(1):25–31. doi: 10.1017/s1481803500009970.6a058f95715d4c1e8c5af253fd6e79f9 [DOI] [PubMed] [Google Scholar]
- 3.Hoot NR, Aronsky D. Systematic review of emergency department crowding: causes, effects, and solutions. Ann Emerg Med. 2008 Aug;52(2):126–36. doi: 10.1016/j.annemergmed.2008.03.014.S0196-0644(08)00606-9 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Li G, Lau JT, McCarthy ML, Schull MJ, Vermeulen M, Kelen GD. Emergency department utilization in the United States and Ontario, Canada. Acad Emerg Med. 2007 Jun;14(6):582–4. doi: 10.1197/j.aem.2007.02.030. https://onlinelibrary.wiley.com/resolve/openurl?genre=article&sid=nlm:pubmed&issn=1069-6563&date=2007&volume=14&issue=6&spage=582 .j.aem.2007.02.030 [DOI] [PubMed] [Google Scholar]
- 5.Cha WC, Song KJ, Cho JS, Singer AJ, Shin SD. The Long-Term Effect of an Independent Capacity Protocol on Emergency Department Length of Stay: A before and after Study. Yonsei Med J. 2015 Sep;56(5):1428–36. doi: 10.3349/ymj.2015.56.5.1428. https://www.eymj.org/DOIx.php?id=10.3349/ymj.2015.56.5.1428 .2015091428 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Shen Y, Lee LH. Improving the wait time to consultation at the emergency department. BMJ Open Qual. 2018;7(1):e000131. doi: 10.1136/bmjoq-2017-000131. https://bmjopenquality.bmj.com/cgi/pmidlookup?view=long&pmid=29333496 .bmjoq-2017-000131 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Kim MJ, Park JM, Je SM, You JS, Park YS, Chung HS, Chung SP, Lee HS. Effects of a short text message reminder system on emergency department length of stay. Int J Med Inform. 2012 May;81(5):296–302. doi: 10.1016/j.ijmedinf.2012.01.001.S1386-5056(12)00002-0 [DOI] [PubMed] [Google Scholar]
- 8.Cho SJ, Jeong J, Han S, Yeom S, Park SW, Kim HH, Hwang SY. Decreased emergency department length of stay by application of a computerized consultation management system. Acad Emerg Med. 2011 Apr;18(4):398–402. doi: 10.1111/j.1553-2712.2011.01039.x. doi: 10.1111/j.1553-2712.2011.01039.x. [DOI] [PubMed] [Google Scholar]
- 9.Kim J, Lee Y, Lim S, Lee J. How Are Doctors Using Mobile Electronic Medical Records? An In-Depth Analysis of the Usage Pattern. Stud Health Technol Inform. 2017;245:1231. [PubMed] [Google Scholar]
- 10.Kim S, Lee K, Hwang H, Yoo S. Analysis of the factors influencing healthcare professionals' adoption of mobile electronic medical record (EMR) using the unified theory of acceptance and use of technology (UTAUT) in a tertiary hospital. BMC Med Inform Decis Mak. 2016 Jan 30;16:12. doi: 10.1186/s12911-016-0249-8. https://bmcmedinformdecismak.biomedcentral.com/articles/10.1186/s12911-016-0249-8 .10.1186/s12911-016-0249-8 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Choi W, Park M, Hong E, Kim S, Ahn R, Hong J, Song S, Kim T, Kim J, Yeo S. Early Experiences with Mobile Electronic Health Records Application in a Tertiary Hospital in Korea. Healthc Inform Res. 2015 Oct;21(4):292–8. doi: 10.4258/hir.2015.21.4.292. https://www.e-hir.org/DOIx.php?id=10.4258/hir.2015.21.4.292 . [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Fleischmann R, Duhm J, Hupperts H, Brandt SA. Tablet computers with mobile electronic medical records enhance clinical routine and promote bedside time: a controlled prospective crossover study. J Neurol. 2015 Mar;262(3):532–40. doi: 10.1007/s00415-014-7581-7. http://europepmc.org/abstract/MED/25476692 . [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Burdette SD, Herchline TE, Oehler R. Surfing the web: practicing medicine in a technological age: using smartphones in clinical practice. Clin Infect Dis. 2008 Jul 01;47(1):117–22. doi: 10.1086/588788. [DOI] [PubMed] [Google Scholar]
- 14.Rao AS, Adam TJ, Gensinger R, Westra BL. Study of the factors that promoted the implementation of electronic medical record on iPads at two emergency departments. AMIA Annu Symp Proc. 2012;2012:744–52. http://europepmc.org/abstract/MED/23304348 . [PMC free article] [PubMed] [Google Scholar]
- 15.Duhm J, Fleischmann R, Schmidt S, Hupperts H, Brandt SA. Mobile Electronic Medical Records Promote Workflow: Physicians' Perspective From a Survey. JMIR Mhealth Uhealth. 2016 Jun 06;4(2):e70. doi: 10.2196/mhealth.5464. https://mhealth.jmir.org/2016/2/e70/ v4i2e70 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Jung KY, Kim T, Jung J, Lee J, Choi JS, Mira K, Chang DK, Cha WC. The Effectiveness of Near-Field Communication Integrated with a Mobile Electronic Medical Record System: Emergency Department Simulation Study. JMIR Mhealth Uhealth. 2018 Sep 21;6(9):e11187. doi: 10.2196/11187. https://mhealth.jmir.org/2018/9/e11187/ v6i9e11187 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Wu I, Li J, Fu C. The adoption of mobile healthcare by hospital's professionals: An integrative perspective. Decision Support Systems. 2011 Jun;51(3):587–596. doi: 10.1016/j.dss.2011.03.003. [DOI] [Google Scholar]
- 18.Ben-Assuli O. Electronic health records, adoption, quality of care, legal and privacy issues and their implementation in emergency departments. Health Policy. 2015 Mar;119(3):287–97. doi: 10.1016/j.healthpol.2014.11.014.S0168-8510(14)00329-7 [DOI] [PubMed] [Google Scholar]
- 19.Kim JH, Kim JW, Kim SY, Hong DY, Park SO, Baek KJ, Lee KR. Validation of the Korean Triage and Acuity Scale compare to Triage by Emergency Severity Index for emergency adult patient: Preliminary study in a tertiary hospital emergency medical center. J Korean Soc Emerg Med. 2016 Oct;27(5):436–41. https://www.komci.org/GSResult.php?RID=2358284&DT=1 . [Google Scholar]
- 20.Rathlev NK, Chessare J, Olshaker J, Obendorfer D, Mehta SD, Rothenhaus T, Crespo S, Magauran B, Davidson K, Shemin R, Lewis K, Becker JM, Fisher L, Guy L, Cooper A, Litvak E. Time series analysis of variables associated with daily mean emergency department length of stay. Ann Emerg Med. 2007 Mar;49(3):265–71. doi: 10.1016/j.annemergmed.2006.11.007.S0196-0644(06)02528-5 [DOI] [PubMed] [Google Scholar]
- 21.Morley C, Unwin M, Peterson GM, Stankovich J, Kinsman L. Emergency department crowding: A systematic review of causes, consequences and solutions. PLoS One. 2018;13(8):e0203316. doi: 10.1371/journal.pone.0203316. http://dx.plos.org/10.1371/journal.pone.0203316 .PONE-D-18-06823 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Yoon P, Steiner I, Reinhardt G. Analysis of factors influencing length of stay in the emergency department. CJEM. 2003 May;5(3):155–61. doi: 10.1017/s1481803500006539.C13723E0934649F8BA0A0B77D4A3D106 [DOI] [PubMed] [Google Scholar]
- 23.Wu R, Rossos P, Quan S, Reeves S, Lo V, Wong B, Cheung M, Morra D. An evaluation of the use of smartphones to communicate between clinicians: a mixed-methods study. J Med Internet Res. 2011 Aug 29;13(3):e59. doi: 10.2196/jmir.1655. https://www.jmir.org/2011/3/e59/ v13i3e59 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.Przybylo JA, Wang A, Loftus P, Evans KH, Chu I, Shieh L. Smarter hospital communication: secure smartphone text messaging improves provider satisfaction and perception of efficacy, workflow. J Hosp Med. 2014 Sep;9(9):573–8. doi: 10.1002/jhm.2228. doi: 10.1002/jhm.2228. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.Lo V, Wu RC, Morra D, Lee L, Reeves S. The use of smartphones in general and internal medicine units: a boon or a bane to the promotion of interprofessional collaboration? J Interprof Care. 2012 Jul 09;26(4):276–82. doi: 10.3109/13561820.2012.663013. [DOI] [PubMed] [Google Scholar]
- 26.Gulacti U, Lok U, Hatipoglu S, Polat H. An Analysis of WhatsApp Usage for Communication Between Consulting and Emergency Physicians. J Med Syst. 2016 Jun;40(6):130. doi: 10.1007/s10916-016-0483-8.10.1007/s10916-016-0483-8 [DOI] [PubMed] [Google Scholar]
- 27.Prochaska MT, Bird A, Chadaga A, Arora VM. Resident Use of Text Messaging for Patient Care: Ease of Use or Breach of Privacy? JMIR Med Inform. 2015 Nov 26;3(4):e37. doi: 10.2196/medinform.4797. https://medinform.jmir.org/2015/4/e37/ v3i4e37 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.Moon BC, Chang H. Technology Acceptance and Adoption of Innovative Smartphone Uses among Hospital Employees. Healthc Inform Res. 2014 Oct;20(4):304–12. doi: 10.4258/hir.2014.20.4.304. https://www.e-hir.org/DOIx.php?id=10.4258/hir.2014.20.4.304 . [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.Prgomet M, Georgiou A, Westbrook JI. The impact of mobile handheld technology on hospital physicians' work practices and patient care: a systematic review. J Am Med Inform Assoc. 2009;16(6):792–801. doi: 10.1197/jamia.M3215. http://jamia.oxfordjournals.org/cgi/pmidlookup?view=long&pmid=19717793 .M3215 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30.Lee PA, Rowe BH, Innes G, Grafstein E, Vilneff R, Wang D, van Rheenen S, Lang E. Assessment of consultation impact on emergency department operations through novel metrics of responsiveness and decision-making efficiency. CJEM. 2014 May;16(3):185–92. doi: 10.2310/8000.2013.130973. [DOI] [PubMed] [Google Scholar]
- 31.Sieverink F, Kelders S, Poel M, van Gemert-Pijnen Lisette. Opening the Black Box of Electronic Health: Collecting, Analyzing, and Interpreting Log Data. JMIR Res Protoc. 2017 Aug 07;6(8):e156. doi: 10.2196/resprot.6452. https://www.researchprotocols.org/2017/8/e156/ v6i8e156 [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
Demographic characteristics of the patients receiving specialty consultations.
Number of consultation cases by department.
Comparison between high and low frequency users among specialty doctors who had left log records during the consultation completion interval.