Abstract
Background
Digitization is spreading exponentially in medical care, with improved availability of electronic devices. Guidelines and standard operating procedures (SOPs) form an important part of daily clinical routine, and adherence is associated with improved outcomes.
Objective
This study aimed to evaluate a digital solution for the maintenance and distribution of SOPs and guidelines in 2 different anesthesiology departments in Switzerland.
Methods
A content management system (CMS), WordPress, was set up in 2 tertiary-level hospitals within 1 year: the Department of Anesthesiology and Pain Medicine at the Kantonsspital Lucerne in Lucerne, Switzerland, as an open-access system, followed by a similar system for internal usage in the Department of Anaesthesiology and Pain Medicine of the Inselspital, Bern University Hospital, in Bern, Switzerland. We analyzed the requirements and implementation processes needed to successfully set up these systems, and we evaluated the systems’ impact by analyzing content and usage.
Results
The systems’ generated exportable metadata, such as traffic and content. Analysis of the exported metadata showed that the Lucerne website had 269 pages managed by 44 users, with 88,124 visits per month (worldwide access possible), and the Bern website had 341 pages managed by 35 users, with 1765 visits per month (access only possible from within the institution). Creation of an open-access system resulted in third-party interest in the published guidelines and SOPs. The implementation process can be performed over the course of 1 year and setup and maintenance costs are low.
Conclusions
A CMS, such as WordPress, is a suitable solution for distributing and managing guidelines and SOPs. Content is easily accessible and is accessed frequently. Metadata from the system allow live monitoring of usage and suggest that the system be accepted and appreciated by the users. In the future, Web-based solutions could be an important tool to handle guidelines and SOPs, but further studies are needed to assess the effect of these systems.
Keywords: standards; computer communication networks; anesthesiology; decision making, computer-assisted
Introduction
Guidelines and Standard Operating Procedures
Generally, guidelines and standard operating procedures (SOPs) are an integral part of perioperative medicine, and these are particularly an integral part of anesthesiology. They have found their way into daily clinical routine, and they form the basis for patient safety algorithms [1-3]. Adherence to guidelines has been associated with improved outcomes in the fields of anesthesiology and intensive care, and it has an impact on patient safety, employee training, and overall quality [4-7]. Guidelines have also been shown to motivate a team, especially if the employees were involved in creating the content [8]. However, the creation, maintenance, and distribution of these guidelines within an institution can be challenging, and the potential benefits and drawbacks remain unclear [9], especially as scientific data on the benefits of guidelines are scarce. Furthermore, measuring quality and safety in anesthesia remains a challenge [10], especially as there are only a few validated indicators, and evidence of their scientific validity is low [11].
Digitization in Medical Care
Before the age of computers, many institutions distributed their guidelines and SOPs in paper form. Over time, the increased use and availability of computers has led to the digitization of medical care [12,13]. During this transformation, many printed guidelines were transformed into digital files, often using PDF, and these files were commonly stored on local servers. However, this approach can lead to outdated files, and availability to users (eg, the anesthesia providers) is limited, with no search function or linking of content. Managing and reviewing content is challenging and laborious. In the era of digitization, with increased access to computers in the operating room, a fully computerized approach to this problem seems practical, and improved adherence to guidelines can be expected because of improved availability [14]. Digitization has enabled solutions that provide fast navigation, a broad overview, and new formats for content, such as movies. Digitized learning material and mobile learning, in general, can be effective [15]. With digital solutions, content is easily accessible and can be managed in a centralized database, and updates are easy and time saving. The choice of a content management system (CMS) depends on various factors, such as the publication process, accessibility, open-platform support, the implementation process, costs, and security [16]. Scientific evidence to support the implementation of digital distribution and CMSs remains scarce, and issues, such as insufficient security or unsatisfactory publication processes, have been raised with certain workflows [17].
Aim
This paper presents a digital solution for the development, distribution, and management of guidelines and SOPs. We have successfully implemented our Web-based solution in 2 different anesthesiology departments in Switzerland. In this paper, we describe the necessary requirements, the implementation process, and the metadata generated by the users (ie, employees of the department). Furthermore, we lay out the process for content management and development.
Methods
Content Management Systems
The CMS is a software used to create, update, and organize content produced by a defined group. This is usually done with a Web-based solution. The CMS allows creation and structuring of websites, without advanced knowledge or training in coding. The most common Web-based CMSs are WordPress, Joomla, Drupal, and TYPO3 [18]. Through the front end of the CMS (the interface for the regular user), users can access the content either directly or through a search function and receive information about upcoming updates and news within the system. Content managers can log in to the system and access the back end, through which content is created, updated, and distributed to the users. Administrators are in charge of system updates, as well as troubleshooting. Multiple users can access the CMS simultaneously, and role-based access control maps users to roles and different levels of permission. The goal of the CMS is to make permission management convenient by grouping users into different roles and enabling them to work within the CMS.
WordPress as a Content Management System
Various CMSs exist, and they can be used to distribute guidelines and SOPs within an institution. We chose WordPress (WordPress Foundation), as it can be implemented independently, is free, can be adapted to individual needs, and is intuitive to use. WordPress is a Web-based app, running on an Apache HTTP Server (Apache Software Foundation) in a Hypertext Preprocessor (PHP) environment (The PHP Group, php.net). It requires database access, such as MySQL (Oracle Corporation) or MariaDB (MariaDB Corporation). In November 2018, WordPress was the most frequently used CMS worldwide (used by 60.7% of all websites whose CMS is public knowledge) [18]. This results in extensive resources and a huge support community.
Implementation Process
The system’s main purpose is the distribution of general and local SOPs and guidelines. The system will never store any kind of patient-related data. An overview of the implementation process is shown in Figure 1.
Figure 1.
Process of implementing the content management system in an institution. CMS: content management system.
Before implementation of the system, the existing guidelines and SOPs were collected to gain an overview of the existing content. After that, we performed a review of requirements (Textbox 1).
System requirements.
Requirements for the back end.
The system must have a centralized database, which can be accessed through different devices
The system can be managed and developed simultaneously by different users. Personnel shortages must not impede the performance
Drafting, commenting, and revising content must be possible before publishing
All changes and revisions must be trackable
Data must be backed up on a regular basis
Updates and maintenance must be performed regularly
Requirements for the front end.
The user must be able to see which contents were updated and when
Users must be able to find the desired content using simple navigation or a fast-performing search function
There should be no limitations as far as devices or operating systems are concerned
Depending on the technical knowledge available within a department, a technical partner for the system implementation may be needed. The system can either be run internally within the institution or externally on a public server that is accessible worldwide. This ultimately depends on the sensitivity of the information published and the technical possibilities within an institution. Both solutions offer advantages and disadvantages (Table 1).
Table 1.
Advantages and disadvantages of external and internal systems
| System type | Advantages | Disadvantages |
| External system |
|
|
| Internal system |
|
|
After we had chosen a hosting platform and decided to develop an internal system (Bern) and an external system (Lucerne), the systems could be set up. Given the open-source character of the software used, documentation was easily available. An operational concept with specified roles and responsibilities was drafted, and this concept was approved by the head of the department. Requirements pertaining to availability and security were defined.
Content managers (ie, users in charge of different sections, such as attending specialists in charge of certain anesthesia divisions) needed training. One of the big advantages of such a system is that content management can be delegated to a number of employees within the department. This precludes a bottleneck that could develop if only a single user or a few users are in charge of content management. Finally, an in-depth analysis of metadata and usage was performed.
Statistical Analysis and Metadata
Metadata generated by user access were recorded with either WP Statistics (Verona Labs) or Visitor Statistics Pro. Data were imported and analyzed using Microsoft Excel (Version 2016) or Sigmaplot 13.0 (Systat Software). Continuous variables were expressed as means (SD); categorical variables were presented as frequencies and percentages.
Results
Implementation and Content
The system was implemented in 2 tertiary-level hospitals in Switzerland: first, it was implemented in the Department of Anesthesiology and Pain Medicine at the Kantonsspital Lucerne in Lucerne, Switzerland, and second, it was implemented in the Department of Anaesthesiology and Pain Medicine of the Inselspital, Bern University Hospital, in Bern, Switzerland. The content was divided into various sections (eg, clinical anesthesia, regional anesthesia, and airway management), and each section was overseen by a senior specialist. This included creating new content, as well as updating existing pages. Content was reviewed at least once a year. Users could report directly to the senior specialist in charge if they noticed a need for changes or for implementation of new content. Content could be navigated using a menu bar or accessed directly through a search function. The most frequently accessed content was guidelines on regional anesthesia, followed by various SOPs used with clinical anesthesia.
Department of Anesthesiology and Pain Medicine, Kantonsspital Lucerne
WordPress was set up on an external server, providing worldwide access to the department’s SOPs and guidelines (Figure 2). The system went live in May 2014. The external server is hosted by a Swiss hosting company, and it provides the necessary infrastructure, such as the latest versions of PHP and MySQL, and it includes a preinstalled version of WordPress. There is no need for manual app setup or updates, apart from WordPress itself. Implementation took place over a period of roughly 1 year. This involved a requirements analysis, the collection of already existing guidelines and SOPs, the setting up of a test website, and the gradual transfer of the content to the CMS. There are 269 pages of content within the CMS. These pages are divided into clinical SOPs (eg, SOPs for neuroanesthesia, cardiac anesthesia; 196 pages), regional anesthesia guidelines (13 pages), emergency guidelines (7 pages), airway guidelines (6 pages), patient management guidelines (eg, patients with diabetes, kidney disease; 18 pages), guidelines on drugs (10 pages), SOPs for monitoring (6 pages), and checklists (13 pages). In the 365 days ending on November 1, 2018, there were 155,379 visitors to the website, corresponding to 1,057,492 website requests. As the content is in German, the website is primarily accessed by people in German-speaking countries (73,136 visitors from Germany, 41,262 visitors from Switzerland, and 9852 visitors from Austria). Access to the website was primarily gained using iPhone (113,692 visitors, 35.80%) or Windows (113,213 visitors, 35.28%; Table 2). There are 44 registered users involved in managing the content. The cost of this setup is minimal. Other than buying a domain name (CHF 70) and paying for a hosting service (CHF 100 per year), there were no financial investments. This did not include the time invested by the department’s employees. Roughly 300 to 400 hours were needed for system setup and 50 hours per year for system maintenance. This resulted in an overall cost of less than CHF 1000 for the entire project. The hosting company updates all server applications on a regular basis. The administrators perform WordPress core updates and updates of all installed plug-ins multiple times per year. This ensures that security flaws are promptly fixed. Furthermore, we ran All In One WP Security (Tips and Trick HQ), which protects the website from unwarranted access, with an additional firewall function. No patient-relevant data were stored on the website. Content was backed up on a weekly basis, and backups were kept for half a year.
Figure 2.
Screenshot of the content management system running in Lucerne.
Table 2.
Operating systems most commonly used to access the Lucerne Hospital’s hosting system.
| Operating system | Overall use, % |
| Windows | 35.28 |
| iPhone | 34.80 |
| Android | 7.11 |
| iPad | 6.81 |
| Macintosh | 11.01 |
| Linux | 0.99 |
| Unknown | 3.99 |
Department of Anaesthesiology and Pain Medicine, Inselspital, Bern University Hospital
The system was set up on an internal departmental server and went live in March 2018 (Figure 3). External access is impossible, as the system operates in a separate domain behind the hospital firewall. The infrastructure runs on a Windows Server (Version 2012 R2); Apache HTTP Server, PHP, MariaDB, and WordPress were installed manually. The entire setup process was documented. As installations are maintained manually and the systems need constant development, the setup comprises a test server, as well as a live server. All updates and major changes to the system are first established within the test environment before going live. The project started in March 2017, and realization was possible within 12 months. Content is presented on 341 pages managed by 35 active users. Content is divided into the following sections: in-hospital SOPs (eg, local phone numbers, operating room schedule, and hygiene; 16 pages), clinical anesthesia (236 pages), patient management (18 pages), airway guidelines (6 pages), guidelines on monitoring (3 pages), regional anesthesia (8 pages), SOPs on pain therapy (41 pages), guidelines for drugs (6 pages), and SOPs for postanesthesia care (7 pages).
Figure 3.
Screenshot of the internal content management system running in Bern.
Since going live, the system has been visited 13,856 times, corresponding to 45,284 page views (3.27 page views per visit). Users access the website predominantly from outside the operating room or patient care, with only 25% of users using computers positioned directly at the anesthesia station and 75 % using computers outside of the operating room. As the system is locked behind the department’s firewall, virtual private network was not provided for mobile phones, and no mobile phone access was possible. Hourly usage peaked twice daily, between 9 am and 10 am, with 8.4 (SD 5.9) visitors, and between 3 pm and 4 pm, with 8.7 (SD 6.1) visitors (Figure 4). As there are no expenses for external servers, the system has not produced any expenses, except for the time which system developers and users dedicated to the platform.
Figure 4.
Hourly usage of the internal content management system for October and November 2018 at the Bern University Hospital. Dots represent means and whiskers represent SD.
As the system runs on an internal platform with in-hospital access only, digital attacks from the World Wide Web are not possible, and the website is protected by the corporate firewall. However, all apps and plug-ins are updated regularly, which ensures that security holes are closed. The system does not contain any patient-relevant information, and it is backed up daily. System security was discussed with the information technology department.
Discussion
Principal Findings
The implementation process described in this paper has been successfully performed twice in large anesthesia departments in Switzerland. Although the process requires some technological knowledge or at least an appropriate technical partner, setup itself is easy, and it can be done within a reasonable period of time. There are various CMS options available, and CMSs have been shown to be an ideal tool for efficient and consistent management of guidelines [16]. Our detailed requirement review allowed us to choose an appropriate CMS and showed that WordPress would be superior to regular wiki-based systems. Metadata generated by the systems show high usage. Use during the day reflects the active hours in our operating rooms. However, as the database is primarily accessed independent of direct patient care, it is safe to assume that its primary use is as a reference book. As a limitation to our study, direct comparison of the systems is not possible, as the Lucerne system is hosted externally, and its metadata are skewed by worldwide access. However, the statistics from Lucerne show that there is international interest in these guidelines and SOPs.
Content Management Systems in the Health Care Sector and Digital Maturity
WordPress has already been used as an electronic portfolio system [19], as a platform for the dissemination of evidence-based medicine [20], and as a centralized in-hospital database to share and distribute information, with low costs [21]. However, it has never been applied as a distribution system for guidelines and SOPs in anesthesia or emergency care. With WordPress, content can be easily managed by our senior staff, who are able to create and update pages. It is a major advantage that these content managers are anesthesiologists working in clinical practice on a daily basis and are thus in close contact with the users. This ensures a direct feedback loop and prompts implementation of new content or updates to existing content. The possibility of having multiple users manage content simultaneously prevents the system from being dependent on a single person or a small group, as might be the case with an individually coded app (eg, iOS or Android). WordPress is the most commonly used CMS worldwide, appreciated for its flexibility and features. However, this also makes it a target for security breaches and attacks. The best way to protect a system is by always running the latest stable release [22]. To avoid problems, we do not keep any sensitive information, especially patient-related data, in our databases. The modernization of the health care sector in Western Europe was reported to increase spending in technology and informatics from US $13.2 billion in 2013 to US $14.6 billion in 2018 [23]. In an assessment of Swiss hospitals, investment in hardware and software was found to be the most promising way to improve digital maturity of a health care organization [23]. The concept of digital maturity represents the ability to respond to changing needs and challenges in a computerized world. A strong link was found between usage intensity and digital maturity. The implementation of a Web-based CMS might be seen as an investment in software solutions, and therefore, it might be seen as an improvement of the digital maturity of the 2 corresponding health care organizations. It seems reasonable to record usage intensity over time to assess whether these apps might increase digital maturity through wider usage.
Mobile Technology Enhancing Accessibility and Usability
Our metadata concerning operating systems show that mobile phones are frequently used to access our guidelines and SOPs. Mobile learning has been shown to be as effective as traditional learning [15], suggesting that mobile phones apps are a viable tool to access learning and reference materials. The increasing availability of these mobile phones devices and the possibility of accessing the content on the go suggest that there could be a further peak in usage if the internal system in Bern is opened up for mobile phones access. The effect on patient care remains unclear, but usage patterns suggest that electronic access to guidelines is highly appreciated. Mobile phones apps are an emerging tool in health care [24-27], and they are leading to new possibilities, such as applications in patient management, resource distribution, and quality control [28]. Our Web-based system and most of the apps available fall in the category of patient management [28-30]. Some trials investigating the effect of mobile technology have shown that it significantly improves outcomes related to disease management [29].
Improving Outcome and Cost-Effectiveness
Studies concerned with the implementation of digital solutions have shown variable results with regard to guideline adherence [14,31-33], but the scientific data on this topic are limited. To further develop the CMS to meet the needs of our users, we intend to assess the effect of the implemented systems through frequent administration of questionnaires, and if feasible, an outcome-related study will be considered. Owing to its high usage, ease of use, and low cost, our Web-based repository for health care guidelines and operating procedures could potentially contribute to the digitization of other health care organizations with needs similar to ours [34]. Solutions that can be developed rapidly and implemented easily may be crucial for the survival of organizations in the health care landscape [34].
Conclusions
We have demonstrated that WordPress is a suitable solution for distributing and managing the internal SOPs and guidelines of 2 tertiary anesthesia departments. Although our study was performed solely in anesthesia departments, implementation in different areas of health care seems feasible. Metadata allow live monitoring and feedback. The systems are cost effective and can be handled from within the department, without depending on third-party support.
Acknowledgments
The authors wish to thank Jeannie Wurz, medical writer and editor, Department of Anaesthesiology and Pain Medicine, Inselspital, for the careful editing of the manuscript. This research did not receive funding from agencies in the public, commercial, or not-for-profit sectors.
Abbreviations
- CMS
content management system
- SOP
standard operating procedure
Footnotes
Authors' Contributions: KFB drafted the manuscript, developed the project idea, and implemented the system. CV was responsible for conceptual design and content. LW is a technical partner, and LW helped implement the system. CK is head of the department in Lucerne, and sop.klifairs.ch was developed under his guidance. APV was the senior staff member supervising the project in Bern, and APV revised the manuscript. All authors have read and approved the final version of this manuscript.
Conflicts of Interest: None declared.
References
- 1.Schuster F, Johannsen S, Roewer N. [Helsinki declaration on patient safety in anaesthesiology - part 3: SOP for malignant hyperthermia] Anasthesiol Intensivmed Notfallmed Schmerzther. 2013 Mar;48(3):162–4. doi: 10.1055/s-0033-1342900. [DOI] [PubMed] [Google Scholar]
- 2.Wiesmann T, Bornträger A, Steinfeldt T, Wulf H. [Helsinki declaration on patient safety in anaesthesiology -- SOP for local anesthetics intoxication] Anasthesiol Intensivmed Notfallmed Schmerzther. 2013 Jan;48(1):32–5. doi: 10.1055/s-0032-1333075. [DOI] [PubMed] [Google Scholar]
- 3.Happel O, Roewer N, Kranke P. [Helsinki declaration on patient safety in anaesthesiology--part 8: SOP for checking equipment and drugs] Anasthesiol Intensivmed Notfallmed Schmerzther. 2013 Sep;48(9):538–42. doi: 10.1055/s-0033-1355233. [DOI] [PubMed] [Google Scholar]
- 4.Nachtigall I, Deja M, Tafelski S, Tamarkin A, Schaller K, Halle E, Gastmeier P, Wernecke KD, Bauer T, Kastrup M, Spies C. Adherence to standard operating procedures is crucial for intensive care unit survival of elderly patients. J Int Med Res. 2008;36(3):438–59. doi: 10.1177/147323000803600308. [DOI] [PubMed] [Google Scholar]
- 5.Nachtigall I, Tamarkin A, Tafelski S, Deja M, Halle E, Gastmeier P, Wernecke KD, Bauer T, Kastrup M, Spies C. Impact of adherence to standard operating procedures for pneumonia on outcome of intensive care unit patients. Crit Care Med. 2009 Jan;37(1):159–66. doi: 10.1097/CCM.0b013e3181934f1b. [DOI] [PubMed] [Google Scholar]
- 6.Gutsche JT, Kornfield ZN, Speck RM, Patel PA, Atluri P, Augoustides JG. Impact of guideline implementation on transfusion practices in a surgical intensive care unit. J Cardiothorac Vasc Anesth. 2013 Dec;27(6):1189–93. doi: 10.1053/j.jvca.2013.05.040.S1053-0770(13)00315-7 [DOI] [PubMed] [Google Scholar]
- 7.Rognås L, Hansen TM, Kirkegaard H, Tønnesen E. Standard operating procedure changed pre-hospital critical care anaesthesiologists' behaviour: a quality control study. Scand J Trauma Resusc Emerg Med. 2013 Dec 5;21:84. doi: 10.1186/1757-7241-21-84. https://sjtrem.biomedcentral.com/articles/10.1186/1757-7241-21-84 .1757-7241-21-84 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.de Treville S, Antonakis JM, Edelson NM. Can standard operating procedures be motivating? Reconciling process variability issues and behavioural outcomes. Total Qual Manag Bus. 2010 Dec 3;16(2):231–41. doi: 10.1080/14783360500054236. doi: 10.1080/14783360500054236. [DOI] [Google Scholar]
- 9.Woolf SH, Grol R, Hutchinson A, Eccles M, Grimshaw J. Clinical guidelines: potential benefits, limitations, and harms of clinical guidelines. Br Med J. 1999 Feb 20;318(7182):527–30. doi: 10.1136/bmj.318.7182.527. http://europepmc.org/abstract/MED/10024268 . [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Haller G, Stoelwinder J, Myles PS, McNeil J. Quality and safety indicators in anesthesia: a systematic review. Anesthesiology. 2009 May;110(5):1158–75. doi: 10.1097/ALN.0b013e3181a1093b. [DOI] [PubMed] [Google Scholar]
- 11.Chazapis M, Gilhooly D, Smith AF, Myles PS, Haller G, Grocott MP, Moonesinghe SR. Perioperative structure and process quality and safety indicators: a systematic review. Br J Anaesth. 2018 Jan;120(1):51–66. doi: 10.1016/j.bja.2017.10.001. https://linkinghub.elsevier.com/retrieve/pii/S0007-0912(17)53939-2 .S0007-0912(17)53939-2 [DOI] [PubMed] [Google Scholar]
- 12.Kvedar J, Coye MJ, Everett W. Connected health: a review of technologies and strategies to improve patient care with telemedicine and telehealth. Health Aff (Millwood) 2014 Feb;33(2):194–9. doi: 10.1377/hlthaff.2013.0992.33/2/194 [DOI] [PubMed] [Google Scholar]
- 13.Neubeck L, Lowres N, Benjamin EJ, Freedman SB, Coorey G, Redfern J. The mobile revolution--using smartphone apps to prevent cardiovascular disease. Nat Rev Cardiol. 2015 Jun;12(6):350–60. doi: 10.1038/nrcardio.2015.34.nrcardio.2015.34 [DOI] [PubMed] [Google Scholar]
- 14.McEvoy MD, Hand WR, Stoll WD, Furse CM, Nietert PJ. Adherence to guidelines for the management of local anesthetic systemic toxicity is improved by an electronic decision support tool and designated 'Reader'. Reg Anesth Pain Med. 2014;39(4):299–305. doi: 10.1097/AAP.0000000000000097. http://europepmc.org/abstract/MED/24956454 .00115550-201407000-00007 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Dunleavy G, Nikolaou CK, Nifakos S, Atun R, Law GC, Tudor CL. Mobile digital education for health professions: systematic review and meta-analysis by the digital health education collaboration. J Med Internet Res. 2019 Feb 12;21(2):e12937. doi: 10.2196/12937. http://www.jmir.org/2019/2/e12937/ v21i2e12937 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Reddy S, Herring S, Gray A. Identifying an appropriate content management system to develop clinical practice guidelines: a perspective. Health Informatics J. 2017 Dec;23(1):14–34. doi: 10.1177/1460458215616264.1460458215616264 [DOI] [PubMed] [Google Scholar]
- 17.Barwise A, Garcia-Arguello L, Dong Y, Hulyalkar M, Vukoja M, Schultz MJ, Adhikari NK, Bonneton B, Kilickaya O, Kashyap R, Gajic O, Schmickl CN. Checklist for early recognition and treatment of acute illness (CERTAIN): evolution of a content management system for point-of-care clinical decision support. BMC Med Inform Decis Mak. 2016 Dec 3;16(1):127. doi: 10.1186/s12911-016-0367-3. https://bmcmedinformdecismak.biomedcentral.com/articles/10.1186/s12911-016-0367-3 .10.1186/s12911-016-0367-3 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.W3Techs - Extensive and Reliable Web Technology Surveys. [2019-04-24]. Usage Statistics and Market Share of Wordpress https://w3techs.com/technologies/details/cm-wordpress/all/all .
- 19.Avila J, Sostmann K, Breckwoldt J, Peters H. Evaluation of the free, open source software WordPress as electronic portfolio system in undergraduate medical education. BMC Med Educ. 2016 Jun 3;16:157. doi: 10.1186/s12909-016-0678-1. https://bmcmededuc.biomedcentral.com/articles/10.1186/s12909-016-0678-1 .10.1186/s12909-016-0678-1 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Dyson MP, Newton AS, Shave K, Featherstone RM, Thomson D, Wingert A, Fernandes RM, Hartling L. Social media for the dissemination of cochrane child health evidence: evaluation study. J Med Internet Res. 2017 Dec 1;19(9):e308. doi: 10.2196/jmir.7819. http://www.jmir.org/2017/9/e308/ v19i9e308 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Kotoulas A, Stratis I, Goumenidis T, Lambrou G, Koutsouris DD. Short-term adoption rates for a web-based portal within the intranet of a hospital information system. BMJ Health Care Inform. 2019 Apr;26(1):1–4. doi: 10.1136/bmjhci-2019-100004. http://informatics.bmj.com/cgi/pmidlookup?view=long&pmid=31039127 .bmjhci-2019-100004 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Rosso S, Abrahamson B, Adams M, Cave J, HouSandí H, Hulse D, Jangda M, Maiorana P. WordPress. 2015. Security https://wordpress.org/about/security/
- 23.Mettler T, Pinto R. Evolutionary paths and influencing factors towards digital maturity: an analysis of the status quo in Swiss hospitals. Technol Forecast Soc Change. 2018 Aug;133:104–17. doi: 10.1016/j.techfore.2018.03.009. doi: 10.1016/j.techfore.2018.03.009. [DOI] [Google Scholar]
- 24.Gupta RK, McEvoy MD. Initial experience of the American Society of Regional Anesthesia and Pain Medicine COAGS regional smartphone application: a novel report of global distribution and clinical usage of an electronic decision support tool to enhance guideline use. Reg Anesth Pain Med. 2016;41(3):334–8. doi: 10.1097/AAP.0000000000000391. [DOI] [PubMed] [Google Scholar]
- 25.Machado GC, Pinheiro MB, Lee H, Ahmed OH, Hendrick P, Williams C, Kamper SJ. Smartphone apps for the self-management of low back pain: a systematic review. Best Pract Res Clin Rheumatol. 2016 Dec;30(6):1098–109. doi: 10.1016/j.berh.2017.04.002.S1521-6942(17)30002-5 [DOI] [PubMed] [Google Scholar]
- 26.BinDhim NF, Hawkey A, Trevena L. A systematic review of quality assessment methods for smartphone health apps. Telemed J E Health. 2015 Feb;21(2):97–104. doi: 10.1089/tmj.2014.0088. [DOI] [PubMed] [Google Scholar]
- 27.Haskins BL, Lesperance D, Gibbons P, Boudreaux ED. A systematic review of smartphone applications for smoking cessation. Transl Behav Med. 2017 Dec;7(2):292–9. doi: 10.1007/s13142-017-0492-2. http://europepmc.org/abstract/MED/28527027 .10.1007/s13142-017-0492-2 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.Olivero E, Bert F, Thomas R, Scarmozzino A, Raciti IM, Gualano MR, Siliquini R. E-tools for hospital management: an overview of smartphone applications for health professionals. Int J Med Inform. 2019 Dec;124:58–67. doi: 10.1016/j.ijmedinf.2019.01.010.S1386-5056(18)30040-6 [DOI] [PubMed] [Google Scholar]
- 29.Free C, Phillips G, Watson L, Galli L, Felix L, Edwards P, Patel V, Haines A. The effectiveness of mobile-health technologies to improve health care service delivery processes: a systematic review and meta-analysis. PLoS Med. 2013;10(1):e1001363. doi: 10.1371/journal.pmed.1001363. http://dx.plos.org/10.1371/journal.pmed.1001363 .PMEDICINE-D-12-00641 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30.Thomairy NA, Mummaneni M, Alsalamah S, Moussa N, Coustasse A. Use of smartphones in hospitals. Health Care Manag (Frederick) 2015;34(4):297–307. doi: 10.1097/HCM.0000000000000080.00126450-201510000-00005 [DOI] [PubMed] [Google Scholar]
- 31.Semler MW, Weavind L, Hooper MH, Rice TW, Gowda SS, Nadas A, Song Y, Martin JB, Bernard GR, Wheeler AP. An electronic tool for the evaluation and treatment of sepsis in the ICU: a randomized controlled trial. Crit Care Med. 2015 Aug;43(8):1595–602. doi: 10.1097/CCM.0000000000001020. http://europepmc.org/abstract/MED/25867906 . [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32.Kessler ME, Carter RE, Cook DA, Kor DJ, McKie PM, Pencille LJ, Scheitel MR, Chaudhry R. Impact of electronic clinical decision support on adherence to guideline-recommended treatment for hyperlipidaemia, atrial fibrillation and heart failure: protocol for a cluster randomised trial. BMJ Open. 2017 Dec 4;7(12):e019087. doi: 10.1136/bmjopen-2017-019087. http://bmjopen.bmj.com/cgi/pmidlookup?view=long&pmid=29208620 .bmjopen-2017-019087 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33.Sim EY, Tan DJ, Abdullah HR. The use of computerized physician order entry with clinical decision support reduces practice variance in ordering preoperative investigations: a retrospective cohort study. Int J Med Inform. 2017 Dec;108:29–35. doi: 10.1016/j.ijmedinf.2017.09.015.S1386-5056(17)30238-1 [DOI] [PubMed] [Google Scholar]
- 34.van Velthoven MH, Cordon C, Challagalla G. Digitization of healthcare organizations: the digital health landscape and information theory. Int J Med Inform. 2019 Dec;124:49–57. doi: 10.1016/j.ijmedinf.2019.01.007.S1386-5056(18)30321-6 [DOI] [PubMed] [Google Scholar]