Abstract
Digitization of medicine requires systematic handling of the increasing amount of health data to improve medical diagnosis. In this context, the integration of the versatile diagnostic information, e.g., from anamnesis, imaging, histopathology, and clinical chemistry, and its comprehensive analysis by artificial intelligence (AI)–based tools is expected to improve diagnostic precision and the therapeutic conduct. However, the complex medical environment poses a major obstacle to the translation of integrated diagnostics into clinical research and routine. There is a high need to address aspects like data privacy, data integration, interoperability standards, appropriate IT infrastructure, and education of staff. Besides this, a plethora of technical, political, and ethical challenges exists. This is complicated by the high diversity of approaches across Europe. Thus, we here provide insights into current international activities on the way to digital comprehensive diagnostics. This includes a technical view on challenges and solutions for comprehensive diagnostics in terms of data integration and analysis. Current data communications standards and common IT solutions that are in place in hospitals are reported. Furthermore, the international hospital digitalization scoring and the European funding situation were analyzed. In addition, the regional activities in radiomics and the related publication trends are discussed. Our findings show that prerequisites for comprehensive diagnostics have not yet been sufficiently established throughout Europe. The manifold activities are characterized by a heterogeneous digitization progress and they are driven by national efforts. This emphasizes the importance of clear governance, concerted investments, and cooperation at various levels in the health systems.
Key Points
• Europe is characterized by heterogeneity in its digitization progress with predominantly national efforts. Infrastructural prerequisites for comprehensive diagnostics are not given and not sufficiently funded throughout Europe, which is particularly true for data integration.
• The clinical establishment of comprehensive diagnostics demands for a clear governance, significant investments, and cooperation at various levels in the healthcare systems.
• While comprehensive diagnostics is on its way, concerted efforts should be taken in Europe to get consensus concerning interoperability and standards, security, and privacy as well as ethical and legal concerns.
Electronic supplementary material
The online version of this article (10.1007/s00330-020-06874-x) contains supplementary material, which is available to authorized users.
Keywords: Diagnosis, Information storage and retrieval, Artificial intelligence, Electronic health records, Europe
Introduction
The digitization of medicine with its increasing amount of heterogeneous data and technologies faces significant challenges and also offers a great potential for medical diagnostics [1–4]. In clinical routine, diagnostic information derives from various sources and is collected by medical doctors with different expertise. These comprise physicians who do the anamnesis and physical examination, radiologists, nuclear medicine specialists, pathologists, and experts in clinical chemistry and omics analysis. Their diagnostic findings are usually presented in board meetings (e.g., tumor boards), where diagnoses are rendered and therapeutic strategies discussed. Some disciplines already use computer-assisted (decision) support to facilitate data interpretation [5]. However, it can be expected that the integration of the entirety of diagnostic information from the different disciplines in one analysis tool that uses artificial intelligence (AI) will elucidate important new connections between the features and improve the diagnostic accuracy as well as the prognostic power of clinical examinations.
Unfortunately, in most European countries, the lack of a suitable information technology (IT) infrastructure in the hospitals and medical practices, the absence of high-quality curated data, and difficulties to access and exchange data are inhibiting the translation of integrated diagnostics into clinical routine and even research. Comprehensive diagnostic centers were founded to act as local seeding points at university hospitals to evaluate the value of integrated diagnostics for distinct disease entities [6]. However, for the broad implementation of eHealth and AI integrated diagnostics, these local centers do certainly not replace central organizations (at national or even international level) that ensure common structures, standards, and data safety.
The reasons for an unexploited potential of comprehensive approaches with a lack of clinical as well as research implementation are manifold, interconnected and concern infrastructural, technical, political, and ethical challenges. The complexity makes it difficult to keep up with the variety of approaches across Europe. Therefore, we provide insights into current international activities on the way to digital comprehensive diagnostics (CD). For this purpose, we analyzed European funding and international hospital scoring concerning digitization. Furthermore, the article includes a technical view on CD in terms of data integration and analysis. In this context, we discuss radiomics as an example of an evolving field with particularly high relevance for radiologists.
Data integration and analysis
On the way to digital CD, technical data infrastructures are fundamental and among others substantially connected to regulative aspects in terms of data ownership, data privacy, and ethics. Due to the high complexity of the field, in this work, we predominantly focus on the technical elements of CD (Fig. 1).
Fig. 1.
Overview of different data solutions for comprehensive diagnostics (CD) infrastructure. CD requires solutions for data integration and data analysis. Data integration can be performed based on own data (internal) or data imports (external) or a mixture of both. Data integration can be performed locally or in the cloud to build data warehouses or data lakes. One can also build the data bases from individual cases or groups. Data warehouses store organized data, which requires efforts of structuring and cleaning. Data lakes store raw data. Subsequent efforts need to be taken for the specific selection and organization of the data for each need/analysis. Data analysis can be performed on the integrated data. It can be descriptive (e.g., graphical presentation of data), inferential (concluding from the sample case to the collective), and predictive (pattern found in historical data are used to foresee the fate of present cases). These analyses can be performed locally or by cloud computing. For this purpose, statistical methods, artificial intelligence, and data mining are applied
CD approaches are characterized primarily by the processing of heterogeneous health data. This demands for the integration of data from diverse sources as a prerequisite for their analysis. Currently, this is mostly done in the context of research. Its use in clinical routine would be much more restrictive, e.g., requiring the approval of the medical software and the related medical procedures. However, even research strongly depends on the availability of structured health data from the clinical routine [7]. Thus, much effort must be spent into IT infrastructures and their interoperability to facilitate comprehensive approaches and translational medicine with a “bi-lateral ‘two-way’ iteration between bench-side and bedside” [8].
Infrastructure and interoperability
Health data are generated and stored in highly diverse systems by heterogeneous stakeholders. However, due to the organization of most health providers, the established clinical procedures, and ethical and data ownership concerns, a huge amount of usable health data are currently trapped inside the organizational boundaries of private medical practices, hospitals, clinics, and within patients’ monitoring devices (e.g., smart watches). This disrupts the progress of comprehensive diagnostics. Many healthcare institutions implement centralized repositories by pooling data from multiple systems into data warehouses or data lakes [9, 10]. Sharing these data out of the organizations’ boundaries is not a viable solution since the anonymization of data may not be possible for certain data types, such as genomic data, and also since linking data sets increases the re-identification risk [11, 12]. Furthermore, research communities build domain-specific data infrastructures that cannot easily communicate with each other (e.g., biobanks) [13, 14]. The problem of accessing data outside the network remains, and since data are collected for a specific use and duplicated outside of the first data source, it limits the record linkage and integration of multimodal data. However, sharing health data offers great advantages, such as the improved comparability and reproducibility of the results of image data analysis between different sites [15]. International and national initiatives, such as European Open Science Cloud [16] or German Medical Informatics Initiative [17], are establishing research data infrastructures for supporting access to data and reuse of it. They provide federated environments of semantically interoperable and integrated data as well as related services for access and data analytics.
In this context, data stewardship in healthcare is gaining importance. It refers to the process of creation, (re)use, storage, and archiving of research and clinical data that aims to ensure data quality, integration, and reuse. This also includes reducing or eliminating data silos and protecting patient privacy [18]. The FAIR (findable, accessible, interoperable, and reusable) principles for scientific data management and stewardship provide guidance for data producers and infrastructures to improve discoverability and interoperability of data. A specific emphasis is on supporting the reuse by individuals and enhancing the ability of machines to automatically find and use the data [19, 20].
Data analytics is another challenge in this fragmented health data space. We would like to point out that the term “analytics” is used in various ways, often in the context of business intelligence, big data, and also predictive analysis. We use it as a synonym to “analysis” but want to distinguish analysis, processing, and use of data from their management and integration. To enable data-driven research, healthcare, and thus CD, there are approaches to support the distribution of analytics over distributed data (often related to the terms distributed analytics or federated learning). For this, new solutions such as grid/cloud computing have been proposed [21]. Moreover, software solutions such as i2b2 or DataShield support analyzing sensitive data in a distributed fashion [22, 23]. The Personal Health Train is another approach that improves the reuse of data by sharing analytics [24]. The core design principle is to give data owners the authority to decide and monitor the use of their data, e.g., in terms of access and purpose. Distributed data analytics utilizes the data at the original location, can interact with the data, and complete their task without giving access to the end-user. In contrast to other approaches, it is technology agnostic and aims at maximum interoperability between diverse systems, by focusing on machine-readable and interpretable data, metadata, workflows, and services [25] (Table 1).
Table 1.
Comparing the data analytics solutions for integrated health data with a selection of exemplary activities. ETL stands for extract, transform, load
Features | Cloud computing | Data warehouses or lakes | Distributed analytics |
---|---|---|---|
Data Integration and Transformation | Data to be transferred and transformed into a central repository. ETL cost/effort comparably high. | Data to be transferred and transformed into a central repository. ETL cost/effort comparably high. | FAIR data points. ETL cost/effort comparably less. |
Security | Data need to be exported to an external network and platform owner by different firms or entities. Rules and regulations should be checked. | Data reside in owner site but need to be moved into central server. Some data sources may be privacy sensitive and require encryption or anonymization before moving into central repository. |
Data reside in actual source and owner has the authority. Authentication and authorization mechanisms need to be established between parties. |
Speed | Network latency may occur. | No network latency issues. | Network latency may occur. |
Scalability | Easy due to dynamic scaling model of cloud. | Need to purchase new software or hardware to accommodate large-scale growth. |
Execution power requirement is distributed through different sites. Scalability requirement and extension cost may be less compared to central systems. |
Data Integration | Assuming that all data are kept in a centralized manner, data integration will be easy. | Assuming that all data are kept in a centralized manner, data integration will be easy. | Data integration is done through executing aggregations on results coming from different nodes. |
Cost | In general, cloud software is priced under a monthly or annual subscription, with additional recurring fees for support, training and updates. Considered as operating expenditure (an additional overhead cost the organization will continue to pay). | On-premise software is generally priced under a one-time perpetual license fee (usually based on the size of the organization or the number of concurrent users). There are recurring fees for support, training and updates. A capital expenditure (one large investment upfront). | Network cost |
Reliability | Uptime and reliability are guaranteed through provider’s service agreement. | Dependent on the human resources and equipment and acquired support services. |
Dependent on the reliability of each node in the systems. Multiple control centers reduce the risk of a system breakdown. |
Exemplary activities |
End of 2019 the National Health Service (NHS) Shared Business Services (SBS) in UK launched a cloud solutions framework valued at up to £500 m [26] that provides streamlined and OJEU (Official Journal of the European Union) compliant route to purchase cloud infrastructure and cloud optimization solutions for NHS and other authorities of the public sector. “The framework provides access to 24 carefully selected suppliers and offers bespoke and off-the-shelf solutions from cloud solution design and as-is assessment to end-to-end cloud solutions.” [27] |
The Research IT at Stanford Medicine established a clinical data warehouse “STAnford Research Repository” (STARR) that integrates data of several clinics. 2018 STARR-Radio was introduced: a cloud scale radiology imaging repository that brings data from PACS into a research archive with different modalities, e.g., chest and breast X-ray, MRI, CT, and ultrasound. [28] 2019 STARR-OMOP was launched that includes EHR data from ~ 2.67 M patients. This data infrastructure is connected to Stanford Nero, which allows Big Data Analytics. [29] |
Research partners from the Netherlands, Belgium, and Germany implemented an IT infrastructure “euroCAT” in five radiation clinics. They showed a proof-of-principle with the use-case of predicting severe dyspnea after radiotherapy for future “big data” infra-structures and distributed learning studies for personalized medicine. [30] |
The market for software systems and individual solutions, in clinical and research environments related to data integration and analysis, is diverse (Table 2). It includes comprehensive infrastructural software solutions such as Electronic Medical Record (EMR) systems used by health providers, especially as part of hospital information systems. An EMR, which is also known as Electronic Health Record (EHR), includes digital patient records such as diagnostic and therapeutic data across time and medical fields. These EMR systems are the basis for generating integrated clinical workflow solutions and cross-disciplinary data exchange for research. Moreover, there are software solutions from IT giants such as Google for data analysis approaches [31], domain-specific popular software libraries such as OpenCV [32] in the field of computer vision, or tool and data repositories such as the Neuroimaging Informatics Tools and Resources Clearinghouse (NITRC) [33]. Further overviews can be found in reports such as “Magic Quadrant for Data Integration Tools” provided by Gartner [34].
Table 2.
Selection of tools with capabilities in data integration (DI) and data analysis (DA). The tools are specified according to their open-source (OS) availability and their use in scientific publications together with the top 5 countries/regions according to their (co-)authorships. As an example: XNAT might be one suitable open-source tool for managing radiomics DICOM (Digital Imaging and Communications in Medicine) image data and clinical patient data supporting the HL7 (Health Level 7) FHIR protocol (Fast Healthcare Interoperability Resources) (see Supplement for further details on the methods)
Among the various health software systems and tools, in recent years, IBM Watson Health has been the subject of controversial debate [35, 36]. It is an AI-based software program designed for the decision support strongly focusing on oncology, clinical trials, and genomics with worldwide projects at 230 hospitals and health organizations [37]. Besides success stories such as recommending the best fitting breast cancer treatment [38] or enhancing next-generation sequencing [39], the projects also elucidated some problems for the clinical practice. For example, the MD Anderson Cancer Center first installed the EMR system from Epic System Corporation, which is besides Cerner Corporation one of the EMR market leaders in the USA [40]. However, the introduction of the Epic EMR system at MD Anderson was challenging in terms of time (~ 4 years), costs (up to 76.9% drop in adjusted income), and integration into clinical workflow [41–43]. The implementation of IBM Watson at MD Anderson failed with an estimated cost of $62 million due to mismanagement and problems regarding the integration with the EMR system [41, 44]. Projects in Germany and China with IBM Watson indicate obstacles to clinical applicability. This might be caused by the fact that the system was trained on data of the Memorial Sloan Kettering Cancer Center in New York [45–47]. These data may not directly translate to the other countries due to the different healthcare environment (e.g., regarding ethnical population, medical guidelines, and available treatments and medication). Those issues are related to the ongoing discussion about “poor data quality, incompatible datasets, inadequate expertise, and hype” holding up the big data revolution in healthcare [48].
In summary, we were not able to identify a ready-to-use solution, especially not for CD. The selection, implementation, and integration of software systems depend on the environment and its capabilities. With the increasing digitization, the growing amount of health data, and the upcoming new regulations, the tasks are becoming even more extensive, especially regarding comprehensive approaches. This makes standards and supporting regulations all the more important for the selection and use of IT systems and software tools. Furthermore, standards might unlock the so far restrained sharing of health data. A multitude of standards already exists for different domains (Table 3). However, many of these are historically grown and co-exist in different versions (e.g., HL7v2.x, HL7v3, and HL7 FHIR) that might limit their interoperability. Furthermore, also the commercial implementation of standards like DICOM is heterogeneous, not fully compatible between different vendors and contains a different degree of information. This complicates their use for comprehensive approaches. Therefore, one needs to analyze the homogeneity and compatibility of each standard for CD, extinct redundancies, and try to reduce the overall number of standards despite the complicating large number of stakeholders involved [67].
Table 3.
Selection of commonly used international standards and profiles for medical data documentation and communication. In addition, the use of the standards in scientific publications together with the top 5 countries/regions according to their (co-)authorships is shown (see Supplement for further details on the methods)
Acronym | Full name | Issued by | Purpose | Publications and top 5 countries by (co-)author affiliation |
---|---|---|---|---|
ATC [49] | Anatomical Therapeutic Chemical Classification System | WHO | Classification system for the active ingredients of drugs | 5008: 811 US, 707 SE, 659 NL, 577 DK, 517 DE |
DICOM [50] | Digital Imaging and Communication in Medicine | NEMA | Broadly accepted, open communication standard for encoding and exchange of medical image data and associated meta-information | 12,149: 5012 US, 1245 CN, 913 DE, UK 860, 564 KR |
EDIFACT [51] | Electronic Data Interchange for Administration, Commerce and Transport | UN/CEFACT (ISO 9735) | Open communication standard for the exchange of administrative data also healthcare IT systems | 49: 8 UK, 7 DK, 5 FR/US, 3 NL/SE |
HL7 V2 [52] | Health Level 7 | HL7 | Dominant communication standard for event notification between hospital IT systems | 237: 89 US, 14 KR, 11 UK, 9 FR/DE |
HL7 V3, CDA [53, 54] | Health Level 7, Clinical Document Architecture | HL7 | Open documentation standard regarding the structure and content of clinical documents based on XML | 626: 228 US, 38 DE, 32 KR, 20 UK, 18 SP |
HL7 V4, FHIR [55] | Fast Healthcare Interoperability Resources | HL7 | Fine granular communication standard for medical resources, data, and interfaces, including application programming interface (API) specification | 450: 193 US, 33 DE, 28 UK, 25 CA, 14 NL |
ICD [56] | International Classification of Diseases | WHO | Documentation standard for disease classification | 52,948: 23,504 US, 6107 UK, 3271 CA, 2925 CN, 2800 TW |
IHE PIX [57, 58] | Patient Identifier Cross Referencing | IHE | Integration profile for patient ID management based on HL7v2.x | 30: 11 US, 6 DE, 4 CA, 2 CN, 1 BR/DK/SI/ KR/FR/PT/UK |
IHE XDS [59] | Cross-Enterprise Document Sharing | IHE | Dominant interoperability profile for patient electronic health records | 103: 28 US, 10 CA,7 AT, 6 DE/NL |
ISO/IEEE 11073 [60] | Medical/Health Device Communication Standards | ISO/IEEE | Family of ISO, IEEE, and CEN joint standards addressing the interoperability of medical devices | 45: 11 KR, 8 US, 7 SP, 5 UK, 3 IT |
LOINC [61] | Logical Observation Identifiers Names and Codes | Regenstrief Institute | Documentation standard and ontology for laboratory data | 1227: 630 US, 45 DE, 35 UK, 33 KR, 29 FR |
MeSH [62] | Medical Subject Headings | NLM | Nomenclature enabling the indexing of medical publications | 10,526: 3142 US, 1488 UK, 1304 CN, 1111 CA, 640 AU |
RadLex [63] | Radiology Lexicon | RSNA | Comprehensive lexicon for standardized indexing and retrieval of radiology information resources | 267: 166 US, 16 DE, 12 UK, 11 CN, 10 CA/FR |
SNOMED CT [64] | Systemized Nomenclature of Medicine Clinical Terms | SNOMED Int. | Documentation standard for comprehensive, unified medical nomenclature comprising English and other languages | 3717: 1529 US, 367 UK, 173 DE, 151 SW, 144 FR |
UMLS [65] | Unified Medical Language System | NLM | Metathesaurus aiming at integrating all important medical terms | 2829: 1408 US, 190 UK, 146 CN, 100 DE, 85 FR |
XSPA [66] | Cross-Enterprise Security and Privacy Authorization | OASIS | eHealth profiles for Security Assertion Markup Language (SAML) and eXtensible Access Control Markup Language (XACML) | 15: 4 DE/US, 3 SP, 1 AT/BE/CA/PL/TW |
Radiomics
Radiomics is a part of CD and describes the extraction of quantifiable features from radiologic images and its analysis by machine or deep learning [68, 69]. The combination of genomic and radiomics features is described by the term radiogenomics [70]. However, the term radiogenomics is also applied to describe the use of genomic data to refine radiotherapy. Thus, there are ambiguities in the terminology and some authors even suggest dividing it further into radiogenomics, radioproteomics, radiolipidomics, etc. Nonetheless, everything targets towards integrated diagnostics supported by AI. The evolving field of radiomics (Table 4) presents multiple publications reporting every year about the diagnostic power of radiomics analyses [75–80].
Table 4.
Overview of radiomics generations from handcrafted features to end-to-end learning and delta radiomics
Radiomics generation | Technical details | References |
---|---|---|
1st | Few, well-understood handcrafted features | Kumar et al 2012 [71] |
2nd | Large number of generic, deterministic features | Aerts et al 2014 [69] |
3rd | Self-learning deep CNNs as feature extractor | Khalvati et al 2018 [72] |
4th | End-to-end deep learning integrates both feature extraction and classification/prediction | Hosny et al 2018 [73] |
Delta | Based on temporal feature changes instead of single time points, can be combined with all radiomics generations | Fave et al 2017 [74] |
However, there is an increasing discussion about the reliability of publications due to the data quality in terms of heterogeneity of datasets and parameters, sample size, and risk of bias regarding patient selection [81, 82]. This concern could be partially addressed by centralized databases continuously integrating huge amounts of data from various sites. Although in some countries like Denmark, Sweden, Finland, Austria, UK, Switzerland, and Spain, the nationwide implementation of eHealth is strongly promoted by the government, a common conduct has not yet been defined in Europe, which is highly demanded.
Our analysis of publications shows that the international research activity in radiomics is substantially increasing (Fig. 2). Between 2011 and 2019, 3009 radiomics publications have been indexed in the Web of Science, of which more than 73% have been published within the last 2 years. Article frequencies put Italy (the Netherlands before 2018) in the leading position in Europe and in third place in the worldwide ranking behind the USA and China.
Fig. 2.
Annual international publication activity in radiomics from 2011 to 2019 (total 3009) based on a Web of Science search. a Number of publications. b Top 5 countries ranked by their number of (co-)authorships in publications (e.g., in 2012 there were two publications, both NL and US were involved, so each of them has two co-authorships in the two publications of 2012). c Number of highly cited publications (top 1% of the citations). d Top 5 countries ranked by their number of highly cited (co-)authorship publications (in total 60 high cited publications with 167 citations on average) (the methods and table of highly cited publications are part of the Supplement)
With the increase in publications related to radiomics since 2015, the publication activity is characterized by multiple research fields with clinical and technical topics (Fig. 3). A screening of the publications showed the dominance of the clinical topic “oncology” and the lack of additional data sources besides medical images in the sense of comprehensive diagnostics.
Fig. 3.
Share of 3009 radiomics publications in the clinical and technical research areas assigned by the Web of Science for 2011 to 2019. Multiple assignments of research areas per publications are possible (see Supplement for further details on the methods)
In this context, there is a wide range of tools for data viewing and analysis, both in-house solutions and online available software that is often based on MATLAB (e.g., MITK, 3D-Slicer, IBEX, itk-SNAP, TexRAD, CERR). Since other fields like digital pathology, genomics, and proteomics are evolving and also show their potential for CD, foundations need to be laid for consolidating the different data qualities in the ongoing digitization processes.
Digitization of the healthcare systems
The basis for the implementation of CD including data integration and analysis in healthcare and research lies in the digitization. For an insight, we evaluated EU funding as well as the digitization of hospitals.
The EU funded 330 health-related projects in the Horizon 2020 [83] and FP7 [84] framework with a total budget of approximately €1.67 billion since 2015 regarding data integration, data analysis, and radiomics (Table 5). Considering the number and budget of projects, UK, Spain, the Netherlands, Germany, and Italy are at the forefront in data integration and analysis. There are more projects with industry coordination in data analysis; however, the relative budget shares are larger for data integration. Radiomics has played a minor role in EU funding so far. However, in agreement with the publication activity, the Netherlands has the biggest EU funding fraction in radiomics. Besides UK, other nations (e.g. Italy, France, and Germany) are hardly represented.
Table 5.
Analysis of European funding in health-related topics for data integration, data analysis, and radiomics. In this context, budget, industrial participation, and geographical hotspots based on Horizon 2020 and FP7 projects (not finished before 2015) were considered. *Industrial participation includes public private partnerships (PPP) such as the German Research Center for Artificial Intelligence (DFKI) (see Supplement for further details on the methods)
Data integration (DI) | Data analysis (DA) | Radiomics | Total | |
---|---|---|---|---|
By number of projects | ||||
Total number of projects | 26 | 304 | 5 | 330 |
Top 10 geographical hotspots |
DE (7) ES (5) UK (4) IT (2) NL (2) CH (2) LU (1) PL (1) FI (1) IL (1) |
UK (45) DE (35) NL (34) ES (33) IT (20) FR (17) EL (15) CH (13) DK (12) IL (12) |
NL (4) UK (1) |
UK DE ES NL IT FR CH EL IL DK |
% of projects coordinated by industry* | 23% | 32% | 40% | 31% |
By project budget (budget rounded in million €) | ||||
Total budget of projects | 164 | 1006 | 13 | 1170 |
Top 10 geographical hotspots |
ES (72) DE (29) UK (26) IT (14) NL (8) IL (7) CH (5) FI (2) LU (0.4) PL (0.1) |
NL (167) UK (140) ES (127) DE (106) EL (71) IT (67) CH (63) FR (49) DK (43) FI (37) |
NL (9) UK (4) |
ES NL UK DE IT EL CH FR DK FI |
% of budget of projects coordinated by industry* | 29% | 18% | 20% | 19% |
Top 3 industrial partners* (DI and DA budget > €9 million; radiomics budget > €2 million) |
GlaxoSmithKline Alacris Theranostics Sintea Plustek |
F. Hoffmann-La Roche Philips German Research Center for Artificial Intelligence (DFKI) |
ptTheragnostic |
F. Hoffmann-La Roche GlaxoSmithKline Philips |
In relation to all projects as a whole, our financing comparison shows that the focus of the funded project activities is clearly on data analysis, while data integration ranks far behind. Based on this, one may conclude that the prerequisites for data integration are already in place. Therefore, we analyzed the maturity of EMR systems in hospitals in order to gain an impression of their degree of digitization. The basis for this is the evaluation with the EMR Adoption Model (EMRAM) provided by HIMSS Analytics [85] (Fig. 4), which allows the analysis across countries and regions over several years. There are multiple other maturity models in the health sector especially for the “management of information systems and technologies” [86]. However, these models are predominantly limited to partial aspects of digitization in the hospital, they are focused on local analysis, or they lack data over time and across multiple countries/regions.
Fig. 4.
Degree of digitization of different countries’ hospitals based on the annually averaged EMRAM Score provided by HIMSS Analytics. Since in 2018, the criteria of the EMRAM stages were slightly modified and recent data are not yet available, we present data evaluated between 2011 and 2017. The eight-stage EMRAM Score ranges from 0 “paper-based” to 7 “paperless with data analytics” and it considers specific aspects such as closed-loop medication management. Besides single European nations, also United States (US), Middle East, Canada, and Asia-Pacific (APAC) are included. The numbers on the right represent the EMRAM Scores from 2017. In addition to the countries, the numbers of hospitals with EMRAM Score in 2017 are indicated. We would like to point out that due to the different number of hospitals assessed with the EMRAM Score, only a tendency can be evaluated (see Supplement for further details on the methods)
The comparison shows a heterogeneity in the digitization of European hospitals. There are pioneers such as the Nordic countries (e.g., Denmark and Estonia) and the Netherlands, which keep up with the US level. For example, Denmark already has a countrywide functioning IT infrastructure, which may explain that they are not represented in EU funding projects related to data integration. However, they are among the top 10 in funded data analysis projects. The Netherlands and Spain with increasing scores above the European average are strongly represented in EU funding and are still evolving their infrastructure. Furthermore, there are countries such as Germany that are lagging behind and try to catch up with a greater EU funding share and national efforts but “with varying degrees of enthusiasm and success” [87]: e.g., the German Medical Informatics Initiative comprises a national funding with more than €150 million for the development of data integration centers since 2018 [17], UK announced a £37.5 million investment in digital innovation hubs, and Japan released a law “to increase shared use of EMR data” [87]. Figure 5 illustrates the measures and challenges towards a digital healthcare system.
Fig. 5.
Challenges and implemented solutions for the digitalization of national healthcare systems including examples of countries at different stages of evolution
Our findings show the heterogeneity of (catching-up) activities related to data integration, so that the basis for comprehensive approaches has not yet been created throughout Europe. This is also in line with a recent study about integrated care programs in Europe [94] and with the Annual European eHealth Survey 2018 [95] that identifies diverse eHealth priorities: e.g., Germany has the highest priority in EMR implementation and UK in improving clinical access to information. The survey states that the top 3 challenges of healthcare providers are funding, standards for interoperability, and IT security.
The EU shows awareness to “support digital transformation of health and care in the EU by seeking to unlock the flow of health data across borders” [96] with a recommendation on an EMR exchange format [96]. This also relates to the potential risks for patients and public in terms of privacy, consent, and further aspects such as representative data and algorithmic bias [97]. A recent data leak of medical images and data from more than 5 million patients emphasizes the importance of data security and privacy [98]. Furthermore, the European Commission provides general ethics guidelines for trustworthy artificial intelligence [99], but without a legally binding consensus in Europe. These aspects also concern the current practice in medicine, which relies on guidelines that are evidence-based, practice-oriented recommendations.
Guidelines refer to groups and subgroups of diseases but they do not represent the level of the individual patient. Furthermore, guidelines are “conservative.” They reflect the current state of knowledge with a time delay, required to provide evidence and consensus. In contrast, AI has the potential to act more “progressive” and faster, with a finer granularity, because a diagnostic or therapeutic concept could be determined based on the entire data basis and all available frame conditions of an individual patient. However, its evidence level is vague. This raises some questions: How do physicians act in the area of conflict between “guideline truth” and AI-based recommendation? Could AI contribute to the process of generating and updating guidelines? Could this establish a new quality of evidence?
These questions are also linked to the new challenging topic of explainability of AI results as they derive from a “black box” [67, 100, 101]. In terms of the European General Data Protection Regulation (GDPR), the legal existence and feasibility of “a ‘right to explanation’ of all decisions made by automated or artificially intelligent algorithmic systems” are in doubt [102]. It becomes even more complex, when continuously learning and modifying AI systems in the clinical environment might no longer correspond to the initially approved system [103]. In this regard, the first attempts to approve such medical products and to standardize the process have been initiated by the US Food and Drug Administration (FDA) [104, 105]. They might serve as role models for Europe [103].
Conclusion
Comprehensive approaches in diagnostics and their clinical implementation are still in their early stages because the prerequisites for digital medicine have not yet been sufficiently created throughout the European health systems. The manifold international activities are characterized by the heterogeneity of the European progress in digitization and driven by national efforts. Therefore, it is difficult to predict when and how most questions will be answered. Besides the leading examples, there is currently still a patchwork of systems and regulations as well as isolated solutions, which is why the effort for individuals in both clinical and research environments remains high. This emphasizes the importance of clear governance, investment, and cooperation at various levels in the healthcare system for the catching-up nations and institutions. These activities are crucial to overcome the multiple hurdles such as digital infrastructure, interoperability, security, and privacy as well as ethical and legal concerns for the benefit of research, healthcare, and ultimately patient health.
Electronic supplementary material
(DOCX 47 kb).
Acknowledgments
We thank HIMSS Europe GmbH (HIMSS Analytics) for providing us the data for the cross-regional EMRAM Score distribution.
Abbreviations
- AI
Artificial intelligence
- APAC
Asia-Pacific
- API
Application programming interface
- ATC
Anatomical Therapeutic Chemical Classification System
- CD
Comprehensive diagnostics
- CDA
Clinical Document Architecture
- CEN
European Committee for Standardization (Comité Européen de Normalisation)
- DBLP
Digital Bibliography & Library Project
- DFKI
German Research Center for Artificial Intelligence
- DICOM
Digital Imaging and Communications in Medicine
- EDIFACT
Electronic Data Interchange for Administration, Commerce and Transport
- EHR
Electronic health record
- EMR
Electronic medical record
- EMRAM
Electronic medical record adoption model
- ETL
Extract, transform, load
- FAIR
Findable, accessible, interoperable, and reusable
- FDA
US Food and Drug Administration
- FHIR
Fast Healthcare Interoperability Resources
- FP
Framework Programmes for Research and Technological Development
- GDPR
EU General Data Protection Regulation
- HL7
Health Level 7
- IEEE
Institute of Electrical and Electronics Engineers
- IHE
Integrating the Healthcare Enterprise
- ISO
International Organization for Standardization
- IT
Information technology
- LOINC
Logical Observation Identifiers Names and Codes
- MeSH
Medical Subject Headings
- ML
Machine learning
- NEMA
National Electrical Manufacturers Association
- NHS
National Health Service
- NITRC
Neuroimaging Informatics Tools and Resources Clearinghouse
- NLM
National Library of Medicine
- OASIS
Organization for the Advancement of Structured Information Standards
- OJEU
Official Journal of the European Union
- PIX
Patient Identifier Cross Referencing
- PPP
Public Private Partnerships
- RadLex
Radiology Lexicon
- RSNA
Radiological Society of North America
- SAML
Security Assertion Markup Language
- SBS
Shared Business Services
- SNOMED CT
Systemized Nomenclature of Medicine Clinical Terms
- STARR
STAnford Research Repository
- UMLS
Unified Medical Language System
- UN/CEFACT
United Nations Centre for Trade Facilitation and Electronic Business
- WHO
World Health Organization
- WoS
Web of Science
- XACML
eXtensible Access Control Markup Language
- XDS
Cross-Enterprise Document Sharing
- XML
Extensible Markup Language
- XSPA
Cross-Enterprise Security and Privacy Authorization
Funding information
Open Access funding provided by Projekt DEAL. This study has received funding by the Exploratory Research Space (project prepCDCA) of RWTH Aachen University.
Compliance with ethical standards
Guarantor
The scientific guarantor of this publication is Thomas Schmitz-Rode.
Institute of Applied Medical Engineering, Helmholtz Institute, RWTH Aachen University, Pauwelsstr. 20, 52074 Aachen, Germany, +49 241 80 87111, smiro@ame.rwth-aachen.de
Conflict of interest
The authors of this manuscript declare no relationships with any companies whose products or services may be related to the subject matter of the article.
Statistics and biometry
No complex statistical methods were necessary for this paper.
Informed consent
Informed consent was not required as this study is not on human or animal subjects.
Ethical approval
Institutional Review Board approval was not required because this study is not on human or animal subjects.
Methodology
• Performed at one institution
Footnotes
Publisher’s note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Contributor Information
Robert Farkas, Email: farkas@ame.rwth-aachen.de.
Fabian Kiessling, Email: fkiessling@ukaachen.de.
Thomas Schmitz-Rode, Email: smiro@ame.rwth-aachen.de.
References
- 1.Esteva A, Robicquet A, Ramsundar B, et al. A guide to deep learning in healthcare. Nat Med. 2019;25(1):24–29. doi: 10.1038/s41591-018-0316-z. [DOI] [PubMed] [Google Scholar]
- 2.Topol EJ. High-performance medicine: the convergence of human and artificial intelligence. Nat Med. 2019;25(1):44–56. doi: 10.1038/s41591-018-0300-7. [DOI] [PubMed] [Google Scholar]
- 3.Pesapane F, Codari M, Sardanelli F. Artificial intelligence in medical imaging: threat or opportunity? Radiologists again at the forefront of innovation in medicine. Eur Radiol Exp. 2018;2(1):35. doi: 10.1186/s41747-018-0061-6. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Brink JA, Arenson RL, Grist TM, Lewin JS, Enzmann D. Bits and bytes: the future of radiology lies in informatics and information technology. Eur Radiol. 2017;27(9):3647–3651. doi: 10.1007/s00330-016-4688-5. [DOI] [PubMed] [Google Scholar]
- 5.Yu K-H, Beam AL, Kohane IS. Artificial intelligence in healthcare. Nat Biomed Eng. 2018;2(10):719–731. doi: 10.1038/s41551-018-0305-z. [DOI] [PubMed] [Google Scholar]
- 6.Kiessling F. The changing face of cancer diagnosis: from computational image analysis to systems biology. Eur Radiol. 2018;28(8):3160–3164. doi: 10.1007/s00330-018-5347-9. [DOI] [PubMed] [Google Scholar]
- 7.Benchimol EI, Smeeth L, Guttmann A, et al. The REporting of studies Conducted using Observational Routinely-collected health Data (RECORD) statement. PLoS Med. 2015;12(10):e1001885. doi: 10.1371/journal.pmed.1001885. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Cohrs RJ, Martin T, Ghahramani P, Bidaut L, Higgins PJ, Shahzad A (2017) Translational Medicine definition by the European Society for Translational Medicine. New Horiz Transl Med 2(3):86
- 9.Natarajan P, Frenzel JC, Smaltz DH. Demystifying big data and machine learning for healthcare. Boca Raton: CRC Press, Taylor & Francis; 2017. [Google Scholar]
- 10.Danciu I, Cowan JD, Basford M, et al. Secondary use of clinical data: the Vanderbilt approach. J Biomed Inform. 2014;52:28–35. doi: 10.1016/j.jbi.2014.02.003. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Hansson MG, Lochmüller H, Riess O, et al. The risk of re-identification versus the need to identify individuals in rare disease research. Eur J Hum Genet. 2016;24(11):1553–1558. doi: 10.1038/ejhg.2016.52. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Rocher L, Hendrickx JM, de Montjoye Y-A. Estimating the success of re-identifications in incomplete datasets using generative models. Nat Commun. 2019;10(1):3069. doi: 10.1038/s41467-019-10933-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Durinx C, McEntyre J, Appel R et al (2016) Identifying ELIXIR core data resources. F1000Res 5:ELIXIR-2422 [DOI] [PMC free article] [PubMed]
- 14.Sudlow C, Gallacher J, Allen N, et al. UK biobank: an open access resource for identifying the causes of a wide range of complex diseases of middle and old age. PLoS Med. 2015;12(3):e1001779. doi: 10.1371/journal.pmed.1001779. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Attyé A. Data sharing improves scientific publication: example of the “hydrops initiative”. Eur Radiol. 2019;29(4):1959–1960. doi: 10.1007/s00330-018-5759-6. [DOI] [PubMed] [Google Scholar]
- 16.Giannoutakis KM, Tzovaras D. The European strategy in research infrastructures and Open Science Cloud. In: Kalinichenko L, Kuznetsov SO, Manolopoulos Y, editors. Data analytics and management in data intensive domains. Cham: Springer International Publishing; 2017. pp. 207–221. [Google Scholar]
- 17.Semler SC, Wissing F, Heyder R. German medical informatics initiative. Methods Inf Med. 2018;57(S 01):e50–e56. doi: 10.3414/ME18-03-0003. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Hripcsak G, Bloomrosen M, FlatelyBrennan P, et al. Health data use, stewardship, and governance: ongoing gaps and challenges: a report from AMIA’s 2012 health policy meeting. J Am Med Inform Assoc. 2014;21(2):204–211. doi: 10.1136/amiajnl-2013-002117. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Wilkinson MD, Dumontier M, Aalbersberg IJJ, et al. The FAIR guiding principles for scientific data management and stewardship. Sci Data. 2016;3:160018. doi: 10.1038/sdata.2016.18. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Mons B, Neylon C, Velterop J, Dumontier M, da Silva Santos LOB, Wilkinson MD. Cloudy, increasingly FAIR; revisiting the FAIR data guiding principles for the European Open Science Cloud. ISU. 2017;37(1):49–56. [Google Scholar]
- 21.Duarte AMS, Psomopoulos FE, Blanchet C, et al. Future opportunities and trends for e-infrastructures and life sciences: going beyond the grid to enable life science data analysis. Front Genet. 2015;6:197. doi: 10.3389/fgene.2015.00197. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Gaye A, Marcon Y, Isaeva J, et al. DataSHIELD: taking the analysis to the data, not the data to the analysis. Int J Epidemiol. 2014;43(6):1929–1944. doi: 10.1093/ije/dyu188. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Murphy SN, Weber G, Mendis M, et al. Serving the enterprise and beyond with informatics for integrating biology and the bedside (i2b2) J Am Med Inform Assoc. 2010;17(2):124–130. doi: 10.1136/jamia.2009.000893. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.van Soest J, Sun C, Mussmann O, et al. Using the personal health train for automated and privacy-preserving analytics on vertically partitioned data. Stud Health Technol Inform. 2018;247:581–585. [PubMed] [Google Scholar]
- 25.Beyan O, Choudhury A, van Soest J, et al. Distributed analytics on sensitive medical data: the personal health train. Data Intelligence. 2019;350(3):96–107. [Google Scholar]
- 26.Donnelly C (2019) NHS Shared Business Services seeks suppliers for £500m cloud procurement framework; Available via https://www.computerweekly.com/news/252459453/NHS-Shared-Business-Services-seeks-suppliers-for-500m-cloud-procurement-framework. Accessed 29 Jan 2020
- 27.NHS Shared Business Services (2019) Cloud Solutions; Available via https://www.sbs.nhs.uk/fas-cloud-solutions. Accessed 29 Jan 2020
- 28.Stanford Medicine (2018) Radiology imaging data now integrated with STARR; Available via https://med.stanford.edu/researchit/news/radiology-imaging-data-now-integrated-with-starr.html. Accessed 29 Jan 2020
- 29.Stanford Medicine (2019) STARR-OMOP launched; Available via http://med.stanford.edu/researchit/news/starr-omop-launched.html. Accessed 29 Jan 2020
- 30.Deist TM, Jochems A, van Soest J, et al. Infrastructure and distributed learning methodology for privacy-preserving multi-centric rapid learning health care: euroCAT. Clin Transl Radiat Oncol. 2017;4:24–31. doi: 10.1016/j.ctro.2016.12.004. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.Tomašev N, Glorot X, Rae JW, et al. A clinically applicable approach to continuous prediction of future acute kidney injury. Nature. 2019;572(7767):116–119. doi: 10.1038/s41586-019-1390-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32.opencv.org (2019) OpenCV (Open Source Computer Vision Library); Available via https://opencv.org. Accessed 28 Aug 2019
- 33.Kennedy DN, Haselgrove C, Riehl J, Preuss N, Buccigrossi R. The NITRC image repository. Neuroimage. 2016;124(Pt B):1069–1073. doi: 10.1016/j.neuroimage.2015.05.074. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34.Zaidi E, Thoo E, Heudecker N (2019) Magic quadrant for data integration tools; Available via https://www.gartner.com/en/documents/3955823. Accessed 25 Aug 2019
- 35.Strickland E (2019) How IBM Watson overpromised and underdelivered on AI Health Care; Available via https://spectrum.ieee.org/biomedical/diagnostics/how-ibm-watson-overpromised-and-underdelivered-on-ai-health-care. Accessed 09 Jul 2019
- 36.Hernandez D, Greenwald T (2018) IBM has a Watson dilemma; Available via https://www.wsj.com/articles/ibm-bet-billions-that-watson-could-improve-cancer-treatment-it-hasnt-worked-1533961147. Accessed 10 Jul 2019
- 37.Kelly III JE (2018) Watson health: setting the record straight; Available via https://www.ibm.com/blogs/watson-health/setting-the-record-straight/. Accessed 09 Jul 2019
- 38.Somashekhar SP, Sepúlveda M-J, Puglielli S, et al. Watson for oncology and breast cancer treatment recommendations: agreement with an expert multidisciplinary tumor board. Ann Oncol. 2018;29(2):418–423. doi: 10.1093/annonc/mdx781. [DOI] [PubMed] [Google Scholar]
- 39.Patel NM, Michelini VV, Snell JM, et al. Enhancing next-generation sequencing-guided cancer care through cognitive computing. Oncologist. 2018;23(2):179–185. doi: 10.1634/theoncologist.2017-0170. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 40.Drees J (2019) KLAS: Epic, Cerner dominate EMR market share; Available via https://www.beckershospitalreview.com/ehrs/klas-epic-cerner-dominate-emr-market-share.html. Accessed 27 Sep 2019
- 41.University of Texas System Administration (2017) Special review of procurement procedures related to the M.D. Anderson Cancer Center Oncology Expert Advisor Project. Report; Available via https://www.utsystem.edu/sites/default/files/documents/UT/System/Administration/Special/Review/of/Procurement/Procedures/Related/to/UTMDACC/Oncology/Expert/Advisor/Project/ut-system-administration-special-review-procurement-procedures-related-utmdacc-oncology-expert-advis.pdf. Accessed 18 Jun 2019
- 42.Atul Gawande (2018) Why doctors hate their computers. The New Yorker, 12 November 2018; Available via https://www.newyorker.com/magazine/2018/11/12/why-doctors-hate-their-computers. Accessed 05 Feb 2019
- 43.Becker’s Healthcare (2016) MD Anderson points to epic implementation for 77% drop in adjusted income; Available via https://www.beckershospitalreview.com/finance/md-anderson-points-to-epic-implementation-for-77-drop-in-adjusted-income.html. Accessed 10 Jul 2019
- 44.Mearian L (2018) Did IBM overhype Watson Health’s AI promise?; Available via https://www.computerworld.com/article/3321138/did-ibm-put-too-much-stock-in-watson-health-too-soon.html. Accessed 10 Jul 2019
- 45.Zhou N, Zhang C-T, Lv H-Y, et al. Concordance study between IBM Watson for oncology and clinical practice for patients with cancer in China. Oncologist. 2019;24(6):812–819. doi: 10.1634/theoncologist.2018-0255. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 46.Balzter S (2018) Im Krankenhaus fällt die Wunderwaffe durch; Available via https://www.faz.net/aktuell/wirtschaft/kuenstliche-intelligenz/computer-watson-scheitert-zu-oft-bei-datenanalyse-15619989.html. Accessed 10 Jul 2019
- 47.Krempl S (2018) Kampf gegen Krebs: Dr. Watson enttäuscht Erwartungen; Available via https://www.heise.de/newsticker/meldung/Kampf-gegen-Krebs-Dr-Watson-enttaeuscht-Erwartungen-4137203.html. Accessed 10 Jul 2019
- 48.Dhindsa K, Bhandari M, Sonnadara RR. What’s holding up the big data revolution in healthcare? BMJ. 2018;363:k5357. doi: 10.1136/bmj.k5357. [DOI] [PubMed] [Google Scholar]
- 49.WHO (2019) ATC classification system: structure and principles; Available via https://www.whocc.no/atc/structure_and_principles/. Accessed 07 Oct 2019
- 50.NEMA (2019) DICOM: Digital imaging and communications in medicine; Available via https://www.dicomstandard.org/. Accessed 07 Oct 2019
- 51.UN/CEFACT (2019) UN/EDIFACT syntax implementation guidelines; Available via https://www.unece.org/trade/untdid/texts/old/d423.htm. Accessed 07 Oct 2019
- 52.HL7 (2019) HL7 Version 2; Available via http://www.hl7.org/implement/standards/product_brief.cfm?product_id=185. Accessed 07 Oct 2019
- 53.HL7 (2019) HL7 Version 3; Available via http://www.hl7.org/implement/standards/product_section.cfm?section=14. Accessed 07 Oct 2019
- 54.HL7 (2019) HL7 clinical document architecture; Available via http://www.hl7.org/implement/standards/product_section.cfm?section=10. Accessed 07 Oct 2019
- 55.HL7 (2019) HL7 FHIR; Available via https://www.hl7.org/fhir/. Accessed 07 Oct 2019
- 56.WHO (2019) International Classification of Diseases; Available via https://www.who.int/classifications/icd/en/. Accessed 07 Oct 2019
- 57.IHE (2019) Patient identifier cross-referencing; Available via https://wiki.ihe.net/index.php/Patient_Identifier_Cross-Referencing. Accessed 07 Oct 2019
- 58.IHE (2019) Patient identifier cross-reference HL7 v3; Available via https://wiki.ihe.net/index.php/Patient_Identifier_Cross-Reference_HL7_v3. Accessed 07 Oct 2019
- 59.IHE (2019) Cross-enterprise document sharing; Available via https://wiki.ihe.net/index.php/Cross-Enterprise_Document_Sharing. Accessed 07 Oct 2019
- 60.ISO/IEEE (2019) ISO/IEEE 11073; Available via https://www.iso.org/search.html?q=11073. Accessed 07 Oct 2019
- 61.Regenstrief Institute (2019) LOINC; Available via https://loinc.org/. Accessed 07 Oct 2019
- 62.NLM (2019) Medical subject headings; Available via https://www.nlm.nih.gov/mesh/meshhome.html. Accessed 07 Oct 2019
- 63.RSNA (2019) RadLex radiology lexicon; Available via https://www.rsna.org/en/practice-tools/data-tools-and-standards/radlex-radiology-lexicon. Accessed 07 Oct 2019
- 64.SNOMED International (2019) SNOMED CT; Available via https://www.snomed.org/. Accessed 07 Oct 2019
- 65.NLM (2019) Unified medical language system; Available via https://www.nlm.nih.gov/research/umls/index.html. Accessed 07 Oct 2019
- 66.OASIS (2019) Cross-enterprise security and privacy authorization; Available via https://www.oasis-open.org/news/announcements/cross-enterprise-security-and-privacy-authorization-xspa-profile-of-saml-v2-0-for. Accessed 07 Oct 2019
- 67.Krumm S, Dwertmann A. Perspektiven der KI in der Medizin. In: Wittpahl V, editor. Künstliche Intelligenz. Berlin: Springer Berlin Heidelberg; 2019. pp. 161–175. [Google Scholar]
- 68.Gillies RJ, Kinahan PE, Hricak H. Radiomics: images are more than pictures, they are data. Radiology. 2016;278(2):563–577. doi: 10.1148/radiol.2015151169. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 69.Aerts HJWL, Velazquez ER, Leijenaar RTH, et al. Decoding tumour phenotype by noninvasive imaging using a quantitative radiomics approach. Nat Commun. 2014;5:4006. doi: 10.1038/ncomms5006. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 70.Lambin P, Rios-Velazquez E, Leijenaar R, et al. Radiomics: extracting more information from medical images using advanced feature analysis. Eur J Cancer. 2012;48(4):441–446. doi: 10.1016/j.ejca.2011.11.036. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 71.Kumar V, Gu Y, Basu S, et al. Radiomics: the process and the challenges. Magn Reson Imaging. 2012;30(9):1234–1248. doi: 10.1016/j.mri.2012.06.010. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 72.Khalvati F, Zhang J, Chung AG, Shafiee MJ, Wong A, Haider MA. MPCaD: a multi-scale radiomics-driven framework for automated prostate cancer localization and detection. BMC Med Imaging. 2018;18(1):16. doi: 10.1186/s12880-018-0258-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 73.Bi WL, Hosny A, Schabath MB, et al. Artificial intelligence in cancer imaging: clinical challenges and applications. CA Cancer J Clin. 2019;69(2):127–157. doi: 10.3322/caac.21552. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 74.Fave X, Zhang L, Yang J, et al. Delta-radiomics features for the prediction of patient outcomes in non-small cell lung cancer. Sci Rep. 2017;7(1):588. doi: 10.1038/s41598-017-00665-z. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 75.Wu W, Pierce LA, Zhang Y et al (2019) Comparison of prediction models with radiological semantic features and radiomics in lung cancer diagnosis of the pulmonary nodules: a case-control study. Eur Radiol. 10.1007/s00330-019-06213-9 [DOI] [PMC free article] [PubMed]
- 76.Tan Y, Zhang S-T, Wei J-W, et al. A radiomics nomogram may improve the prediction of IDH genotype for astrocytoma before surgery. Eur Radiol. 2019;29(7):3325–3337. doi: 10.1007/s00330-019-06056-4. [DOI] [PubMed] [Google Scholar]
- 77.Ather S, Kadir T, Gleeson F (2019) Artificial intelligence and radiomics in pulmonary nodule management: current status and future applications. Clin Radiol. 10.1016/j.crad.2019.04.017 [DOI] [PubMed]
- 78.Savadjiev P, Chong J, Dohan A et al (2019) Image-based biomarkers for solid tumor quantification. Eur Radiol. 10.1007/s00330-019-06169-w [DOI] [PubMed]
- 79.Chilamkurthy S, Ghosh R, Tanamala S, et al. Deep learning algorithms for detection of critical findings in head CT scans: a retrospective study. Lancet. 2018;392(10162):2388–2396. doi: 10.1016/S0140-6736(18)31645-3. [DOI] [PubMed] [Google Scholar]
- 80.Lu H, Arshad M, Thornton A, et al. A mathematical-descriptor of tumor-mesoscopic-structure from computed-tomography images annotates prognostic- and molecular-phenotypes of epithelial ovarian cancer. Nat Commun. 2019;10(1):764. doi: 10.1038/s41467-019-08718-9. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 81.van Timmeren JE, Carvalho S, Leijenaar RTH, et al. Challenges and caveats of a multi-center retrospective radiomics study: an example of early treatment response assessment for NSCLC patients using FDG-PET/CT radiomics. PLoS One. 2019;14(6):e0217536. doi: 10.1371/journal.pone.0217536. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 82.Sollini M, Antunovic L, Chiti A, Kirienko M (2019) Towards clinical application of image mining: a systematic review on artificial intelligence and radiomics. Eur J Nucl Med Mol Imaging. 10.1007/s00259-019-04372-x [DOI] [PMC free article] [PubMed]
- 83.EU Publications Office - EU Open Data Portal (2019) CORDIS - EU research projects under Horizon 2020 (2014–2020); Available via http://data.europa.eu/euodp/de/data/dataset/cordisH2020projects. Accessed 08 Jul 2019
- 84.EU Publications Office - EU Open Data Portal (2019) CORDIS - EU research projects under FP7 (2007–2013); Available via http://data.europa.eu/euodp/de/data/dataset/cordisfp7projects. Accessed 08 Jul 2019
- 85.HIMSS Analytics electronic medical record adoption model; Available via https://www.himssanalytics.org/EMRAM. Accessed 27 Jun 2019
- 86.Carvalho JV, Rocha Á, Abreu A. Maturity models of healthcare information systems and technologies: a literature review. J Med Syst. 2016;40(6):131. doi: 10.1007/s10916-016-0486-5. [DOI] [PubMed] [Google Scholar]
- 87.Deloitte (2019) 2019 global health care outlook: shaping the future; Available via https://www2.deloitte.com/global/en/pages/life-sciences-and-healthcare/articles/global-health-care-sector-outlook.html. Accessed 08 Jul 2019
- 88.Kierkegaard P. eHealth in Denmark: a case study. J Med Syst. 2013;37(6):9991. doi: 10.1007/s10916-013-9991-y. [DOI] [PubMed] [Google Scholar]
- 89.Klauber J, Geraedts M, Friedrich J, Wasem J. Krankenhaus-Report 2019. Berlin: Springer; 2019. [Google Scholar]
- 90.Lai T, Habicht T, Kahur K, Reinap M, Kiivet R, van Ginneken E. Estonia: health system review. Health Syst Transit. 2013;15(6):1–196. [PubMed] [Google Scholar]
- 91.Centers for Medicare & Medicaid Services, Department of Health and Human Services (HHS) (2018) 2019 Medicare Electronic Health Record (EHR) incentive program payment adjustment fact sheet for hospitals; Available via https://www.cms.gov/newsroom/fact-sheets/2019-medicare-electronic-health-record-ehr-incentive-program-payment-adjustment-fact-sheet-hospitals. Accessed 26 Aug 2019
- 92.Hoggle L. The Health Information Technology for Economic and Clinical Health (HITECH) act and nutrition inclusion in Medicare/Medicaid electronic health records: leveraging policy to support nutrition care. J Acad Nutr Diet. 2012;112(12):1935–1940. doi: 10.1016/j.jand.2012.10.005. [DOI] [PubMed] [Google Scholar]
- 93.IHE Deutschland e.V (2019) Sicherstellen der Interoperabilität im eigentlichen Sinn: IHE Deutschland e.V. bemängelt proprietäre Verwendung internationaler Standards in aktueller ePA-Spezifikation: Öffentliche Stellungnahme zur IHE Nutzung in den GEMATIK-Spezifikationen; Available via http://www.ihe-d.de/. Accessed 08 Apr 2019
- 94.Baltaxe E, Czypionka T, Kraus M, et al. Digital health transformation of integrated care in Europe: overarching analysis of 17 integrated care programs. J Med Internet Res. 2019;21(8):e14956. doi: 10.2196/14956. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 95.HIMSS Europe (2018) Annual European eHealth survey 2018; Available via https://www.himss.eu/content/annual-european-ehealth-survey-2018. Accessed 26 Aug 2019
- 96.European Commission (2019) Exchange of Electronic Health Records across the EU; Available via https://ec.europa.eu/digital-single-market/en/exchange-electronic-health-records-across-eu. Accessed 23 Sep 2019
- 97.Shaw J, Rudzicz F, Jamieson T, Goldfarb A. Artificial intelligence and the implementation challenge. J Med Internet Res. 2019;21(7):e13659. doi: 10.2196/13659. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 98.Gillum J, Kao J, Larson, Jeff (2019) Millions of Americans’ medical images and data are available on the Internet. Anyone can take a peek; available via https://www.propublica.org/article/millions-of-americans-medical-images-and-data-are-available-on-the-internet. Accessed 17.09.19
- 99.European Commission (2019) Ethics guidelines for trustworthy AI; Available via https://ec.europa.eu/digital-single-market/en/news/ethics-guidelines-trustworthy-ai. Accessed 11 Jul 2019
- 100.Holzinger A, Langs G, Denk H, Zatloukal K, Müller H (2019) Causability and explainabilty of artificial intelligence in medicine. Wiley Interdiscip Rev Data Min Knowl Discov 9(4):e1312 [DOI] [PMC free article] [PubMed]
- 101.London AJ. Artificial intelligence and black-box medical decisions: accuracy versus explainability. Hast Cent Rep. 2019;49(1):15–21. doi: 10.1002/hast.973. [DOI] [PubMed] [Google Scholar]
- 102.Wachter S, Mittelstadt B, Floridi L (2017) Why a right to explanation of automated decision-making does not exist in the general data protection regulation. Int Data Priv Law 7(2):76–99. 10.1093/idpl/ipx005
- 103.Lernende Systeme – Die Plattform für Künstliche Intelligenz (2019) Lernende Systeme im Gesundheitswesen: Prävention, Diagnose, Therapie; Available via https://www.plattform-lernende-systeme.de/publikationen-details/lernende-systeme-im-gesundheitswesen.html. Accessed 26 Aug 2019
- 104.U.S. Food & Drug Administration (2019) Developing a software precertification program: a working model. Version 1.0; Available via https://www.fda.gov/media/119722/download. Accessed 26 Aug 2019
- 105.U.S. Food & Drug Administration (2019) Proposed regulatory framework for modifications to artificial modifications intelligence/machine learning (AI/ML) - based software as a medical device (SaMD); Available via https://www.fda.gov/media/122535/download. Accessed 26 Aug 2019
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
(DOCX 47 kb).