Summary
Background
In 2009, Applied Clinical Informatics (ACI) – focused on applications in clinical informatics – was launched as a companion journal to Methods of Information in Medicine (MIM). Both journals are official journals of the International Medical Informatics Association.
Objectives
To explore which congruencies and interdependencies exist in publications from theory to practice and from practice to theory and to determine existing gaps. Major topics discussed in ACI and MIM were analyzed. We explored if the intention of publishing companion journals to provide an information bridge from informatics theory to informatics practice and vice versa could be supported by this model. In this manuscript we will report on congruencies and interdependences from practice to theory and on major topics in MIM.
Methods
Retrospective, prolective observational study on recent publications of ACI and MIM. All publications of the years 2012 and 2013 were indexed and analyzed.
Results
Hundred and ninety-six publications were analyzed (ACI 87, MIM 109). In MIM publications, modelling aspects as well as methodological and evaluation approaches for the analysis of data, information, and knowledge in biomedicine and health care were frequently raised – and often discussed from an interdisciplinary point of view. Important themes were ambient-assisted living, anatomic spatial relations, biomedical informatics as scientific discipline, boosting, coding, computerized physician order entry, data analysis, grid and cloud computing, health care systems and services, health-enabling technologies, health information search, health information systems, imaging, knowledge-based decision support, patient records, signal analysis, and web science. Congruencies between journals could be found in themes, but with a different focus on content. Interdependencies from practice to theory, found in these publications, were only limited.
Conclusions
Bridging from informatics theory to practice and vice versa remains a major component of successful research and practice as well as a major challenge.
Keywords: Biomedical informatics, health informatics, clinical informatics, medical informatics, serial publications
1. Introduction
In 2008, a call for an applied clinical informatics journal was published in Methods of Information in Medicine (MIM) [1] as a result of an increasing demand for research and information focusing on the implementation and maintenance of bedside health information systems that had been perceived. Subsequently, in late 2009, Applied Clinical Informatics (ACI) started to publish papers in the core domains of clinical information systems, administrative and management systems, eHealth systems, information technology development, deployment, and evaluation, socio-technical aspects of information technology (IT) and health IT training [2, 3].
Five years after the launch of ACI, an opportunity to explore the relationship of the content of MIM and ACI was grasped, to investigate if informatics theory and methods (as reflected in MIM) were developing in parallel to the application of the science (as reflected in ACI) and to explore which congruencies and which interdependencies exist.
2. Questions
The following research questions were raised:
Which congruencies and which interdependencies exist
-
(tp) from theory to practice?
– (I.e., in this context, from content reported in MIM to content published in ACI.)
-
(pt) from practice to theory?
– (I.e., in this context, from content reported in ACI to content published in MIM.)
– And what are existing gaps?
To answer these questions, we first needed to know
-
Which major topics were being discussed
– (a)in ACI?
– (m)in MIM?
The final question was:
(b) Can the intent to bridge knowledge from informatics practice to informatics theory be supported by this model of companion journals?
The study design for our investigation is presented in the next section. Answers to questions (m) and (pt) will be presented in this paper in sections 4.1 and 4.2 (as being of major interest to the readership of this journal), those for questions (a) and (tp) are presented in MIM (4). Reflections on question (b) will be discussed in both papers in section 4.3. To increase the ease of reading, we have almost identical sections 1–3 and sections 5 and 6 in both papers, being aware that this will generate some redundancy.
3. Material and Methods
We conducted a retrospective, but prolective observational study (cf. [5] on the differences of pro/retro-spective and -lective).
As empirical basis for the intended analysis, the authors decided to evaluate publications which appeared in the years 2012 and 2013 in ACI (ACI volumes 3 in 2012 and 4 in 2013, journal information at [6]) and in MIM (MIM volumes 51 in 2012 and 52 in 2013, journal information at [7]). Both journals are official journals of IMIA, the International Medical Informatics Association [8] and both are published by the same publisher, Schattauer Verlag, Stuttgart, Germany [9].
Publications were defined as journal articles excluding editorials and letters to the editor. To identify these publications we used Medline/PubMed [10], specifying as time limits January 1, 2012, until December 31, 2013, and as journals ACI and MIM. The Medline/PubMed search was done on September 21, 2014. From the reference list obtained, we excluded all editorials and all electronic publications to be printed later than 2013. The number of publications in the respective years is presented in ▶Table 1.
Table 1.
Number of publications and issues for ACI and MIM in the years 2012 and 2013.
| Number of publications (Number of issues) | Applied Clinical Informatics | Methods of Information in Medicine | Total |
|---|---|---|---|
| 2012 | 41 (4) | 58 (6) | 99 |
| 2013 | 46 (4) | 51 (6) | 97 |
| Total | 87 | 109 | 196 |
To analyze these publications with respect to the research questions raised in section 2, all relevant publications were indexed. Complying with rules for good scientific practice (e.g., [11]), all indexing data and observations, recorded by the authors as basis for this publication, have been stored. Copies of the files can be requested from the authors. All analyzed publications can be accessed through the respective publishing company’s web site mentioned above or in case of ACI through PubMedCentral [12].
4. Results
4.1 Major topics discussed in MIM
As a journal that emphasizes the methodology and scientific fundamentals of organizing, representing, and analyzing data, information, and knowledge in biomedicine and health care, the publication topics of MIM were as expected quite broad and beyond the scope of ’just’ biomedical and health informatics in the two years. The following list of publications is not complete, but highlights the major themes from various perspectives including important (but not all) references. Modelling aspects as well as aspects on methodological approaches for the analysis of data, information, and knowledge were raised in most of the papers. These aspects were quite often discussed from an interdisciplinary point of view. For example the methodological roots came from informatics as well as from biostatistics and sometimes from both sides.
As so-called focus themes, seven areas of research were highlighted and discussed: Recent developments in boosting methodology (e.g., [13], [14], [15]), intelligent data analysis for knowledge discovery, patient monitoring, and quality assessment (e.g., [16], [17] [18]), grid and cloud computing in biomedical research (19, [20], [21], [22]), two topics of medical imaging, one of high performance methods ([23], [24]) and another one on image analysis and modelling (e.g., [25], [26], [27]), health information search, combining text, visual Information, and knowledge bases (e.g., [28], [29], [30]), and web science in medicine and health care ([31], [32], [33]). Most of these themes have also been addressed in other publications, outside these focus themes.
For stimulating discussion, including controversial debates, four times in this time period papers were opened up ”for discussion”, i.e. international experts were invited to comment and an editorial was provided introducing both the paper and the comments. Themes set for discussion were investigations on automatic alerting in computerized physician order entry systems ([34], [35]), biomedical informatics as scientific discipline ([36], [37]), new representations of anatomical spatial relations [38], and new approaches on the joint basis and on relationships of time-frequency techniques in biomedical signal analysis ([39], [40]).
Reflections on biomedical and health informatics as disciplines have a long tradition in MIM. In addition to the one discussion paper this topic was also raised in [41] and [42]. Other, more general and comprehensive reflections could be found on informatics approaches for health care systems and its services (e.g., [43], [44], [45]), on new approaches for patient records (e.g., [46], [47], [48], [49]) and coding systems for diagnoses (e.g., [50]), and on knowledge-based decision support for diagnosis and therapy (e.g., [51], [52], [53]).
Communications on research on health information systems focused on questions of patient-centered (i.e. not institution-centered) architectures and organizational principles (e.g., [54], [55]); often research on ambient-assisted living technologies was presented, including home care as part of patient-centered care (e.g., [56], [57]).
Research in these publications was covering many clinical disciplines. A certain new focus was on psychiatry and mental health, due to new opportunities through health-enabling technologies (e.g., [58], [59]). Last, but not least, questions on appropriate evaluation approaches were discussed (e.g., [60], [61], [62]).
4.2 Congruencies and interdependencies from practice to theory
In analyzing the publications of ACI and MIM in the respective time period and in considering the summaries in sections 4.1 of [4] and of this paper, we can see that some of the contents is overlapping in its themes. Examples are computerized physician order entry systems (e.g., [33] and [63]), knowledge-based decision support (e.g., [51] and [64]), health information systems (e.g., [53] and [65]), ambient-assisted living and telecare (e.g., [55] and [66]). In a more detailed look, we can see that these congruencies are among themes, but with different focus in their contents. ACI is clearly focusing on case studies and investigations in the practice of health care, including implementation, whereas MIM has a focus on communication research results. Interdependencies can be assumed from practice to theory insofar as these practice reports are now communicated through ACI on an appropriate scientific level. A direct impact could, however not be observed.
Limited congruencies could be observed in papers on education and concerning evaluation studies, which are clearly a long-term part of MIM, although some overlaps exist (e.g., [67] for education and [68] for evaluation). Few discussion papers and practically no focus theme papers in MIM overlapped with topics in ACI papers. Insofar here also no interdependencies (at least immediate ones) could be identified, neither form practice to theory nor vice versa.
4.3 Could the intention to support bridging from informatics practice to informatics theory be supported by this model of companion journals?
Based on the results presented in sections 4.1 and 4.2 in the related paper in MIM [4] and in this paper, we have to acknowledge that bridging from practice to theory through the two companion journals is limited. At least significant bridging could not be observed in the comparison of publications in both journals. As the readership of both journals is probably overlapping, we can assume that indirect interdependencies are given.
5. Discussion
The results of this exploratory analysis are twofold. First, there is a clear need for both of these two journals with very different and distinct, but related scope of communicating research results in informatics. Second, we were able to observe some congruencies in journal content, but have to acknowledge that few interdependencies exist. This was even then the case when we excluded publications in MIM focusing on biostatistics and epidemiology (as the scope of MIM – stressing the methodology and scientific fundamentals of organizing, representing, and analyzing data, information, and knowledge in biomedicine and health care extends beyond publications from biomedical and health informatics).
For the editors of these two companion journals this may lead to modifications in their future editorial policy. As bridging from informatics theory to practice and vice versa – informing theory from the bedside – were and are regarded as crucial for progress in informatics practice and theory, additional publication formats that strengthening such bridging as well as targeted related publications that appear simultaneously in both journals may be helpful for future researchers and readers of these journals.
We are aware of several limitations of this exploratory analysis. Adding additional journals in the field may have been more informative and helpful, as well as including a more formal citation analysis. As we wanted to focus after five years of the launch of ACI on the aspects of the two companion journals of ACI and MIM, we finally decided to concentrate on the direct analysis of the contents (as being from our point of view of the highest priority) of the respective papers of these two journals only.
6. Conclusions
Bridging from informatics theory to practice and vice versa, as has been argued in [1]–[3], remains a major component of successful research and practice. Based on the results of our exploratory analysis, we have to acknowledge that these bridging goals remain far from achieved and will require additional efforts.
Footnotes
Conflicts of Interests
The authors are the respective editors of Methods of Information in Medicine and Applied Clinical Informatics. There are no other conflicts to declare.
Human Subject Protection
The study was performed in compliance with the World Medical Association Declaration of Helsinki on Ethical Principles for Medical Research Involving Human Subjects.
References
- 1.Lehmann CU, Altuwaijri MM, Li YC, Ball MJ, Haux R.Translational research in medical informatics or from theory to practice. A call for an applied informatics journal. Methods Inf Med 2008; 47(1):1–3. [PubMed] [Google Scholar]
- 2.Kim GR, Lehmann CU.In search of dialogue and discourse in applied clinical informatics. Appl Clin Inform 2009; 0: 1–7. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.Haux R, Ball M.From Theory into Practice: Bridging The Clinical Informatics Divide! Appl Clin Inform 2009; 0: 8–11. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Lehmann CU, Haux R.Bridging from informatics theory to practice – an exploratory analysis. Methods Inf Med 2014; 53(6) (to appear). [DOI] [PubMed] [Google Scholar]
- 5.Feinstein AR.Clinical biostatistics. XX. The epidemiologic trohoc, the ablative risk ratio, and „retrospective“ research. Clin Pharmacol Ther 1973; 14(2):291–307. [DOI] [PubMed] [Google Scholar]
- 6.Applied Clinical Informatics. http://aci.schattauer.de/en/home.html Last access: October 11, 2014. [Google Scholar]
- 7.Methods of Information in Medicine. http://www.methods-online.com. Last access: October 11, 2014. [Google Scholar]
- 8.International Medical Informatics Association. http://www.imia.org. Last access: October 11, 2014. [Google Scholar]
- 9.Schattauer Verlag. http://www.schattauer.de/nc/en/home.html. Last access: October 11, 2014. [Google Scholar]
- 10.PubMed. http://www.ncbi.nlm.nih.gov/pubmed/. Last access: October 11, 2014. [Google Scholar]
- 11.German Research Associacion. Proposals for Safeguarding Good Scientific Practice. Bonn, 1998. http://www.dfg.de/download/pdf/foerderung/rechtliche_rahmenbedingungen/gute_wissenschaftliche_praxis/self_regulation_98.pdf Last access: October 11, 2014. [Google Scholar]
- 12.PubMedCentral. http://www.ncbi.nlm.nih.gov/pmc/. Last accessed October 15, 2014. [Google Scholar]
- 13.Groll A, Tutz G.Regularization for generalized additive mixed models by likelihood-based boosting. Methods Inf Med 2012; 51(2):168–177. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Ma S, Huang J, Xie Y, Yi N.Identification of breast cancer prognosis markers using integrative sparse boosting. Methods Inf Med 2012; 51(2):152–161. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Wang Z.Multi-class HingeBoost. Method and application to the classification of cancer types using gene expression data. Methods Inf Med 2012; 51(2):162–167. [DOI] [PubMed] [Google Scholar]
- 16.Minne L, Eslami S, de Keizer N, de Jonge E, de Rooij SE, Abu-Hanna A.Statistical process control for monitoring standardized mortality ratios of a classification tree model. Methods Inf Med 2012; 51(4):353–358. [DOI] [PubMed] [Google Scholar]
- 17.Mulas F, Zagar L, Zupan B, Bellazzi R.Supporting regenerative medicine by integrative dimensionality reduction. Methods Inf Med 2012; 51(4):341–347. [DOI] [PubMed] [Google Scholar]
- 18.Popescu M, Mahnot A.Early illness recognition using in-home monitoring sensors and multiple instance learning. Methods Inf Med 2012; 51(4):359–367. [DOI] [PubMed] [Google Scholar]
- 19.Bernau C, Boulesteix AL, Knaus J.Application of microarray analysis on computer cluster and cloud platforms. Methods Inf Med 2013; 52(1):65–71. [DOI] [PubMed] [Google Scholar]
- 20.Knaus J, Hieke S, Binder H, Schwarzer G.Costs of cloud computing for a biometry department. A case study. Methods Inf Med 2013; 52(1):72–79. [DOI] [PubMed] [Google Scholar]
- 21.Piotrowski M, McGilvary GA, Sloan TM, Mewissen M, Lloyd AD, Forster T, Mitchell L, Ghazal P, Hill J.Exploiting parallel R in the cloud with SPRINT. Methods Inf Med 2013; 52(1):80–90. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Pütz B, Kam-Thong T, Karbalai N, Altmann A, Müller-Myhsok B.Cost-effective GPU-grid for genomewide epistasis calculations. Methods Inf Med 2013; 52(1):91–95. [DOI] [PubMed] [Google Scholar]
- 23.Qi X, Xing F, Foran DJ, Yang L.A fast, automatic segmentation algorithm for locating and delineating touching cell boundaries in imaged histopathology. Methods Inf Med 2012; 51(3):260–267. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.Sofka M, Ralovich K, Zhang J, Zhou SK, Comaniciu D.Progressive data transmission for anatomical landmark detection in a cloud. Methods Inf Med 2012; 51(3):268–278. [DOI] [PubMed] [Google Scholar]
- 25.Forkert ND, Schmidt-Richberg A, Fiehler J, Illies T, Möller D, Handels H, Säring D.Automatic correction of gaps in cerebrovascular segmentations extracted from 3D time-of-flight MRA datasets. Methods Inf Med 2012; 51(5):415–422. [DOI] [PubMed] [Google Scholar]
- 26.Goossen A, Weber GM, Dries SP.Automatic joint alignment measurements in pre- and post-operative long leg standing radiographs. Methods Inf Med 2012; 51(5):406–414. [DOI] [PubMed] [Google Scholar]
- 27.Wesarg S, Kirschner M, Becker M, Erdt M, Kafchitsas K, Khan MF.Dual-energy CT-based assessment of the trabecular bone in vertebrae. Methods Inf Med 2012; 51(5):398–405. [DOI] [PubMed] [Google Scholar]
- 28.Cavallaro A, Kriegel HP, Petri M, Schubert M.Semantic localization-driven partial image retrieval in CT series. Methods Inf Med 2012; 51(6):557–565. [DOI] [PubMed] [Google Scholar]
- 29.Markonis D, Holzer M, Dungs S, Vargas A, Langs G, Kriewel S, Müller H.A survey on visual information search behavior and requirements of radiologists. Methods Inf Med 2012; 51(6):539–548. [DOI] [PubMed] [Google Scholar]
- 30.Randorff Højen A, Rosenbeck Gøeg K.Snomed CT implementation. Mapping guidelines facilitating reuse of data. Methods Inf Med 2012; 51(6):529–538. [DOI] [PubMed] [Google Scholar]
- 31.Chomutare T, Arsand E, Fernandez-Luque L, Lauritzen J, Hartvigsen G.Inferring community structure in healthcare forums. An empirical study. Methods Inf Med 2013; 52(2):160–167. [DOI] [PubMed] [Google Scholar]
- 32.Konstantinidis S, Fernandez-Luque L, Bamidis P, Karlsen R.The role of taxonomies in social media and the semantic web for health education. A study of SNOMED CT terms in YouTube health video tags. Methods Inf Med 2013; 52(2):168–179. [DOI] [PubMed] [Google Scholar]
- 33.Wu H, Fang H, Stanhope SJ.Exploiting online discussions to discover unrecognized drug side effects. Methods Inf Med 2013; 52(2):152–159. [DOI] [PubMed] [Google Scholar]
- 34.Jung M, Hoerbst A, Hackl WO, Kirrane F, Borbolla D, Jaspers MW, Oertle M, Koutkias V, Ferret L, Massari P, Lawton K, Riedmann D, Darmoni S, Maglaveras N, Lovis C, Ammenwerth E.Attitude of physicians towards automatic alerting in computerized physician order entry systems. A comparative international survey. Methods Inf Med 2013; 52(2):99–108. [DOI] [PubMed] [Google Scholar]
- 35.Bates DW, Baysari MT, Dugas M, Haefeli WE, Kushniruk AW, Lehmann CU, Liu J, Mantas J, Margolis A, Miyo K, Nohr C, Peleg M, de Quiros FG, Slight SP, Starmer J, Takabayashi K, Westbrook JI.Discussion of „Attitude of physicians towards automatic alerting in computerized physician order entry systems“. Methods Inf Med 2013; 52(2):109–127. [PubMed] [Google Scholar]
- 36.Elkin PL, Brown SH, Wright G.Biomedical informatics: we are what we publish. Methods Inf Med 2013; 52(6):538–546 [DOI] [PubMed] [Google Scholar]
- 37.Geissbuhler A, Hammond WE, Hasman A, Hussein R, Koppel R, Kulikowski CA, Maojo V, Martin-Sanchez F, Moorman PW, Moura LA, de Quiros FG, Schuemie MJ, Smith B, Talmon J.Discussion of „Biomedical informatics: we are what we publish“. Methods Inf Med 2013; 52(6):547–562. [PubMed] [Google Scholar]
- 38.Puget A, Mejino JL, Jr, Detwiler LT, Franklin JD, Brinkley JF.Spatial-symbolic Query Engine in Anatomy. Methods Inf Med 2012; 51(6):463–478; discussion 479–488. [DOI] [PubMed] [Google Scholar]
- 39.Wacker M, Witte H.Time-frequency techniques in biomedical signal analysis: a tutorial review of similarities and differences. Methods Inf Med 2013; 52(4):279–296. [DOI] [PubMed] [Google Scholar]
- 40.Baumgartner C, Blinowska KJ, Cichocki A, Dickhaus H, Durka PJ, McClintock PV, Pfurtscheller G, Stefanovska A, Tong S.Discussion of „time-frequency techniques in biomedical signal analysis: a tutorial review of similarities and differences“. Methods Inf Med 2013; 52(4):297–307. [PubMed] [Google Scholar]
- 41.Maojo V, Garcia-Remesal M, Bielza C, Crespo J, Perez-Rey D, Kulikowski C.Biomedical informatics publications: a global perspective: part I: conferences. Methods Inf Med 2012; 51(1):82–90. [DOI] [PubMed] [Google Scholar]
- 42.Maojo V, Garcia-Remesal M, Bielza C, Crespo J, Perez-Rey D, Kulikowski C.Biomedical informatics publications: a global perspective. Part II: Journals. Methods Inf Med 2012; 51(2):131–137. [DOI] [PubMed] [Google Scholar]
- 43.Liebe JD, Hübner U.Developing and Trialling an independent, scalable and repeatable IT-benchmarking procedure for healthcare organisations. Methods Inf Med 2013; 52(4):360–369. [DOI] [PubMed] [Google Scholar]
- 44.Koetsier A, van der Veer SN, Jager KJ, Peek N, de Keizer NF.Control charts in healthcare quality improvement. A systematic review on adherence to methodological criteria. Methods Inf Med 2012; 51(3):189–198. [DOI] [PubMed] [Google Scholar]
- 45.Sockolow PS, Crawford PR, Lehmann HP.Health services research evaluation principles. Broadening a general framework for evaluating health information technology. Methods Inf Med 2012; 51(2):122–130. [DOI] [PubMed] [Google Scholar]
- 46.Cillessen FH, de Vries Robbé PF.Modeling problem-oriented clinical notes. Methods Inf Med 2012; 51(6):507–515. [DOI] [PubMed] [Google Scholar]
- 47.Dugas M, Dugas-Breit S.A generic method to monitor completeness and speed of medical documentation processes. Methods Inf Med 2012; 51(3):252–257. [DOI] [PubMed] [Google Scholar]
- 48.Kopanitsa G, Hildebrand C, Stausberg J, Englmeier KH.Visualization of medical data based on EHR standards. Methods Inf Med 2013; 52(1):43–50. [DOI] [PubMed] [Google Scholar]
- 49.Munyisia EN, Yu P, Hailey D.Caregivers’ time utilization before and after the introduction of an electronic nursing documentation system in a residential aged care facility. Methods Inf Med 2013; 52(5):403–410. [DOI] [PubMed] [Google Scholar]
- 50.Prins H, Hasman A.Appropriateness of ICD-coded diagnostic inpatient hospital discharge data for medical practice assessment. A systematic review. Methods Inf Med 2013; 52(1):3–17. [DOI] [PubMed] [Google Scholar]
- 51.Maffei RM, Dunn K, Zhang J, Hsu CE, Holmes JH.Understanding behavioral intent to participate in shared decision-making in medically uncertain situations. Methods Inf Med 2012; 51(4):301–308. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 52.Spreckelsen C, Spitzer K, Honekamp W.Present situation and prospect of medical knowledge based systems in German-speaking countries: results of an online survey. Methods Inf Med 2012; 51(4):281–294. [DOI] [PubMed] [Google Scholar]
- 53.Wilk S, Michalowski W, O’Sullivan D, Farion K, Sayyad-Shirabad J, Kuziemsky C, Kukawka B.A task-based support architecture for developing point-of-care clinical decision support systems for the emergency department. Methods Inf Med 2013; 52(1):18–32. [DOI] [PubMed] [Google Scholar]
- 54.Bettencourt-Silva J, DeLa Iglesia B, Donell S, Rayward-Smith V.On creating a patient-centric database from multiple Hospital Information Systems. Methods Inf Med 2012; 51(3):210–220. [DOI] [PubMed] [Google Scholar]
- 55.Gusew N, Bartkiewicz T, Bautsch W, Gerlach A, Goldapp M, Haux R, Heller U, Kierdorf HP, Kleinschmidt T, Ludwig W, Markurth U, Pfingsten-Würzburg S, Plischke M, Reilmann H, Schubert R, Seidel C, Warnke R.A Regional health care network: eHealth.Braunschweig. Domain fields and architectural challenges. Methods Inf Med 2012; 51(3):199–209. [DOI] [PubMed] [Google Scholar]
- 56.Kuroda T, Noma H, Naito C, Tada M, Yamanaka H, Takemura T, Nin K, Yoshihara H.Prototyping sensor network system for automatic vital signs collection. Evaluation of a location based automated assignment of measured vital signs to patients. Methods Inf Med 2013; 52(3):239–249. [DOI] [PubMed] [Google Scholar]
- 57.Spitalewsky K, Rochon J, Ganzinger M, Knaup P.Potential and requirements of IT for ambient assisted living technologies. Results of a Delphi study. Methods Inf Med 2013; 52(3):231–238, [DOI] [PubMed] [Google Scholar]
- 58.Akar SA, Kara S, Bilgiç V.Respiratory variability during different auditory stimulation periods in schizophrenia patients. Methods Inf Med 2012; 51(1):29–38. [DOI] [PubMed] [Google Scholar]
- 59.Yoshino K, Matsuoka K.Personal adaptive method to assess mental tension during daily life using heart rate variability. Methods Inf Med 2012; 51(1):39–44. [DOI] [PubMed] [Google Scholar]
- 60.de Keizer NF, Talmon J, Ammenwerth E, Brender J, Rigby M, Nykanen P.Systematic prioritization of the STARE-HI reporting items. An application to short conference papers on health informatics evaluation. Methods Inf Med 2012; 51(2):104–111. [DOI] [PubMed] [Google Scholar]
- 61.Liu K, Mitchell KJ, Chapman WW, Savova GK, Sioutos N, Rubin DL, Crowley RS.Formative evaluation of ontology learning methods for entity discovery by using existing ontologies as reference standards. Methods Inf Med 2013; 52(4):308–316. [DOI] [PubMed] [Google Scholar]
- 62.Michel-Verkerke MB, Hoogeboom AM.Evaluation of the USE IT-questionnaire for the evaluation of the adoption of electronic patient records by healthcare professionals. Methods Inf Med 2013; 52(3):189–198. [DOI] [PubMed] [Google Scholar]
- 63.Cadwallader J, Asirwa C, Li X, Kesterson J, Tierney WM, Were MC.Using computerized provider order entry to enforce documentation of tests with pending results at hospital discharge. Appl Clin Inform 2012; 3(2):154–163. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 64.Groshaus H, Boscan A, Khandwala F, Holroyd-Leduc J.Use of clinical decision support to improve the quality of care provided to older hospitalized patients. Appl Clin Inform 2012; 3(1):94–102. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 65.Payne T, Fellner J, Dugowson C, Liebovitz D, Fletcher G.Use of more than one electronic medical record system within a single health care organization. Appl Clin Inform 2012; 3(4):462–474. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 66.Radhakrishna K, Bowles K, Zettek-Sumner A.Contributors to frequent telehealth alerts including false alerts for patients with heart failure: a mixed methods exploration. Appl Clin Inform 2013; 4(4):465–475. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 67.Katzer R, Barton DJ, Adelman S, Clark S, Seaman EL, Hudson KB.Impact of implementing an EMR on physical exam documentation by ambulance personnel. Appl Clin Inform 2012; 3(3):301–308. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 68.Staggers N, Xiao Y, Chapman L.Debunking health IT usability myths. Appl Clin Inform. 2013; 4(2):241–250. [DOI] [PMC free article] [PubMed] [Google Scholar]
