Version Changes
Revised. Amendments from Version 1
We present here a revised manuscript striving for more clarity and better presentation of the results including language and style. The conclusion is revised with the inclusion of discussion of some of the available image based databases, which can directly profit from MSL by fast, automatic and rapid separation of text, and text describing the images.
Abstract
Published scientific literature contains millions of figures, including information about the results obtained from different scientific experiments e.g. PCR-ELISA data, microarray analysis, gel electrophoresis, mass spectrometry data, DNA/RNA sequencing, diagnostic imaging (CT/MRI and ultrasound scans), and medicinal imaging like electroencephalography (EEG), magnetoencephalography (MEG), echocardiography (ECG), positron-emission tomography (PET) images. The importance of biomedical figures has been widely recognized in scientific and medicine communities, as they play a vital role in providing major original data, experimental and computational results in concise form. One major challenge for implementing a system for scientific literature analysis is extracting and analyzing text and figures from published PDF files by physical and logical document analysis. Here we present a product line architecture based bioinformatics tool ‘Mining Scientific Literature (MSL)’, which supports the extraction of text and images by interpreting all kinds of published PDF files using advanced data mining and image processing techniques. It provides modules for the marginalization of extracted text based on different coordinates and keywords, visualization of extracted figures and extraction of embedded text from all kinds of biological and biomedical figures using applied Optimal Character Recognition (OCR). Moreover, for further analysis and usage, it generates the system’s output in different formats including text, PDF, XML and images files. Hence, MSL is an easy to install and use analysis tool to interpret published scientific literature in PDF format.
Keywords: Bioinformatics, Data mining, Images, Scientific literature, Text, OCR, PDF, Biomedical
Introduction
There has been an enormous increase in the amount of the scientific literature in the last decades 1. The importance of information retrieval in the scientific community is well known; it plays a vital role in analyzing published data. Most published scientific literature is available in Portable Document Format (PDF), a very common way for exchanging printable documents. This makes it all-important to extract text and figures from the PDF files to implement an efficient Natural Language Processing (NLP) based search application. Unfortunately, PDF is only rich in displaying and printing but requires explicit efforts in the extraction of information, which significantly impacts the search and retrieval capabilities 2. Due to this reason several document analysis based tools have been developed for physical and logical document structure analysis of this file type.
The recently, provided basic information retrieval (IR) system by PubMed is efficient in extracting literature based on published text (titles, authors, abstracts, introduction etc.), with the application of automatic term mapping and Boolean operators 3. The normal outcome of a successful NLP query brings a maximum of 20 relevant results per page; however, user can improve the search by customizing the query using the provided advanced options. So far, the current PubMed system, as well many other related orthodox NLP approaches are unable to completely implement an efficient information retrieval system, capable of extracting both text and figures from published PDF files. One of the major and technical challenges is the availability of structured text and figures. To our limited knowledge, there still is no single tool available which can efficiently perform both physical and logical structure analysis of all kinds of PDF files and can extract and classify all kinds of information (embedded text from all kinds of biological and scientific published figures). Different commercial and free downloadable software applications provide support in extracting the text and images from PDF files:
A-PDF ( http://www.a-pdf.com/image-extractor/),
PDF Merge Split Extract ( http://www.pdf-technologies.com/pdf-library-merge-split.aspx),
BePDF ( http://haikuarchives.github.io/BePDF/), KPDF ( https://kpdf.kde.org),
MuPDF ( http://mupdf.com), Xpdf tool ( http://www.foolabs.com/xpdf/),
Power PDF ( http://www.nuance.com/for-business/imaging-solutions/document-conversion/power-pdf-converter/index.htm)
However, these software applications do not provide text and images in a form where they could be considered for further logical analysis e.g. mining text in reading order from double or multiple columns documents (the text of first column followed by the text of second column, and so on), searching marginal text using key-words, removing irrelevant graphics (e.g. journal, publisher’s logos and header-footer images embedded inside document etc.) and extracting embedded text inside single and multi-panel complex biological images.
So far, the current PubMed system as well many other related orthodox NLP approaches e.g. 4– 13, are unable to completely implement an efficient information retrieval system, capable of extracting both text and figures from published PDF files.
To meet the technological objectives of this challenge, we took a step forward in the development of a new user friendly, modular and client based system MSL (software acronym denotes “Mining Scientific Literature”) for the extraction of full and marginal text from PDF files based on the keywords and coordinates ( Figure 1). It was build with a product line architecture. Since MSL provides a module for the extraction of figures from PDF files and applies Optical Character Recognizer (OCR) to extract text from all kinds of biomedical and biological Images. MSL comprises three modules working in product-line architecture: Text, Image and OCR ( Figure 2). Each module performs its task independently and its output is used as an input for the next module. When a PDF file is input to the MSL, first full and marginal text is automatically extracted, and then images are automatically extracted and placed in the same directory where PDF file is located. Later, user needs to select from all extracted and visible images in the image view, and apply OCR to particular image to extract text.
Methods
MSL extracts text and figures from the published scientific literature and helps in analyzing embedded text inside figures. The overall methodological implementation and workflow of the MSL is divided into two processes: (I) Text mining and (II) Image analysis. MSL is a desktop application, designed and developed following the scientific software engineering principles of three-layered Butterfly 14 software development model.
Text mining
Physical and logical document analysis is one of the living challenges. To the best of the authors’ knowledge, there is no solution available which can perform efficient physical and logical structural analysis of PDF files, implement completely correct rendering order and classify text in all possible categories e.g. Tile, Abstract, Headings, Figure Captions, Table Captions, Equations, References, Headers, Footers etc.
However, there are some tools available which are helping in this regard e.g. PDF2HTML towards contextual modeling of logical labelling 15, PDF-Analyzer for object level document analysis 16, XED for hidden structure analysis 2, Dolores for the logical structure analysis and recovery 17 automatic conversation from PDF to XML 18 and PDF to HTML 19 etc.
MSL has enhanced capabilities compared to these tools including Dolores (see comparison below). Thus we developed MSL’s Text module, which is capable of processing PDF files with single, double or multiple columns. It divides the system’s text based output in four sub-modules: full text, marginal text, keyword based extracted text and file attributes. Full text gives the complete text from PDF file, marginal allows user to give the coordinates (Lower Left X, Lower Left Y, Upper Right X and Upper Right Y) and extract the desired portion of the text from the PDF file. The keyword based text allows user to extract the information from PDF file based on keywords and respective coordinates (Left, Top, Width, Height) e.g. if a user is only interested in getting the figure caption or references, this kind of search will be helpful. The last sub module, File attributes gives the information about input file including title, author, creator, producer, subject, creation date, keywords, modified, number of pages and number of figures.
While implementing Text module, we researched and tried different available commercial and freely downloadable libraries with a focus on full text extraction, marginal text extraction, keyword based text extraction and text extraction from embedded images from PDF files. We tried different implemented systems and libraries ( Table 1) e.g. iTextSharp Bytescout, Spire PDF Sautinsoft PDF Focus Dynamic PDF, PDFBox, iText PDF, QPDF, PoDoFo, Haru PDF Library, JPedal, SVG Imprint, Glance PDF Tool Kit, BCL SharpPDF etc.
Table 1. Systems and Libraries tested for MSL 1.
Library Name | Weblink |
---|---|
iTextSharp | ( http://sourceforge.net/projects/itextsharp/), |
Bytescout | ( https://bytescout.com) |
Spire PDF | ( http://www.e-iceblue.com/Introduce/pdf-for-net-introduce.html) |
Sautinsoft
PDF Focus |
( http://www.sautinsoft.com/products/pdf-focus/) |
Dynamic
|
( https://www.dynamicpdf.com) |
PDFBox | ( https://pdfbox.apache.org) |
iText PDF | ( http://itextpdf.com) |
QPDF | ( http://qpdf.sourceforge.net) |
PoDoFo | ( http://podofo.sourceforge.net) |
Haru PDF
Library |
( http://libharu.sourceforge.net) |
JPedal | ( https://www.idrsolutions.com/jpedal/) |
SVG Imprint | ( http://svgimprint-windows.software.informer.com) |
Glance PDF
Tool Kit |
( http://www.planetpdf.com/forumarchive/53545.asp) |
BCL | ( http://www.pdfonline.com/corporate/) |
SharpPDF | ( http://sharppdf.sourceforge.net) |
1This table gives the list of different systems and libraries, which all have been used for the extraction of text from PDF files.
One of the common problems in almost all libraries is merging and mixing of text, using double or multiple columns. Our developed system is the combination of different libraries, useful for different purposes. We have used Spire PDF to remove the Book-marks, iTextSharp for the extraction of full and marginal text, Bytescoute for the keyword based marginalized text search and producing output in the form of XML file ( Figure 2). The generated XML file contains structured (tagged) text along with the information about its coordinates (placement in the file), font (Bold, Italic etc.) and size, which can be used for mapping and pattern recognition tasks.
Image processing
Image-based analysis is a versatile and inherently multiplexed approach as it can quantitatively measure biological images to detect those features, which are not easily detectable by a human eye. Millions of figures have been published in scientific literature that includes information about results obtained from different biological and medicinal experiments. Several data and image mining solutions have been already implemented, published and are in use in the last 15 years 20. Some of the mainstream approaches are towards the analysis of all kinds of images (flow charts, experimental images, models, geometrical shapes, graphs, images of thing or objects, mixed etc.). There are not many approaches proposed for specific kinds of image-analysis e.g. towards the identification and quantification of cell phenotypes 21, prediction of subcellular localization of proteins in various organism 22, analysis of gel diagrams 23, mining and integration of pathway diagrams 24.
While implementing a new data-mining tool, one of our goals was to extract images from published scientific literature and try to extract embedded text as well. We analyzed different freely available and commercial OCR systems and libraries including Aspose, PUMA, Microsoft OCR, Tesseract, LEADTOOLS, Nicomsoft OCR, MeOCR OCR, OmniPage, ABBYY, Bytescout claiming to be able to extract embedded text from figures. During our research we found LEADTOOLS ( Figure 2) as one of the best available solutions for this purpose. MSL is capable of automatically extracting images from the PDF files and allowing the user to apply OCR to any extracted image by clicking and enlarging it for a better view (using Windows default image viewer).
Results and Discussion
MSL mining performance tested on different literature sources
We tested MSL with similar parameters on randomly selected scientific manuscripts (ten PDF files) from different open access ( F1000Research, Frontiers, PLOS, Hindawi, PeerJ, BMC) and restricted access ( Oxford University Press, Springers, Emerald, Bentham Science, ACM) publishers, including some of the authors’ published papers, details are given in Table 2. While testing MSL on the selected manuscripts, we observed best overall performance for the manuscripts 25, 26– 30, with satisfactory results from almost all publishers (including Oxford University Press, BMC, Frontiers, PeerJ, Bentham Science, ACM) in terms of both extracting text in reading order and extracting images. An observed poor performance involved manuscripts from PLOS 31 , Hindawi 32, F1000Research 33 and IEEE 34 publishers. Here, in the case of text extraction we observed that the text was in reading order when using manuscripts from F1000Research and IEEE but text was without spaces in the manuscript from PLOS and with additional lines and extra spaces in the manuscript from Hindawi. In the case of figure extraction we observed one common problem among the four manuscripts from these publishers; along with the manuscript images (Figures), embedded journal or publishers’ logos and images were also extracted. Additionally, while analyzing the manuscript from F1000Research, we observed that the images were broken into many pieces and it was not possible to find one single complete image. As we did not test all manuscripts from the mentioned publishers, we cannot claim that the results will be the same for all papers from a publisher, as the output may vary in different papers. Our observed results using MSL are given in attached supplementary material ( Supplementary Table S1 and Dataset 1).
Table 2. Papers (PDF files) tested using MSL 1.
Publishers | Manuscript |
---|---|
F1000-Research | Ant-App-DB: a smart solution for monitoring arthropods activities, experimental
data management and solar calculations without GPS in behavioral field studies 33. |
PLOS | The Genomic Aftermath of Hybridization in the Opportunistic Pathogen Candida
metapsilosis 31. |
Hindawi | Mathematical Properties of the Hyperbolicity of Circulant Networks 32. |
IEEE | Design implementation of I-SOAS IPM for advanced product data management 34. |
BMC | Software LS-MIDA for efficient mass isotopomer distribution analysis in metabolic
modeling 26. |
PeerJ | Anvi’o: an advanced analysis and visualization platform for ‘omics data 27. |
Frontiers | Ontology-based approach for
in vivo human connectomics: the medial Brodmann
area 6 case study 28. |
ACM | Intelligent semantic oriented agent based search (I-SOAS) 29. |
Bentham Science | DroLIGHT-2: Real Time Embedded and Data Management System for
Synchronizing Circadian Clock to the Light-Dark Cycles 30. |
Oxford University Press | Bioimaging-based detection of mislocalized proteins in human cancers by semi-
supervised learning 25. |
1We selected these ten manuscripts from different publishers for testing and validating the MSL application.
To apply MSL, published scientific literature has first to be downloaded in the form of a PDF file, from any published source. The validation process using MSL consists of three major steps: 1) Text mining, 2) Image extraction, and 3) Application of OCR to extract text from selected images as shown in Figure 1, following the implemented workflow as shown in Figure 2. Example results and graphics are shown in Figure 1, Figure 3 and Figure 4. Representation includes the extraction of text and images from one of the randomly selected papers 35, and application of OCR to one of the extracted images from another randomly picked publication 25.
Figure 1 shows that one randomly selected published article’s PDF file 35 is inputted to the MSL’s text, the extracted text is divided into three categories (i) complete text in excellent rendering order (ii) marginalized text and (iii) keyword based searched text. Two figures ( Figure 1 and Figure 2) are extracted and displayed in the image section, and one of those is selected to apply OCR. The applied OCR extracts textual information, which is displayed in and can be exported in a PDF file.
MSL validation and comparison to other tools
To further validate the application of OCR and discuss different results, Figure 3 show another example of embedded text extraction from a complex figure 36, which includes three panels of images (i) colorful pie and circle charts, (ii) biological images and (iii) tabular information. Similar to our prior application of OCR, results are displayed in textual form as well as generated PDF file of extracted text. A noticeable difference between both outputs is that the textual information is presented in line-by-line order whereas in the PDF file the information is displayed in margins with respect to the original image.
The last resultant example is based on the validation of MSL by extracting the textual information from image based PDF files. We produced an image form of one of the randomly selected article 25 and then processed one of pages. As Figure 4 shows, the obtained results were comprehensive in both textual as well as the PDF form. This kind of textual extraction can be very helpful, especially when the literature is available in only images e.g. in the case of old published literature in print only format but electronically available in scanned form. MSL produces several files as system output in the parent folder of the files. These files are: XML files (which include structured or tagged information), an Images File (extracted from the PDF file) and PDF files for all analyzed images using OCR.
We mentioned earlier that we have tried and implemented different libraries for text and image extraction and analysis. The best text based outcome was observed using iTextSharp, better image extraction was observed using Spire and OCR from LEADTOOLS was the most promising. While validating the implemented solution, other than the expected results (text and images), we observed some limitations in the used libraries: Irrelevant images are also automatically extracted e.g. journal logos, publisher’s logos and header-footer images embedded inside document (e.g. images added by the publishers, to provide publishing details). However, these images are easily recognized by the user and can also be automatically removed if desired as e.g. always referring to the same logo.
Furthermore, text was not always in good rendering order, especially when there were text-based mathematical equations with super and subscripts; and in case of double or multicolumn PDF files, most of the libraries’ rendering order is not correct. During extracting text, we found that some important symbols were missed and spaces were generated for some paragraphs. We found that it was not possible to extract particular images that are created as a combination of different sub-images and text objects in the manuscript. In these cases, text is found in extracted text area and all extracted sub-images are image sections, with the possibility of missing some sub-images as well. Moreover, when we applied OCR to different images (extracted or loaded), we found that its performance does vary with respect to the complexity of inputted images. In case of special characters (e.g. Greek delta, alpha, beta etc.), it does not perform well unless these are hard wired in the software.
In comparison to earlier mentioned tools; MSL possess some advantages as well as limitations. For instance, Dolores helps the user in adding custom tags to the PDF document and create a semantic model associated to the processed class of documents, PDF2HTML implements conditional random fields (CRF) based model to learn semantics from processed PDF page’s content, PDF-Analyzer devised a model based on rectangular objects for the analysis on PDF documents, XED applies method to combine PDF symbol analysis with traditional document image processing technique. MSL does not apply any of these methods and support such features. However, beyond the capabilities of the above tools, MSL does support marginalization of text, provides text in correct reading order, enable users with keywords based search and provide extraction of embedded text from figures (using OCR), which none of these tools does. To enhance the functionality of the MSL program (e.g. our standard version available here for download), we give a table of the most often used special symbols in biomedical literature ( Table 3). Depending on your application in mind, you thus simply extend the MSL parser by considering also these special characters occurring often in your texts.
Table 3. Special symbols found in biomedical literature 1.
Number | Special
Symbols |
Name |
---|---|---|
1 | Δ | Delta |
2 | α | Alpha |
3 | β | Beta |
4 | ϕ | Phi |
1The table illustrates that special characters occurring most often in the texts of choice enhance further MSL capabilities if incorporated in addition in the parser. This is, however, a text-dependent additional modification of the MSL program.
MSL Implementation & operation
MSL architecture is based on the Product Line Architecture (PLA) and Multi-Document Interface (MDI) developmental principles, and it is designed and developed (using C-Sharp programming language, Microsoft Dot NET Framework) following the key principles of Butterfly paradigm 14, 36. The work-flow of MSL is divided into two processes: (I) extraction and marginalization of text with respect to the division and placement of text in PDF file and keyword based search by using the iTextSharp, Bytescoute, Spire PDF libraries, and (II) extraction and analysis of figures by using the Spire PDF library and LEADTOOLS OCR.
It takes Portable Document Format (PDF) based literature files as input, performs partial physical structure analysis, and exports output in different formats e.g. text, images and XML files. It allows user to extract keywords and marginal (X and Y coordinates) information based text, have PDF file’s metadata information (title, author, creator, producer, subject, creation date, keywords, modified, number of pages and number of figures) and save extracted full and marginal text in text files.
Biomedical image extraction and analysis is one of the most complex tasks from the field of computer sciences and image analysis. Some of the mainstream approaches 37– 42 have been proposed towards the analysis of all kinds of images (e.g. flow charts, experimental images, models, geometrical shapes, graphs, image-of-thing, mix etc.). MSL allows user to automatically extracting images from the PDF files, let any selected image viewed via Windows default image viewer and apply implemented OCR. Other than extract images from PDF file, MSL allow user to load any image, apply OCR and export output in readable PDF file.
MSL produces several out files in the parent folder including XML files (which include structured or tagged information), Images File (extracted from PDF file) and PDF files for all analyzed images using OCR ( Figure 5).
MSL application is very simple to install and use. It was tested and can be well configured on a Microsoft Windows platform (preferred OS version: 7). MSL follows a simple six steps installation process ( Figure 6). After installation, it can be run by either clicking on the installed application’s icon at the desktop or execute application following sequence of steps: Start → All Programs → MSL 1.0.0 → MSL.
Regarding using the MSL application, one important point to remember is that it is based on different PDF text extraction, marginalization and figure extraction libraries, which are automatically configured during installation but used OCR by the LEADTOOLS is not a freely available library, which we have used upon academic research (free) license. The OCR library is also automatically configured during installation but its performance at different (non-licensed) machines is not confirmed. Moreover, the recommended display screen resolution size is 1680×1050 with landscape orientation.
Conclusions
The development of a virtual research environment to store and link molecular data, can be well achieved and established if first the mixture of text, protocols and omics data is properly separated from images, figures and figure legends – a task for which our tool can be well suited. There are a number of databases (e.g. Alzheimer’s Disease Neuroimaging Initiative (ADNI); Breast Cancer Digital Repository (BCDR); BiMed; Public Image Databases; Cancer Image Database (caIMAGE); COllaborative Informatics and Neuroimaging Suite (COINS); DrumPID; Digital Database for Screening Mammography (DDSM); Electron Microscopy Data Bank (EMDB); LONI image data archive; Mammography Image Databases (MID); New Database Provides Millions of Biomedical Images; Open Access Series of Imaging Studies (OASIS); Stanford Tissue Microarray Database (TMA); STRING; The Cancer Imaging Archive (TCIA); Whitney Imaging Center etc.) which can directly profit from MSL by fast, automatic and rapid separation of text and text description from images and figure legends describing the images is important for further improvement of the database and its content. One in-house example is the DrumPID database 43, where different types of data and images are warehoused by us and an improved separation and retrieval of text versus figure legends, image descriptions etc. is highly useful and currently applied.
The latest available and easy to use version of MSL has been tested and validated in-house. The advancements in information retrieval techniques for text and figure analysis combined with this sophisticated computational tool can support various studies.
Data availability
The data referenced by this article are under copyright with the following copyright statement: Copyright: © 2017 Ahmed Z and Dandekar T
Data associated with the article are available under the terms of the Creative Commons Zero "No rights reserved" data waiver (CC0 1.0 Public domain dedication). http://creativecommons.org/publicdomain/zero/1.0/
F1000Research: Dataset 1. Extracted Images and Text from Papers tested using MSL, 10.5256/f1000research.7329.d108739 44
Software availability
Software access
The software executable is freely available at the following web link: https://zenodo.org/record/30941#.Vi0PtmC5LHM
The software download section provides one executable: MSL, setup to be installed on the Microsoft Windows platform.
MSL has been NOT been developed for any commercial purposes but as a non-commercial prototype application for academic research, analysis and development purposes.
Archived software files as at the time of publication
Mining Scientific Literature (MSL) Ver 1.0.0 (DOI: 10.5281/zenodo.30941).
License
All associated files are licensed under the Academic Free License 3.0 (AFL 3.0).
Acknowledgments
We thank the German Research Foundation (DFG-TR34/Z1) for support. We would like to thank Dr. Chunguang Liang (University of Wuerzburg, Germany) for his help in testing MSL and all interested colleagues for critical community input on the approach and anonymous reviewers for their helpful comments.
We would like to thank all the open source, licensed and commercial library providers, for their help in this non-commercial and academic research and software development.
Funding Statement
This work was supported by a German Research Foundation grant (DFG-TR34/Z1) to TD.
The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
[version 2; referees: 4 approved with reservations]
Supplementary material
Supplementary Table S1. List of Papers (PDF files) tested using MSL.Supplementary which gives the list of some of those manuscripts from different publishers ( F1000Research, PLOS, Hindawi, IEEE, BMC, PeerJ, Frontiers, ACM, Bentham Science and Oxford University Press), which have been used for testing and validating the MSL application. The attached table provides the information about some of the extracted images and observed full and marginal text.
References
- 1. Hunter L, Cohen KB: Biomedical language processing: what’s beyond PubMed? Mol Cell. 2006;21(5):589–594. 10.1016/j.molcel.2006.02.012 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2. Hadjar K, Rigamonti M, Lalanne D, et al. : Xed: A New Tool for Extracting Hidden Structures from Electronic Documents. In International Workshop on Document Image Analysis for Libraries. 2004;221–224. 10.1109/DIAL.2004.1263250 [DOI] [Google Scholar]
- 3. Sayers EW, Barrett T, Benson DA, et al. : Database resources of the National Center for Biotechnology Information. Nucleic Acids Res. 2010;38(Database issue):D5–16. 10.1093/nar/gkp967 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4. States DJ, Ade AS, Wright ZC, et al. : MiSearch adaptive pubMed search tool. Bioinformatics. 2009;25(7):974–76. 10.1093/bioinformatics/btn033 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5. Poulter GL, Rubin DL, Altman RB, et al. : MScanner: a classifier for retrieving Medline citations. BMC Bioinformatics. 2008;9(1):108. 10.1186/1471-2105-9-108 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6. Plikus MV, Zhang Z, Chuong CM: PubFocus: semantic MEDLINE/PubMed citations analytics through integration of controlled biomedical dictionaries and ranking algorithm. BMC Bioinformatics. 2006;7:424. 10.1186/1471-2105-7-424 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7. Smalheiser NR, Zhou W, Torvik VI, et al. : Anne O’Tate: A tool to support user-driven summarization, drill-down and browsing of PubMed search results. J Biomed Discov Collab. 2008;3:2. 10.1186/1747-5333-3-2 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8. Doms A, Schroeder M: GoPubMed: exploring PubMed with the Gene Ontology. Nucleic Acids Res. 2005;33(Web Server issue):W783–86. 10.1093/nar/gki470 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9. Kim JJ, Pezik P, Rebholz-Schuhmann D: MedEvi: retrieving textual evidence of relations between biomedical concepts from Medline. Bioinformatics. 2008;24(11):1410–12. 10.1093/bioinformatics/btn117 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10. Rebholz-Schuhmann D, Kirsch H, Arregui M, et al. : EBIMed--text crunching to gather facts for proteins from Medline. Bioinformatics. 2007;23(2):e237–44. 10.1093/bioinformatics/btl302 [DOI] [PubMed] [Google Scholar]
- 11. Douglas SM, Montelione GT, Gerstein M, et al. : PubNet: a flexible system for visualizing literature derived networks. Genome Biol. 2005;6(9):R80. 10.1186/gb-2005-6-9-r80 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12. Eaton AD: HubMed: a web-based biomedical literature search interface. Nucleic Acids Res. 2006;34(Web Server issue):W745–47. 10.1093/nar/gkl037 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13. Hearst MA, Divoli A, Guturu H, et al. : BioText Search Engine: beyond abstract search. Bioinformatics. 2007;23(16):2196–97. 10.1093/bioinformatics/btm301 [DOI] [PubMed] [Google Scholar]
- 14. Ahmed Z, Zeeshan S, Dandekar T: Developing sustainable software solutions for bioinformatics by the “Butterfly” paradigm [version 1; referees: 2 approved with reservations]. F1000Res. 2014;3:71. 10.12688/f1000research.3681.2 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15. Tao X, Tang Z, Xu C: Contextual Modeling for Logical Labeling of PDF Documents. Comput Electr Eng. 2014;40(4):1363–75. 10.1016/j.compeleceng.2014.01.005 [DOI] [Google Scholar]
- 16. Hassan T: Object-Level Document Analysis of PDF Files. In Proceedings of the 9th ACM symposium on Document engineering. 2009;47–55. 10.1145/1600193.1600206 [DOI] [Google Scholar]
- 17. Bloechle JL, Rigamonti M, Ingold R: OCD Dolores - Recovering Logical Structures for Dummies. In 10th IAPR International Workshop on Document Analysis Systems (DAS). 2012;245–249. 10.1109/DAS.2012.58 [DOI] [Google Scholar]
- 18. Déjean H, Meunier JL: A System for Converting PDF Documents into Structured XML Format. In Proceedings of the 7th international conference on Document Analysis Systems. 2006;129–140. 10.1007/11669487_12 [DOI] [Google Scholar]
- 19. Rahman F, Alam H: Conversion of PDF Documents into HTML: A Case Study of Document Image Analysis. In Proceedings of Conference Record of the Thirty-Seventh Asilomar Conference on Signals, Systems and Computers. 2003;1:87–91. 10.1109/ACSSC.2003.1291873 [DOI] [Google Scholar]
- 20. Zweigenbaum P, Demner-Fushman D, Yu H, et al. : Frontiers of biomedical text mining: current progress. Brief Bioinform. 2007;8(5):358–375. 10.1093/bib/bbm045 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21. Carpenter AE, Jones TR, Lamprecht MR, et al. : CellProfiler: image analysis software for identifying and quantifying cell phenotypes. Genome Biol. 2006;7(10):R100. 10.1186/gb-2006-7-10-r100 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22. Chou KC, Shen HB: Cell-PLoc: a package of Web servers for predicting subcellular localization of proteins in various organisms. Nat Protoc. 2008;3(2):153–162. 10.1038/nprot.2007.494 [DOI] [PubMed] [Google Scholar]
- 23. Kuhn T, Nagy ML, Luong T, et al. : Mining images in biomedical publications: Detection and analysis of gel diagrams. J Biomed Semantics. 2014;5(1):10. 10.1186/2041-1480-5-10 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24. Kozhenkov S, Baitaluk M: Mining and integration of pathway diagrams from imaging data. Bioinformatics. 2012;28(5):739–742. 10.1093/bioinformatics/bts018 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25. Xu YY, Yang F, Zhang Y, et al. : Bioimaging-based detection of mislocalized proteins in human cancers by semi-supervised learning. Bioinformatics. 2015;31(7):1111–9. 10.1093/bioinformatics/btu772 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26. Ahmed Z, Zeeshan S, Huber C, et al. : Software LS-MIDA for efficient mass isotopomer distribution analysis in metabolic modelling. BMC Bioinformatics. 2013;14:218. 10.1186/1471-2105-14-218 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27. Eren AM, Esen ÖC, Quince C, et al. : Anvi'o: an advanced analysis and visualization platform for 'omics data. PeerJ. 2015;3:e1319. 10.7717/peerj.1319 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28. Moreau T, Gibaud B: Ontology-based approach for in vivo human connectomics: the medial Brodmann area 6 case study. Front Neuroinform. 2015;9:9. 10.3389/fninf.2015.00009 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29. Ahmed Z: Intelligent semantic oriented agent based search (I-SOAS).In Proceedings of the 7th International Conference on Frontiers of Information Technology2009. 10.1145/1838002.1838065 [DOI] [Google Scholar]
- 30. Ahmed Z, Helfrich-Förster C: DroLIGHT-2: Real Time Embedded and Data Management System for Synchronizing Circadian Clock to the Light-Dark Cycles. Recent Patents on Computer Sci. 2013;6(3):191–205. 10.2174/2213275906666131108211241 [DOI] [Google Scholar]
- 31. Pryszcz LP, Németh T, Saus E, et al. : The Genomic Aftermath of Hybridization in the Opportunistic Pathogen Candida metapsilosis. PLoS Genet. 2015;11(10):e1005626. 10.1371/journal.pgen.1005626 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32. Hernández JC, Rodríguez JM, Sigarreta JM: Mathematical Properties of the Hyperbolicity of Circulant Networks. Adv Math Phys. 2015;2015: 723451. 10.1155/2015/723451 [DOI] [Google Scholar]
- 33. Ahmed Z, Zeeshan S, Fleischmann P, et al. : Ant-App-DB: a smart solution for monitoring arthropods activities, experimental data management and solar calculations without GPS in behavioral field studies [version 2; referees: 1 approved, 2 approved with reservations]. F1000Res. 2015;3:311. 10.12688/f1000research.5931.3 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34. Zeeshan A, Detlef G: Design implementation of I-SOAS IPM for advanced product data management. In IEEE 2nd International Conference on Computer, Control and Communication2009;1–5. 10.1109/IC4.2009.4909215 [DOI] [Google Scholar]
- 35. Ahmed Z, Mayr M, Zeeshan S, et al. : Lipid-Pro: a computational lipid identification solution for untargeted lipidomics on data-independent acquisition tandem mass spectrometry platforms. Bioinformatics. 2015;31(7):1150–1153. 10.1093/bioinformatics/btu796 [DOI] [PubMed] [Google Scholar]
- 36. Ahmed Z, Zeeshan S: Cultivating Software Solutions Development in the Scientific Academia. Recent Patents on Computer Sci. 2014;7(1):54–66. 10.2174/2213275907666140612210552 [DOI] [Google Scholar]
- 37. Schindelin J, Arganda-Carreras I, Frise E, et al. : Fiji: an open-source platform for biological-image analysis. Nat Methods. 2012;9(7):676–82. 10.1038/nmeth.2019 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 38. Schmid B, Schindelin J, Cardona A, et al. : A high-level 3D visualization API for Java and ImageJ. BMC Bioinformatics. 2010;11:274. 10.1186/1471-2105-11-274 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 39. Schneider CA, Rasband WS, Eliceiri KW: NIH Image to ImageJ: 25 years of image analysis. Nat Methods. 2012;9(7):671–75. 10.1038/nmeth.2089 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 40. Peng H, Ruan Z, Long F, et al. : V3D enables real-time 3D visualization and quantitative analysis of large-scale biological image data sets. Nat Biotechnol. 2010;28(4):348–53. 10.1038/nbt.1612 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 41. Lopez LD, Yu J, Arighi C, et al. : A framework for biomedical figure segmentation towards image-based document retrieval. BMC Syst Biol. 2013;7(Suppl 4):S8. 10.1186/1752-0509-7-S4-S8 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 42. Sheng J, Xu S, Deng W, et al. : Novel Image Features for Categorizing Biomedical Images.In IEEE International Conference on Bioinformatics and Biomedicine (BIBM)2012. 10.1109/BIBM.2012.6392689 [DOI] [Google Scholar]
- 43. Kunz M, Liang C, Nilla S, et al. : The drug-minded protein interaction database (DrumPID) for efficient target analysis and drug development. Database (Oxford). 2016;2016: pii: baw041. 10.1093/database/baw041 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 44. Ahmed Z, Dandekar T: Dataset 1 in: MSL: Facilitating automatic and physical analysis of published scientific literature in PDF format. F1000Research. 2015. Data Source [DOI] [PMC free article] [PubMed] [Google Scholar]