Abstract
Induced pluripotent stem cells (iPSC) are one the most prominent innovations of medical research in the last few decades. iPSCs can be easily generated from human somatic cells and have several potential uses in regenerative medicine, disease modeling, drug screening, and precision medicine. However, further innovation is still required to realize their full potential. Machine learning is an algorithm that learns from large datasets for pattern formation and classification. Deep learning, a form of machine learning, uses a multilayered neural network that mimics human neural circuit structure. Deep neural networks can automatically extract features from an image, although classical machine learning methods still require feature extraction by a human expert. Deep learning technology has developed recently; in particular, the accuracy of an image classification task by using a convolutional neural network (CNN) has exceeded that of humans since 2015. CNN is now used to address several tasks including medical issues. We believe that CNN would also have a great impact on the research of stem cell biology. iPSCs are utilized after their differentiation to specific cells, which are characterized by molecular techniques such as immunostaining or lineage tracing. Each cell shows a characteristic morphology; thus, a morphology-based identification system of cell type by CNN would be an alternative technique. The development of CNN enables the automation of identifying cell types from phase contrast microscope images without molecular labeling, which will be applied to several researches and medical science. Image classification is a strong field among deep learning tasks, and several medical tasks will be solved by deep learning-based programs in the future.
Keywords: Induced pluripotent stem cell, Deep learning, Machine learning, Artificial intelligence, Endothelial cell, Stem cell, Image recognition
Background
Induced pluripotent stem cells (iPSCs) can be established from somatic cells by gene transfer with defined factors [1, 2]. Development of iPSCs has focused on their use as resources for regenerative medicine [3–5], drug screening [6, 7], disease modeling [8–12], and precision medicine [13]. However, their full potential has yet to be realized. Artificial intelligence (AI) has had a significant impact as an innovative technology. Among the several types of AI, machine learning is an algorithm for learning pattern formation and classification from large datasets. Deep learning, a form of machine learning, learns data features using a multilayered neural network that mimics human neural circuit structure. A deep neural network can extract the features of an image automatically, although classical machine learning methods require feature extraction by a human expert. Over the past few years, image recognition systems based on convolutional neural network (CNN) have improved dramatically [14–18]. The accuracy of image classification by a CNN has exceeded that of humans. We believe that CNN would also have a great impact on the research of stem cell biology.
iPSCs have multipotency and can differentiate into numerous types of cells. To use these cells for any purposes, the cell type must be characterized by specific molecular techniques, such as immunostaining with specific antibodies or lineage tracing. Each cell type shows a distinct characteristic morphology based on cell type-specific gene expression. Although we cannot identify cell type-specific morphology by microscopic observation alone, a morphology-based identification system by CNN could be an alternative to molecular techniques to identify the cell types. The development of CNN enables the automation of identifying cell types from phase contrast microscope images without molecular labeling. This method could be applied in many ways in research and medicine. In this review, we introduce the development of deep learning technology for stem cell biology and discuss its future direction.
Main text
Development of deep learning technology
Conceptual and technological development of AI began in the 1950s. AI is designed to imitate human thinking ability; to achieve this, many technologies have been developed. Machine learning technology has played a central role in AI since the 1990s [19–22]. Machine learning is an algorithm for pattern formation and classification without explicit instruction and can establish the learning of rules and statistical structures from big data [23, 24]. Deep learning, a type of machine learning, learns data features using a multilayer neural network that mimics human neural circuit structure [25]. The first breakthrough in neural networks was the concept of the simple perceptron, a single layer feed-forward neural network developed in the 1940s [26, 27]. Each neuron, an architectural component of the neural network, receives signals from upstream neurons. Each received signal has its own weight, the signals are assembled, and the output signals are calculated by activation function (Fig. 1a). The neural network consists of multiple layers of neurons and converts input signal to the final output signal, called the predictive value. The predictive value is compared with the objective value, and error is calculated by loss function. Each neuron signal weight is adjusted to minimize the error by an optimizer method, based on the backward propagation method (Fig. 1b). The backward propagation method was developed in the 1980s and has significantly contributed to the development of the neural network. It was a second breakthrough that allows rapid calculation of the optimal neuron signal [28]. A third breakthrough in 2006 was the development of an algorithm that enables efficient learning in a multilayered neural network without overfitting [29–31] and the development of a calculator that includes a Graphics Processing Unit. Deep learning won the ImageNet Large Scale Visual Recognition Challenge (ILSVRC), which is a competition for the most accurate machine learning that classifies multicategory objects [15]. At the 2012 ILSVRC, the convolutional neural network (CNN), a type of deep neural network, showed significant progress in accuracy. Since then, CNN has become a standard method in image classification tasks using machine learning. Indeed, CNN-based deep learning algorithms have won the ILSVRC every year since 2012 [14–16, 18]; importantly, accuracy of classification has exceeded that of humans since 2015 [14]. One of the most important characteristics of deep learning is the ability to extract image features automatically [25], although older machine learning techniques require independent feature extraction. Thus, datasets with data labels are required for deep learning. In comparison with other machine learning techniques, deep learning is straightforward and achieves high levels of accuracy. Image recognition by CNN is a powerful tool and is currently applied in many diverse fields.
Convolutional neural network for clinical medicine
Currently, medical science is encumbered with big data, including that of large clinical studies, genomic analyses, and various type of imaging. In the clinical setting, physicians should be able to efficiently analyze laboratory data and imaging in order to determine the appropriate therapeutic strategy. Laboratory data can be analyzed in an objective manner, but image data are often subjectively analyzed. Image recognition tasks in medical science play an important role in image classification and disease diagnosis. The challenge for AI in clinical medicine is to develop a program that has the ability to judge medical conditions as accurately as a physician. Analysis of medical images is a heavy burden for clinicians; therefore, such programs would support their tasks. If the accuracy of image classification and recognition by a deep neural network can approach that of a human for a particular task, it is expected that many medical images could be diagnosed with the same accuracy as clinical specialists.
Skin cancer is often diagnosed visually by a dermatologist; however, it is difficult for a non-specialist to make a diagnosis based on visual appearance only. By using a large dataset of images of labeled tissues, a deep neural network can classify skin cancer with almost the same accuracy as a dermatologist [32]. In the USA, over 20,000 patients lose their eyesight due to diabetic retinopathy. Early detection of retinopathy by an ophthalmologist using images of the eyeground is important for successful treatment. A deep learning algorithm also allows diagnosis of retinopathy with > 90% sensitivity [33, 34]. In April 2018, the US Food and Drug Administration granted marketing authorization for a test device that enables diagnosis of diabetic retinopathy without a clinical physician [35].
Microscopic observations of hematoxylin-eosin-stained sections by a pathologist are most important for a definitive diagnosis of cancer [36]. CNN shows the same power as a pathologist and, as a support tool, is expected to markedly decrease their workload [37, 38]. Radiographic [39–41], electrocardiographic [42, 43], and echographic [44, 45] images can also be classified accurately by deep learning. It is likely that deep learning-based automated systems will aid clinicians in the diagnosis of many diseases in the near future.
Convolutional neural network for cell biology
In addition to medical science, deep learning is also used for big data analyses in the field of molecular biology. Microscopic observation of cultured cells is important in cell biology. Specific cell types or conditions are recognized by fluorescently labeled antibodies. Each cell shows a characteristic gene expression pattern, including for structural proteins specific to the cell type and state; therefore, each cell type has unique morphological features. Although humans cannot identify differentiated cells visually, machine learning can (Fig. 2).
Christiansen et al. developed a label-free cell recognition system termed in silico labeling [46], which allows identification of nuclei, cell type, and cell state from bright field microscopy images without immunolabeling. Hematopoietic stem cells have multipotency and can differentiate into all types of blood cell lineages. The deep learning method can identify the final hematopoietic lineage of differentiated cells from microscope images with high accuracy [47]. iPSC [48] and C2C12 [49] cells can also be recognized by CNN. The semantic segmentation method, which is based on CNN, allows classification of images at the pixel level by assigning each pixel in the image to an object class. It enables the detection of object boundaries and classifies images within the boundary area. It is best known for its use in driverless car technology [50]. Semantic segmentation is also used in cell biology and medical science. U-Net is one of the most common networks used for segmentation and is optimized for biological and medical imaging [51]. Semantic segmentation enables identification of both cell location and classification. The deep learning method can be applied not only to microscope images, but also to genomic and RNA sequencing. The DeepBind system can predict the binding motifs for transcription factors in DNA and RNA from ChIP-seq data [52]. In ghost cytometry, which is cell sorting without molecular labels, morphological features are converted to wave data using a random barcode system to classify and sort cells [53]. A machine learning algorithm can also be used to classify cell morphology [54, 55], cardiac tissue contractility, and molecular imaging [56].
Automated recognition of iPSC-derived differentiated cells
iPSC-derived cells show patient-specific cellular physiology; thus, they have several uses in disease analysis, drug screening, and regenerative medicine. Endothelial cells line the inside of blood vessels in vivo and have important roles in organ homeostasis. iPSCs can differentiate into mature endothelial cells [57] and can be applied in disease modeling and organ formation. iPSC-derived endothelial cells (iPSC-ECs) have been used to ameliorate the cellular pathology of Moyamoya disease [58], aortic valve calcification [59], and pulmonary arterial hypertension [11]. The initial step in iPSC research is to identify iPSC-derived cells and check their quality by microscopic observation. Indeed, quality of iPSCs, including differentiation efficiency, differs among several iPSC lines.
We developed an automated recognition system for iPSC-ECs without molecular labeling using deep learning technology [60]. iPSC-ECs can be recognized by a deep learning system with high performance, with F1 score > 0.75 and accuracy > 0.9. First, we prepared input datasets for learning. To develop an image classification system, it is important to prepare a large number of high-quality datasets. Although the development of an algorithm allows us to use a reduced number of datasets, over 10,000 images are necessary for accurate learning [33, 60, 61]. To avoid overfitting, it is indispensable to obtain plural differentiation induction data from the study of iPSCs. The strategy for identification of iPSC-ECs is shown in Fig. 3. CNN was used to predict whether target blocks were endothelial cells or non-endothelial cells from the input dataset, based on random phase contrast images. Immunostaining for CD31 was used and the results were compared with the CNN prediction, and weights of the neural network were optimized by the back-propagation method. Although hyperparameters affect the efficiency of learning, dataset preparation such as input data size, threshold of answer (endothelial cells/non-endothelial cells), and network types is highly important to increase the accuracy of prediction. The depth and complexity of the neural network also affects the prediction accuracy [14, 16–18]. Morphology-based identification systems by deep learning have a significant advantage in the practical use of iPSCs, as they are easy to use and highly versatile.
Future direction of deep learning in clinical medicine and biology
The development of image classification tasks is promising for the replacement of human expertise by automated systems in the near future. Moreover, automated systems will be able to perform the tasks that humans cannot, because their ability in image classification and recognition for a particular job has exceeded that of humans since 2015 [14]. Furthermore, an automated system can recognize iPSC-ECs in microscope images, which a human expert cannot do. Deep learning can handle various types of datasets [25], such as sound, natural language, and time-series data. Natural language processing is also a field that has developed rapidly through deep learning [62, 63]. The processing ability of natural language is now inferior to that of humans. When this ability is applied to literature searching, writing preparation, and conversation, deep learning in natural language processing will be applicable to science and clinical medicine. Reinforcement learning has also significantly developed in recent years [64]. AlphaGo Zero, which is based on a reinforcement learning algorithm, was able to compete with overwhelming success against the world’s top players of Go by learning in only 3 days [65]. The fact that a machine could exceed human ability by self-learning without being taught by humans was extraordinary. In the concept of self-learning, reward is involved in the algorithm of reinforcement learning, and reinforcement learning is performed with problem setting that maximizes reward. Reinforcement learning is likely to have a significant bearing in the medical and biological fields in the future [66]. However, although it is anticipated that AI will exceed humans in many tasks, there are obvious limitations. The real world is much more complicated than previously thought. Even in situations that humans have never encountered before, they can make inferences and change their actions accordingly. In machine learning, it is difficult to deal with unexpected problems. In the future, we predict that complicated problems will be solved with AI, providing correct conclusions using less human labor, in less time, and with high accuracy.
Conclusions
The accuracy of image recognition has been dramatically improved by deep learning technology. Several medical issues may be addressed by automated systems based on deep learning. For cell biology, deep learning-based image recognition systems may replace molecular techniques such as immunostaining. Indeed, the detection of iPSC-ECs from microscope images without molecular labeling with high accuracy will significantly enhance the study of iPSCs.
Acknowledgements
We thank all our laboratory members for their assistance.
Abbreviations
- AI
Artificial intelligence
- CNN
Convolutional neural network
- ILSVRC
ImageNet Large Scale Visual Recognition Challenge
- iPSC-ECs
Induced pluripotent stem cell-derived endothelial cells
- iPSCs
Induced pluripotent stem cells
Authors’ contributions
DK and SY wrote the manuscript. Both authors read and approved the final manuscript.
Funding
This research was supported by AMED under Grant Number JP18bm0404026.
Availability of data and materials
Not applicable.
Ethics approval and consent to participate
Not applicable.
Consent for publication
Not applicable.
Competing interests
SY owns equity in Heartseed, Inc.
Footnotes
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
References
- 1.Takahashi K, Tanabe K, Ohnuki M, Narita M, Ichisaka T, Tomoda K, et al. Induction of pluripotent stem cells from adult human fibroblasts by defined factors. Cell. 2007;131(5):861–872. doi: 10.1016/j.cell.2007.11.019. [DOI] [PubMed] [Google Scholar]
- 2.Takahashi K, Yamanaka S. Induction of pluripotent stem cells from mouse embryonic and adult fibroblast cultures by defined factors. Cell. 2006;126(4):663–676. doi: 10.1016/j.cell.2006.07.024. [DOI] [PubMed] [Google Scholar]
- 3.Nagoshi N, Okano H. Applications of induced pluripotent stem cell technologies in spinal cord injury. J Neurochem. 2017;141(6):848–860. doi: 10.1111/jnc.13986. [DOI] [PubMed] [Google Scholar]
- 4.Yuasa S, Fukuda K. Recent advances in cardiovascular regenerative medicine: the induced pluripotent stem cell era. Expert Rev Cardiovasc Ther. 2008;6(6):803–810. doi: 10.1586/14779072.6.6.803. [DOI] [PubMed] [Google Scholar]
- 5.Yuasa S, Fukuda K. Cardiac regenerative medicine. Circulation. 2008;72(Supplement A):A49–A55. doi: 10.1253/circj.cj-08-0378. [DOI] [PubMed] [Google Scholar]
- 6.Avior Y, Sagi I, Benvenisty N. Pluripotent stem cells in disease modelling and drug discovery. Nat Rev Mol Cell Biol. 2016;17(3):170–182. doi: 10.1038/nrm.2015.27. [DOI] [PubMed] [Google Scholar]
- 7.Ebert AD, Liang P, Wu JC. Induced pluripotent stem cells as a disease modeling and drug screening platform. J Cardiovasc Pharmacol. 2012;60(4):408–416. doi: 10.1097/FJC.0b013e318247f642. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Moretti A, Bellin M, Welling A, Jung CB, Lam JT, Bott-Flugel L, et al. Patient-specific induced pluripotent stem-cell models for long-QT syndrome. N Engl J Med. 2010;363(15):1397–1409. doi: 10.1056/NEJMoa0908679. [DOI] [PubMed] [Google Scholar]
- 9.Shimojima M, Yuasa S, Motoda C, Yozu G, Nagai T, Ito S, et al. Emerin plays a crucial role in nuclear invagination and in the nuclear calcium transient. Sci Rep. 2017;7:44312. doi: 10.1038/srep44312. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Tanaka A, Yuasa S, Mearini G, Egashira T, Seki T, Kodaira M, et al. Endothelin-1 induces myofibrillar disarray and contractile vector variability in hypertrophic cardiomyopathy-induced pluripotent stem cell-derived cardiomyocytes. J Am Heart Assoc. 2014;3(6):e001263. doi: 10.1161/JAHA.114.001263. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Gu M, Shao NY, Sa S, Li D, Termglinchan V, Ameen M, et al. Patient-specific iPSC-derived endothelial cells uncover pathways that protect against pulmonary hypertension in BMPR2 mutation carriers. Cell Stem Cell. 2017;20(4):490–504.e5. doi: 10.1016/j.stem.2016.08.019. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Tanaka A, Yuasa S, Node K, Fukuda K. Cardiovascular disease modeling using patient-specific induced pluripotent stem cells. Int J Mol Sci. 2015;16(8):18894–18922. doi: 10.3390/ijms160818894. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Chen IY, Matsa E, Wu JC. Induced pluripotent stem cells: at the heart of cardiovascular precision medicine. Nat Rev Cardiol. 2016;13(6):333–349. doi: 10.1038/nrcardio.2016.36. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.He K, Zhang X, Ren S, Sun J. Deep residual learning for image recognition. ArXiv e-prints. 2015. [Google Scholar]
- 15.Krizhevsky A, Sutskever I, Hinton GE. Proceedings of the 25th International Conference on Neural Information Processing Systems. Lake Tahoe, Nevada: Curran Associates Inc; 2012. ImageNet classification with deep convolutional neural networks; pp. 1097–1105. [Google Scholar]
- 16.Szegedy C, Liu W, Jia Y, Sermanet P, Reed S, Anguelov D, et al. Going deeper with convolutions: ArXiv e-prints; 2014. p. 1409. http://adsabs.harvard.edu/abs/2014arXiv1409.4842S
- 17.Zeiler MD, Fergus R. Visualizing and understanding convolutional networks. In: Fleet D, Pajdla T, Schiele B, Tuytelaars T, editors. Computer Vision – ECCV 2014: 13th European Conference, Zurich, Switzerland, September 6-12, 2014, Proceedings, Part I. Cham: Springer International Publishing; 2014. pp. 818–833. [Google Scholar]
- 18.Zeng X, Ouyang W, Yan J, Li H, Xiao T, Wang K, et al. Crafting GBD-Net for object detection. ArXiv e-prints. 2016. [DOI] [PubMed] [Google Scholar]
- 19.Mor-Yosef S, Samueloff A, Modan B, Navot D, Schenker JG. Ranking the risk factors for cesarean: logistic regression analysis of a nationwide study. Obstet Gynecol. 1990;75(6):944–947. [PubMed] [Google Scholar]
- 20.Gorodeski EZ, Ishwaran H, Kogalur UB, Blackstone EH, Hsich E, Zhang ZM, et al. Use of hundreds of electrocardiographic biomarkers for prediction of mortality in postmenopausal women: the Women’s Health Initiative. Circ Cardiovasc Qual Outcomes. 2011;4(5):521–532. doi: 10.1161/CIRCOUTCOMES.110.959023. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Heylman C, Datta R, Sobrino A, George S, Gratton E. Supervised machine learning for classification of the electrophysiological effects of chronotropic drugs on human induced pluripotent stem cell-derived cardiomyocytes. PLoS One. 2015;10(12):e0144572. doi: 10.1371/journal.pone.0144572. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Hsich E, Gorodeski EZ, Blackstone EH, Ishwaran H, Lauer MS. Identifying important risk factors for survival in patient with systolic heart failure using random survival forests. Circ Cardiovasc Qual Outcomes. 2011;4(1):39–45. doi: 10.1161/CIRCOUTCOMES.110.939371. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Cortes C, Vapnik V. Support-vector networks. Mach Learn. 1995;20(3):273–297. [Google Scholar]
- 24.Quinlan JR. Induction of decision trees. Mach Learn. 1986;1(1):81–106. [Google Scholar]
- 25.Lecun Y, Bengio Y, Hinton G. Deep learning. Nature. 2015;521(7553):436–444. doi: 10.1038/nature14539. [DOI] [PubMed] [Google Scholar]
- 26.McCulloch WS, Pitts W. A logical calculus of the ideas immanent in nervous activity. Bull Math Biophys. 1943;5(4):115–133. [PubMed] [Google Scholar]
- 27.Rosenblatt F. The perceptron: a probabilistic model for information storage and organization in the brain. Psychol Rev. 1958;65(6):386–408. doi: 10.1037/h0042519. [DOI] [PubMed] [Google Scholar]
- 28.Rumelhart DE, Hinton GE, Williams RJ. Learning representations by back-propagating errors. Nature. 1986;323:533. [Google Scholar]
- 29.Bengio Y, Lamblin P, Popovici D, Larochelle H. Proceedings of the 19th International Conference on Neural Information Processing Systems. Canada: MIT Press; 2006. Greedy layer-wise training of deep networks; pp. 153–160. [Google Scholar]
- 30.Hinton GE, Osindero S, Teh YW. A fast learning algorithm for deep belief nets. Neural Comput. 2006;18(7):1527–1554. doi: 10.1162/neco.2006.18.7.1527. [DOI] [PubMed] [Google Scholar]
- 31.Ranzato MA, Poultney C, Chopra S, LeCun Y. Proceedings of the 19th International Conference on Neural Information Processing Systems. Canada: MIT Press; 2006. Efficient learning of sparse representations with an energy-based model; pp. 1137–1144. [Google Scholar]
- 32.Esteva A, Kuprel B, Novoa RA, Ko J, Swetter SM, Blau HM, et al. Dermatologist-level classification of skin cancer with deep neural networks. Nature. 2017;542(7639):115–118. doi: 10.1038/nature21056. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33.Gulshan V, Peng L, Coram M, Stumpe MC, Wu D, Narayanaswamy A, et al. Development and validation of a deep learning algorithm for detection of diabetic retinopathy in retinal fundus photographs. JAMA. 2016;316(22):2402–2410. doi: 10.1001/jama.2016.17216. [DOI] [PubMed] [Google Scholar]
- 34.Ting DSW, Cheung CY, Lim G, Tan GSW, Quang ND, Gan A, et al. Development and validation of a deep learning system for diabetic retinopathy and related eye diseases using retinal images from multiethnic populations with diabetes. JAMA. 2017;318(22):2211–2223. doi: 10.1001/jama.2017.18152. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 35.Abràmoff MD, Lavin PT, Birch M, Shah N, Folk JC. Pivotal trial of an autonomous AI-based diagnostic system for detection of diabetic retinopathy in primary care offices. Npj Digit Med. 2018;1(1):39. doi: 10.1038/s41746-018-0040-6. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 36.Komura D, Ishikawa S. Machine learning methods for histopathological image analysis. Comput Struct Biotechnol J. 2018;16:34–42. doi: 10.1016/j.csbj.2018.01.001. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37.Ehteshami Bejnordi B, Veta M, Johannes van Diest P, van Ginneken B, Karssemeijer N, Litjens G, et al. Diagnostic assessment of deep learning algorithms for detection of lymph node metastases in women with breast cancer. JAMA. 2017;318(22):2199–2210. doi: 10.1001/jama.2017.14585. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 38.Litjens G, Sanchez CI, Timofeeva N, Hermsen M, Nagtegaal I, Kovacs I, et al. Deep learning as a tool for increased accuracy and efficiency of histopathological diagnosis. Sci Rep. 2016;6:26286. doi: 10.1038/srep26286. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 39.Liu F, Jang H, Kijowski R, Bradshaw T, McMillan AB. Deep learning MR imaging-based attenuation correction for PET/MR imaging. Radiology. 2018;286(2):676–684. doi: 10.1148/radiol.2017170700. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 40.Teramoto A, Fujita H, Yamamuro O, Tamaki T. Automated detection of pulmonary nodules in PET/CT images: ensemble false-positive reduction using a convolutional neural network technique. Med Phys. 2016;43(6):2821–2827. doi: 10.1118/1.4948498. [DOI] [PubMed] [Google Scholar]
- 41.Yasaka K, Akai H, Abe O, Kiryu S. Deep learning with convolutional neural network for differentiation of liver masses at dynamic contrast-enhanced CT: a preliminary study. Radiology. 2018;286(3):887–896. doi: 10.1148/radiol.2017170706. [DOI] [PubMed] [Google Scholar]
- 42.Acharya UR, Oh SL, Hagiwara Y, Tan JH, Adam M, Gertych A, et al. A deep convolutional neural network model to classify heartbeats. Comput Biol Med. 2017;89:389–396. doi: 10.1016/j.compbiomed.2017.08.022. [DOI] [PubMed] [Google Scholar]
- 43.Rajkomar A, Oren E, Chen K, Dai AM, Hajaj N, Hardt M, et al. Scalable and accurate deep learning with electronic health records. Npj Digit Med. 2018;1(1):18. doi: 10.1038/s41746-018-0029-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 44.Gandhi S, Mosleh W, Shen J, Chow CM. Automation, machine learning, and artificial intelligence in echocardiography: a brave new world. Echocardiography. 2018;35(9):1402–1418. doi: 10.1111/echo.14086. [DOI] [PubMed] [Google Scholar]
- 45.Han S, Kang HK, Jeong JY, Park MH, Kim W, Bang WC, et al. A deep learning framework for supporting the classification of breast lesions in ultrasound images. Phys Med Biol. 2017;62(19):7714–7728. doi: 10.1088/1361-6560/aa82ec. [DOI] [PubMed] [Google Scholar]
- 46.Christiansen EM, Yang SJ, Ando DM, Javaherian A, Skibinski G, Lipnick S, et al. In silico labeling: predicting fluorescent labels in unlabeled images. Cell. 2018;173(3):792–803.e19. doi: 10.1016/j.cell.2018.03.040. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 47.Buggenthin F, Buettner F, Hoppe PS, Endele M, Kroiss M, Strasser M, et al. Prospective identification of hematopoietic lineage choice by deep learning. Nat Methods. 2017;14(4):403–406. doi: 10.1038/nmeth.4182. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 48.Yuan-Hsiang C, Abe K, Yokota H, Sudo K, Nakamura Y, Cheng-Yu L, et al. Conference proceedings : Annual International Conference of the IEEE Engineering in Medicine and Biology Society IEEE Engineering in Medicine and Biology Society Annual Conference. 2017. Human induced pluripotent stem cell region recognition in microscopy images using Convolutional Neural Networks; pp. 4058–4061. [DOI] [PubMed] [Google Scholar]
- 49.Niioka H, Asatani S, Yoshimura A, Ohigashi H, Tagawa S, Miyake J. Classification of C2C12 cells at differentiation by convolutional neural network of deep learning using phase contrast images. Hum Cell. 2018;31(1):87–93. doi: 10.1007/s13577-017-0191-9. [DOI] [PubMed] [Google Scholar]
- 50.Badrinarayanan V, Kendall A, Cipolla R. SegNet: a deep convolutional encoder-decoder architecture for image segmentation: ArXiv e-prints; 2015. https://ui.adsabs.harvard.edu/#abs/2015arXiv151100561B. [DOI] [PubMed]
- 51.Ronneberger O, Fischer P, Brox T. U-Net: convolutional networks for biomedical image segmentation: ArXiv e-prints; 2015. https://ui.adsabs.harvard.edu/#abs/2015arXiv150504597R.
- 52.Alipanahi B, Delong A, Weirauch MT, Frey BJ. Predicting the sequence specificities of DNA- and RNA-binding proteins by deep learning. Nat Biotechnol. 2015;33:831. doi: 10.1038/nbt.3300. [DOI] [PubMed] [Google Scholar]
- 53.Ota S, Horisaki R, Kawamura Y, Ugawa M, Sato I, Hashimoto K, et al. Ghost cytometry. Science. 2018;360(6394):1246–1251. doi: 10.1126/science.aan0096. [DOI] [PubMed] [Google Scholar]
- 54.Fan K, Zhang S, Zhang Y, Lu J, Holcombe M, Zhang X. A machine learning assisted, label-free, non-invasive approach for somatic reprogramming in induced pluripotent stem cell colony formation detection and prediction. Sci Rep. 2017;7(1):13496. doi: 10.1038/s41598-017-13680-x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 55.Sommer C, Gerlich DW. Machine learning in cell biology - teaching computers to recognize phenotypes. J Cell Sci. 2013;126(Pt 24):5529–5539. doi: 10.1242/jcs.123604. [DOI] [PubMed] [Google Scholar]
- 56.Juhola M, Joutsijoki H, Varpa K, Saarikoski J, Rasku J, Iltanen K, et al. Conference proceedings : Annual International Conference of the IEEE Engineering in Medicine and Biology Society IEEE Engineering in Medicine and Biology Society Annual Conference. 2014. On computation of calcium cycling anomalies in cardiomyocytes data; pp. 1444–1447. [DOI] [PubMed] [Google Scholar]
- 57.Zhang J, Chu LF, Hou Z, Schwartz MP, Hacker T, Vickerman V, et al. Functional characterization of human pluripotent stem cell-derived arterial endothelial cells. Proc Natl Acad Sci U S A. 2017;114(30):E6072–E60e8. doi: 10.1073/pnas.1702295114. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 58.Hamauchi S, Shichinohe H, Uchino H, Yamaguchi S, Nakayama N, Kazumata K, et al. Cellular functions and gene and protein expression profiles in endothelial cells derived from Moyamoya disease-specific iPS cells. PLoS One. 2016;11(9):e0163561. doi: 10.1371/journal.pone.0163561. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 59.Theodoris CV, Li M, White MP, Liu L, He D, Pollard KS, et al. Human disease modeling reveals integrated transcriptional and epigenetic mechanisms of NOTCH1 haploinsufficiency. Cell. 2015;160(6):1072–1086. doi: 10.1016/j.cell.2015.02.035. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 60.Kusumoto D, Lachmann M, Kunihiro T, Yuasa S, Kishino Y, Kimura M, et al. Automated deep learning-based system to identify endothelial cells derived from induced pluripotent stem cells. Stem Cell Rep. 2018;10(6):1687–1695. doi: 10.1016/j.stemcr.2018.04.007. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 61.Shichijo S, Nomura S, Aoyama K, Nishikawa Y, Miura M, Shinagawa T, et al. Application of convolutional neural networks in the diagnosis of Helicobacter pylori infection based on endoscopic images. EBioMedicine. 2017;25:106–111. doi: 10.1016/j.ebiom.2017.10.014. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 62.Chen MC, Ball RL, Yang L, Moradzadeh N, Chapman BE, Larson DB, et al. Deep learning to classify radiology free-text reports. Radiology. 2018;286(3):845–852. doi: 10.1148/radiol.2017171115. [DOI] [PubMed] [Google Scholar]
- 63.Mikolov T, Sutskever I, Chen K, Corrado G, Dean J. Distributed representations of words and phrases and their compositionality: ArXiv e-prints; 2013. https://ui.adsabs.harvard.edu/#abs/2013arXiv1310.4546M
- 64.Mnih V, Kavukcuoglu K, Silver D, Rusu AA, Veness J, Bellemare MG, et al. Human-level control through deep reinforcement learning. Nature. 2015;518:529. doi: 10.1038/nature14236. [DOI] [PubMed] [Google Scholar]
- 65.Silver D, Schrittwieser J, Simonyan K, Antonoglou I, Huang A, Guez A, et al. Mastering the game of Go without human knowledge. Nature. 2017;550(7676):354–359. doi: 10.1038/nature24270. [DOI] [PubMed] [Google Scholar]
- 66.Mahmud M, Shamim Kaiser M, Hussain A, Vassanelli S. Applications of deep learning and reinforcement learning to biological data: ArXiv e-prints; 2017. https://ui.adsabs.harvard.edu/#abs/2017arXiv171103985M [DOI] [PubMed]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Data Availability Statement
Not applicable.