Skip to main content
Springer Nature - PMC COVID-19 Collection logoLink to Springer Nature - PMC COVID-19 Collection
. 2023 Jun 7:1–14. Online ahead of print. doi: 10.1007/s12553-023-00757-z

A comprehensive review of COVID-19 detection with machine learning and deep learning techniques

Sreeparna Das 1, Ishan Ayus 2, Deepak Gupta 3,
PMCID: PMC10244837  PMID: 37363343

Abstract

Purpose

The first transmission of coronavirus to humans started in Wuhan city of China, took the shape of a pandemic called Corona Virus Disease 2019 (COVID-19), and posed a principal threat to the entire world. The researchers are trying to inculcate artificial intelligence (Machine learning or deep learning models) for the efficient detection of COVID-19. This research explores all the existing machine learning (ML) or deep learning (DL) models, used for COVID-19 detection which may help the researcher to explore in different directions. The main purpose of this review article is to present a compact overview of the application of artificial intelligence to the research experts, helping them to explore the future scopes of improvement.

Methods

The researchers have used various machine learning, deep learning, and a combination of machine and deep learning models for extracting significant features and classifying various health conditions in COVID-19 patients. For this purpose, the researchers have utilized different image modalities such as CT-Scan, X-Ray, etc. This study has collected over 200 research papers from various repositories like Google Scholar, PubMed, Web of Science, etc. These research papers were passed through various levels of scrutiny and finally, 50 research articles were selected.

Results

In those listed articles, the ML / DL models showed an accuracy of 99% and above while performing the classification of COVID-19. This study has also presented various clinical applications of various research. This study specifies the importance of various machine and deep learning models in the field of medical diagnosis and research.

Conclusion

In conclusion, it is evident that ML/DL models have made significant progress in recent years, but there are still limitations that need to be addressed. Overfitting is one such limitation that can lead to incorrect predictions and overburdening of the models. The research community must continue to work towards finding ways to overcome these limitations and make machine and deep learning models even more effective and efficient. Through this ongoing research and development, we can expect even greater advances in the future.

Keywords: COVID-19, Machine learning, Deep learning, CT-Scan, SARS-CoV-2

Introduction

A virus is a protein-coated microscopic organism that hijacks the host cells for its development and in turn, makes the host sick. The Severe Acute Respiratory Syndrome Coronavirus Disease 2019 (SARS-CoV-2) is a special type of coronavirus, which inflicts mild symptoms to severe respiratory distress, multi-organ failure even death [1]. In November-December 2019, an outbreak of unknown pneumonia (caused by SARS-CoV-2) began in Wuhan, China, which was later named COVID-19. On 11th March 2020, finally World Health Organization (WHO) declared the COVID19 as a pandemic. Till that time, this deadly virus had already displayed its symptoms in different countries [2]. As of 31st October 2021, the most affected countries are the United States of America, India, Brazil, United Kingdom. India, with 34,246,157 confirmed cases, ranked the second most affected country succeeding the USA [3].

Due to the collective efforts of researchers, doctors, and vaccines; the world is gradually getting out from the havoc. But, still, humanity have a long way to go. So the continuous efforts are still going in the researches to develop various efficient techniques to deal with this pandemic. Efficient Diagnosis is one of those most researched domains. There is a two-step technique for the diagnosis, one is laboratory technique and the other is medical imaging technique.

Laboratory techniques mainly deal with the analysis of sputum and nasopharyngeal lesions. It includes two techniques, one is Rapid Antigen Test (RAT), where the infected patients are revealed when he / she is at the peak of its infection, by detecting the viral protein which is present in bulk during this time. And another technique is Reverse Transcriptase Polymerase Chain Reaction (RT-PCR) which detects the viral RNA in nasopharyngeal swab during the initial stage of the disease, helping in early isolation. Among these two, RT-PCR is the most efficient but it is time-consuming and costly [4]. The second step i.e. Medical Imaging Technique (CT-Scan /X-Ray) imaging is necessary as sometimes RT-PCR produces a false negative. In Radiology Imaging i.e CT-scan / X-Ray are passed through the lungs to detect various characteristics for lung involvement which includes ground-glass opacity, air bronchograms, reverse halo, and perilobular pattern with a specificity of 100% [5].The radiologists play a very important role, while detecting the presence of the above mentioned features. But, if it is replaced by AI, then the process of detection will be faster [6].

In a highly populated and developing country like India, the limitation of performing RT-PCR [7] is more vivid because of its high cost, less availability, less reliability, and more time-consuming nature. Towards the path of the solution to this problem, the researcher came across the application of Artificial Intelligence on CT-Scan / X-Ray. In this paper, 50 research articles of both 2020 and 2021 are reviewed from some popular digital archives, which utilized various ML / DL models, for learning the characteristic feature of COVID from Lung CT-Scans / X-Rays of suspected patients and by using that knowledge the models classifies the COVID-19 from other viral/bacterial pneumonia and healthy ones and some of them showed a very impressive accuracy of about 99% (approx.).

The paper is structured in the following pattern. Section 1 reveals the introduction of the research article. Section 2 provides a brief description of the search mechanism for review. Section 3 contains a brief review of methodology which is used by the research articles as a pre-requisite for classification. Section 4 briefly discusses all AI models utilized for the above requirement. The Future scope and Conclusion are depicted in Sects. 5 and 6 respectively.

Search mechanism

Google Scholar, PubMed, Science Direct (S.D), Web of Science (WoS), arXiv and medRxiv, are some of the popular digital archives which acted as the library for the research articles. Fig. 1 describes the flow of the search and selection mechanism for the current systemetic research article review. These resources are generally considered reliable in the field of medical, bio-engineering, and computer science studies. These digital archives were selected for their originality and adequate scope of studies. Important search keywords were chosen to get hold of the relevant research articles from these archives. “COVID-19”, “SARS-CoV-2”, “Coronovirus”, “Machine learning”, “Deep learning”, “Detection”, “diagnosis”, “prediction”, “classification” etc. are some of the keywords which have been used to search the research articles. Many articles performing COVID-19 detection, using ML and DL models, are retrieved. The article screening is performed where the duplicate articles and articles dealing with data from modalities other than radiology such as protein sequence, laboratory findings, etc. are removed. The remaining articles were sorted on the basis of a complete context study and 50 articles from radiological modalities (X-Ray and CT-Scan) are chosen for the systematic review purpose, from both 2020 and 2021. The data collected are ready for extraction and segregation, based on different techniques used by the authors during feature extraction and classification. The research articles, which are filtered by thorough screening, are studied thoroughly. The common methodology followed by the researchers to perform their research is drafted in Sect. 3.

Fig. 1.

Fig. 1

Search and selection mechanism flow for systematic research article review

Methodolody

A number of 50 research articles are selected from various journals, where classifications are performed for X-Rays / CT-Scans images with COVID-19 v/s Non-COVID-19 ( healthy, other viral or bacterial pneumonia), using machine learning (ML) and deep learning (DL) models. All of these follows a sequence of common procedure which are as follows:

Dataset collection

The research articles, throughout this study, used CT-Scan / X-Ray modalities as datasets. They are collected through various public data repositories, hospital databases as well as from closed experimental groups. The database consist of X-rays / CT-Scan images which mainly belongs to COVID-19, other type of Viral/Bacterial Pneumonia and healthy classes. Some of them are presented in Table 1. The various features are extracted, which are further useful for determining, whether a particular input image belongs to a certain class or not.

Table 1.

Descrition of various datasets

Dataset Name COVID19 Healthy Other Pneumonia Ref. no. of the derived dataset Ref. no of the paper
CXR 371 1341 1345 [58, 6065] [8]
Dataset-1 216 837 838 [103, 104] [10]
Dataset-2 214 670 671 [105] [10]
SARS-CoV-2 CT scan 1250 615 615 [59, 6675] [14]
CXR dataset 220 27 - [107] [15]
COVID-CT 2282 4888 4888 [108] [16]
SARS-CoV-2 CT-scan 1252 615 615 [109] [17]
X-Ray 296 1341 3875 [109, 110] [18]
CT images 79 90 90 [57, 7695] [21]
X-Ray 247 1341 3875 [5996106] [25]

Pre-processing techniques

The scarcity of public datasets leads to a condition that is well known as overfitting. Data scarcity can be caused due to the limited availability of labeled training data or data imbalance. To prevent this, the least abundant datasets are subjected to pre-processing or augmentation through various techniques. Some of the most used preprocessing techniques may include contrast adjustment, intensity adjustment, brightness adjustment, cropping, scaling, resizing, flipping, or rotating at some angle. In some research articles, authors have also used a special type of machine learning framework, Generative adversial network(GAN), to recreate the images from the available datasets with realistic characteristics.

Segmentation

The detection of the region of interest has helped the researchers to obtain an efficient COVID-19 detection system. The U-Net architecture is based on the Convolutional Neural Network(CNN) where informations, from both upsampling and downsampling paths, are combined to perform better segmentation. The researchers also have used a 3D version of U-Net architecture to extract contextual information in CT Scan images. V-Net and VB-Net facilitate volumetric medical image segmentation improving the detection of infected lungs segment.

Feature extraction

In most of the research articles, the feature is generally extracted by deep learning models due to its self-learning capabilities. The feature extractors extract important features from CT-Scan / X-ray images and these features are trained by the models for solving the classification problem. The different techniques used by the authors include VGG, Inception, ResNet, DenseNet, Xception, EfficientNet, and many more. VGG is a CNN which uses 224 x 224 input channels, 3x3 convolution layers with 1x1 convolutional filters followed with ReLU activation function, three fully connected layers, hidden layers with ReLU, and local response normalization (LRN). Inception-v3 (GoogleNet) is a special kind of CNN with inception layer which is a combination of different filters such as 1x1 convolutional layer, 3x3 convolutional layer, 5x5 convolutional layer, 3x3 max-pooling layer with the outputs combined to produce a single output vector for the next stage. ResNet is a popular CNN that supports layers with double or triple skip and batch normalization between the layers to prevent the problem of vanishing gradient. DenseNet is a densely connected CNN with various advantages like strengthening feature propagation, reuse of features, and reducing the possibility of vanishing gradient problems. Xception is an extension of Inception architecture which converts the parallel convolutional layers into a horizontally inseparable convolutional layer. MobileNet is a streamlined architecture with depth-wise separable convolution layers producing a lightweight CNN. EfficientNet uniformly measures all the dimensions (depth, width, and resolutions) through a set of scaling coefficients. Multilayer Perceptron is a layered feed-forward Artificial Neural network with at least 3 layers (input layer, an output layer, and Hidden layer) that utilized backpropagation and non-linear activation functions. The recurrent neural network processes, both inputs at the present state and the output, of the previous state to produce the output of the present state through the different layers.

Classification

Mainly classification is of two types, binary and multiclass classification. In binary classification, the classification is performed between two classes (COVID +ve v/s COVID –ve), whereas in multi-class classification, the classification is performed among many classes (COVID v/s healthy, other viral/bacterial pneumonia, and other pulmonary diseases). The extracted features play an important role in this whole process as they are learned by different models during the training phase. The researchers have used a wide variety of machine and deep learning models during their implementation of the COVID-19 detection system. Some of these models are K-Nearest neighbor (KNN), Logistic regression (LR), Decision tree, XGBoost, AdaBoost, Bagging classifier, Support vector machine (SVM), and many more. KNN classifies a particular object depending on the class of its K (an integer) nearest neighboring object. Logistic Regression is used to classify categorical datasets based on the probability of the presence of an object in a particular class. A Decision Tree is a supervised machine learning algorithm in which data are divided into different decision nodes from the root node based on some conditions the leaf nodes will denote the corresponding outcomes. XGBoost is a machine learning model in which decision trees are added to rectify the previous errors called boosting and here gradient boosting algorithm is implemented. Adaboost is an ensemble machine learning algorithm where the above-mentioned boosting is applied to binary classification. Bagging classifier is another ensemble machine learning algorithm that will help the base classifiers to produce a much powerful classifier in-order to provide more accurate classification. SVM is a supervised machine learning algorithm that is primarily used for binary classification.

Discussion and result

In this survey paper, a few papers are collected on the basis of search mechanisms which are further segregated into the following categories i.e., machine learning, deep learning, and ML + DL. Figure 2a displays the frequency of different models used in the review study. In a number of studies, the researchers have utilized different deep learning models for its self-learning capability of learning features from the CT-Scan / X-Ray image dataset. However, the combination of the deep learning model as a feature extractor and the machine learning model as the classifier is also popularly used by researchers to produce an efficient system. The diagnosis is considered a crucial event for the effective treatment of COVID-19. Therefore, a thorough investigation is required and radiological modalities do achieve this. X-Ray images are the most preferable modality for research as shown in Fig. 2b.

Fig. 2.

Fig. 2

a. Rate of using different types of models during the survey, 2. b. Rate of using different modalities during the survey

Table 2 summarizes the selected research articles on the basis of modalities, type of models, techniques used along with accuracy. The reviewed research articles mainly emphasize the study of accuracies of different models (ML / DL / ML+DL) for the classification of COVID-19 v/s non-COVID-19 and other pulmonary diseases. In the field of medical science, machine learning models are found to be useful for the classification of medical images. The features are extracted from the given dataset by algorithms such as hybrid social group optimization algorithm (Singh et.al.) and MrFODE algorithm (Elaziz et.al.) followed by classification using different ML classifiers such as SVM, random forest, KNN, etc. Among the three ML-based research articles, the model proposed by Elaziz et.al. achieved the highest accuracy of 99.65%. In particular, deep learning algorithms can be used for both feature extraction and classification. The most commonly used models may include VGG16, VGG19, ResNet50, Xception, Inception, etc which are either trained from scratch or by transfer learning. The authors have also proposed some new models such as DarkNet, ChexNet, VDSNet, DCovNet, etc. Mahmood et al. implemented the Xception model (X-Ray) as well as the Inception V3 (CT-Scan) model with the following results i.e. accuracy of 99.94%. The hybrid model utilizes the advantages of both machine learning and deep learning models. The CT-Scan / X-Ray images are represented in the form of a matrix of pixels. The deep learning models pick up the important pixels to form different feature matrices and these features matrices are learned by the machine during the training phase using ML models. Wang et al. designed a hybrid model i.e. Xception+SVM which obtained the best accuracy of 99.33% among the other DL+ML models.

Table 2.

Summary of selected research articles

Author References Image Modality Type of AI model Techniques used Prediction results
Singh et al. [8] X-Ray ML

Hybrid Social Group Optimization Algorithm- extraction and filtration of features

SVM-classification of features

Accuracy obtained by the system is 99.65%
Tang et al. [9] CT-Scan ML Random forest Accuracy is 87.5%
Elaziz et.al. [10] X-Ray ML

FrMEMs moment+

MRFODE algorithm+

KNN classifier,

operators of MRFO

MRFODE

Dataset1 has an accuracy of 96.09%

Dataset2 has an accuracy of 98.09%

Abbas et al. [11] X-Ray DL Three pre-trained model like AlexNet,GoogleNet,SqueexeNet

Two ClassClassification

AlexNet has an accuracy of 99.77%

GoogleNet has an accuracy of 99.70%

SqueexeNet has an accuracy of 99.85%

Three Class Classification

AlexNet has an accuracy of 97.59%

GoogleNet has an accuracy of 96.20%

SqueezeNet has an accuracy of 97.47%

Mahmood et al. [12]

X-Ray

+

CT-Scan

DL Xception and Inception V3 Xception on X-Ray dataset and InceptionV3 on CT-Scan obtains an Accuracy 99.94%,
Biswas et.al. [13] CT-Scan DL Combined VGG16, ResNet50 and Xception using Transfer Learning Classification accuracy obtained by this system is 98.79%
Shankar et al. [14] X-Ray DL Barnacle Mating Optimization with cascaded recurrent neural Network(BMO-cRNN) Accuracy obtained by the system is 97.31%
Mansour et al. [15] X-Ray DL Inception v4 with Adagrad technique is used for Feature Extraction and Unsupervised DL based Variational Autoencoder(UDL-VAE) for classification Accuracy obtained by the system is 98.7%
Jangam et al. [16] CT-Scan DL Stacked ensemble heterogeneous pre-trained Computer Vision model(VGG19,ResNet101,DenseNet169,WideResNet50

On Dataset1 accuracy is 85.71%

On Dataset2 Accuracy is 99%

On Dataset3 Accuracy is 93.5%

Sarki et al. [17] X-Ray DL VGG16, Inception V3 and Xception trained using Transfer learning + from scratch In 1st case, Tertiary Classification obtains an accuracy of 87.50% and in 2nd case the same obtains an accuracy of 93.75%
Elmuogy et al. [18] CT-Scan DL Worried Deep Neural Network(WDNN) with transfer learning Accuracy obtained 99.046%
Wang et al. [19] CT-Scan DL

DenseNet121-FPN

+

COVID-19Net

Accuracy for dataset1 is 78.32% and Accuracy for dataset2 is 80.12%
Zheng et al. [20] CT-Scan DL UNet, 3D deep neural network ( DeCoVNet) Accuracy obtained is 90.1%
Wang et al. [21] CT-Scan DL M-Inception, ROI images extraction and Deep Learning algorithm Accuracy obtained is 89.5%
Farooq et al. [22] X-Ray DL Covid ResNet Accuracy obtained is 96.23%
Maghdid et al. [23]

X-Ray

+

CT-Scan

DL Modified AlexNet model Accuracy obtained is 94.1%
Apostolopoulos et al. [24] X-Ray DL VGG19 + MobileNet v2 + Inception + Xception + Inception + ResNet v2

DATASET_1

The best among the CNN models is VGG19 which obtains the accuracy of 98.75% (2-class classification) and 93.48% (3 class classification)

DATASET_2

MobileNet v2 shows the highest accuracy 96.78% (2-class) and 94.72% (3-Class)

Alom et al. [25]

X-Ray

+

CT Scan

DL Inception Recurrent Residual Neural Network (IRRCNN) Accuracy obtained by the proposed model on X-Ray is 84.67% and CT-Scan is 98.78%
Loey et al. [26] X-Ray DL Alexnet + Googlenet + Restnet18 + GAN

Four Classes

GoogleNet has an accuracy of 80.3%

Three Classes

AlexNet has an accuracy of 85.2%

Two Classes

GoogleNet has an accuracy of 100%

Butt et al. [27] CT-Scan DL

3D CNN Model

(ResNet 18 for feature extraction and ResNet 23 for classification)

Accuracy obtained 86.7%
Rajaraman et al. [28] X-Ray DL Custom WRN + VGG-16, Inception-V3 + Xception + DenseNet-121 + NasNet-mobile VGG16 obtains the Best accuracy of 93.02%
Asanaoui et al. [29]

CT-Scan +

X-Ray

DL VGG19 + DenseNet121 + ResNetV2+ InceptionV3+ InceptionResNetV2 + Xception + MobileNetV2 Inception_Resnet_V2 obtains the best accuracy of 92.18 %
Pathak et al. [30] CT scan DL ResNet50 + Transfer Learning. Accuracy obtained is 93.01%
Asif et al. [31] X-Ray DL DCNN + Inception V3 Accuracy is 98%
Ozturk et al. [32] X-Ray DL DarkNet Accuracy obtained by the proposed model for COVID v/s No-Findings=98.08% and COVID v/s No-Findings v/s Pneumonia=87.02%
Brunese et al. [33] X-Ray DL

Three fold model is used (1st and 2nd models is based on VGG16 group used to determine whether anX-ray belongs to COVID19 and 3rd model used to determine the effected region of X-rays if it belongs to COVID19),

Gradient-weighted Class Activation Mapping (Grad-CAM) algorithm

Accuracy obtained by the 1st model is 96% and by the 2nd model is 90%
Haque et al. [34] X-Ray DL CNN Model 1 (4 convolutional layer), CNN Model 2 (3 convolutional layer and CNN Model3 (5 convolutional layers) Accuracy obtained by Model 1 is 97.56%, by Model 2 = 96.34% and by Model 3 = 96.34%
Haghanifar et al. [35] X-Ray DL COVID - CXNet (ChexNet)

Accuracy obtained by

COVID-CXNet v1 is 99.04% and

COVID-CXNet v2 is 98.62%

Ucar et al. [36] X-Ray DL Deep Bayes - Squeeze Net based CNN(Convolutional neural network) Overall accuracy obtained is 98.26%
Das et al. [37] X-Ray DL Extreme Inception (Xception) model (Automated deep transfer-based approach) Accuracy obtained is 97.41%
Bharati et al. [38] X-Ray DL Hybrid CNN VGG Data STN (VDSNet) Overall accuracy is 73%
Sakib et al. [39] X-Ray DL 2D CNN (DL-CRC) model Accuracy obtained is 93.94%
Misra et al. [40] X-Ray DL MultiChannel pre-trained ResNet architecture Accuracy obtained is 95.5%
Mishra et al. [41] CT-Scan DL A fusion decision model is created by using five DL models VGG16, Inception V3, ResNet50, DenseNet121, DenseNet201 Accuracy obtained is 88.34%
Panwar et al. [42]

X-Ray

+

CT-Scan

DL VGG19 model (a fully connected layer and five extra layers) Overall accuracy obtained is 89.47%
Abbas et al. [11] X-Ray DL Deep Convolutional neural network (DeTraC (Decompose, Transfer and Compose)) Accuracy obtained is 93.1%
Zhang et al. [43] X-Ray DL Multilayer Perceptron, 18-layer ResNet, EfficientNet-B0 The overall accuracy is 95.18%
Hall et al. [44] X-Ray DL VGG16 and ResNet50 The overall accuracy obtained is 91.24%
Abraham et al. [45] X-Ray DL

Resnet-101, Densenet-201, InceptionResnetV2, NasnetLarge, Xception, Shufflenet, Darknet-53, MobilenetV2, VGG-19 and Squeezenet (pre-trained CNN model)

Bayesian Classifier

Accuracy is 97.4%
Sethy et al. [46] X-Ray DL+ML

AlexNet, VGG16, VGG19, GoogleNet, ResNet18, ResNet50,

ResNet101, InceptionV3, InceptionResNetV2, DenseNet201 and XceptionNet (Feature extraction)

SVM.(Classification)

ResNet50 +SVM obtained the best accuracy of 95.38%
Kumar et al. [47] X-Ray DL+ML

ResNet152 architecture (feature extraction)

Classifier:

logistic regression, decision trees, k-nearest neighbour, naïve bayes, random forest, adaptive boosting, and XGBoost

Accuracy obtained is 97.7% (ResNet152+XGBoost)
Kassani et al. [48]

X-Ray

+

CT Scan

DL+ML

Feature extraction using CNN : MobileNet, Xception, DenseNet ResNet, InceptionRes- NetV2, InceptionV3, VGGNet, NASNet

Classifier:

decision tree, random

forest, XGBoost, AdaBoost, bagging classifier and LightGBM.

The best performance is achieved DenseNet121 feature extractor with Bagging tree classifier with 99% classification accuracy.
Basu et al. [49] X-Ray DL+ML

CNN models: VGGNet (16 layers), AlexNet (8 layers), and ResNet(feature extraction)

linear classifier (Classifier)

Accuracy is 85.98%(ResNet+Linear classifier)
Wang et al. [50] X-Ray DL+ML

Feature extractor: CNN models: VGG16, InceptionV3, ResNet50, DenseNet121, and Xception

Machine learning classifiers: decision tree, random forest, support vector machine, AdaBoost,

Bagging.

Xception + SVM obtains the best Accuracy of 99.33%.
Shi et al. [51] CT-Scan DL+ML

VB-Net (Image Segmentation) combined with V-Net (bottleneck layers), LASSO (feature selection),

classification: logistic regression, support vector machine, and neural network, Semantics Aware Random Forest

Accuracy is 87.9%
Sharifrazi et al. [52] X-Ray DL+ML A fusion of CNN+SVM+Sobel filter with with 10 fold cross validation technique Accuracy obtained is 99.02%
Das et al. [53] X-Ray DL+ML

VGG19 for feature extraction

Bi-stage Classification approach

1st to divide the features into normal and infected(bacterial and COVID)

2nd this infected features are used the classify the images using ML(CART,K-NN,LR,RF,XGB)

Accuracy is 99.26%
Sen et al. [54] CT-Scan DL+ML

1.CNN to extract the features from CT scans

2.A bi-stage FS(Feature Selection)in which in relevant features are filteres using two filter methods(Mutual Information (MI) and Relief-F ) and Dragonfly algorithm (DA)

3.SVM used the features to classify between COVID and non-COVID CT scans

Accuracy from dataset1 is 98.39%

And that from 2nd dataset is 90.0%

Qaid et al. [55] X-Ray DL+ML

Hybrid model composed of three blocks

1)CNN block

2)VGG16 or VGG19 using transfer learning

3)CNN with ML algorithm (naiive Bayes, Support Vector Machine, random forest and XGBoost)

Accuracy obtained by this hybrid model for multiclass classification is 97.8%
Saba et al. [56] CT-Scan DL+ML

ML based (KNN and RF)

Tranfer Learning based (VGG19 and InceptionV3)

Custom designed DL (CNN and iCNN)

Accuracies of KNN, RF, VGG19, InceptionV3, CNN and iCNN are 74.58 ± 2.44%, 96.84 ± 2.6, 94.84 ± 2.85%, 99.53 ± 0.75%, 99.53 ± 1.05%, and 99.69 ± 0.66% respectively.

From the above references, we can observe that ML and DL show the accuracy of more than 99% for the classification of COVID-19 from non-COVID-19 using X-Rays and CT-Scan images which are quite impressive. This review of published research articles shows the importance of different ML and DL algorithm for designing the medical image diagnosis system. The diagnosis system under the supervision of radiologists can be helpful to predict COVID-19 more efficiently. Thus asymptomatic cases can also be detected more accurately further reducing the transmission risk. This diagnosis system can also act as the second step for diagnosis after RT-PCR.

Clinical applications

In this section, the clinical applications for the ML and DL models are summarized. The authors have mentioned various scopes for the application of their proposed mechanisms. Singh et al. concluded that the Hybrid Social Group Optimization Algorithm [8] can be implemented as a mobile application, to make it available at a cheaper price for the early detection of COVID-19. The FrMems algorithm [10] stated by Elaziz et al., can be proposed in various medical domains including early COVID-19 detection. The model presented by Mahmood et al. [12], is capable to inform patients regarding COVID-19-infection through an email notification. Zheng et al. [20] have identified a better-performing model for the detection of lesions using COVID-19-infected CT-Scan data. The suggested methodology by Wang et al. [21] and Farooq et al. [22] have accurately identified whether the patients are healthy or infected by COVID-19. The algorithm proposed by Maghdid et.al [23], can be used to design a mobile application system to identify COVID-19 using the data of the symptoms collected from sensors. Apostopoulos et al. [24] and Alom et al. [25] have concluded that their proposed work can be used to develop an automatic COVID-19 detection system, as it provides higher accuracy while classifying COVID-19 from others. The proposed technique by Loey et al. [26] classifies the stages of COVID-19 utilizing the X-ray medical modality data with higher accuracy and lesser false negative results. Butt et al. presented a DL model in the article [27] which classifies healthy, other viral infections, and COVID-19 patients with an accuracy of 86.7%. Rajaraman et al. [28] have proposed and stated that their methodology can be used for implementation of the future COVID-19 detection system as it showcases lesser false negative results. El Asanoui [29] et al. presented a model that can be utilized, not only in the automatic detection of COVID-19 but also in other medical domains. Other than these applications, the DL and ML models can also be used in other aspects. They can be applied as a clinical diagnostic decision system where they will help medical professionals to detect disease more efficiently and within less time. They can help in predicting the survival rate after getting infected by a disease (namely COVID-19) in the form of a survival prediction system. In turn, they can also assist doctors in designing a better-personalized treatment plan to ensure quick recovery of the patient. Thus, the ML and DL algorithms can be utilized in various forms as efficient clinical tools. But, there are various limitations in its realistic implementation which are mentioned in the following section along with its possible scope of research.

Challenges and future research direction

The implementation of different ML, DL, and combinational models is accompanied by several challenges. The researcher’s hard work has provided us with various types of diagnosis and detection strategies for COVID-19. Although, researchers have found out some of the suitable models for detection of the virus, the knowledge available is still insufficient. The unavailability of a considerable amount of clinical image data (generally CT scan and X-Ray images), could decrease the degree of reliabilty of these models.. The misclassification of the given image can be considered as another challenge, that signifies the presence of unclear, noisy, inaccurate, missing, and redundant data, which makes the datasets unfit to be used as the training dataset. Thus the machine trained using these images are neither feasible nor they are reliable.With the passing time, more and more COVID-19 CT-Scan / X-Ray datasets will be available. And with these the ML / DL models will be able to get trained more effectively, increasing their efficiency and reliability for the detection of the disease.

Conclusion

All researchers are in search of a convenient solution to hinder this pandemic. Till now, AI proved to be one of the best diagnostic tool for many medical avenues, so researchers are trying to inculcate AI in the field of diagnosis of COVID19. Amidst the requirement of the quick detection of COVID19, in this review paper, an ensemble of some of the most popular ML and DL models, are created which are used for the detection of COVID-19. Through this paper, it is being hoped that all the researchers will get a decent idea about the COVID-19 detection models using ML / DL and medical images. Thus, more efficient models could be built, which would help in relaxing the overburdened healthcare systems and saving lives from this deadly virus. In this paper, some of the ML / DL models are discussed and and analyzed. After all such review and analysis, it is concluded that their combination can result in achieving an efficient and effective system for COVID-19 diagnosis with an efficiency of 99.33%. The limitation of these models is the result of the less availability of image data of patients suffering from COVID-19. As this disease is only one and half years old, not much COVID19 data are available in the databases. The efficient prediction of COVID-19 may not be possible due to the scarcity of the dataset. For the limited images, the model would work well for the training data but is not generalized enough to give the correct result for new input data due to overfitting conditions. If somehow someone is wrongly predicted then it may lead to more transmission and overburdening of the healthcare system. Thus, these models could only be used if they are efficient and accurate for detecting this disease. Among the different models, some of them are giving a satisfying performance with a small dataset, which is evident that AI models have a huge potential to fill the gap in COVID-19 detection. Therefore, the researchers are hopeful and working towards making the automatic detection of COVID-19 to make it a reality sooner. Until then, we all the citizens have to maintain the social distancing and get vaccinated to curb the spread of the havoc named COVID-19.

Abbreviations

ML

Machine Learning.

DL

Deep Learning.

AI

Artificial Intelligence.

WHO

World Health Organization.

SARS-CoV-2

Severe Acute Respiratory Syndrome Coronavirus 2.

COVID-19

Corona Virus Disease 2019.

CNN

Convolutional Neural Network.

KNN

K-Nearest Neighbour.

SVM

Support Vector Machine.

LR

Logistic Regression

RF

Random Forest

XGBoost

eXtreme Gradient Boosting

RAT

Rapid Antigen Test

RTPCR

Reverse Transcriptase Polymerase Chain Reaction

S.D

Science Direct

WoS

Web of Science

Availability of data and materials

Not applicable.

Declarations

Ethical approval

Not applicable.

Consent to participate

Not applicable.

Consent to publication

Not applicable.

Conflict of interests

The authors declare that they have no conflict of interest.

Footnotes

This article is part of the COVID-19 Health Technology: Design, Regulation, Management, Assessment

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Contributor Information

Sreeparna Das, Email: sreeparna.mtech.cse.20@nitap.ac.in.

Ishan Ayus, Email: ishan.mtech.cse.20@nitap.ac.in.

Deepak Gupta, Email: deepakjnu85@gmail.com, Email: deepakg@mnnit.ac.in.

References

  • 1.The species Severe acute respiratory syndrome-related coronavirus classifying 2019-nCoV and naming it SARS-CoV-2. Nat Microbiol. 2020;4:536–544. doi: 10.1038/s41564-020-0695-z. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 2.Timeline of WHO’s response to COVID-19. WHO | World Health Organization. n.d. Retrieved October 31, 2021, from https://www.who.int/emergencies/diseases/novel-coronavirus2019/interactivetimeline?gclid=CjwKCAjw8KmLBhB8EiwAQbqNoMe2KBSaW9JGsA2kDuCe-sOqkgMELaGUJ-0t4wa8o4RAbVSzW6_xYxoC1NcQAvD_BwE#.
  • 3.WHO Coronavirus (COVID-19) Dashboard | WHO Coronavirus (COVID-19) Dashboard With Vaccination Data| WHO Coronavirus (COVID-19) Dashboard | WHO Coronavirus (COVID-19) Dashboard With Vaccination Data Retrieved October 31,2021 from http://covid19.who.int/?gclid=CjwKCAjw8KmLBhB8EiwAQbqNoAQF669E29xtQxZeOrBjBOEg0WZ3X_2OgH4h32GnFPEmy8bqhY3nPBoCkfMQAvD_BwE.
  • 4.Comparison of different types of tests · Covid Portál. Covid Portal. n.d. Retrieved October 31, 2021, from https://covid.gov.cz/en/situations/infection-and-general-measures/comparison-different-types-tests.
  • 5.Hare SS, Tavare AN, Dattani V, Musaddaq B, Beal I, Cleverley J, Cash C, Lemoniati E, Barnett J. Validation of the British Society of Thoracic Imaging guidelines for COVID-19 chest radiograph reporting. Clin Radiol. 2020;9:710.e9–710.e14. doi: 10.1016/j.crad.2020.06.005. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6.Pesapane F, Codari M, Sardanelli F. Artificial intelligence in medical imaging: threat or opportunity? Radiologists again at the forefront of innovation in medicine. European Radiol Exp. 2018;1. 10.1186/s41747-018-0061-6. [DOI] [PMC free article] [PubMed]
  • 7.Langer T, Favarato M, Giudici R, Bassi G, Garberi R, Villa F, Gay H, Zeduri A, Bragagnolo S, Molteni A, Beretta A. Development of machine learning models to predict RT-PCR results for severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) in patients with influenza-like symptoms using only basic clinical data. Scandinavian J Trauma Resuscitation Emerg Med. 2020;1. 10.1186/s13049-020-00808-8. [DOI] [PMC free article] [PubMed]
  • 8.Singh AK, Kumar A, Mahmud M, Kaiser MS, Kishore A. COVID-19 Infection Detection from Chest X-Ray Images Using Hybrid Social Group Optimization and Support Vector Classifier. 2021. [DOI] [PMC free article] [PubMed]
  • 9.Tang Z, Zhao W, Xie X, Zhong Z, Shi F, Liu J, Shen D. Severity assessment of coronavirus disease 2019 (COVID-19) using quantitative features from chest CT images. 2020. arXiv preprint arXiv:2003.11988.
  • 10.Elaziz MA, Hosny KM, Salah A, Darwish MM, Lu S, Sahlol AT. New machine learning method for image-based diagnosis of COVID-19. PLOS One. 2020;6:e0235187. 10.1371/journal.pone.0235187. [DOI] [PMC free article] [PubMed]
  • 11.Singh A, Kumar K, Mahmud M, Kaiser MS. COVID-19 Infection Detection from Chest X-Ray Images Using Hybrid Social Group Optimization and Support Vector Classifier 10.1007/s10489-020-01829-7. [DOI] [PMC free article] [PubMed]
  • 12.Mahmood AF, Mahmood SW. Auto informing COVID-19 detection result from x-ray/CT images based on deep learning. Rev Scientific Instruments. 2021;8:084102. 10.1063/5.0059829. [DOI] [PubMed]
  • 13.Biswas S, Chatterjee S, Majee A, Sen S, Schwenker F, Sarkar R. Prediction of COVID-19 from Chest CT Images Using an Ensemble of Deep Learning Models. Appl Sci. 2021;15:7004. doi: 10.3390/app11157004. [DOI] [Google Scholar]
  • 14.Shankar K, Perumal E, Díaz VG, Tiwari P, Gupta D, Saudagar AK, Muhammad K. An optimal cascaded recurrent neural network for intelligent COVID-19 detection using Chest X-ray images. Appl Soft Comput. 2021;107878. 10.1016/j.asoc.2021.107878. [DOI] [PMC free article] [PubMed]
  • 15.Mansour RF, Escorcia-Gutierrez J, Gamarra M, Gupta D, Castillo O, Kumar S. Unsupervised Deep Learning based Variational Autoencoder Model for COVID-19 Diagnosis and Classification. Pattern Recog Lett. 2021;267–274. 10.1016/j.patrec.2021.08.018. [DOI] [PMC free article] [PubMed]
  • 16.Jangam E, Annavarapu CSR. A stacked ensemble for the detection of COVID-19 with high recall and accuracy. Comp Biol Med. 2021;104608. 10.1016/j.compbiomed.2021.104608. [DOI] [PMC free article] [PubMed]
  • 17.Sarki R, Ahmed K, Wang H, Zhang Y, Wang K. Automated Detection of COVID-19 through Convolutional Neural Network using Chest x-ray images. 2021. 10.1101/2021.02.06.21251271. [DOI] [PMC free article] [PubMed]
  • 18.Elmuogy S, Hikal NA, Hassan E. An efficient technique for CT scan images classification of COVID-19. Journal of Intelligent & Fuzzy Systems. 2021;3:5225–5238. doi: 10.3233/jifs-201985. [DOI] [Google Scholar]
  • 19.Wang S, Zha Y, Li W, Wu Q, Li X, Niu M, Wang M, Qiu X, Li H, Yu H, Gong W, Bai Y, Li L, Zhu Y, Wang L, Tian J. A fully automatic deep learning system for COVID-19 diagnostic and prognostic analysis. Eur Respir J. 2020;2:2000775. doi: 10.1183/13993003.00775-2020. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20.Zheng C, Deng X, Fu Q, Zhou Q, Feng J, Ma H, Liu W, Wang X. Deep Learning-based Detection for COVID-19 from Chest CT using Weak Label. 2020. 10.1101/2020.03.12.20027185.
  • 21.Wang Shuai, Kang B, Ma J, Zeng X, Xiao M, Guo J, Cai M, Yang J, Li Y, Meng X, Xu B. A deep learning algorithm using CT images to screen for Corona virus disease (COVID-19) Eur Radiol. 2021 doi: 10.1007/s00330-021-07715-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22.Farooq M, Hafeez A. Covid-resnet: A deep learning framework for screening of covid19 from radiographs. 2020. arXiv preprintarXiv:2003.14395.
  • 23.Maghdid HS, Asaad AT, Ghafoor KZ, Sadiq AS, Mirjalili S, Khan MK. Diagnosing COVID-19 pneumonia from X-ray and CT images using deep learning and transfer learning algorithms. 2020. arXiv preprint arXiv:2004.00038.
  • 24.Apostolopoulos ID, Mpesiana TA. Covid-19: automatic detection from x-ray images utilizing transfer learning with convolutional neural networks. Physical and Engineering Sciences in Medicine. 2020;43(2):635–640. doi: 10.1007/s13246-020-00865-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 25.Alom MZ, Rahman MM, Nasrin MS, Taha TM, Asari VK. Covid_mtnet: Covid-19 detection with multi-task deep learning approaches. 2020. arXiv preprint arXiv:2004.03747.
  • 26.Loey M, Smarandache F, Khalifa M, N. E. Within the Lack of Chest COVID-19 X-ray Dataset: A Novel Detection Model Based on GAN and Deep Transfer Learning. Symmetry. 2020;4:651. doi: 10.3390/sym12040651. [DOI] [Google Scholar]
  • 27.Butt C, Gill J, Chun D, Babu BA. Retracted article: Deep learning system to screen coronavirus disease 2019 pneumonia. Appl Intell. 2020 doi: 10.1007/s10489-020-01714-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28.Rajaraman S, Antani S. Training deep learning algorithms with weakly labeled pneumonia chest X-ray data for COVID-19 detection. medRxiv : the preprint server for health sciences. 2020;20090803. 10.1101/2020.05.04.20090803.
  • 29.El Asnaoui K, Chawki Y. Using X-ray images and deep learning for automated detection of coronavirus disease. J Biomol Struct Dynam. 2020;1–12. 10.1080/07391102.2020.1767212. [DOI] [PMC free article] [PubMed]
  • 30.Pathak Y, Shukla PK, Tiwari A, Stalin S, Singh S, Shukla PK. Deep Transfer Learning Based Classification Model for COVID-19 Disease. IRBM. 2020 doi: 10.1016/j.irbm.2020.05.003. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 31.Asif S, Wenhui Y, Jin H, Jinhai S. Classification of COVID-19 from Chest X-ray images using Deep Convolutional Neural Networks. medRxiv and bioRxiv. 2020. 10.1101/2020.05.01.20088211.
  • 32.Ozturk T, Talo M, Yildirim EA, Baloglu UB, Yildirim O, Acharya UR. Automated detection of COVID-19 cases using deep neural networks with X-ray images. Comp Biol Med. 2020;103792. 10.1016/j.compbiomed.2020.103792. [DOI] [PMC free article] [PubMed]
  • 33.Brunese L, Mercaldo F, Reginelli A, Santone A. Explainable Deep Learning for Pulmonary Disease and Coronavirus COVID-19 Detection from X-rays. Comp Methods Programs Biomed. 2020;105608. 10.1016/j.cmpb.2020.105608.. [DOI] [PMC free article] [PubMed]
  • 34.Haque KF, Haque FF, Gandy L, Abdelgawad A. Automatic Detection of COVID-19 from Chest X-ray Images with Convolutional Neural Networks. 2020 International Conference on Computing, Electronics & Communications Engineering (iCCECE), Southend, UK. 2020;125-130. 10.1109/iCCECE49321.2020.9231235.
  • 35.Haghanifar A, Majdabadi MM, Choi Y, Deivalakshmi S, Ko S. Covid-cxnet: Detecting covid-19 in frontal chest x-ray images using deep learning. 2020. arXiv preprint arXiv:2006.13807. [DOI] [PMC free article] [PubMed]
  • 36.Ucar F, Korkmaz D. COVIDiagnosis-Net: Deep Bayes-SqueezeNet based diagnosis of the coronavirus disease 2019 (COVID-19) from X-ray images. Med Hypotheses. 2020;109761. 10.1016/j.mehy.2020.109761. [DOI] [PMC free article] [PubMed]
  • 37.Narayan Das N, Kumar N, Kaur M, Kumar V, Singh D. Automated Deep Transfer Learning-Based Approach for Detection of COVID-19 Infection in Chest X-rays. IRBM. 2020 doi: 10.1016/j.irbm.2020.07.001. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 38.Bharati S, Podder P, Mondal MRH. Hybrid deep learning for detecting lung diseases from X-ray images. Inform Med Unlocked. 2020;100391. 10.1016/j.imu.2020.100391. [DOI] [PMC free article] [PubMed]
  • 39.Sakib S, Tazrin T, Fouda MM, Fadlullah ZM, Guizani M. DL-CRC: Deep Learning-Based Chest Radiograph Classification for COVID-19 Detection: A Novel Approach. IEEE Access. 2020;171575–171589. 10.1109/access.2020.3025010. [DOI] [PMC free article] [PubMed]
  • 40.Misra S, Jeon S, Lee S, Managuli R, Jang I-S, Kim C. Multi-Channel Transfer Learning of Chest X-ray Images for Screening of COVID-19. Electronics. 2020;9:1388. doi: 10.3390/electronics9091388. [DOI] [Google Scholar]
  • 41.Mishra AK, Das SK, Roy P, Bandyopadhyay S. Identifying COVID19 from Chest CT Images: A Deep Convolutional Neural Networks Based Approach. J Healthcare Eng. 2020;1–7. 10.1155/2020/8843664. [DOI] [PMC free article] [PubMed]
  • 42.Panwar H, Gupta PK, Siddiqui MK, Morales-Menendez R, Bhardwaj P, Singh V. A deep learning and grad-CAM based color visualization approach for fast detection of COVID-19 cases using chest X-ray and CT-Scan images. Chaos Solitons Fractals. 2020;110190. 10.1016/j.chaos.2020.110190. [DOI] [PMC free article] [PubMed]
  • 43.Zhang J, Xie Y, Pang G, Liao Z, Verjans J, Li W, Sun Z, He J, Li Y, Shen C, Xia Y. Viral Pneumonia Screening on Chest X-rays Using Confidence-Aware Anomaly Detection. IEEE Trans Med Imag. 2020;1–1. 10.1109/tmi.2020.3040950. [DOI] [PMC free article] [PubMed]
  • 44.Hall LO, Paul R, Goldgof DB, Goldgof GM. Finding covid-19 from chest x-rays using deep learning on a small dataset. 2020. arXiv preprint arXiv:2004.02060.
  • 45.Abraham B, Nair MS. Computer-aided detection of COVID-19 from X-ray images using multi-CNN and Bayesnet classifier. Biocybernetics and Biomedical Engineering. 2020;4:1436–1445. doi: 10.1016/j.bbe.2020.08.005. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 46.Sethy PK, Behera SK. Detection of coronavirus Disease (COVID-19) based on Deep Features and Support Vector Machine. 2020;643-651. 10.33889/IJMEMS.2020.5.4.052.
  • 47.Kumar R, Arora R, Bansal V, Sahayasheela VJ, Buckchash H, Imran J, Narayanan N, Pandian GN, Raman B. Accurate Prediction of COVID-19 using Chest X-Ray Images through Deep Feature Learning model with SMOTE and Machine Learning Classifiers. 2020. 10.1101/2020.04.13.20063461.
  • 48.Kumar R, Arora R, Bansal V, Sahayasheela VJ, Buckchash H, Imran J, Narayanan N, Pandian GN, Raman B. Automatic detection of coronavirus disease (covid-19) in x-ray and ct images: A machine learning-based approach. 2020. arXiv preprint arXiv:2004.10641.
  • 49.Basu S, Mitra S, Saha N. Deep learning for screening covid-19 using chest x-ray images. In 2020 IEEE Symposium Series on Computational Intelligence (SSCI). IEEE. 2020;2521-2527.
  • 50.Wang D, Mo J, Zhou G, Xu L, Liu Y. An efficient mixture of deep and machine learning models for COVID-19 diagnosis in chest X-ray images. PLOS One. 2020;11:e0242535. 10.1371/journal.pone.0242535.. [DOI] [PMC free article] [PubMed]
  • 51.Shi F, Xia L, Shan F, Song B, Wu D, Wei Y, Yuan H, Jiang H, He Y, Gao Y, Sui H. Large-scale screening to distinguish between COVID-19 and community-acquired pneumonia using infection size-aware classification. Phys Med Biol 2021;6:065031. 10.1088/1361-6560/abe838. [DOI] [PubMed]
  • 52.Sharifrazi D, Alizadehsani R, Roshanzamir M, Joloudari JH, Shoeibi A, Jafari M, Hussain S, Sani ZA, Hasanzadeh F, Khozeimeh F, Khosravi A. Fusion of convolution neural network, support vector machine and Sobel filter for accurate detection of COVID-19 patients using X-ray images. Biomed Signal Proc Control. 2021;102622. 10.1016/j.bspc.2021.102622. [DOI] [PMC free article] [PubMed]
  • 53.Das S, Roy SD, Malakar S, Velásquez JD, Sarkar R. Bi-Level Prediction Model for Screening COVID-19 Patients Using Chest X-Ray Images. Big Data Res. 2021;100233. 10.1016/j.bdr.2021.100233.
  • 54.Sen S, Saha S, Chatterjee S, Mirjalili S, Sarkar R. A bi-stage feature selection approach for COVID-19 prediction using chest CT images. Appl Intell. 2021 doi: 10.1007/s10489-021-02292-8. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 55.Qaid TS, Mazaar H, Al-Shamri MY, Alqahtani MS, Raweh AA, Alakwaa W. Hybrid Deep-Learning and Machine-Learning Models for Predicting COVID-19. Comput Intell Neurosci. 2021b;1–11. 10.1155/2021/9996737. [DOI] [PMC free article] [PubMed]
  • 56.Saba L, Agarwal M, Patrick A, Puvvula A, Gupta SK, Carriero A, Laird JR, Kitas GD, Johri AM, Balestrieri A, Falaschi Z. Six artificial intelligence paradigms for tissue characterisation and classification of non-COVID-19 pneumonia against COVID-19 pneumonia in computed tomography lungs. Int J Comp Assisted Radiol Surg. 2021;3:423–434. 10.1007/s11548-021-02317-0. [DOI] [PMC free article] [PubMed]
  • 57.Abbas A, Abdelsamea MM, Gaber MM. Classification of COVID-19 in chest X-ray images using DeTraC deep convolutional neural network. Appl Intell. 2020;2:854–864. 10.1007/s10489-020-01829-7. [DOI] [PMC free article] [PubMed]
  • 58.Kaggle, Kaggle's Chest X-Ray Images (Pneumonia) dataset, 2020. https://www.kaggle.com/paultimothymooney/chest-xray-pneumonia.
  • 59.Cohen JP, Morrison P, Dao L. Covid-19 image data collection. 2020. arXiv 2003.11597. https://github.com/ieee8023/covid-chestxray-dataset.
  • 60.Chung A. Figure1-COVID-chestxray-dataset. 2020. Available from: https://github.com/agchung/Figure1-COVID-chestxray-dataset.
  • 61.Armato SG, 3rd, et al. The Lung Image Database Consortium (LIDC) and Image Database Resource Initiative (IDRI): a completed reference database of lung nodules on CT scans. Med Phys. 2011;38:915–931. doi: 10.1118/1.3528204. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 62.Depeursinge A, et al. Building a reference multimedia database for interstitial lung diseases. Comput Med Imaging Graph. 2012;36:227–238. doi: 10.1016/j.compmedimag.2011.07.003. [DOI] [PubMed] [Google Scholar]
  • 63.Saborit-Torres JM, Saenz-Gamboa JJ, Montell JÀ, Salinas JM, Gómez JA, Stefan I, Caparrós M, García-García F, et al. BIMCV COVID-19+: A large annotated dataset of RX and CT images from COVID-19 patients. 2020. arXiv:20.
  • 64.COVID-19 public dataset from Italy. Available from: https://towardsdatascience.com/covid19-public-dataset-on-gcp-nlp-knowledge-graph-193e628fa5cb.
  • 65.Shih G, Wu C, Halabi S, et al. Augmenting the National Institutes of Health chest radiograph dataset with expert annotations of possible pneumonia. 2020. [DOI] [PMC free article] [PubMed]
  • 66.Irvin J, Rajpurkar P, Ko M, et al. Chexpert: a large chest radiograph dataset with uncertainty labels and expert comparison. 2020. https://arxiv.org/abs/1901.07031.
  • 67.Wang X, Peng Y, Lu L, Lu Z, Bagheri M, Summers RM. Chest X-ray: hospital-scale chest X-ray database and benchmarks on weakly-supervised classification and localization of common thorax diseases. 2020. https://arxiv.org/%20abs/1705.02315.
  • 68.Johnson AEW, Pollard TJ, Berkowitz SJ, et al. MIMIC-CXR, a de-identified publicly available database of chest radiographs with free-text reports. Sci Data2019;6:317. http://arxiv.org/abs/1901.07042.[PMC free article][PubMed][Google Scholar]. [DOI] [PMC free article] [PubMed]
  • 69.Bustos A, Pertusa A, Salinas JM, de la Iglesia-Vayá M. PadChest: A large chest x-ray image dataset with multi-label annotated reports. 2020. https://arxiv.org/abs/1901.07441arXiv:1901.07441.. [DOI] [PubMed]
  • 70.North of America RS. RSNA pneumonia detection challenge. 2019. https://www.kaggle.com/c/rsna-pneumonia-detection-challenge/data.
  • 71.Afshar P, et al. COVID-CT-MD: COVID-19 Computed Tomography (CT) Scan Dataset Applicable in Machine Learning and Deep Learning. 2020. https://www.researchgate.net/publication/344436821_COVID-CT-MD_COVID-19_Computed_Tomography_CT_Scan_Dataset_Applicable_in_Machine_Learning_and_Deep_Learning. [DOI] [PMC free article] [PubMed]
  • 72.Ahishali M, Degerli A, Yamac M, Kiranyaz S, Chowdhury ME, Hameed K, Hamid T, Mazhar R, Gabbouj M. Advance warning methodologies for covid 19 using chest x-ray images. 2020. arXiv e-prints, arXiv-2006. [DOI] [PMC free article] [PubMed]
  • 73.Vayá MD, Saborit JM, Montell JA, Pertusa A, Bustos A, Cazorla M, Galant J, Barber X, Orozco-Beltrán D, García-García F, et al. BIMCV COVID-19+: A large annotated dataset of RX and CT images from COVID-19 patients. 2020. arXiv:20.
  • 74.Ahishali M, Degerli A, Yamac M, Kiranyaz S, Chowdhury ME, Hameed K, Hamid T, Mazhar R, Gabbouj M. Comparative Study on Early Detection of COVID-19 from Chest X-Ray Images. . arXiv preprint arXiv:2006.05332. 2020 Jun 7.
  • 75.Covid-19 database. [Online]. Available: https://www.sirm.org/category/senza-categoria/covid-19/.
  • 76.Rajpurkar P, Irvin J, Zhu K, Yang B, Mehta H, Duan T, Ding D, Bagul A, Langlotz C, Shpanskaya K, et al. Chexnet: Radiologistlevel pneumonia detection on chest x-rays with deep learning. 2017. arXiv preprint arXiv:1711.05225.
  • 77.Quinlan JR. Induction of decision trees. Mach Learn. 1986;1:81–106. doi: 10.1007/BF00116251. [DOI] [Google Scholar]
  • 78.Breiman L. Random forests. Mach Learn. 2001;45:5–32. doi: 10.1023/A:1010933404324. [DOI] [Google Scholar]
  • 79.Chen T, Guestrin C, Boost XG. In: Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining - KDD '16, ACM Press, New York, USA, pp. 785- 794. http://dl.acm.org/citation.cfm?doid=2939672.2939785. 10.1145/2939672.2939785.
  • 80.Freund Y, Schapire RE. A desicion-theoretic generalization of on-line learning and an application to boosting. In: European conference on computational learning theory, Springer, 1995;23-37.
  • 81.Breiman L. Bagging predictors. Mach Learn. 1996;24:123–140. doi: 10.1007/BF00058655. [DOI] [Google Scholar]
  • 82.Ke G, Meng Q, Finley T, Wang T, Chen W, Ma W, Ye Q, Liu TY. Lightgbm: A highly efficient gradient boosting decision tree, in: Advances in neural information processing systems. 2017;3146-3154.
  • 83.Fushman D, Kohli MD, Rosenman MB, et al. Preparing a collection of radiology examinations for distribution and retrieval. Demner-J Am Med Inform Assoc. 2016;23:304–310. [DOI] [PMC free article] [PubMed]
  • 84.Luz EJ, Silva PL, Silva R, Silva L, Moreira G, Menotti D. Towards an Effective and Efficient Deep Learning Model for COVID-19 Patterns Detection in X-ray Images. CoRR. 2020.
  • 85.Pereira RM, Bertolini D, Teixeira LO, Silla Jr CN, Costa YM. COVID-19 identification in chest X-ray images on flat and hierarchical classification scenarios. Comp Methods Prog Biomed. 2020;8:105532. [DOI] [PMC free article] [PubMed]
  • 86.Wang X, Peng Y, Lu L, Lu Z, Bagheri M, Summers RM. Chestxray8: Hospital-scale chest x-ray database and benchmarks on weakly-supervised classification and localization of common thorax diseases. In Proceedings of the IEEE conference on computer vision and pattern recognition, pages 2097–2106, 2017.
  • 87.Chung M, et al. CT imaging features of 2019 novel coronavirus (2019-nCoV). 2020. 10.1148/radiol.2020200230. [DOI] [PMC free article] [PubMed]
  • 88.Muhammad EHC, Tawsifur R, Amith K, Rashid M, Muhammad Abdul K, Zaid Bin M. COVID-19 radiology database. “Can AI help screen viral COVID-19 pneumonia?”. 2020. https://arxiv.org/abs/2003.13145.
  • 89.Radiology IS of M and I. Italian society of medical and interventional radiology. https://www.sirm.org/category/senza-categoria/covid-19/.
  • 90.Joseph Paul C, Paul M, Lan D. COVID-19 image data collection. https://arxiv.org/pdf/2003.11597.pdf.
  • 91.Cohen JP, Morrison P, Dao L. COVID-19 Image Data Collection. arXiv e-prints [Internet]. 2020 March 01, 2020 [arXiv:2003.11597 p.]. https://ui.adsabs.harvard.edu/abs/2020arXiv200311597C.
  • 92.LIDC-IDRI database. https://wiki.cancerimagingarchive.net/display/Public/LIDC-IDR.
  • 93.Alibabadatabase. https://tianchi.aliyun.com/competition/entrance/231601/information.
  • 94.CC-CCII database. http://ncov-ai.big.ac.cn/download.
  • 95.Koo HJ, Lim S, Choe J, Choi SH, Sung H, Do KH. Radiographic and CT Features of Viral Pneumonia. Radiographics. 2018. 10.1148/rg.2018170048. [DOI] [PubMed]
  • 96.Ai T, Yang Z, Hou H, Zhan C, Chen C, Lv W, et al. Correlation of Chest CT and RT-PCR Testing in Coronavirus Disease 2019 (COVID-19) in China: A Report of 1014 Cases. 2020. https://pubmed.ncbi.nlm.nih.gov/32101510/. [DOI] [PMC free article] [PubMed]
  • 97.Li X, Zeng X, Liu B, Yu Y. Covid-19 infection presenting with CT Halo Sign. 2020. 10.1148/ryct.2020200026. [DOI] [PMC free article] [PubMed]
  • 98.Bernheim A, Mei X, Huang M, Yang Y, Fayad ZA, Zhang N, Diao K, Lin B, Zhu X, Li K et al. Chest CT findings in coronavirus disease-19 (COVID-19): relationship to duration of infection. 2020. 10.1148/radiol.2020200463. [DOI] [PMC free article] [PubMed]
  • 99.Song F, Shi N, Shan F, Zhang Z, Shen J, Lu H, Ling Y, Jiang Y, Shi Y. Emerging 2019 novel coronavirus (2019-nCoV) pneumonia. 2020. 10.1148/radiol.2020200274.
  • 100.Oh Y, Park S, Ye JC. Deep learning covid-19 features on cxr using limited training data sets. IEEE Trans Med Imag. 2020;39:2688–2700. [DOI] [PubMed]
  • 101.Hansell DM, Bankier AA, MacMahon H, McLoud TC, Muller NL, Remy J. Fleischner Society: glossary of terms for thoracic imaging. 2020. https://pubmed.ncbi.nlm.nih.gov/18195376/. [DOI] [PubMed]
  • 102.Swapnarekha H, Behera HS, Nayak J, Naik B. Role of intelligent computing in COVID-19 prognosis: A state-of-the-art review. Chaos Solitons Fractals. 2020;138:109947. [DOI] [PMC free article] [PubMed]
  • 103.Izzo Andrea DAL. (2020, April-11-2020). Radiology. (2020). COVID-19 Database. Available: https://www.sirm.org/category/senza-categoria/covid-19.
  • 104.Soares E, Angelov P, Biaso S, Froes MH, Abe DK. SARS-CoV-2 CT-scan dataset: A large dataset of real patients CT scans forSARS-CoV-2 identification. medRxiv 2020.
  • 105.Rahimzadeh Mohammad, Attar Abolfazl, Mohammad Sakhaei Seyed. medRxiv; 2020. A Fully Automated Deep Learning-Based Network for Detecting Covid-19 from a New and Large Lung Ct Scan Dataset. [DOI] [PMC free article] [PubMed]
  • 106.Soares Eduardo, Angelov Plamen, Biaso Sarah, Froes Michele Higa, Abe Daniel Kanda. medRxiv; 2020. Sars-cov-2 Ct-Scan Dataset: A Large Dataset of Real Patients Ct Scans for Sars-Cov-2 Identification.
  • 107.Cohen JP, Morrison P, Dao L. Covid-19 image data collection. arXiv 2003.11597, 2020. [Online]. Available: https://github.com/ieee8023/covid-chestxray-dataset.
  • 108.Cohen JP, Morrison P, Dao L, Roth K, Duong TQ, Ghassemi M. Covid-19 image data collection: Prospective predictions are the future. arXiv 2006.11988, 2020. Available:https://github.com/ieee8023/covid-chestxray-dataset.
  • 109.Kermany DS, Goldbaum M, Cai W, Valentim CC, Liang H, Baxter SL, McKeown A, Yang G, Wu X, Yan F, et al. Identifying medical diagnoses and treatable diseases by image-based deep learning. Cell. 2018;172(5):1122–1131. doi: 10.1016/j.cell.2018.02.010. [DOI] [PubMed] [Google Scholar]
  • 110.Wang D, Hu B, Hu C, et al. Clinical characteristics of 138 hospitalized patients with 2019 novel coronavirus-infected pneumonia in Wuhan. China: JAMA; 2020. [DOI] [PMC free article] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Data Availability Statement

Not applicable.


Articles from Health and Technology are provided here courtesy of Nature Publishing Group

RESOURCES