Development of artificial intelligence technology in diagnosis, treatment, and prognosis of colorectal cancer

Abstract

Artificial intelligence (AI) technology has made leaps and bounds since its invention. AI technology can be subdivided into many technologies such as machine learning and deep learning. The application scope and prospect of different technologies are also totally different. Currently, AI technologies play a pivotal role in the highly complex and wide-ranging medical field, such as medical image recognition, biotechnology, auxiliary diagnosis, drug research and development, and nutrition. Colorectal cancer (CRC) is a common gastrointestinal cancer that has a high mortality, posing a serious threat to human health. Many CRCs are caused by the malignant transformation of colorectal polyps. Therefore, early diagnosis and treatment are crucial to CRC prognosis. The methods of diagnosing CRC are divided into imaging diagnosis, endoscopy, and pathology diagnosis. Treatment methods are divided into endoscopic treatment, surgical treatment, and drug treatment. AI technology is in the weak era and does not have communication capabilities. Therefore, the current AI technology is mainly used for image recognition and auxiliary analysis without in-depth communication with patients. This article reviews the application of AI in the diagnosis, treatment, and prognosis of CRC and provides the prospects for the broader application of AI in CRC.

Core Tip: The current artificial intelligence (AI) technology is mainly used for image recognition and auxiliary analysis without in-depth communication with patients. We here review the application of AI in the diagnosis, treatment, and prognosis of colorectal cancer (CRC) and look at the prospects for the broader application of AI in CRC.

INTRODUCTION

With the invention of the computer, heavy scientific and engineering calculations have shifted from being done primarily by the human brain to being done more quickly and accurately by computers. Artificial intelligence (AI) has evolved rapidly with the continuous development of computer science and technology. AI is an umbrella term that helps humans perform tasks including computer simulation, decision-making, language understanding, problem-solving, voice and image recognition, and other “intelligent” tasks[1-3]. AI can be divided into machine learning (ML), deep learning (DL), anti-learning, quasi-supervised learning (QSL), and active learning (AL)[4-7]. ML is a subset of AI algorithm which uses statistical techniques to adjust and improve itself[1,3]. ML produces algorithms for analyzing data and learning to predict models, which means that ML is data-driven, with a little human intervention as possible in the decision-making process[4,8]. The model created by ML can be used as an independent executable system to predict the clinical phenotype[9]. The relevant technologies in ML include support vector machine (SVM), neural network (NN), random forest (RF), decision tree, and regression analysis[10]. Based on the association of class labels, ML is generally divided into supervised learning, unsupervised learning, and semi-supervised learning (SSL)[8,9]. Supervised learning is mainly used for solving classification and regression problems. Unsupervised learning is used for a cluster, density estimation, and dimensionality reduction[9]. SSL can significantly improve the learning accuracy when unlabeled data combined with a limited number of labeled data are used in SSL[11]. At present, supervised learning plays a leading role in AI and ML in the medical field[2]. Supervised learning provides more accurate results than other AI techniques because it considers the characteristics of the patients[10].

DL is a kind of developed ML based on an artificial NN (ANN)[2], which is inspired by the biological characteristics of the human brain, especially the connection of neurons[2,4]. DL can not only automatically find lesions, make recommendations for differential diagnosis, and write elementary medical reports, but can also be self-learning, i.e., key characters and quantities can be extracted without a manual indication if the training data is provided[4]. Moreover, DL aims to copy the brain's learning process and process a large amount of high-dimensional data[12]. QSL is a statistical learning algorithm that avoids the manual marking of normal tissue and cancer tissue samples in traditional supervised learning and greatly reduces the intervention of experts[5]. ML usually needs a large number of annotated training sets, which are expensive to create. AI reduces the size of the required annotation set and generates a better classification model[7]. In some research, to predict the stage of colorectal cancer (CRC) from immune attributes, the anti-learning method has better performance than a series of ML algorithms[6].

CRC is the second reason for cancer death in males and the third reason for cancer death in females[13]. If colonic polyps, which may lead to at least 80%-95% of CRC[14], are detected by the screening procedure and resected in the precancerous stage, it can help prevent CRC development[15]. Although early and intensive screening can reduce cancer incidence and mortality, patients avoid CRC screening due to the complexity and cost of screening[15-17]. Generally, the methods of diagnosing CRC are divided into imaging diagnosis, endoscopy, and pathology diagnosis. Treatment methods are divided into endoscopic treatment, surgical treatment, and drug treatment. If lymph node metastasis is not confirmed preoperatively, lymph node dissection is not required intraoperatively[18]. AI has great diagnostic potential because it can learn from a large data set. In the clinical image, AI is superior to medical experts and existing biomarkers[10]. This paper will describe the use of AI in the diagnosis, treatment, and prognosis of CRC. Web of Science and PubMed databases were searched using keywords “artificial intelligence” and “colorectal cancer”.

USE OF AI IN DIAGNOSIS OF CRC

DL in imaging diagnosis

The DL intelligent assistant diagnosis system can help the clinical diagnosis and treatment of CRC[19]. The computer-aided diagnosis (CAD) system usually analyzes the nature of the selected area (cancerous or noncancerous) through the informative characteristics of the known potential (cancerous) structure[20]. The CAD system can help radiologists diagnose CRC by visual cues (CAD marks) associated with potential pathology. In addition, CAD can help determine the location of the disease (computer-aided detection, CADe) and determine whether the abnormality is benign or malignant. Regardless of the outcome, doctors must ultimately decide whether to “believe” the CAD mark[21]. The key for radiologists accepting the clinical use of CAD systems is to have a high detection sensitivity and a low false-positive rate (FP)[20]. Apart from polyps and cancer, other colorectal pathological morphologies are rare, which can explain why CAD solutions for computed tomography colonography (CTC) have developed so rapidly[22]. CAD of CTC has indeed improved sensitivity in finding polyps without disproportionately decreasing specificity, but the lesions mistaken for false-negative are significantly large and irregular[21-23]. Regge et al[21] believed that the difficulty of characterization (irregular and flat morphology) was the main determinant of radiologists’ rejection of true positive CAD indications.

Although the consequence of CRC misdiagnosis is much more severe than that of polyp misdiagnosis, the research of CADe for CRC in CTC is still very limited[24]. The reason may be that the lack of literature on the detection characteristics of early CRC[25] and the fact that it remains a problem to effectively distinguish masses from normal colonic anatomy based on the design features of mathematical images[24]. Taylor et al[25] collected the morphological characteristics of flat tumors by locating tumors to distinguish tumors from normal tissue structure and found that the CAD system combined with CTC was relatively effective for detecting flat (non-polypoid) cancer. CAD can improve the speed of image interpretation, find out the polyps missed by experts, reduce the variability between observers, and improve the sensitivity of polyp detection[26,27]. However, the increase of FP generated by CAD may reduce the efficiency[22]. Deep transfer learning can greatly improve the accuracy of polyp detection in CTC[28]. Because the virtual intracavity images of polyp filtered by the CADe system can be used to modify the deep convolutional NN (DCNN) trained by millions of non-medical images, the DCNN can identify polyps[28]. It can significantly improve the detection of polyps for inexperienced doctors using a visualization scheme in CTC. Combined with the CAD system, the visualization scheme can reduce radiologists’ interpretation time and improve the detection of colon tumors in CTC[29]. Van Wijk et al[30] presented a method by measuring the protrusion of candidate objects in a scale adaptive way to evaluate polyps larger than or equal to 6 mm, with a 95% sensitivity obtained. It was believed that identifying the size of polyps can reduce the risk of missed diagnosis of large polyps more than identifying the shape[30]. Kim et al[31] collected the CTC dataset interpreted by the CAD algorithm from polyp patients. The CTC dataset was designed to describe the lumpy structure extending into the lumen and could identify large polyps (> 6 mm) with a high sensitivity and acceptable FP. Based on the characteristics of volume and shape, Nappi et al[32] developed a CADe method to detect the location of colonic polyps and used this method to evaluate the serrated polyps confirmed by colonoscopy and biopsy. The results showed that the detection accuracy of the method was much higher than that of the traditional CADe system[32]. Therefore, the application of CAD diagnosis has a promising prospect. However, more data sets and effective annotations are still needed to enhance the accuracy of AI diagnosis[21].

The optimal portal venous phase timing recognition scan was selected for classifying the contrast enhancement time, which could help analyze the radiologic characteristics of the tumor and evaluate the efficacy of patients with advanced CRC[33]. Soomro et al[34] found that three-dimensional (3D) fully convolutional NNs combined with 3D level-set showed a higher sensitivity than 3D fully convolutional NNs alone in the segmentation of CRC on magnetic resonance imaging (MRI), which helped for the diagnosis of CRC. In 3D-T2 weighted MRI, the 3D full collaborative network architecture based on DL could segment CRC more reasonably and effectively than other techniques[35]. In the high-resolution MRI image of rectal cancer, the use of a faster region-based convolution NN (Faster R-CNN) had a high accuracy in evaluating tumor boundaries[36,37]. Circumferential resection margin is one of the key factors affecting the treatment decision of CRC patients. Joshi et al[38] proposed an automatic calculation and visualization method of circumferential resection margin distance in MRI images of CRC to segment the middle rectal fascia, the corresponding tumor, and lymph node into different regions. The segmentation was used to analyze the shortest cut edge automatically, and the results obtained were almost identical to the experts’ judgment[38].

DL in pathological diagnosis

If CRC is detected early, it is almost curable. However, in order to make a correct diagnosis, a double examination of biopsy and colonoscopy image is required, so the cost of diagnosis has increased[39]. Thus, the use of DL and automatic image analysis in pathology is increasing, which is called the third revolution of pathology[40]. Although the automatic coding in DL is considered helpful in extracting multi-layer image features and deep NNs can classify the features, it takes much time to train artificial neurons[41].

Convolutional NN (CNN) is a common method in pathological image analysis. Compared with other methods, CNN has the advantages of convenience for end-to-end learning (CNN learning parameters and representations are designed manually), flexibility, and high capacity[2]. The choice of color space is important for identifying cancer tissue because it deeply affects the performance of the classification model. CNN is used to analyze the tissue classification of different color spaces. Tiwari S proved that hue, saturation, value (HSV) color space was more suitable than any other color model for cancer tissue classification[42]. Because of the heterogeneity of the cells, texture, and cell contact complexity, it is challenging to detect and classify the nuclei in the pathological images of cancer tissues stained with hematoxylin and eosin (H&E)[43,44]. A space-constrained CNN based on DL was proposed for nuclear detection, which might provide a possibility for quantitative analysis of tissue components and clarify the tumor microenvironment. Moreover, the neighbor ensemble predictor combined with CNN could accurately predict the detected nuclear markers and classify the nuclei[43]. Although qualitative and quantitative analysis of histopathological images can clarify the tumor and explore various options for cancer treatment, it remains challenging due to cell heterogeneity. Zhang et al[45] proved that it had a good accuracy and lower cost of time when Faster R-CNN was used in feature extraction, providing a useful quantitative analysis group for pathological practice.

CNN, widely used to analyze histopathological images, only performs directly on the histopathological images, ignoring the histopathological images’ stain decomposition. Xu et al[46] reported a new model based on DCNN to classify the H&E and immunohistochemistry images of epithelial and stromal cells in colon cancer. For distinguishing stromal from epithelial cells, the DCNN based model was always better than the traditional hand-made model. The morphology of glands and nuclei is used to evaluate the malignant degree of adenocarcinoma. As a necessity for quantitative diagnosis, the accurate detection and segmentation of the histological image are challenging due to its appearance variation, strong similarity, and tissue degradation. Chen et al[47] attempted to use a depth profile awareness network, which could output the accurate probability map of histological objects and draw clear contour lines, to improve the accuracy of detection and segmentation.

Digital pathology is a new field. The development of digital pathology may help pathologists to improve the quality of routine pathological operations[48]. The key to promoting the development of digital pathology is the CAD system, based on the principle of extracting histopathological features that pathologists consider important. Then, the existence of these features was explained quantitatively by computer calculation[49,50]. There are two important steps towards the CAD: Tumor segmentation of the whole section image in the histological section and the automatic segmentation of tumors in the H&E staining histological image[51]. Qaiser et al[51] found that tumor and non-tumor plaques had distinct homology, and proved the robustness and significance of persistent homology by exploring connectivity between nucleus. A method called persistent homology maps (PHPs) was proposed, which could distinguish tumor area from the normal area by simulating the atypical characteristics of tumor cell nucleus[51]. PHPs outperform other methods, including traditional CNN[51]. Two different tumor segmentation methods are proposed: Targeting speed without affecting accuracy and targeting higher accuracy. The combination of PHPs and CNN features was shown to be better than competition algorithms[51].

DL in endoscopic diagnosis

Colonoscopy is a common method to screen polyps. The detection and removing of adenomatous polyps can reduce the incidence and mortality rates of CRC [13]. AI is necessary to improve machine performance and diagnosis accuracy, reducing the variability between operators and helping rapid treatment decision-making[3]. In addition, AI has a great potential to improve the detection rate of adenoma and reduce the cost of polypectomy[52]. The quality of intestinal preparation is an important factor influencing the effect of colonoscopy examination[53]. When the fecal residues are present in the colon, the rate of missed diagnosis of polyps will increase. Although the endoscopic image diagnostic program based on CNN has yielded good results, its diagnostic ability depends heavily on the quality and quantity of training data[4,54]. The use of CNN and colonoscopy procedure is expected to improve the detection rate and diagnosis accuracy of polyps[55]. Zhou et al[53] developed a CNN based system that was trained by collecting colonoscopy images. Through a human-machine competition, the system was found to be more reliable than endoscopic physicians in diagnosis of CRC. Taha et al[56] introduced a DL solution for polyps from colonoscopy, a pre-training architecture for feature extraction, used together with the classical SVM classifier. As the solution can avoid the high computational complexity and high resource requirements of CNN, it outperforms other models in the early screening of CRC[56]. Yao et al[57] proved that the features in red, green, blue (RGB) and HSV color space could well describe the frames in colonoscopy videos. It could improve the model’s efficiency by integrating the prior knowledge based on vision into the data extracted by DL. Therefore, a feature extraction algorithm in HSV color space was designed to effectively improve the accuracy of diagnosis and reduce the cost[57]. McNeil et al[58] proposed an automatic quality control system based on DCNN, improving colonoscopy quality by cleaning the mucosal wall and reexamining the rushed segment. The system could increase the detection rate of polyps and have great significance for the early diagnosis and prevention of CRC.

The missed diagnosis rate of traditional colonoscopy approaches 25%[59,60], partly due to the lack of depth information, inter-observer variation, and contrast on the surface of the colon[60,61]. Computer-aided technology is important for polyp detection in endoscopic video. The method based on DL takes the lead in the evolution of algorithm performance[62]. It is a challenging task for CAD to minimize the FP of colonic polyps[63]. Mahmood et al[61] used a joint depth learning and graphics model-based framework to estimate depth from endoscopic images. At the same time, they used the texture-free colon model to generate training images and trained the model with those images[61]. The system could estimate the depth of virtual data with a relative error of 0.164, which was helpful to perfect the CAD system and identify lesions[61]. Komeda et al[64] believed that CNN had the advantage of learning from large data and led to high precision and fast processing time, and they designed a CNN-CAD system to study endoscopic images extracted from colonoscopy[64]. The analysis and cross-validation of 1200 cases of colonoscopy confirmed that the CNN-CAD system was helpful for the rapid diagnosis of colonic polyps and could simplify the decision-making process of colorectal polypectomy[64]. Compared with other algorithms, the CAD method (named RYCO) had the potential for rapid and accurate computer-aided polyp detection in colonoscopy. The fast target detection algorithm ResYOLO was pre-trained using a large non-medical image database, and the colonoscopy image was fine-tuned. At the same time, the time information was combined by a tracker named Efficient Convolution Operator to improve the detection results given by ResYOLO. RYCO could clarify the spatial characteristics of colorectal polyps directly and improve the detection efficiency of colorectal polyps[65]. In order to distinguish stage T1b and Tis/T1a CRC, the optical diagnostic system developed by CNN was proposed[66]. Zhu et al[66] selected the early CRC digital images without magnification and under a pure white light endoscope as the training dataset. At the end of the training process, 122 early CRC images were used to evaluate the diagnostic performance. The results showed that optical diagnoses by CNN had a high sensitivity but low specificity, which was different from humans[66]. Variations in polyp size and shape made the diagnosis of polyp in colonoscopy video challenging[67]. However, the Faster R-CNN could reduce the risk of polyp loss during colonoscopy[62]. Furthermore, Akbari et al[67] presented a fully convolutional network (FCN) method of polyp segmentation based on CNN. In the test phase, they did effective post-processing for the probability map generated by the network. The CVC-ColonDB database was used to evaluate the method. The result showed that FCN could get more accurate segmentation results[67]. 3D-FCN could learn more representative spatiotemporal features from colonoscopy video and had stronger recognition ability than FCN[68].

The goal of the real-time endoscopic image diagnosis support system is to use AI during colonoscopy without interrupting the operation of any doctor[69]. Based on the DL method, the real-time optical detection and analysis of polyps can be carried out by white light endoscopy alone[70]. A real-time automatic polyp detection system can help endoscopists detect lesions that may correspond to adenomas quickly and reliably[13]. The accuracy of endoscopic differential diagnosis enables the “resection and discard” mode of small-scale colorectal polyps[71]. To relieve the high cost, long time consuming, and patients’ discomfort, Lund Henriksen et al[71] explored a system for automatic polyp detection to assist and automate the examination procedures. By comparing root mean square propagation, stochastic gradient descent, and adaptive moment estimation, when stochastic gradient descent was used as the training optimizer, the detection rate increased while the number of FP was relatively stable[71].

Although optical biopsy is a promising field, tissue biopsy remains the gold standard. Whether the surface microstructure accurately reflects the histological characteristics of lesions will affect the results of optical biopsy[3,13,72,73]. The widespread clinical use of microscopic technology, especially the combination of virtual chromoendoscopy and microscopic imaging, has brought more attention to the field of optical biopsy[74]. Endoscopists can reliably diagnose and differentiate micro-adenomatous and hyperplastic polyps using established optical evaluation criteria[75]. The development of CAD and AI algorithms may overcome the main obstacles of optical biopsy and change the treatment of colorectal lesions[74,76]. Endocytoscopy is an effective method for deep diagnosis of CRC because of the high resolution[73]. Kudo et al[77] developed an AI-based system called EndoBRAIN which could identify the colon tumor by analyzing the nucleus, crypt structure, and microvasculature in the endoscopic image. The initial training of EndoBRAIN was carried out using endoscopic images. The diagnostic efficiency of endoscopists and the diagnostic performance of EndoBRAIN were analyzed retrospectively. The result showed that EndoBRAIN could increase the accuracy of the diagnosis[77]. Mahmood et al[78] proposed a new monocular endoscope depth estimation and terrain reconstruction system, which took advantage of the joint training framework based on CNN and conditional random field. The system used the synthetic endoscope data for training and the colon model data for fine-tuning. It could be integrated into the endoscope system, which provided a basis for improving the CAD algorithm to detect, segment, and classify lesions[78].

ML in imaging diagnosis

ML has to extract the most relevant or predictive features from many tested features and use these to determine the categories of new image samples[79,80]. The features will help diagnose CRC in imaging. It is very important to segment colorectal tumors accurately in MRI images, while the manual or semi-manual method is very tedious, time-consuming, and operator-dependent[81]. CAD plays an important role in many medical analyses, especially in computed tomography (CT) image analysis. Although many methods are designed, there are still some deficiencies in structure segmentation[82]. Onder et al[5] reported that ML methods including SVM and logistic regression could achieve better classification performance and improve the accuracy of the baseline CAD system. The ideal colon segmentation effect could be achieved in a CT image using the NN algorithm to remove the turbid liquid of the large intestine[83]. Jian et al[81] proposed a segmentation method based on the FCN framework. The normalization method was used to reduce the difference between images. The segmentation method could extract features from standardized images and generate corresponding predictions for reference using the idea of transfer learning. Finally, all predictions were fused to determine the final tumor boundary[81]. Compared with manual segmentation of T2 weighted MRI images of CRC, the FCN based segmentation method had a higher accuracy. The FCN based segmentation method might replace the time-consuming manual method[81]. In order to achieve accurate segmentation, a regression NN-augmented lagrangian genetic algorithm (RNN-ALGA) based on ML was proposed. Using RNN-ALGA, an accuracy of 97% could be achieved under the condition of small error. RNN-ALGA was suitable for abdominal CT image slices and could improve structural segmentation accuracy and time efficiency in diagnosing colonic diseases[82].

ML in pathological diagnosis

Computational pathology based on AI and ML methods is most promising. The computer model has better image recognition ability than human experts[2]. Large-scale and high-quality training datasets are necessary for an ML-based image classifier to achieve high performance[84]. ML-based tissue classification is a valuable method for manual histological analysis. However, high-resolution image classification is a complex and computationally expensive task. In addition, the goal of many tissue analysis tasks is to identify rare areas in the tissue. In colon cancer, tumor budding (TB) exists in the front of the tumor-infiltrating area, which is an important sign of tumor invasiveness[85]. When the image is examined at a low resolution, the small objects are difficult or impossible to detect. Sun et al[85] provided a two-tier CNN classification method that was explored to identify the small and important tissue areas in the whole slice tissue. The processing time of the method is reduced by 43%. The two-tier classifier provided an effective tissue classification by reducing the task area and increasing the chance of tumor bud recognition[85]. A variety of serum tumor markers can be used in the diagnosis of CRC. There is a wide range of variability in the types and quantities of routinely used markers. The traditional single cut-off point also hinders the effective use of tumor markers. In order to improve the diagnosis accuracy and reduce the cost, it is important to optimize the inspection combination and make full use of the inspection value. Shi et al[86] proposed an AI algorithm called diagnosis strategy of serum tumor maker, which proved that two markers were enough for diagnosis. Compared with SVM and decision tree, the multiple tumor markers with multiple cut-off values (MVMTM) algorithm could greatly improve the diagnosis efficiency of CRC using carcinoembryonic antigen, carbohydrate antigen 19-9 (CA19-9), and CA50[87]. The establishment of an image database for colorectal tumor biopsy is an important step to detect the tumor. The automatic classification of tumor cells can improve the rapidity and accuracy of tumor diagnosis. Image processing and ML can be used to distinguish different cell types in digital biopsy sections. In addition to using conventional RGB/grayscale images, multispectral images often provide extensive information to support classification tasks. Kunhoth et al[88] used a multispectral image acquisition system to develop a colorectal biopsy section database divided into training sets and test sets. In order to avoid the deviation, 50 iterations were run, and the results of a single operation were averaged, which finally proved that the database had a high classification accuracy. The colorectal biopsy section database could help diagnose CRC[88].

ML in endoscopic diagnosis

With good results in computer vision and other fields, ML still requires certain manual guidance[4]. Removal of precancerous polyps is important for colon cancer prevention. However, the detection rate of adenomatous polyps is quite different among endoscopists[89]. By calculating the risk and difference of detecting polyps, adenomas, and CRC, Barua et al[90] compared colonoscopy with AI and colonoscopy without AI. It was found that an AI-based polyp detection system in colonoscopy could increase the detection rate of nonprogressive small adenomas and polyps but could not increase the detection rate of progressive adenomas[90]. Wang et al[89] developed the ENDOANGEL system and compared AI colonoscopy with colonoscopy without AI through random-control experiments. The results showed that AI significantly improved the detection rate of adenoma in colonoscopy[91]. Lui et al[92] suggested that the DL AI model could detect adenomas missed in routine colonoscopy in the real-time examination. They believed that the combination of AI and auxiliary equipment could eliminate the risk of missing lesions in colonoscopy when the intestine was well prepared[92]. Elastic scattering spectroscopy (ESS) for optical guided biopsy had a high accuracy in tumor detection. Rodriguez-Diaz et al[93] proposed two spectral classification frameworks, called ensemble classification and misclassification rejection, for clinical problems of non-tumor and tumor colorectal lesion classification based on ESS measurement. When the two frameworks were used to develop the diagnosis algorithm together, the classification effect would be better, and the medical cost would be reduced[93]. Near-infrared spectroscopy could also be used to diagnose CRC and differentiate malignant tumors. Kondepati et al[94] collected the spectrum of cancer tissue and normal tissue from colonic tissue with an optical fiber probe. Major spectral differences could be observed. The spectrum was divided into cancer tissue and normal tissue with an accuracy of 89% using ANN, linear discriminant analysis, and other pattern recognition methods[94]. The method based on AL could perform real-time detection during colonoscopy and enhance detection performance at the same time. However, the possibility of increased FP made the algorithm difficult to use in daily clinical practice[95]. Colon cancer might cause anemia as a common indication of colonoscopy. Hemoglobin concentration could be used as an indicator for the diagnosis of colon cancer, but it was not enough to diagnose colon cancer by hemoglobin concentration alone[96]. The AI-based ColonFlagTM might be an appropriate indicator, which used all indicators of whole blood count, age, and gender. At the same time, ColonFlagTM could provide appropriate treatment suggestions for patients who did not accept the fecal examination or colonoscopy[96]. Tian et al[97] believed that enhanced patient education (EPE) can be realized through visual aids, telephone, mobile and social media applications, multimedia education, and other software. EPE was used to guide the intestinal preparation of patients with colonoscopy and improve the detection rate of polyps, adenomas, and sessile serrated adenomas[97].

QSL and SSL in diagnosis

QSL eliminates the need for traditional supervised learning for manual labeling and reduces expert intervention. QSL texture labeling may be useful in the analysis and classification of pathological sections, but further research is needed[5]. The main purpose of analyzing millions of pixel histological images is to help pathologists predict cancer. At present, most methods are limited to the classification of tumors and stroma. Moreover, most of the existing methods are based on fully supervised learning and require many annotations that are difficult to obtain[98]. Javed et al[98] proposed a new group detection algorithm based on SSL, which could identify six different phenotypes in millions of pixels of image data. Two independent CRC datasets showed that the SSL algorithm was superior to the latest method[98]. ANNs are a class of models inspired by biological NNs, which are used to estimate functions that depend on a large number of general unknown inputs[99]. ANNs are usually shown as interconnected neuron systems, exchanging information with each other. Each connection has a digital weight, adjusted according to experience to make the input flexible and learn[4,9,99]. The establishment of diagnosis models based on ANN is helpful for clinicians to diagnose CRC, predicting postoperative outcomes, and screening high-risk prognosis subgroups[99]. ANNs have a good prospect in the general survey of CRC by establishing a clinical data model. This method is simple, low-cost, and non-invasive[100]. Other studies also described the application of AI in the diagnosis of CRC[101-107].

It is important to increase the sensitivity and specificity of early detection of CRC. First, massive endoscopic image datasets of early CRC should be set, with the early screening performed by colonoscopy and AI automatic recognition system. Second, early identification and timely warning for high-risk groups with a family history can be realized through new media and smartphone software. Third, with many pathological images and optical maps, we can identify whether the cutting edge is negative after endoscopic intervention in real time to adjust the treatment plan in time and avoid secondary surgery. Fourth, the government should establish a timely and effective national physical examination plan through AI to conduct early intervention and treatment for the high-risk population (Table 1).

Table 1.

Artificial intelligence in diagnosis of colorectal cancer

Type of study	Ref.	No. of participants	Method	Control and interventions	Conclusion
Case control study	Yang et al[19], 2019	241	Depth-learning intelligent assistant diagnosis system	By comparing the accuracy of different algorithms on MRI images of patients with CRC, the algorithms that were conducive to the diagnosis of CRC were defined	T2-weighted imaging method had obvious advantages over other methods in differentiating CRC
Analytical research	Liu et al[20], 2011	429	SVM	Compared the performance of new and old classification methods in colorectal polyps CAD system	SVM could help CAD system get excellent classification performance
Review	Regge et al[21], 2013	NA	CAD system	NA	CAD system helped radiologists diagnose CRC with visual markers
Case control study	Summers et al[22], 2008	104	CAD system	The sensitivity of adenoma was measured by CAD system and compared with previous studies	CAD system had high accuracy in detecting and distinguishing adenoma
Descriptive research	Chowdhury et al[23], 2008	53	CAD-CTC system	The sensitivity of CAD-CTC system and manual CTC was compared through the image data of 53 patients	CAD-CTC system could effectively identify polyps and cancers with clinical significance in CT images
Case control study	Nappi et al[24], 2018	196	ResNets	Based on the clinical data of 196 patients, the classification performance of different models in distinguishing masses from normal colonic anatomy was compared	ResNets solved the practical problem of how to optimize the performance of DL
Case control study	Taylor et al[25], 2008	24	CAD system	The effectiveness of CAD system in detecting tumors was tested using the clinical data of 24 patients	CAD could effectively detect flat carcinoma by tumor morphology
Case control study	Summers et al[26], 2010	394	CAD-CTC system	The CTC data sets of 394 patients were trained in CAD system. It was confirmed that the experimental group could reduce the missed diagnosis rate of cancer	CAD-CTC system used advanced image processing and ML to reduce the occurrence of FP results
Case control study	Lee et al[27], 2011	65	CAD system	The CTC data sets of patient polyps were divided into a training data set and a test data set to compare the detection performance of CAD system	CAD system included colon wall segmentation, polyp specific volume filter, cluster size counting and thresholding, which had high detection performance of polyps and cancer tissue
Case control study	Nappi et al[28], 2015	154	DCNN	The clinical data were divided into a training data set and a test data set to compare the polyp detection performance of multiple classifiers	DCNN could greatly improve the accuracy of automatic detection of polyps in CTC
Case control study	Näppi et al[29], 2005	14	CAD system	The clinical data of 14 patients were used to test the effect of different staining methods on the effectiveness of polyp detection	CAD system helped to improve the ability to detect polyps in CTC
Case control study	van Wijk et al[30], 2010	84	CAD-CTC system	The polyp detection performance of different classification methods was tested through the clinical data of 84 patients	The sensitivity of the CAD-CTC system to distinguish polyps over 6 mm was very high
Case control study	Kim et al[31], 2007	35	CAD system	The sensitivity of CAD polyp detection was tested using colonoscopy data of 35 patients	CAD system helped to distinguish polyps and cancer tissue larger than or equal to 6 mm
Case control study	Nappi et al[32], 2017	101	CADe system	The polyp detection accuracy of novel and old CADe systems was compared by colonoscopy data of 101 patients	CADe system could improve the accuracy of detecting serrated polyps or cancer tissues
Case control study	Ma et al[33], 2020	681	Portal venous phase timing algorithm	Training through 479 CT scan data sets; 202 CT scans were used for retrospective analysis and algorithm development and verification	It was helpful to quantitatively describe the characteristics of tumor enhancement
Case control study	Soomro et al[34], 2018	12	3D fully convolutional neural networks	The effects of polyp segmentation and recognition of different models were compared using MRI data of 12 patients	3D fully convolutional neural networks provided a more accurate segmentation result of colon MRI
Case control study	Soomro et al[35], 2019	43	DL	43 patients with CRC were evaluated by MRI. The data set was divided into 30 volumes for training and 13 volumes for testing	DL achieved better performance in colorectal tumor segmentation in volumetric MRI
Retrospective study	Wang et al[36], 2020	240	Faster R-CNN	The Faster R-CNN was trained using pelvic MRI images to establish an AI platform. The diagnosis results of AI platform were compared with those of senior radiologists	It was highly feasible to segment the circumcision positive margin with Faster R-CNN in MRI image of rectal cancer
Retrospective study	Wu et al[37], 2021	183	Faster R-CNN	The MRI data of 183 patients were collected as training objects. The platform was constructed using Faster R-CNN. The diagnostic accuracy was compared with that of radiologists	AI could effectively predict the T stage of rectal cancer
Case control study	Joshi et al[38], 2010	10	Non-parametric mixture model	Compared the accuracy of the algorithm and expert conclusions through the patient's MRI images	The algorithm could be used to distinguish T3 and T4 tumors accurately
Case control study	Shiraishi et al[40], 2020	314	CNN	The prognostic significance was evaluated by CNN based on the expression of tumor markers in 314 patients	CNN could help to evaluate the diagnosis and prognosis of tumor markers
Case control study	Pham[41], 2017	NA	DL	NA	DL could reduce training time and improve classification rate
Case control study	Tiwari[42], 2018	10	CNN	CNN was used to compare the accuracy of image classification methods for seven different tissue types	CNN determined the most suitable color for cancer tissue classification (HSV color space) by classifying tissues in different color spaces
Case control study	Sirinukunwattana et al[43], 2016	100	SC-CNN	Through the comparative evaluation on the image data set of 100 cases of CRC, SC-CNN was helpful to the quantitative analysis of tissue components	SC-CNN can help to predict the nuclear class tags more accurately
Case control study	Koohababni et al[44], 2018	NA	DL	NA	DL could combine the probability maps of a single nucleus to generate the final image, so as to improve the diagnostic performance of complex colorectal adenocarcinoma datasets
Case control study	Zhang et al[45], 2018	NA	Faster R-CNN	NA	Faster R-CNN provided quantitative analysis of tissue composition in pathological practice
Case control study	Xu et al[46], 2016	1376	DCNN	Compared the classification effects of AI and manual methods on the same pathological image dataset	DCNN can help to improve the accuracy of differentiation between epithelial and mesenchymal regions in digital tumor tissue microarray
Retrospective study	Chen et al[47], 2017	85	Deep contour-aware network	The classification performance of different segmentation methods on the same pathological image dataset was compared	Output accurate probability map of gland cells, draw clear outline to separate the originally gathered cells, and further improve the segmentation performance
Case control study	Yoshida et al[48], 2017	1328	An automated image analysis system	The classification results of the same dataset by human pathologists and electronic pathologists were compared	Compared with manual classification, the system had higher classification accuracy
Retrospective study	Saito et al[49], 2013	NA	CAD system	NA	CAD system could be used for quality control, double check diagnosis, and prevention of missed diagnosis of cancer
Descriptive research	Jin et al[50], 2019	NA	AI	NA	AI accelerated the transformation of pathology to quantitative direction, and provided annotation storage, sharing, and visualization services
Case control study	Qaiser et al[51], 2019	75	CNN	The segmentation and recognition effects of different methods on the same pathological dataset were compared	CNN and PHPs can more accurately and quickly distinguish tumor regions from normal regions by simulating the atypical characteristics of tumor nuclei
Retrospective study	Zhou et al[53], 2020	120	DCNN	In the man-machine competition of 120 images, the accuracy of AI and endoscopists was compared	DCNN helped to establish an objective and stable bowel preparation system
Case control study	de Almeida et al[54], 2019	NA	CNN	NA	CNN improved the accuracy of polyp segmentation. It can help to automatically increase the sample number of medical image analysis dataset
Case control study	Taha et al[56], 2017	15	DL	The effectiveness of the DL method for identifying polyps in colonoscopy images was verified on the public database	In the early screening of CRC, it was better than other single models
Case control study	Yao et al[57], 2019	NA	DL	NA	A DL algorithm in HSV color space was designed to effectively improve the accuracy of diagnosis and reduce the cost
Case control study	Bravo et al[59], 2018	NA	Supervised learning model	NA	Supervised learning model could help to detect polyps more than 5 mm automatically with high accuracy
Review	de Lange et al[60], 2018	NA	CAD system	NA	CAD system could eliminate the leakage rate of polyps, thus avoiding polyps from developing into CRC
Case control study	Mahmood et al[61], 2018	NA	CAD system	NA	CAD system combined with depth map could more accurately identify polyps or early cancer tissue
Retrospective study	Mo et al[62], 2018	16	DL	Compared the performance of multiple algorithms in the same dataset	DL was in the leading position in many aspects such as the performance of evolutionary algorithm, and was an effective clinical method
Case control study	Zhu et al[63], 2010	50	CAD system	Through the database of 50 patients, the performance differences of different segmentation strategies were compared	Initial polyp candidates could greatly facilitate the FP reduction process of CAD system
Case control study	Komeda et al[64], 2017	1200	CNN-CAD system	The efficiency of CNN-CAD system was evaluated by maintaining cross validation for 10 times	CNN-CAD system can quickly diagnose colorectal polyp classification
Retrospective study	Zhang et al[65], 2018	18	CNN-CAD system	Through the video of 18 cases of colonoscopy, the efficiency of polyp detection between CNN-CAD system and existing methods was compared	CNN-CAD system can reduce the chance of missed diagnosis of polyps
Case control study	Zhu et al[66], 2019	357	CNN	The diagnostic performance of CNN was trained, fine-tuned, and evaluated using endoscopic data of 357 patients, and compared with that of manual diagnosis	The sensitivity of CNN optical diagnosis is higher than that of endoscopy, but the specificity is lower than that of endoscopy
Retrospective study	Akbari et al[67], 2018	300	FCN	The polyp segmentation method based on CNN was evaluated using CVC ColonDB database	FCN proposed a new method of image block selection and the probability map was processed effectively
Retrospective study	Yu et al[68], 2017	NA	3D-FCN	NA	3D-FCN could learn representative spatiotemporal features, and it had strong recognition ability
Case control study	Yamada et al[69], 2019	4395	AI	The AI system was trained through a large amount of data to make it sufficient to detect missed non polypoid lesions with high accuracy	AI could automatically detect the early features of CRC and improve the early detection rate of CRC
Retrospective study	Lund et al[71], 2019	20	DL	Polyp video dataset was used as training data. At the same time, a 5-fold cross validation method was used to evaluate the accuracy of the system	DL could improve the network training efficiency of polyp detection accuracy
Meta-analysis	Takamaru et al[73], 2020	NA	Endocytoscopy	NA	AI combined with endocytoscopy could greatly improve the efficiency of optical biopsy of CRC
Review	Djinbachian et al[76], 2019	NA	AI	NA	The sensitivity of optical diagnosis based on AI could be comparable to that of experienced endoscopists
Retrospective study	Kudo et al[77], 2019	69142	EndoBRAIN	A retrospective comparative analysis was performed between EndoBRAIN and 30 endoscopists on the diagnostic performance of endoscopic images in the same dataset	In the image of color cell endoscopy, EndoBRAIN could distinguish between tumor and non-tumor lesions accurately
Retrospective study	Mahmood et al[78], 2018	NA	CRF	NA	CRF estimated the depth of the colonoscopy image and reconstructed the surface structure of the colon
Case control study	Jian et al[81], 2018	2772	FCN	Quantitative comparison of manual and AI segmentation results of 2772 cases of CRC in MRI images	FCN was helpful for accurate segmentation of colorectal tumors
Case control study	Sivaganesan[82], 2016	20	RNN-ALGA	In the same database, milestone algorithms such as graph cut and level set were compared with RNN-ALGA algorithm	RNN-ALGA is suitable for abdominal slice of CT image, which can improve the accuracy and time efficiency of structure segmentation
Case control study	Gayathri et al[83], 2015	NA	NN	NA	NN can help to remove the colonic effusion and obtain the ideal colon segmentation effect
Retrospective study	Therrien et al[84], 2018	NA	SVM, CNN	NA	Using multiple datasets to train SVM and CNN could more accurately distinguish CRC staining tissue than single dataset
Case control study	Sun et al[85], 2019	NA	ML	NA	ML increased the chance of recognizing tumor bud by narrowing the region, thus providing effective tissue classification
Case control study	Shi et al[86], 2010	NA	DS-STM	NA	DS-STM could reduce the cost of diagnosis
Case control study	Su et al[87], 2012	212	MVMTM	The training set included 124 cases. The validation set included 88 cases. Comparedthe diagnostic efficiency of different methods for CRC	Compared with the traditional ML method, MVMTM has the advantages of low cost
Case control study	Kunhoth et al[88], 2017	80	Multispectral image acquisition system	A group of 20 samples were selected from 4 different types of colorectal cells. Compared the accuracy of different feature extraction methods	The database developed by this system had high classification accuracy
Case control study	Wang et al[89], 2018	1290	DL	Through the data of 1290 patients, an AI algorithm for real-time polyp detection was developed and verified	Compared with ML, DL could detect polyps in real time and reduce the cost
Meta-analysis	Barua et al[90], 2021	NA	AI	NA	AI based polyp detection system could increase the detection of small non-progressive adenomas and polyps
Randomized controlled study	Gong et al[91], 2020	704	ENDOANGEL system	704 patients were randomly assigned to use the ENDOANGEL system for colonoscopy or unaided (control) colonoscopy to compare the efficiency of ENDOANGEL system with conventional colonoscopy	The system significantly improved the detection rate of adenoma in colonoscopy
Meta-analysis	Lui et al[92], 2020	NA	AI	NA	AI system could improve the detection rate of adenoma and reduce the missed lesions in real-time colonoscopy
Case control study	Rodriguez-Diaz et al[93], 2011	134	A diagnostic algorithm with ESS	80 patients were randomly assigned to the training set, and the remaining 54 patients were assigned to the test set for prospective verification by the new algorithm	The algorithm with ESS reduced the risk and cost of biopsy, avoided the removal of non-neoplastic polyps, and reduced the operation time
Case control study	Kondepati et al[94], 2007	37	ANN	The tumor recognition accuracy of different algorithms was compared by collecting the spectra of cancer tissue and normal tissue	The spectrum was divided into cancer tissue group and normal tissue group by ANN, and the accuracy was 89%
Case control study	Angermann et al[95], 2016	NA	AL	NA	AL helped to realize real-time detection and distinguish between polyps and cancer tissues
Case control study	Ayling et al[96], 2019	619	ColonFlagTM	Through the clinical data of 619 patients, the performance of different systems in detecting CRC and high adenoma was compared	ColonFlagTM could help special patients establish an appropriate safety net
Meta-analysis	Tian et al[97], 2020	4560	EPE	Ten randomized controlled trials were included and 4560 participants were included for meta-analysis	EPE could guide the intestinal preparation of patients undergoing colonoscopy, and improve the detection rate of polyps, adenomas, and sessile serrated adenomas
Retrospective study	Javed et al[98], 2018	NA	QSL	NA	The prevalent communities found by QSL represented different tissue phenotypes with biological significance
Case control study	Wang et al[99], 2019	328	ANN	Different diagnostic models were established by back propagation and other methods, and the performance of each model was evaluated by cross validation test	ANN combined with gene expression profile data could improve the diagnosis mode of CRC
Case control study	Battista et al[100], 2019	345	ANN	The diagnostic performance and FP of the new model were measured in the experimental group (patients with CRC) and the control group (patients with good health)	ANN could help to establish an easily available, low-cost mathematical tool for CRC screening
Review	Zhang et al[101], 2021	NA	ML	NA	ML based on cell-free DNA and microbiome data helped diagnose CRC
Case control study	Wang et al[102], 2021	9631	DCNN	The diagnostic accuracy of AI tools and experienced expert pathologists was compared through the same database	A novel strategy for clinic CRC diagnosis using weakly labeled pathological whole-slide image patches based on DCNN
Review	Jones et al[103], 2021	NA	AI	NA	Electronic health record type data combined with AI could help diagnose early cancer
Case control study	Lorenzovici et al[104], 2021	33	A computer aided diagnosis system	The accuracy of the system in diagnosing CRC was tested through a dataset of 33 patients	The system used ML to improve the accuracy of CRC diagnosis
Review and Meta-analysis	Xu et al[105], 2021	NA	CNN	NA	Through the comparative study of online database, CNN system had good diagnostic performance for CRC
Case control study	Öztürk et al[106], 2021	NA	CNN	NA	CNN was the most successful method that could effectively classify gastrointestinal image datasets with a small amount of labeled data
Review	Echle et al[107], 2021	NA	DL	NA	DL could directly extract the hidden information from the conventional histological images of cancer, so as to provide potential clinical information

NA: Not available; DL: Deep learning; ML: Machine learning; AL: Active learning; QSL: Quasi-supervised learning; CNN: Convolutional neural network; CRC: Colorectal cancer; SVM: Support vector machine; CAD: Computer-aided diagnosis; CTC: Computed tomography colonography; CT: Computed tomography; FP: False-positive rate; DCNN: Deep convolutional neural network; CADe: Computer-aided detection; 3D: Three-dimensional; MRI: Magnetic resonance imaging; AI: Artificial intelligence; R-CNN: Region-based convolutional neural network; SC-CNN: Space-constrained convolutional neural network; PHPs: Persistent homology maps; HSV: Hue, saturation, value; FCN: Fully convolutional network; CRF: Conditional random field; DS-STM: Diagnosis strategy of serum tumor maker; MVMTM: Multiple tumor markers with multiple cut-off values; ANN: Artificial neural network.

USE OF AI IN TREATMENT OF CRC

AI in treatment decision

AI has become an irresistible trend in the medical field[108]. At present, oncologists are familiar with clinical practice guidelines (CPGs) and provide follow-up treatment for patients based on CPGs. On the contrary, physicians may not be familiar with the guidelines[109]. Passi et al[109] developed a decision support system (DSS) that used CRC follow-up data as a source of knowledge to generate appropriate follow-up recommendations for patients. Passi et al[109] designed and proposed the semantic framework of the web application, combining the current web technology and database storage with the designed ontology, and realized the unified development of DSS. Passi et al[109] also designed a web application interface to provide doctors with the functions of CPGs. DSS development could help physicians and nurses provide postoperative care for CRC patients[109]. Watson for Oncology provided oncologists with various cancer treatment suggestions, such as recommended, representing the preferred method; for consideration, not recommended. The absolute consistency of the treatment regimen with the recommendations of the multidisciplinary team of oncologists was studied. Lee et al[110] used Watson for Oncology to process cases and compared the results with the actual treatment received by patients. Key findings included an increased consistency rate after multiple disciplinary team implementation, a low consistency rate in elderly patients, and a high consistency rate in patients receiving chemotherapy. The results proved that Watson for Oncology might be helpful to simulate the effect of multiple disciplinary teams. Using evidence-based guidelines and simplifying treatment pathways, multidisciplinary care could provide best practices[110]. It is crucial to achieving personalized treatment since radiotherapy and chemotherapy are very painful. However, it is impossible to individualize patient treatment because the clinical situation of patients cannot easily link with DNA mutation[111]. Siddiqi et al[111] designed a MATCH system that provided a unique combination of clinical and genetic sequence data and constructed a database for all users. The MATCH system was currently providing hundreds of data samples, including clinical information, tumor markers, proteome sequences, gene inhibitors, etc. The importance of all data attributes and the corresponding processing information were modifiable[111]. Moreover, the system was developed with web services, which guaranteed interoperability among hospitals, pharmaceutical laboratories, and research centers, allowing them to access and exchange samples, information, and data models. The MATCH system helped identify the correlation between medical features so that oncologists could understand each patient’s individual situation[111]. Nanorobots are expected to become intelligent drug delivery systems that respond to small molecular triggers[112]. Felfoul et al[113] developed a nanorobot that could deliver drugs to cancer cells. The robot sensed the concentration of hypoxia and delivered drugs in the “anoxic area” generated by the active proliferation of cancer cells. The robot achieved an accurate effect of attacking cancer tumors[113]. Li et al[112] developed a nanorobot, which could kill cancer cells by releasing procoagulant substances in the cancer tissue, interrupting the blood supply to the cancer tissue. The greatest progress of robots is that it can significantly improve the targeting of chemotherapy drugs and reduce the killing effect of chemotherapy drugs on human normal tissues.

ML in immunotherapy pathway

Computational pathology can help obtain complete and repeatable datasets to promote individualized prediction of immunotherapy. ML can help evaluate the expression of immunohistochemical markers, tumor morphology, and the spatial distribution of tumor-infiltrating lymphocytes. The methylome group features queried by ML are proved to be suitable for predicting the response to immunosuppressive checkpoint inhibitors. Similar to image analysis, this method considers both tumor cells and reactive cells. The immune profiling is detected by spatial analysis and multiplexing of tumor immune cell interaction, and it is used as a predictor of patients’ response to cancer treatment[114]. ML can be used to inhibit the Wnt/beta-catenin signaling, which is beneficial in cancer therapy[115], and it has the potential to provide new therapeutic strategies for patients by recognizing the interaction of tumor cells[114].

AI in endoscopic and surgical therapy

The estimation of the invasion depth is an important step in successfully implementing endoscopic submucosal dissection[116]. At present, narrow-band imaging with magnifying endoscopy is a practical method to estimate the invasion depth of CRC. Lee et al[116] used AI to interpret the cell endoscope images. Processing thousands of images, the algorithm could diagnose more than 90% of invasive CRC in hundreds of images detected[116]. Although the incidence of lymph node metastasis is relatively low, most T1 CRCs still need to undergo colectomy and lymphadenectomy[117]. Ichimasa et al[117] used the data of hundreds of patients in the AI model. The model analyzed 45 clinical and pathological factors and predicted positive or negative lymph node metastasis. The operation specimen is the gold standard of lymph node metastasis. Model validation results showed that patients received many unnecessary surgeries without lymph node metastasis[117]. AI can reduce unnecessary surgeries after endoscopic resection of T1 CRCs by predicting the presence of lymph node metastasis[117].

Compared with open surgery, a minimally invasive one is superior in short-term prognosis and long-term efficacy[118]. With the increasing popularity of laparoscopic surgery, the number of robotic surgeries is also growing. Surgeons can control the robot system 100% and perform more accurate operations at any time[119]. Kim[119] reported an animal experiment in which the effect of using smart tissue autonomous robots was comparable or even superior to open surgery, laparoscopic surgery, or robotic surgery[119]. The smart tissue autonomous robot integrates the sewing tool, robot arm, force sensor, and camera in hardware and software. The robot has the ability to stitch soft tissue. The efficiency of the robot sutured on the plane was 5 times faster than that of the surgeons, and 9 times faster than that of the surgeons using laparoscopic manual tools. Experiments also showed that the stitching robot was more accurate and consistent[120]. Compared with the Da Vinci Si robot system, the new Da Vinci Xi increased more flexibility of operation, and it was expected to promote the performance of multi quadrant surgery[121]. The clinicopathological characteristics and perioperative outcomes of patients with two kinds of robot systems were analyzed. The results showed that the ileostomy rate of Xi group was low, the operation time was short, the amount of bleeding was small, and the recovery was fast[121]. Surgeons can input operation instructions, order medical robots to perform complicated operations, and constantly monitor the operation on the monitor. During the operation, the surgeon can see the anatomical structure without opening the abdomen. Because the fluorescent dye is injected before the operation, the malignant cells and tissues can be visible. As a result, doctors can remove lesions more precisely[119]. Because of the precise recognition and detailed operation of robotic surgery, the learning curve of robotic colorectal surgery is shorter than that of laparoscopic surgery.

Robotic surgeries are beneficial in minimally invasive surgery of tumors, such as high-resolution and stable 3D views, optimal in situ free movement, and elimination of natural tremors[118]. However, in the face of a real surgical suture, the robot exposes its limitations. The complex structure of the human body requires the robot to spend much time processing information about the anastomosis, which is obviously not beneficial in the time-consuming operation. Therefore, improving the image recognition and processing ability of the robot is the right direction to improve and develop the robot’s autonomous stitching[120]. Compared with traditional laparoscopic surgery, robot surgery has some benefits, such as less urinary and sexual dysfunction and less intraoperative blood loss. However, more powerful evidence is needed[122]. Due to the high cost of robot, it will take a while to collect the data of robot surgery. However, as competition can decrease the price of robotic surgical systems, its promotion will be accelerated in the future. In robotic CRC surgery, many limitations have presented, such as the lack of unified technical standards and excessive dependence on surgical robot equipment. The problems will be solved by establishing training system and integrating medicine, research, and production. During clinical studies and large data analysis, robotic surgery will be the new development trend of colorectal surgery[122]. Other studies also described the application of AI in the therapy of CRC[123-127] (Table 2).

Table 2.

Artificial intelligence in treatment of colorectal cancer

Type of study	Ref.	Method	Conclusion
Retrospective study	Passi et al[109], 2015	DSS system	DSS system used follow-up data as a knowledge source to generate appropriate follow-up recommendations for patients receiving treatment
Retrospective study	Lee et al[110], 2018	Watson for Oncology	Watson for Oncology could provide evidence-based treatment advice for oncologists
Retrospective study	Siddiqi et al[111], 2008	MATCH system	MATCH system could provide hundreds of data samples to help doctors choose the most personalized treatment plan
Retrospective study	Li et al[112], 2018	Nanorobot	Nanorobots were relatively safe and immune inert. DNA nanorobots might represent a strategy for precise drug delivery in cancer treatment
Experimental study	Felfoul et al[113], 2016	Nanorobot	The robot achieved an accurate effect of attacking cancer tumors
Review	Koelzer et al[114], 2019	ML	The combination of ML and computational pathology could inform the clinical choice and prognosis stratification of CRC patients
Retrospective study	Lee et al[116], 2019	Narrow-band imaging	Narrow-band imaging helped doctors to predict the histology of colorectal polyps and estimate the depth of invasion
Meta-analysis, Case control study	Ichimasa et al[117], 2018	AI	AI could reduce unnecessary surgery after endoscopic resection of stage T1 CRC without loss of lymph node metastasis
Review	Kirchberg et al[118], 2019	Operation robot	Robotic surgery had great potential, but it still needed high-quality evidence-based medicine
Experimental study	Leonard et al[120], 2014	Smart tissue autonomous robot	Smart tissue autonomous robot was more accurate than surgeons using the most advanced robotic surgical system
Case control study	Huang et al[121], 2019	Operation robot	The operation robot had the advantages of short operation time, low estimated bleeding, and fast recovery after operation
Review	Zheng et al[122], 2020	Operation robot	There were some limitations, such as the disunity of technical standards and the excessive dependence on surgical robot equipment
Review	Mitsala et al[123], 2021	Computer-assisted drug delivery techniques	The technology could help to enhance the sensitivity and accuracy of targeted drugs
Case control study	Aikemu et al[124], 2020	AI	AI provided personalized and novel evidence-based clinical treatment strategies for CRC
Review	Hamamoto et al[125], 2020	AI	AI provided a variety of new technologies for the treatment of CRC, such as surgical robots, drug localization technology, and various medical devices
Review	Pritzker[126], 2020	AI	AI could screen individual biomarkers for comprehensive and individualized treatment of colon cancer with low toxicity
Experimental study	Ding et al[127], 2020	AI	The drug dose optimization technology based on AI could achieve more accurate individualized treatment than traditional methods

AI: Artificial intelligence; CRC: Colorectal cancer; DSS: Decision support system; ML: Machine learning.

USE OF AI IN PROGNOSIS EVALUATION OF CRC

As one of the most common cancers globally, CRC is a result of multi-step and multi-factor action. The key to early diagnosis and improving the overall survival rate is determining the high-risk population[128]. Some related risk factors may increase the possibility of CRC, such as age, lifestyle, personal disease history, and genetic syndrome[129]. In order to establish a risk prediction model of CRC, appropriate feature selection is needed. It is important to identify features with predictive power for taking appropriate interventions to address risks[130]. Each AI technology generates different important attributes to evaluate tumor prognosis based on potential biases and assumptions. Based on the accuracy and the minimum deviation, it is clear that the most significant tumor characteristics are lymphocyte infiltration, Dukes stage, age, and mitotic count[131]. Tumor invasiveness score is a new prognostic factor for predicting tumor stage in colon cancer patients[132]. It helps use ML to increase patient ethnicity in cancer survivability prediction and support personalized general medicine[133]. Most medical studies concentrate on treatment and etiology rather than prediction because prediction tends to be uncertain and risky. The decision tree classifier can predict recurrence or death according to various factors. It is beneficial for doctors to make further treatment decisions and avoid unnecessary treatments[134]. An accurate prognosis is a basis of making an appropriate treatment plan for cancer patients. Because of the heterogeneity of the disease and the inherent limitations of the pathological reporting system, the outcomes are very different for patients in similar stages of pathology. ML used different types of features that could be easily collected from immunofluorescence images to predict phase II mortality, and ML had more accuracy than current clinical guidelines[135].

ML in prognosis evaluation

The molecular subtype of CRC can be used as a prognostic indicator of relapse-free survival rate. The determination of molecular subtype depends on the analysis of hundreds of genes[136]. Popovici et al[136] proposed a method to recognize CRC molecular subtypes from conventional histological images based on an SVM classifier. They used the DCNN to extract the local descriptors and then construct the dictionary representation of each tumor sample. A set of SVM classifiers were trained to solve different binary decision problems. The combined output was used to predict the molecular subtype. The overall accuracy of the results was very high[136]. It was beneficial to improve the accuracy of prognosis prediction. Zhang et al[128] collected genetic variation and environmental information of CRC patients and cancer-free controls, trained the model with the large data, and established a multi-method integrated model. The model could effectively predict CRC risk[128]. The improved heterogeneous integrated learning model and generalized kernel recursive maximum correlation entropy algorithm had higher prediction ability than SVM[128]. ML is used to extract disease prediction models from electronic medical records[137]. ML can also solve many electronic medical record data, such as timeliness, imprecision, and integrity[129,138]. Hoogendoorn et al[137] could extract useful information from consulting notes, and the prediction performance of the ontology-based extraction method was significantly beyond the age and gender benchmark. It has been proved that the best way to predict CRC is by linking medical record texts with medical concepts[137].

The visual estimation of stroma ratio in microscopic images provides a strong predictor of survival rate in patients with CRC[139,140]. However, visual assessment is highly influenced by the observer and interstitial variation. Based on supervised learning, an objective quantitative method of tumor and stroma was established. Compared with the visual estimation of pathologists, the automatic tissue quantitative method was reliable and practical because it provided a new way to evaluate the prognosis and was crucial to predicting the tumor’s survival ability[139]. Wang et al[141] developed a two-stage model to predict the survival of patients with advanced cancer. The first stage predicted whether patients could survive for more than 5 years. The second stage predicted the exact survival time of patients who could not survive for 5 years (in months). With low prediction error and good generalization performance, the two-stage model could help make treatment decisions, improve patient satisfaction, save medical resources, and reduce medical costs[141]. Based on the knowledge representation method of probability, Oliveira et al[142] designed a Clinical Decision Support System (CDSS) which, based on the cancer patients’ records and the precise knowledge of experts, could propose an effective treatment scheme and solve the uncertainty of prognosis after surgery[142]. CDSS could complete four basic tasks: Data organization, data collection, the combination of various principles and specific data, and user-friendly display of analysis results. CDSS screened out appropriate treatment methods from the aspects of curative effect, total survival rate, and side effect rate[143]. By comparing the treatment and prognosis of 250 cancer patients, Aikemu et al[124] found that Watson for Oncology could replace oncologists to provide patients with cutting-edge medical research and knowledge to a certain extent. It was also believed that the use of Watson for Oncology and other decision support tools could help achieve the promise of precision medicine[124].

Although resection of colon polyps can reduce the incidence rate and mortality of CRC by 75%, there is no individualized surveillance plan for polyp recurrence risk. Harrington et al[144] extracted polyp features from colonoscopy and pathological reports. The features extracted from these records and other demographic and anthropometric information were used to develop and compare ML models to predict polyp recurrence. The evaluation of the ML model further emphasized the important characteristics of predicting polyp recurrence from population and health records. RF model could detect patients with a high risk of recurrence and promote frequent follow-ups[144]. It is of great significance for individualized medical treatment. In order to improve the classification of polyps, Xie et al[145] proposed biometric modeling and ML methods to build polyp classifiers and screened the results of colonoscopy in a Chinese formation. The results showed that the RF model could improve the prediction performance compared with other methods[145]. Xie et al[145] also provided evidence that emotional state might be an influential factor in the early growth of CRC in China.

DL in prognosis evaluation

A deep network can directly predict the prognosis of CRC according to the morphological characteristics of tumor tissue samples[61]. Patients with CRC will benefit from the detection of TB, which is a reliable prognostic biomarker. DL can greatly reduce the number of FPs by detecting TB in H&E stained sections[146]. Zhao et al[147] proposed a DL model for automatic tumor-stroma ratio quantification using HE staining images of CRC. The model could eliminate the errors caused by traditional visual evaluation and reduce the work intensity of pathologists. Therefore, Zhao et al[147] believed that the model was suitable for clinical practice and might be helpful for clinical prognosis prediction and decision-making. Multimodal Deep Boltzmann Machine (DBM) is a DL structure used to predict patients' survival time. Syafiandini et al[148] integrated gene expression and clinical data into a new data form. The new data had few eigenvalues. In the multi-mode DBM architecture, these data were extracted from the joint hidden layer to identify gene subtypes, predict the response to a certain treatment, and find the most suitable treatment for patients[148]. Roadknight et al[149] described a dataset on the cellular and physical conditions of CRC patients who underwent surgical resection. These data provided unique immune status information for tumor resection, tumor classification, and postoperative survival[149]. Roadknight et al[149] studied the clustering and ML of these data to prove that the integrated method could predict the prognosis of patients. Compared with SVM, the better way to predict the tumor-node-metastasis stage from immunohistochemical markers is to use the anti-learning method[149]. Compared with other algorithms, the anti-learning method can more accurately predict cancer stage and survival rate from immune attributes[6].

SSL in prognosis evaluation

SSL methods use labeled or unlabeled data and graph regularization to predict patient survival and cancer recurrence[150,151]. The data of gene expression is transformed into the graph structure of SSL, and the data of protein interaction and gene expression are integrated to select gene pairs[151]. SSL methods can result in more accurate prediction than traditional SVM[11,150]. Recognition of cancer-related mutations is essential for understanding the cancer genomes that cause cancer gene activation or tumor suppressor gene inactivation[152]. Du et al[152] proposed a new feature selection method based on supervised learning that could identify gene mutations. The model was composed of the best features in candidate features’ set with rotation forest. The method had a high accuracy and high prediction performance[152]. Chi et al[153] used the semi-supervised logistic regression method to establish the clinical prediction model of CRC survival risk. The performance of the model was strictly compared with that of other supervised learning models[153]. The model of CRC survival risk prediction established by the SSL method had good correction ability, popularization, interpretability, and clinical practicability. Other commonly used supervised learning methods, such as SVM, RF, and NN, showed poor calibration performance[153]. The SSL model might have more potential to develop a better risk prediction model in the actual clinical environment than the supervision model[153].

Other algorithms of AI in prognosis evaluation

The CRC recurrence support (CARES) system guided the prognosis by comparing the patients with new CRC and those with previous CRC to determine the high-risk group. As a result, only high-risk patients could receive more stringent examinations with reduced medical costs, while low-risk patients could be free from frequent and unnecessary examinations[154]. Immune cores could predict the prognosis of patients with colon cancer, and AI could detect additional prognostic markers on pathological sections. Digital tumor parameters (DGMate) were used to detect the digital parameters related to prognosis in tumor cells. The higher density of CD3+ tumor core, CD3+ invasive margin, and CD8+ tumor core was found, and the longer relapse-free survival was reported. CD3+ tumor core had a similar value to the classical CD3/CD8 immune core in prognosis. It was indicated that AI could help pathologists determine the prognosis of patients with colon cancer, which might improve patient treatments[155]. The existing methods describe the coordination among multiple genes by the additive representation of expression spectrum and use a fast heuristic method to identify the disjointed subnetworks. The methods may not be suitable for the potential combination of the disjointed genes[156]. Chowdhury et al[156] designed the Crane algorithm to solve this problem and proposed that the Crane algorithm was better than the addition algorithm in predicting CRC metastasis. In addition, AI could also be used to build CRC education software, whose menu contained an introduction, signs and symptoms, risk factors, preventive measures, and CRC screening procedures. The education software could achieve publicity and popularization of common sense through the communication between clinicians and patient representatives[157]. Other study also described the application of AI in the prognosis of CRC[158] (Table 3).

Table 3.

Artificial intelligence in prognosis evaluation of colorectal cancer

Type of study	Ref.	Method	Conclusion
Case control study	Zhang et al[128], 2017	Heterogeneous ensemble learning model	Heterogeneous ensemble learning model could use big data to identify high-risk groups of CRC patients
Retrospective study	Morgado et al[129], 2017	Decision support system	Decision support system could evaluate the risk of CRC by processing incomplete, unknown, or even contradictory data
Case control study	Anand et al[131], 1999	Intelligent hybrid system	Each AI technology produced a different set of important attributes. Intelligent hybrid system would be the trend of prognosis evaluation in the future
Case control study	Gupta et al[132], 2019	ML	ML could help to predict tumor stage and survival period
Case control study	Li et al[133], 2018	ML	Combining ML and database, clinicians might add race factor to evaluate prognosis
Case control study	Barsainya et al[134], 2018	Decision tree classifier	Decision tree classifier could predict recurrence and death according to various influencing factors
Cohort study	Dimitriou et al[135], 2018	ML	A framework for accurate prognosis prediction of CRC based on ML datasets
Case control study	Popovici et al[136], 2017	SVM	The accuracy of using SVM to distinguish CRC subtypes was very high
Experimental study	Hoogendoorn et al[137], 2016	AI	AI helped doctors to extract useful predictors from non-coding medical records
Experimental study	Kop et al[138], 2016	ML	The combination of ML and electronic medical records could help early detection and intervention
Case control study	Geessink et al[139], 2015	Supervised learning	Supervised learning helped to predict the survival ability of tumor, so as to accurately stratify the prognosis of tumor patients
Review	Wright et al[140], 2014	RF	RF could reduce the workload of pathologists by automatically calculating the area ratio of each slide
Meta-analysis	Wang et al[141], 2019	A two-stage ML model	Compared with the single-stage regression model, the two-stage model could obtain more accurate prediction results
Experimental study	Oliveira et al[142], 2013	CDSS	CDSS based on cancer patients records and knowledge could provide support for surgeons
Meta-analysis	Lo et al[143], 2000	CDSS	CDSS could select the appropriate treatment from the aspects of curative effect, overall survival rate, and side effect rate
Case control study	Harrington et al[144], 2018	ML	ML could be used to predict the risk of recurrence of colon polyps and cancer based on the pathological characteristics of medical records
Case control study	Xie et al[145], 2018	RF model	RF model helped to speculate the influencing factors of early CRC in China
Retrospective study	Bokhorst et al[146], 2018	DL	DL helped reduce FP by detecting tumor bud
Cohort study	Zhao et al[147], 2020	DL	The method allowed objective and standardized application while reducing the workload of pathologists
Retrospective study	Syafiandini et al[148], 2016	DBM	DBM helped to predict the survival time of cancer patients
Retrospective study	Roadknight et al[149], 2013	ML	ML helped predict the prognosis of patients according to the immune status and other information
Case control study	Cui et al[150], 2013	SSL	SSL improved the accuracy of predicting clinical results according to gene expression profile
Retrospective study	Park et al[151], 2014	SSL	SSL could improve the accuracy of predicting cancer recurrence
Retrospective study	Du et al[152], 2014	Supervised learning	Supervised learning could help to improve the accuracy of identifying cancer-related mutations
Case control study	Chi et al[153], 2019	Semi-supervised logistic regression method	Semi-supervised logistic regression method had better clinical prediction effect than supervised learning method
Review	Ong et al[154], 1997	CARES system	CARES system helped early detection of cancer recurrence in high-risk patients
Case control study	Reichling et al[155], 2020	DGMate	DGMate could judge the prognosis of tumor by detecting immunophenotype
Experimental study	Chowdhury et al[156], 2011	Crane algorithm	Crane algorithm helped to describe the coordination of multiple genes and effectively predicted the metastasis of CRC
Review	Mohamad et al[157], 2019	Nominal group technique	Nominal group technique was used in the content development of mobile app and the app used as a tool for CRC screening education
Retrospective study	Hacking et al[158], 2020	AI	AI could improve the prognosis of patients by increasing the diagnostic accuracy of slide images

CRC: Colorectal cancer; AI: Artificial intelligence; ML: Machine learning; SVM: Support vector machine; RF: Random forest; CDSS: Clinical Decision Support System; DBM: Deep Boltzmann Machine; SSL: Semi-supervised learning.

DISCUSSION

AI plays an important role in the fields of computer, internet, and vehicle engineering. The four main directions of future medical development are “personalization, precision, minimal invasion, and remoteness”[159]. In the field of medicine, first, AI gradually shows its advantages in disease diagnosis, treatment, and prognosis. CRC is one of the common human cancers, and its early diagnosis and standardized treatment have a profound impact on the prognosis. The development of AI for CRC has gone through the following stages: (1) Understanding cancer at the molecular and cellular levels through DL; (2) Assisting in the diagnosis of CRC according to images and pathological specimens; (3) Clinical drug designing and screening; and (4) Promoting the individualization of CRC diagnosis and treatment[159]. The diagnosis of CRC is mainly divided into imaging diagnosis and pathological diagnosis. Most of the imaging datasets are objective datasets with a high degree of information standardization. The CAD system based on DL realizes the automatic analysis and optimization of diversified images by extracting features from experts, extensive image training, making classification rules, and establishing mathematical models. Second, AI is beneficial to medical image analysis. Highly efficient image processing and analysis speed can quickly give auxiliary judgment results. Good sensitivity can reduce the missed diagnosis rate. Expert knowledge learning and quantitative data analysis can improve the quality of the basic inspection. Third, in clinical pathology, many digital sections of CRC have been accumulated, and some have been preliminarily developed with the technology of image recognition and DL. However, at present, AI cannot be separated from the auxiliary role. AI application at the functional level mainly includes disease diagnosis support and treatment decision support. The development of disease diagnosis support is active in treatment decision support. Advanced technologies are integrated with medicine and gradually play a necessary role in assisting diagnosis and early screening of major diseases.

Although AI is developing rapidly, it is still in the experimental stage and still faces many development bottlenecks. For example, first of all, the development of AI overemphasizes “probability association,” but diseases always exist in unknown areas. How to combine data and medical knowledge is the key to the development of image AI. Second, AI-based DL requires much label data for training. Although labeled data has more influence on training results than algorithms, high-quality data acquisition for training is a big problem. Third, the image data standardization is low. The level of image system interaction operation in different hospitals is low. Moreover, the datasets of each imaging system are scattered all over the country with a low level of interaction. Forth, the difficulty of data annotation is great. The AI training requires a large amount of labeled image data, and the annotation needs to spend a lot of manual costs, which directly impacts the training results.

Meanwhile, the “black box” problem in ML raises several concerns clinically. ML can help read imaging and pathological pictures, recommend diagnosis and treatment options, and predict prognosis. However, due to the “black box” problem, the clinical application of AI tools progressed slowly. To further develop AI medicine, it is necessary to improve the interpretability of ML algorithms. The small steps of biological interpretation and clinical experience in ML algorithm can gradually solve the “black box” problem. In order to solve the above problems, data preprocessing is needed to complete the standardization, which requires the integration and fusion of heterogeneous data sets, such as images, physiological data, and information texts. At the same time, automatic software is used to analyze the medical image data quantitatively and extract a large number of features, including texture analysis, shape description, and other quantitative indicators.

The treatments for CRC are mainly surgery and chemotherapy. AI enables individual precision medicine by selecting appropriate treatment measures through big data analysis and comparison. At the same time, the development of robot technology provides a guarantee for the high accuracy of surgery and the high targeting of chemotherapy drugs. However, the quality of the data collection is still not enough to support AI to make treatment decisions independently. The complexity of the human body also reduces the speed of analysis and decision-making of AI in operations. In addition, robots cannot be widely used because of the high economic cost. Patients are often afraid of the unknown survival period after surgery, so giving a specific survival period can eliminate the psychological burden of patients. AI can predict the survival time and recurrence risk through patient information, surgery, and pathology and guide patients’ prognosis and nursing. Therefore, high-quality, accurate data and standard operating specifications are required. In other words, the accuracy of prediction risk depends on the quality of the prognosis data, which in turn depends on the quality of data generated by diagnosis and treatment.

As diagnostic technology evolves, the information available to doctors is becoming more and more complex. In terms of treatment, new drugs are constantly developed, and new treatment schemes and methods are emerging. It is challenging for busy clinicians to have enough time and energy to obtain, screen, and use the information. With the continuous development of AI technology and image recognition, and the continued improvement of other aspects, AI will play an important role in CRC diagnosis and treatment. Therefore, the establishment of an AI standard system will be the top priority of future development. The standardization of images, features, medical record information, and other datasets will improve the accuracy of diagnosis and treatment. DL and ML will fully be combined to enable robots to complete surgery independently. Medical services include not only medical technology but also the guidance of patients’ mental health. In the future, robots will provide nursing and adjust the psychological state of patients. However, moral and ethical issues must be well considered for the proper use of AI robots in today’s medical environment.

Various countries have been trying to establish ethical, legal, and regulatory compliance standards for AI development. But there are many difficulties before fully accepting AI robots. First, patients’ trust and acceptance will become an important factor in developing AI robotic surgery. The “black box” that has been used in many non-surgical applications has little theoretical transparency. In the medical field, lack of transparency impairs the doctors and patients' trust and acceptance of AI. Second, the safety of AI robot surgery is still an important issue to be concerned. The development of AI robot surgery involves a series of security problems, such as patient information protection, network security, robot autonomy, and machine failure. If the control of the AI robot is lost due to external factors such as network transmission delay and hacker attack, the immeasurable loss will happen. Third, the responsibility attribution of medical malpractice remains a problem. Given the limitations of AI robots, the issues of medical malpractice responsibility will lead to a debate about the gray area of law. The solution of this problem will boost AI development[160].

CONCLUSION

Currently, AI is in the era of weak AI and does not have communication capabilities. Therefore, the current AI technology is mainly used for image recognition and auxiliary analysis without in-depth communication with patients. With the continuous development of AI technology, the role of AI in the diagnosis and treatment of CRC will continue to increase until the robot can complete surgery independently. At that time, AI will change the medical technologies and even the medical model.

ACKNOWLEDGEMENTS

We thank the anonymous referees for their useful suggestions.