Abstract
Accurate placement of the endotracheal tube (ETT) is critical for ensuring optimal care for patients requiring mechanical ventilation and preventing potential complications. ETT positioning can be assessed using several methods, with chest X-ray (CXR) being the most precise. Radiologists evaluate whether the ETT requires adjustment by measuring the distance between the distal tip of the ETT and the tracheal carina. This study presents the development of a machine learning model to detect and measure ETT position on adult CXRs and evaluates its performance. Six physicians annotated ETT and trachea locations on a dataset of 3856 CXRs. The U-Net-based model was then trained to generate trachea and ETT segmentations. After post-processing steps, an estimate of the distance between the distal tip of the ETT and the tracheal carina was found. It was demonstrated that the trained model is capable of estimating the position of the ETT and calculating the distance from the tube tip to the tracheal carina. The Dice index for the segmentations on the external validation subset for the trachea and ETT was 89.2% ± 9.0% and 87.8% ± 16.9%, respectively. The estimated absolute error on the external validation subset was 4.72 mm. This model represents a promising tool to support clinicians, particularly in Intensive Care Units, where correct intubation and effective ventilation are critical. It may also be integrated into clinical workflows to facilitate patient management and enhance patient safety.
Keywords: Endotracheal tube, Artificial intelligence, Deep learning, Chest X-ray, Trachea, Intubation
Subject terms: Computational biology and bioinformatics, Diseases, Health care, Mathematics and computing, Medical research
Introduction
Endotracheal intubation (ETI) is a demanding procedure commonly performed in emergency medicine, anesthesiology, and intensive care. It is a life-saving advanced airway management technique used in critically ill patients1. Proper endotracheal tube (ETT) placement is essential for optimal patient outcomes.
Complications associated with incorrect ETT positioning depend on the insertion depth. Excessive advancement into a mainstem bronchus may lead to ineffective mechanical ventilation, hemodynamic instability, pneumothorax, or even pneumonia2. In contrast, a tube positioned too proximally increases the risk of accidental extubation, gas leakage, and laryngeal injury, including vocal fold edema, subglottic stenosis, vocal cord paresis or paralysis, and, in severe cases, permanent aphonia1,3.
The gold standard for confirming tracheal intubation is end-tidal CO₂ measurement. However, accurate assessment of ETT depth requires chest X-ray (CXR), as auscultation alone is insufficient to reliably exclude bronchial intubation. Brunel et al. reported that up to 60% of mainstem bronchial intubations in intensive care unit patients occurred despite apparently symmetrical breath sounds4.
The development and ongoing advances in artificial intelligence (AI) and neural networks have created opportunities to automate radiological assessment and improve workflow efficiency. With the use of AI, the assessment of ETT positioning could be performed more rapidly and without the direct involvement of anesthesiologists or radiologists, reducing the clinical workload and potentially supporting safer patient care.
The aim of this study was to evaluate whether the neural network can accurately determine correct ETT placement based on the distance between the ETT tip and the carina.
Related work
In recent years, numerous original solutions employing deep learning algorithms have been proposed in the literature. To date, no model has been registered for autonomous medical use or as an auxiliary tool. However, the results of some studies are highly promising. Various strategies for addressing the problem can be observed. The works included in the literature review can be divided into two groups. The first group comprises methods aimed at classifying the correctness of intubation. The second group includes methods that estimate the distance between the ends of the analyzed objects, whose operating mechanisms and result presentation are similar to those adopted in this study.
Classification-based quality assessment
Researchers from National Taiwan University, Chih-Hung et al.5, used data collected from their own clinical facilities and applied the DeepLabv3 and ResNet50 architectures. The obtained Dice coefficients were also high. For the NTUH-20 dataset, the results were as follows: 85.4% (82.4% to 88.1%) for the endotracheal tube and 78.5% (77.8% to 79.2%) for the trachea. For another dataset, NTUH-Yulin Branch, the corresponding results were 83.9% (82.0% to 85.7%) and 76.8% (75.9% to 77.6%), respectively.
Brown et al.6 proposed a model to verify endotracheal tube positioning by determining the spatial relationships among segmented anatomical structures. The endotracheal tube, trachea, and carina were subjected to segmentation. The safety zone was defined as the area within the trachea where the ETT tip is located between 3 and 7 cm above the carina. If the ETT is located outside this region, the model issues a warning indicating incorrect positioning. The model achieved 95% accuracy in detecting the tube, and the precise location of the tube tip was provided in 86% of cases.
Similarly, in the study conducted by Jung et al.7, the distance between the ETT tip and the carina was assessed, and chest X-rays were divided into four groups: no ETT, shallow placement greater than 7 cm, correct placement between 3 and 7 cm, and deep placement less than 3 cm. Segmentation of the ETT and trachea was performed using binary masks. Both labeled structures were divided into smaller segments. The dataset consisted of 1985 chest X-rays, of which only 1094 contained an endotracheal tube. In fivefold cross-validation, the Dice index for the trachea averaged 84.1% (SD 6.3%), and for the endotracheal tube, it averaged 89.3% (SD 7.8%). The classification model achieved an F1 score of 88.9% for automatically categorizing the studies into four groups.
Another interesting approach was presented in the study by Yuan et al.8. During segmentation, regions of interest were extracted, including four points: the right and left clavicle heads, the carina, and the ETT tip. A total of 12 models were trained, with the best one (VGG16) achieving an AUC of 92%.
Tsai et al.1 in their study also used the positions of the right and left clavicle heads to assess whether the head position during X-ray imaging was neutral. This ensures repeatability of results, as head position and neck rotation influence the placement of the ETT. Other reference points used included the jaw and the C7 vertebra. Their model achieved an AUC value of 93.8%.
Distance estimation methods
In the study by Kara et al.9, the correctness of intubation was assessed by measuring the distance between the ETT tip and the carina, and a two-stage approach was proposed. First, regions of interest were identified, and then specific points representing the tube’s end and the tracheal bifurcation were localized. The study was conducted on 17,050 images from the MIMIC-CXR v2 database and the Beth Israel Deaconess Medical Center in Boston. Validation results showed that the mean error in predicting the location of the tracheal bifurcation was 6.4 mm with a median of 4.6 mm, and for the ETT tip it was 8.2 mm with a median of 6.0 mm.
In the study by Harris et al.10, 2862 images with an endotracheal tube and 755 without were used. The data were split into 90% for training and 10% for validation. A modified YOLO-v3 architecture was applied, using rectangular bounding boxes instead of segmentation. The center of the rectangle indicated the carina, and the bottom edge marked the ETT tip. The mean and median differences relative to reference measurements were 7 mm and 5.3 mm, respectively, with a maximum value reaching 57.7 mm. The data did not follow a normal distribution.
The team of Lakhani et al.2 in the Department of Radiology at Thomas Jefferson University Hospital developed a method based on the Inception V3 network to classify the position of the ETT relative to the tracheal bifurcation. A total of 22,960 images from 11,153 patients were used, with a mean age of 60.2 years. The images were divided into training (80%), validation (10%), and test (10%) sets. The model assigned each image to one of 12 classes: 2 represented extreme positions, and the remaining 10 corresponded to distances from 1 to 10 cm. The mean difference between the model and radiologists was 6.9 mm for the internal dataset and 6.3 mm for the external one.
The strategy of estimating the distance between the tips of the ETT and the trachea was also applied by Huang et al.11. The ETT was marked by a quadrilateral with vertices P1 to P4, and the trachea was marked by a polygon with vertices P5 to P13. The data were collected at Cheng Kung Hospital. The dataset included 1842 images of patients lying on their backs. Fourfold cross-validation was used along with a model based on Mask R-CNN. Characteristic points were determined based on the segmentation, and the distance error between the tube and the bifurcation was 3.9 mm in the range of 1.8 to 7.1 mm for the training set and 4.2 mm in the range of 1.7 to 7.8 mm for the validation set. The study emphasized that the accuracy of the algorithm was comparable to clinician assessments.
Oliver et al.12 performed segmentation of X-ray images to detect and evaluate the ETT by edge detection and pixel clustering. Annotators then classified the images based on criteria including quality assessment, pixel coordinates of the ETT tip, pixel coordinates of the carina, and classification of the ETT tip position relative to the carina. A threshold value of 2 cm was used to indicate too low a position of the ETT. This model achieved an interrater agreement for the ETT-carina distance worth 6 mm, and the mean absolute error of the model was 8.9 mm for predicting the ETT-carina distance.
Materials and methods
Quality assesment
With the aim of improving the reporting of studies involving AI, the study was evaluated according to the MI-CLAIM13. The items were grouped into six categories: study design (category 1), data and optimization (categories 2 and 3), model performance (category 4), evaluation of the model in clinical practice (category 5), and reproducibility (category 6). In each category, several elements were assessed, for which points were awarded or not. An item was scored as 0 if it was not described in the text, 0.5 if it was partially addressed in the article, and 1 if it was fully addressed. The total score was 15, indicating high quality of the conducted study. To assess Prediction Model Development and Validation, the TRIPOD Checklist14 was used.
Dataset
Participants, source of data and eligibility criteria
The original dataset consists of anonymized chest X-rays (CXR) of adult patients of both sexes, with no upper age limit, performed in the anteroposterior (AP) projection in the supine position, who were intubated and treated in the Intensive Care Unit (ICU). The images originated from two hospitals located in southern Poland. Data were collected between 2016 and 2021. The dataset comprised a total of 5684 CXRs. The images originate from two institutions: the University Clinical Center named after Professor K. Gibinski of the Medical University of Silesia in Katowice (UCK) and the Multispecialty District Hospital S.A. named after Dr. B. Hager in Tarnowskie Gory (TG).
The method for automatic distance estimation was developed after the data collection process had been completed. Therefore, the experts who performed the segmentation and determined the characteristic points used to create and evaluate the method did not have access to it.
Segmentations
Segmentations were performed on all available CXR images: 5684 of the trachea and 1647 of the ETT. The segmentations were created by six individuals with medical degrees at varying levels of medical education. All were associated with radiology. Annotations were made using the tool 3D Slicer V515 equipped with a custom plugin. Independent verification of the annotations was carried out by a radiology specialist with 10 years of professional experience.
Image segmentation involved manually annotating the trachea and ETT on separate layers. The dataset then underwent three independent validation rounds, during which identified errors and omissions were corrected after each review to ensure annotation quality.
Examples of segmentations applied to radiographs from the dataset are presented in Fig. 1.
Fig. 1.

Selected examples from the original dataset with overlaid segmentation.
The X-ray images from UCK were divided into three subsets: training, validation, and hold-out. The data from TG were kept as an independent external hold-out set. The sizes of the created datasets are presented in Table 1.
Table 1.
Subset counts for trachea and endotracheal tube.
| Object | UCK | TG | ||
|---|---|---|---|---|
| Training | Validation | Hold-out | External hold-out | |
| Trachea | 3150 | 1350 | 374 | 810 |
| ETT | 520 | 224 | 100 | 803 |
Gold standard
To establish the gold standard for the location of the endotracheal tube in the trachea, six researchers independently marked the point at the tip of the ETT and the tracheal carina on 1261 CXR images with a visible tube. These independent markings were retained directly for analysis without further consensus derivation. A total of 347 annotations were made on CXR images from UCK and 914 from TG. The segmentation was performed using the Slicer 3D V5 program15. The established gold standard was used to compare the distances calculated by the neural network with the measurements made by physicians. Both proper and improper ETT placement cases were included in the gold standard to better assess the proposed method’s performance. Several random samples of physicians’ segmentations and measurement points, overlaid on the corresponding CXR, are shown in Fig. 2.
Fig. 2.

Characteristic points and segmentations annotated by clinicians overlaid on corresponding CXR from the gold standard.
Data cleaning
The first stage of data cleaning involved standardizing tracheal segmentations. Some annotations included fragments of the main bronchi below the bifurcation, creating multiple regions for the same object and unnecessarily increasing task complexity. Therefore, the main bronchi were removed from the segmentations (Figs. 3 and 4).
Fig. 3.

Example of trachea segmentation standardization.
Fig. 4.

Pipeline of pre-processing of original images.
In the second stage, examples of pairs of characteristic points that were inconsistent with their corresponding expert segmentations were removed (Figs. 5 and 6). For this purpose, the method described in the subsection Characteristic point detection was applied to the expert segmentations. The distances between the manually marked characteristic point and the one detected based on the segmentation were presented using a histogram portrayed in Fig. 7. Based on the observed decrease at 10 mm, pairs with distances exceeding this threshold were excluded. As a result, the number of manually annotated characteristic point pairs was reduced to 202 from UCK and 530 from TG.
Fig. 5.

Example of post-processing workflow for trachea segmentation.
Fig. 6.

Diagram illustrating the geometric interpretation of the characteristic point detection method.
Fig. 7.

Histograms of distances between points obtained from segmentation and characteristic points defined by experts.
Preprocessing
The CXR images underwent preprocessing: outlier values were removed (based on the 0.0025 and 0.9975 percentiles), and pixel intensities were rescaled to the range [0, 1], thereby enabling image standardization and eliminating white annotations. Next, using a previously trained CNN model, the lung region was determined and used to crop the image to the region of interest. Finally, the images were rescaled to 512 × 512 px. The pipeline was adapted from the CIRCA team’s implementation16. An example of an image undergoing the preprocessing steps is shown in Fig. 4.
The final step of preprocessing involved cropping the expert segmentations to the lung region corresponding to their radiograph and rescaling them to 512 × 512 px using nearest-neighbor interpolation.
Creation of segmentation models
The segmentation models were built using the UNet architecture. This architecture is widely used for medical segmentation problems due to its efficiency and the quality of models it produces. The input size was set to 512 × 512 px. By using appropriate padding in the convolutional layers, the network’s output size was made equal to the input size.
Two models were trained independently. The first specialized in trachea segmentation, the second in endotracheal tube (ETT) segmentation. As the loss function, an adaptation of the Dice index17, hereinafter referred to as the Similarity Index (SI), was used. It is adjusted for continuous values of both the ground-truth and predicted segmentations. The SI is defined by Formula 1.
![]() |
1 |
The Adam optimizer (adaptive moment estimation) was used. The initial learning rate was
. The batch size consisted of 3 preprocessed CXRs. The training history of the model’s quality metrics is shown in Fig. 8.
Fig. 8.

History of the loss function values and additional quality metrics during training.
In many CXRs in the dataset, the patient is slightly rotated. To make the model more robust to such cases, for each example in the training set, four augmented versions were added, each rotated by an angle from the set {− 10°, − 5°, 5°, 10°} with respect to the image center. Model quality was assessed using the Dice index, comparing the binarized prediction with the corresponding segmentation from the dataset.
Postprocessing
To be able to determine characteristic points from the model’s predictions, it was necessary to transform them. Continuous values and disjoint areas are not conducive to precisely locating the tip of the endotracheal tube (ETT) and the tracheal carina.
The first step of the final processing was binarization of the prediction results. For this purpose, an analysis was conducted to determine the optimal discretization threshold. Within the training and validation sets, different threshold values in the range < 0; 1 > were tested with a step of 0.001. For each value, the predictions were binarized, after which the Similarity Index was calculated; its mean and standard deviation were determined for individual examples. The final threshold was chosen to maximize the mean value of the Similarity Index.
After binarization of the predictions, fragmented segmentations were handled. First, using the eight-connectivity rule, separate regions in the resulting segmentation were identified. Then their surface areas were calculated, and only the largest region was retained. The processing steps described are shown in Fig. 5.
The processed network segmentations enabled the calculation of the Dice coefficient. Its values were aggregated for all datasets. The results were presented by performing descriptive statistics of the distribution of these values. The segmentation quality results were collated in Table 2.
Table 2.
Numerical values of Dice coefficient statistical analysis.
| Object | Dataset | Count | mean (%) | sigma (%) | q1 (%) | median (%) | q3 (%) | Lower limit (%) | Upper limit (%) | skew | kurt |
|---|---|---|---|---|---|---|---|---|---|---|---|
| Trachea | Training | 3150 | 92.5 | 6.1 | 91.2 | 94.0 | 95.6 | 92.3 | 92.7 | − 6.04 | 64.2 |
| Validation | 1350 | 92.6 | 5.5 | 91.5 | 94.0 | 95.7 | 92.3 | 92.9 | − 3.49 | 17.8 | |
| Hold-out | 374 | 91.0 | 8.9 | 90.1 | 93.0 | 95.4 | 90.1 | 91.9 | − 4.86 | 33.3 | |
| External hold-out | 810 | 89.2 | 9.0 | 86.7 | 92.0 | 94.7 | 88.6 | 89.8 | − 3.26 | 16.1 | |
| ETT | Training | 520 | 91.7 | 8.8 | 90.1 | 94.0 | 96.1 | 90.9 | 92.4 | − 5.73 | 48.7 |
| Validation | 224 | 91.3 | 10.6 | 91.5 | 94.0 | 96.0 | 89.9 | 92.7 | − 4.88 | 31.4 | |
| Hold-out | 100 | 89.2 | 12.2 | 87.7 | 93.0 | 95.4 | 86.8 | 91.6 | − 4.67 | 29.7 | |
| External hold-out | 803 | 87.8 | 16.9 | 88.3 | 93.0 | 95.7 | 86.7 | 89.0 | − 3.69 | 14.6 |
Characteristic points detection and distance estimation
The procedure for determining characteristic points was based on the centerline of the processed prediction. This line was obtained using a morphological operation—skeletonization.
In the first step, the lowest image row containing a skeleton pixel is identified. The x-coordinate of the characteristic point is determined from the active pixel in this row or, if multiple pixels are present, from the average position of the extreme pixels. The y-coordinate is then established by extending a vertical line downward from this centerline point to the lower boundary of the prediction area. The intersection defines the final characteristic point. This procedure was applied to both endotracheal tube and tracheal predictions. Figure 6 illustrates the subsequent stages of characteristic point detection performed by the algorithm.
The points identified in this way in the image were represented in millimeters using information from the DICOM standard on the physical pixel size. The result of the estimation is the Euclidean distance between these points (Figs. 9 and 10).
Fig. 9.

Example images with expert segmentation overlaid on the model prediction.
Fig. 10.

Graphs showing the selection of pixel intensity threshold for trachea and ETT predictions.
The analysis of characteristic point detection was carried out by comparing the detected points with manually marked reference points defined by researchers. One of the stages of the analysis was calculating the Fréchet distance between the segments determined by the automatic method and the expert. For this measure, descriptive statistics were performed, and the distribution was presented as a histogram in Fig. 11.
Fig. 11.

Histogram and density curve for Frechet distances.
The relative positions of the points, determined automatically and by physicians, were also analyzed. A statistical analysis of the distances between these pairs of points was conducted. Additionally, the data were visualized in scatter plots, divided into very good (Fig. 12) and lower-quality (Fig. 13) segmentations. Each dot on the plot represents the result of subtracting the vector describing the expert’s point from the predicted point. To improve the interpretability of dense clusters, contour plots were included. Outliers in the Dice index were removed from the plots mentioned.
Fig. 12.

Scatter and contour plots of relative positions of points compared to expert annotations for examples with a Dice coefficient > 90%.
Fig. 13.

Scatter and contour plots of relative positions of points compared to expert annotations for examples with a Dice coefficient < 90%.
To assess distance estimation accuracy, the absolute errors of the estimated distances between the endotracheal tube and the trachea were calculated, comparing the automatic method with the physician’s evaluations. The study was carried out on the external validation set.
Results
Data cleaning
Histograms of distances between the characteristic point from the gold standard and the point determined using the method described in the chapter “Characteristic points detection and distance estimation” showed a pronounced drop in the number of examples at 10 mm. Those histograms are portrayed in Fig. 7.
Segmentation
During training, the best trachea segmentation model was obtained in the 7th epoch, whereas the best endotracheal tube segmentation model was obtained in the 15th epoch. The training progress for both models is presented in Fig. 8, with separate plots for trachea and endotracheal tube metrics. Accuracy and Intersection over Union (IoU) values collected during training are also included.
For both models, the loss function quickly reached low values. Visually, the segmentation results were correct. When overlaid on the original radiographs, the predictions matched the expert segmentations in most cases. The overlaid model’s and expert’s segmentation were portrayed in Fig. 9
The optimal binarization thresholds for the predictions were identical for both the endotracheal tube and the trachea, at 0.479. Plots in Fig. 10 show the relationship between the mean similarity index and the pixel intensity threshold for each object.
For trachea segmentation, the maximum mean similarity index (SI) for the selected threshold was 0.898; for the endotracheal tube, it was 0.884. Aggregated Dice coefficient values across the dataset subsets indicated high similarity between expert annotations and the model predictions. These results are presented in Table 2, broken down by object type and dataset split.
The distributions of the collected similarity index values are strongly negatively skewed for both the trachea and the endotracheal tube across all dataset subsets. The drop in quality observed in the external validation sets is negligible.
Characteristic point detection and distance estimation
The distribution of Fréchet distances is positively skewed, indicating a predominance of high similarity between the segments determined by the experts and those produced by the proposed method. The histogram with density curve and descriptive statistics is portrayed in Fig. 11.
Descriptive statistics of the distances between points identified by experts and those obtained using the developed method showed strong agreement between the two approaches. The results are summarized in Table 3. In the external hold-out dataset, the mean difference between the automatically detected and expert-annotated carina points was 5.71 ± 7.27 mm, and for the endotracheal tube tip, it was 7.06 ± 8.94 mm. The distributions of these values are highly skewed and concentrated around low distances.
Table 3.
Aggregated values of distances between points expressed in millimeters.
| Object | Dataset | Count | mean (mm) | sigma (mm) | q1 (mm) | median (mm) | q3 (mm) | max (mm) | skew | kurt |
|---|---|---|---|---|---|---|---|---|---|---|
| Carina | Training | 137 | 4.69 | 4.73 | 2.44 | 3.52 | 5.54 | 44.39 | 4.86 | 36.34 |
| Validation | 50 | 3.46 | 2.48 | 1.86 | 3.04 | 4.28 | 13.36 | 2.38 | 7.42 | |
| Hold-out | 15 | 6.81 | 7.32 | 2.39 | 4.44 | 7.82 | 25.07 | 1.8 | 2.55 | |
| External hold-out | 530 | 5.71 | 7.27 | 2.54 | 4.02 | 6.05 | 83.82 | 5.54 | 42.89 | |
| ETT tip | Training | 132 | 4.58 | 2.93 | 2.5 | 4.17 | 5.7 | 20.78 | 2.25 | 8.96 |
| Validation | 48 | 4.45 | 3.42 | 2.67 | 3.48 | 5.77 | 21.44 | 3.03 | 12.91 | |
| Hold-out | 22 | 4.18 | 2.91 | 2.4 | 3.06 | 4.85 | 11.79 | 1.82 | 2.64 | |
| External hold-out | 530 | 7.06 | 8.94 | 2.87 | 4.42 | 7.54 | 89.02 | 4.61 | 29.9 |
The scatter plot of the relative positions of measurement points obtained by the automatic method and the expert (Fig. 12) shows no significant systematic error. The points determined by the method do not differ substantially from the expert annotations. For high-quality segmentations, the relative positions are concentrated within a 10 mm radius. For lower Dice coefficient values, a greater number of discrepant measurement-point locations can be observed (Fig. 12).
The mean absolute measurement error between the distance determined by the automatic method and the expert points is 7.40 ± 8.75 mm. The median of these values is 4.72 mm. Those statistics were obtained on the external validation set.
Discussion
Principal findings
The lower number of endotracheal tube segmentations compared to tracheal segmentations likely contributed to the reduced Dice coefficient of the endotracheal tube segmentation model. Although data augmentation increased the number of training examples, it could not fully replace the diversity of real input data. Future inclusion of additional endotracheal tube segmentations may improve the model’s generalization performance.
The distributions of the collected similarity index values are strongly negatively skewed for both the trachea and the endotracheal tube across all subsets, indicating that segmentation quality is high in most cases. The small decrease in the Dice coefficient observed for the external hold-out set comprising images from a different institution confirms the models’ high robustness to input variability and good generalization properties. Segmentation remains stable despite differences in equipment and image characteristics, suggesting potential applicability of the models in clinical conditions distinct from those represented in the training dataset. Nevertheless, performance may drop for low-quality images or those that differ substantially from the training data.
The method for determining characteristic points based on object skeletonization proved effective but not without limitations. The lack of a standardized approach among radiologists hindered comparison between automatic and expert assessments. Additionally, sharp segmentation edges occasionally shifted the detected characteristic point toward the corner. This case is illustrated in Fig. 14. Incorporating additional heuristics or algorithms that account for the object’s geometry could help mitigate such issues.
Fig. 14.

Example of incorrect distance estimation due to a sharp edge in the segmentation.
The accuracy of characteristic point localization and distance estimation is highly dependent on the quality of segmentation, as demonstrated by the scatter and contour plots in Fig. 14.
The absolute error of distance estimation obtained on the external hold-out subset was comparatively low. As the subset consisted of unseen data from an independent clinical source, these findings indicate that the model’s accuracy is likely to be maintained in practical, real-world settings.
Unlike alternative methodologies that rely on rigid bounding boxes or discrete multi-class safety zones, the proposed method delivers continuous, millimeter-level tracking by combining a dual U-Net segmentation architecture with a geometric skeletonization pipeline. The core strength of this approach lies in its balanced performance, achieving highly competitive results in both anatomical segmentation precision and landmark localization error simultaneously. By maintaining this performance profile on an independent external validation dataset, this framework demonstrates a credible and generalizable workflow for objective airway assessment.
Comparison with existing studies
Among all the works reviewed in the literature, only one provides source code, enabling verification of results on independent datasets12. For benchmark datasets such as MIMIC-CXR, preliminary filtering using Natural Language Processing (NLP) methods is required to extract images of intubated patients. An attempt to evaluate the proposed method on such data would significantly increase the workload and could lead to difficulties in result comparison due to inconsistencies in the selected examples. Thus, an accurate comparison with the methods in the literature review remains unattainable.
The segmentation quality achieved with the proposed model was superior to that reported in some of the works reviewed in the literature. The model developed in this study achieved a Dice coefficient of 92.6% (5.5%) for the trachea and 91.3% (10.6%) for the endotracheal tube on the validation set. For comparison, in7, during five-fold cross-validation, the corresponding values were 84.1% (6.3%) and 89.3% (7.8%). In5, segmentation accuracy was reported as 85.4% for the trachea and 78.5% for the tube. Although this comparison is general due to differences in validation methods and datasets, the high metric values on both the training and validation sets confirm the effectiveness of the proposed approach. These results indicate that the UNet-based model developed in this work performs well in accomplishing the defined task.
The mean difference between automated and expert measurements was small. In the external validation set, the values were 5.71 ± 7.27 mm for the carina and 7.06 ± 8.94 mm for the endotracheal tube. In9, these values were reported as 6.4 mm for the tracheal carina and 8.2 mm for the tube tip.
Limitations
The method was designed for use with frontal chest radiographs of adult patients in the supine position in the ICU setting. Its performance in other patient populations, positioning, or clinical environments remains to be determined.
The preprocessing stage, adapted from the Circa team’s implementation, was effective in most cases and enabled analysis focused on the lung region. However, in some cases, the algorithm failed to correctly identify the region of interest, resulting in the processing of the entire image. This occasionally reduced the accuracy of segmentation and landmark detection due to noise from irrelevant areas. Future improvements could include additional preprocessing error-detection mechanisms or more advanced region-of-interest identification methods.
The postprocessing procedure, which involved identifying the largest connected component in the segmentation mask, also exhibited certain limitations. In rare cases where the segmented object was partially obscured by a foreign body or the neural network incorrectly identified part of the object, the postprocessing algorithm could lead to inaccurate landmark determination, resulting in erroneous distance estimates.
Conclusions
The proposed model provides a reliable estimation of the distance between the distal tip of the ETT and the tracheal carina in millimeters, supporting more accurate assessment of ETT placement.
The developed model demonstrates high quality on the training data, with only a slight decrease in accuracy on the validation sets, confirming its generalization capability. The method is largely robust to photometric variations and differences between X-ray devices, thanks to appropriate preprocessing, pixel intensity standardization, and the diverse examples included in the training dataset.
Although the method has limitations, including dependence on segmentation quality and occasional difficulties in atypical anatomical cases, it produced correct results in most cases. Evaluation metrics demonstrated high agreement between model predictions and expert annotations.
Given its robust performance and generalizability, the method shows strong potential for clinical application. Rapid and objective distance estimation may support radiologists and other clinicians in improving the safety and efficiency of airway management. Further refinement of segmentation algorithms and standardization of measurement procedures may enhance the reliability and clinical utility of the system.
Acknowledgements
We would like to express our gratitude to the Circa research group for developing and sharing their CXR preprocessing pipeline, which greatly facilitated the preparation and standardization of the imaging data used in this study. Their work provided a robust foundation that significantly contributed to the success of our methodology.
Author contributions
Conceptualization, J.K.; Data curation, P.D, Ł.C., M.R., M.S., A.M., M.M., Ł.P. and I.P.; Formal analysis, I.P., J.P. and K.G.; Funding acquisition, K.G. J.K. and J.P.; Investigation, P.D., Ł.C., M.M., M.B., and P.D.; Methodology, J.K. and Ł.P.; Software, Ł.P. and J.P.; Supervision, K.G. and J.P.; Validation, I.P.; Visualization, Ł.C.; Writing—original draft, I.P., P.D., Ł.C., M.M., J.K., A.M., M.B., and Ł.P.; Writing—review and editing, J.K., M.B., A.M., All authors have read and agreed to the published version of the manuscript.
Data availability
The clinical chest X-ray dataset analysed in this study is not publicly available due to institutional data-protection policies and restrictions related to medical confidentiality. The anonymized data may be made available from the corresponding author upon reasonable request and with permission from the participating institutions. The generated data is available from the authors and can be provided to readers upon request after prior contact. [www.eliott.aei.polsl.pl].
Declarations
Competing interests
The authors declare no competing interests.
Ethics approval
All methods were carried out in accordance with relevant guidelines and regulations, including the Declaration of Helsinki and national legislation governing the use of medical data in research. The study was based exclusively on retrospective, fully anonymized chest X-ray images obtained from routine clinical care. According to the opinion of the Bioethics Committee of the Medical University of Silesia in Katowice (Komisja Bioetyczna SUM) (letter No. PCN/0022/KB/195/20, dated 27 January 2021), retrospective analysis of anonymized radiological data does not constitute a medical experiment under Polish law and therefore does not require formal ethical approval. In Poland, all radiological examinations, including X-ray imaging, require prior informed consent from patients as part of standard medical practice. Because the dataset used in this study was anonymized and retrospective, the requirement for additional study-specific informed consent did not apply, in accordance with the guidance of the Bioethics Committee.
Footnotes
Publisher’s note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Contributor Information
Jakub Kufel, Email: jakubkufel92@gmail.com.
Łukasz Piórecki, Email: lukasz.piorecki@polsl.pl.
References
- 1.Tsai, L.-W., Yuan, K.-C. & Hou, S.-K. Determining carina and clavicular distance-dependent positioning of endotracheal tube in critically ill patients: An artificial intelligence-based approach. Biology11, 490. 10.3390/biology11040490 (2022). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Lakhani, P., Flanders, A. & Gorniak, R. Endotracheal tube position assessment on chest radiographs using deep learning. Radiol. Artif. Intell.3(1), e200026. 10.1148/ryai.2020200026 (2021). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.Saeg, A. A. A. & Alnori, H. Laryngeal injury and dysphonia after endotracheal intubation. J. Med. Life.14(3), 355–360. 10.25122/jml-2020-0148 (2021). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Brunel, W., Coleman, D. L., Schwartz, D. E., Peper, E. & Cohen, N. H. Assessment of routine chest roentgenograms and the physical examination to confirm endotracheal tube position. Chest96(5), 1043–1045. 10.1378/chest.96.5.1043 (1989). [DOI] [PubMed] [Google Scholar]
- 5.Wang, C.-H., Hwang, T. & Huang, Y.-S. Deep learning-based localization and detection of malpositioned endotracheal tube on portable supine chest radiographs in intensive and emergency medicine: A multicenter retrospective study. Crit. Care Med.52(2), 237–247. 10.1097/CCM.0000000000006046 (2024). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Brown, M. S., Wong, K.-P. & Shrestha, L. Automated endotracheal tube placement check using semantically embedded deep neural networks. Acad. Radiol.30(3), 412–420. 10.1016/j.acra.2022.04.022 (2023). [DOI] [PubMed] [Google Scholar]
- 7.Jung, H., Kim, C. & Oh, J. Position classification of the endotracheal tube with automatic segmentation of the trachea and the tube on plain chest radiography using deep convolutional neural network. J. Personal. Med.12(9), 1363. 10.3390/jpm12091363 (2022). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Yuan, K.-C. et al. Using transfer learning method to develop an artificial intelligence assisted triaging for endotracheal tube position on chest X-ray. Diagnostics11(10), 1844. 10.3390/diagnostics11101844 (2021). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Kara, S., Akers, J. Y. & Chang, P. D. Identification and localization of endotracheal tube on chest radiographs using a cascaded convolutional neural network approach. J. Digit. Imaging34(4), 898–904. 10.1007/s10278-021-00463-0 (2021). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Harris, R. J., Baginski, S. G. & Bronstein, Y. Measurement of endotracheal tube positioning on chest X-ray using object detection. J. Digit. Imaging34, 846–852. 10.1007/s10278-021-00495-6 (2021). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Huang, M.-H., Chen, C.-Y. & Horng, M.-H. Validation of a deep learning–based automatic detection algorithm for measurement of endotracheal tube–to–carina distance on chest radiographs. Anesthesiology137(6), 704–715. 10.1097/ALN.0000000000004378 (2022). [DOI] [PubMed] [Google Scholar]
- 12.Oliver, M. et al. Image augmentation and automated measurement of endotracheal-tube-to-carina distance on chest radiographs in intensive care unit using a deep learning model with external validation. Crit. Care27(1), 40. 10.1186/s13054-023-04320-0 (2023). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Norgeot, B., Quer, G. & Beaulieu-Jones, B. K. Minimum information about clinical artificial intelligence modeling: The MI-CLAIM checklist. Nat. Med.26, 1320–1324. 10.1038/s41591-020-1041-y (2020). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Moons, K. G. M., Altman, D. G. & Reitsma, J. B. Transparent reporting of a multivariable prediction model for individual prognosis or diagnosis (TRIPOD): Explanation and elaboration. Ann. Intern. Med.162, W1–W73. 10.7326/M14-0698 (2015). [DOI] [PubMed] [Google Scholar]
- 15.3D Slicer Team. 3D Slicer: Software for image segmentation and visualization, version 5. Available at: https://www.slicer.org/
- 16.Prazuch, W., Suwalska, A., Socha, M., Tobiasz, J., Foszner, P., Jaroszewicz, J., Gruszczynska, K., Sliwinska, M., Walecki, J., Popiela, T., Przybylski, G, Cieszanowski, A., Nowak, M., Pawlowska, M., Flisiak, R., Simon, K., Zapolska, G., Gizycka, B., Szurowska, E., POLCOVID Study Group, Marczyk, M. & Polanska, J. CIRCA: Comprehensible online system in support of chest X-rays-based COVID-19 diagnosis. arXiv:2210.05440.
- 17.Seghier, M. L. Image segmentation evaluation with the Dice index: Methodological issues. Int. J. Imaging Syst. Technol.34, e23203. 10.1002/ima.23203 (2024). [DOI] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Data Availability Statement
The clinical chest X-ray dataset analysed in this study is not publicly available due to institutional data-protection policies and restrictions related to medical confidentiality. The anonymized data may be made available from the corresponding author upon reasonable request and with permission from the participating institutions. The generated data is available from the authors and can be provided to readers upon request after prior contact. [www.eliott.aei.polsl.pl].

