Abstract
Accurate break size assessment is critical for the safety response of small modular reactors (SMRs) during loss-of-coolant accidents (LOCAs). Traditional methods struggle with the rapid transient features, strong spatiotemporal coupling, and complex uncertainty characteristics of SMR-LOCA, leading to low accuracy and poor stability. To address these issues, this study proposes an entropy-driven intelligent diagnosis approach based on a CNN-LSTM-Attention hybrid model. The framework adopts information entropy for data uncertainty quantification, adaptive weighting, and loss constraint, so as to realize high-precision break size assessment. A time-series dataset covering break sizes from 0.05 to 10 cm2 was constructed using the PCTRAN/SMART platform. The CNN module extracts spatial coupling features of multi-sensor parameters, the LSTM module captures long-term temporal dependencies, and the attention mechanism dynamically weights key information to enhance feature representation under high uncertainty. Experimental results show that the model achieves a mean absolute error (MAE) of 0.096311, reducing errors by over 64.4% compared with baseline models; more than 90% of prediction errors are within ±5%, and the correlation coefficient reaches 0.994902. Based on the well-validated PCTRAN/SMART simulation platform, the proposed entropy-informed spatiotemporal learning framework provides a technical solution for intelligent LOCA diagnosis, uncertainty quantification, and safety assessment of SMRs.
Keywords: small modular reactor (SMR), loss of coolant accident (LOCA), break size assessment, entropy-driven diagnosis, CNN-LSTM-Attention, deep learning, spatiotemporal feature learning
1. Introduction
Small Modular Reactors (SMRs) represent a key direction in nuclear energy innovation [1]. With their modular design, inherent safety advantages, and flexible deployment capabilities, they have become a critical component of future energy systems. However, SMRs face multiple safety risks, and Loss of Coolant Accidents (LOCA), as the core design-basis accident, pose particularly significant risks [2]. Compared to traditional large reactors, SMRs significantly reduce the risk of LOCA occurrence through features such as passive safety systems and integrated design [3]. However, the faster pressure drop rates and more complex two-phase flow characteristics resulting from their compact design give the LOCA evolution process unique characteristics, presenting new challenges for breach size assessment and creating an urgent need for evaluation methods tailored to these characteristics [4]. Traditional LOCA assessment methods fall into three categories: physical modeling, expert systems, and statistical learning. Among these, physical modeling offers high accuracy but is computationally intensive; expert systems rely on knowledge bases and have limited adaptability; and while statistical learning improves efficiency, it struggles to handle complex nonlinear temporal relationships [5]. None of these methods can fully meet the practical demands of SMR-LOCA assessment. The development of deep learning technologies has opened new avenues for nuclear safety assessment. Convolutional neural networks (CNNs) can effectively extract spatially coupled features from multi-sensor data in nuclear power plants [6], and multi-scale CNN architectures are better able to simultaneously capture local and global features, thereby improving the accuracy of anomaly detection [7]; Long Short-Term Memory (LSTM) networks, with their superior temporal modeling capabilities, have been successfully applied to transient identification and early LOCA diagnosis in nuclear power plants, enabling rapid identification of accident types and preliminary estimation of breach size ranges [8]; the attention mechanism, by dynamically allocating weights to focus on critical time points and core parameters during the accident process, effectively improves the accuracy of feature representation for fault diagnosis and LOCA assessment [9]. Building on this, the CNN-LSTM-Attention hybrid architecture integrates the strengths of all three, forming a triple mechanism of “spatial feature extraction-temporal evolution modeling-key information focusing.” This architecture can simultaneously process spatiotemporal information while possessing strong robustness and feature adaptability [10], making it the preferred solution for the quantitative assessment of LOCA break sizes. Existing research has proposed several end-to-end evaluation frameworks based on this architecture; some frameworks have incorporated multi-task learning mechanisms to further enhance evaluation performance, achieving significant improvements in evaluation accuracy on SMR simulation data [11]. The construction of high-quality datasets is fundamental to the practical application of deep learning models. Since actual SMR-LOCA data is difficult to obtain, researchers primarily generate training data through numerical simulations. Relevant studies have completed adaptation and optimization for thermal-hydraulic codes such as RELAP5-3D and TRACE and have established comprehensive data generation frameworks covering multiple breach locations, sizes, and initial conditions, providing robust support for model training [12]. Most existing intelligent diagnosis methods for SMR-LOCA mainly adopt standard CNN, LSTM, or CNN-LSTM-Attention hybrid architectures. These methods focus on mining spatial and temporal correlations of sensor data, but they have three common limitations. First, most studies ignore the strong random uncertainty of transient parameters during LOCA evolution and fail to quantify and suppress noise interference. Second, many models only achieve satisfactory performance for medium and large break accidents, while their detection accuracy for small-break weak signals is poor. Third, a large number of existing models adopt fixed weight allocation rules, leading to insufficient adaptability under diverse accident working conditions. Different from the above literature, this work innovatively integrates an entropy-driven mechanism into the spatiotemporal learning framework. On the basis of retaining the strengths of CNN in spatial feature extraction and LSTM in temporal dependency capture, we use information entropy to quantify data uncertainty, construct adaptive feature weights combined with the attention mechanism, and realize a full-range high-precision assessment covering small, medium, and large break sizes. This is a targeted improvement over the deficiencies of previous SMR-LOCA diagnosis models. Currently, while some progress has been made in SMR-LOCA break size assessment based on the CNN-LSTM-Attention architecture, most existing models cannot effectively cope with data uncertainty and small-break detection challenges. In view of this, this paper carries out customized modeling for the SMART reactor and realizes a full-range high-precision evaluation. The research results can provide important technical support for the intelligent diagnosis of LOCA accidents in SMRs.
2. Software and Methods
2.1. Introduction to SMART Reactor
SMART is an advanced small modular pressurized water reactor (SMR) developed under the leadership of the Korea Atomic Energy Research Institute (KAERI) [13]. Its latest version, SMART100, received standard design approval from the Korea Nuclear Safety and Security Commission in September 2024. Designed to enhance safety, economic efficiency, and versatility, it has a thermal power of 330 MWth and an electrical output of approximately 100 Mwe (Figure 1). With a design life of 60 years and a refueling cycle of three years, it significantly outlasts traditional large reactors. This reactor type features an integrated primary system design. The core assemblies consist of standard PWR low-enriched uranium dioxide fuel assemblies that have been optimized for miniaturization. Additionally, the core, eight spiral-tube steam generators, one pressurizer, four coolant pumps, and 25 control rod drive mechanisms are integrated within a single reactor pressure vessel. The built-in equipment design eliminates the risk of a LOCA caused by main steam pipe rupture and reduces the number of primary circuit openings and potential leakage points; Its cooling system is significantly simplified based on the typical PWR thermal cycle. The primary coolant circulates between the core and the steam generators, driven by an internal main pump. The secondary system is similar to that of a conventional PWR but scaled down to match the reduced electrical output. The integrated design eliminates traditional main pipelines, thereby eliminating the risk of a major water loss accident at its source. SMART’s safety strategy adheres to the principle of defense in depth. By combining inherent safety features such as low power density and a negative temperature coefficient with highly reliable passive safety systems, including a passive residual heat removal system, it ensures that the reactor can maintain a safe state for at least 36 h during an accident without requiring AC power or operator intervention. Preliminary safety analyses have also verified its robust response capabilities and design reliability against various design basis accidents.
Figure 1.
SMART System Flowchart.
2.2. Introduction to PCTRAN Simulation Platform
PCTRAN is a real-time simulation software developed by Micro-Simulation Technology (MST) in the United States, mainly used for nuclear power plant safety analysis and operator training [14]. It has been widely used in the global nuclear industry and regulatory agencies and includes models of various nuclear power plants such as AP1000, SMART, and NuScale [15]. The PCTRAN/SMART simulation platform (Figure 2) used in this study strictly follows the standard requirements of Korean APR1400 and OPR1000 units, and its model has been certified and used by five institutions, including the Korea Nuclear Safety Research Institute [16]. The platform can simulate the normal operation and various accident conditions of SMRs, providing real-time feedback on operating parameters such as temperature, pressure, and flow rate. The thermal-hydraulic calculation module and transient parameter solution algorithm of PCTRAN/SMART have been fully benchmarked against validated thermal-hydraulic codes and actual transient data of pressurized water reactors. Key transient parameters, including system pressure, core coolant flow rate, primary coolant inventory, and the response characteristics of the Emergency Core Cooling System (ECCS) under LOCA conditions, have been verified to ensure the reliability of simulation outputs, which meet the requirements of nuclear safety transient analysis [17].
Figure 2.
PCTRAN/SMART Graphical User Interface.
2.3. Dataset Construction
To construct a high-quality SMR-LOCA breach dataset, this paper conducts systematic data generation for the SMART reactor type using the PCTRAN/SMR simulation platform [18,19]. By meticulously designing simulation scenarios, controlling parameter variables, and expanding sample diversity, the dataset is ensured to accurately reflect the dynamic characteristics of accidents involving different breaches, thereby providing support for model training and validation. The break size design employs concentration gradient sampling. Combined with the industry classification standard for Loss of Coolant Accidents (LOCA) in pressurized water reactors and the design characteristics of the SMART reactor, the break size range of 0.05–10 cm2 is selected to fully cover small, medium, and large LOCA working conditions of SMRs. The range is segmented into 200 gradient levels with 0.05 cm2 intervals, covering the three typical SMART-LOCA accident scenarios at an average step size. The 0.05 cm2 sampling interval is set to capture the characteristic signals of tiny break leakage, and this approach achieves “gap-free” coverage of the 0.05–10 cm2 range, ensuring no sensitive intervals are omitted, and each size corresponds to an independent simulation case, guaranteeing data independence and completeness. Simulation parameters strictly align with SMR operational characteristics, using a SMART unit rated at 300 MWe, a primary loop design pressure of 15.5 MPa, and passive safety systems as the baseline. Each simulation lasts 300 s with a sampling frequency of 1 Hz, generating 300-step time-series data containing 93 key monitoring parameters. The dataset is segmented using a time-series partitioning strategy to prevent data leakage. All data is normalized using Z-scores and stored in CSV format, forming a comprehensive dataset system that establishes a solid data foundation for subsequent model training and validation.
There are obvious differences between normal steady-state operation and LOCA transient conditions of SMRs. Under steady-state conditions, all operating parameters such as pressure, flow rate, and temperature remain stable within the design range; while under LOCA transient conditions, rapid pressure drop, sharp changes of coolant flow, and two-phase flow phenomena occur continuously, showing strong time-varying characteristics. According to the break area, LOCA is divided into small LOCA, medium LOCA, and large LOCA, and different types of LOCA present completely different transient evolution rules of monitoring parameters.
This research addresses the challenge of multivariate time series prediction, a task where conventional methodologies tend to decompose the multi-dimensional sequence into individual univariate prediction subtasks for separate processing (Figure 3). Such a fragmented approach, however, comes with notable drawbacks: it fails to capture the inherent intercorrelations across different variables, which in turn restricts the representational power of the established models [20]. To mitigate this limitation, we adopt a sequential input strategy in this work, wherein all physical parameters are fed collectively into a single neural network for unified training and prediction. In the prediction process, the historical sequence data vectors at each time step are input into the neural network in a chronological manner. The model then extracts the hidden state corresponding to the final time step, which is utilized to encode the complete input sequence. As shown in Figure 3, when the historical time step is set to T − 1, the input sample is defined as X1:T−1 = [X1, X2, …, XT−1], a six-dimensional sequence with a length of T − 1. The output XT is a six-dimensional vector that denotes the result of single-step prediction. The sample X1:T−1 is fed into the recurrent neural network at distinct time points with different sampling frequencies, generating a series of hidden states H1, H2, …, HT−1 that correspond to each time moment. Eventually, HT−1 is taken as the feature representation of the entire sequence and processed through a fully connected layer to yield the final prediction result XT. A key merit of this sequential input method is its ability to accept input sequences of arbitrary lengths without any modifications to the underlying model architecture. This flexibility allows the length of the historical time step to be treated as a tunable hyperparameter, and it is this very approach that we apply for the modeling and prediction tasks in the present study.
Figure 3.
Schematic of the Sequence-to-One Prediction Model.
3. Theoretical Basis and Technical Platform
3.1. Convolutional Neural Network (CNN)
CNN is a type of deep neural network that is particularly suitable for extracting spatial features from high-dimensional data [21]. Its basic structure includes an input layer, convolutional layers, pooling layers, and fully connected layers (Figure 4). The convolutional layer uses convolutional kernels to perform sliding convolution operations on the input data, extracting local spatial features; the pooling layer reduces the feature dimension through downsampling, improving the model’s robustness and computational efficiency; the fully connected layer maps the extracted features to the output space to complete classification or regression tasks [22]. In this study, the CNN layer is used to extract the spatial coupling features of SMR operation parameters, such as the correlation between primary loop pressure and pressurizer water level, and the coupling relationship between coolant flow rate and temperature.
Figure 4.
Basic Structure Diagram of a CNN Network.
3.2. Long Short-Term Memory (LSTM) Network
LSTM (Figure 5) is a special type of Recurrent Neural Network (RNN) that is suitable for processing time-series data and capturing long-term dependencies [23]. Its core structure includes input gates, forget gates, output gates, and memory cells. The input gate controls the addition of new information to the memory cell; the forget gate decides which information to discard from the previous memory cell; the output gate determines the output value based on the state of the memory cell; the memory cell is responsible for storing and transmitting long-term information, effectively solving the problems of gradient disappearance and gradient explosion in traditional RNNs [24]. In this study, the LSTM layer is used to capture the temporal dynamic evolution law of parameters in LOCA accidents, such as the time-varying trend of pressure drop and the dynamic change process of coolant flow rate.
Figure 5.
LSTM Cell Structure Diagram.
3.3. Attention Mechanism
The attention mechanism (Figure 6) simulates the selective attention process of the human brain, which can adaptively assign weights to different parts of the input data according to the importance of information [25]. Its basic calculation process includes determining query vectors (Query), key vectors (Key), and value vectors (Value); calculating the correlation score between the query vector and each key vector; normalizing the correlation score using the softmax function to obtain attention weights; weighting and summing the value vectors according to the attention weights to obtain the final attention output [26]. Common types of attention mechanisms include self-attention mechanism, cross-attention mechanism, and multi-head attention mechanism [27]. In this study, the self-attention mechanism is adopted to dynamically adjust the weights of different time steps and parameters in the time-series data, enhancing the model’s focus on key features related to break size.
Figure 6.

Schematic Diagram of Attention Weight Calculation Process.
The input of the self-attention layer is the fused spatiotemporal feature sequence, with a standard input tensor shape of RB×T×F. Where B is Batch size, representing the number of samples input in a single training iteration; T is Historical time step of time series, i.e., the length of continuous sampling points used for prediction; F is Number of feature dimensions, equal to 93 monitoring parameters collected in this SMR LOCA dataset.
Three independent trainable linear projection layers are used to map the input feature matrix X to generate Query (Q), Key (K), and Value (V) matrices, respectively. The calculation formulas are:
| (1) |
Where WQ, WK and WV denote learnable weight matrices for three projection layers, which are continuously optimized during model training. The dimensions of Q, K, and V are consistent with the input feature dimension RB×T×F.
3.4. Entropy-Driven Calculation and Optimization Strategy
The entropy-driven design is the core innovation of this study, which is used to quantify the uncertainty of multi-sensor time-series data under SMR LOCA conditions, optimize feature weights, and constrain model training. This section provides the complete mathematical formulas, weighting rules, and entropy-constrained loss function.
Information entropy is adopted to measure the uncertainty of each monitoring parameter sequence. A higher entropy value means the data contains more noise and less valid accident information. For a single time-series feature X = [X1, X2, …, XN], the Shannon information entropy is defined as:
| (2) |
Where N is total number of sampling points of a single parameter; xi is observed value at the i-th sampling moment; p(xi) is probability density of xi obtained by statistical distribution of time-series data; H(x) is information entropy of the corresponding monitoring parameter. For the 93-dimensional fused monitoring data in this work, we calculate the entropy value for each feature dimension separately to obtain the uncertainty distribution of all sensor parameters.
Combining the calculated entropy values with the self-attention mechanism, we construct an entropy adjustment coefficient to correct the attention weights and realize dual control of feature importance and data uncertainty. The entropy adjustment coefficient is calculated as:
| (3) |
Where represents the average entropy of all feature dimensions. Features with high entropy (strong uncertainty) will get a smaller to suppress noise interference; features with low entropy (rich valid LOCA characteristic information) will get a larger to strengthen feature expression. The final feature weight is the product of the self-attention weight and the entropy adjustment coefficient:
| (4) |
This strategy breaks the limitation of single attention weighting in traditional models and realizes uncertainty-aware feature optimization.
To further constrain the model from over-learning high-uncertainty noisy features during training, we construct an entropy-regularized loss function. Taking mean absolute error (MAE) as the basic regression loss, the complete loss function is:
| (5) |
Where is basic mean absolute error loss for break size prediction; is regularization coefficient (empirically set to 0.01 in this study); D is total number of feature dimensions (D = 93); is information entropy of the d-th feature; is network weight vector corresponding to the d-th feature; is L2 norm.
The entropy regularization term penalizes the network weights corresponding to high-entropy noisy features, which effectively improves the model’s robustness under complex LOCA transient conditions.
3.5. Overall Network Topology and Layer Configuration
This section describes the complete topology, layer sequence, and detailed parameter settings of the proposed entropy-driven CNN-LSTM-Attention hybrid model. The CNN module consists of two convolutional layers and two max-pooling layers arranged alternately. The first convolutional layer adopts 32 convolution filters with a kernel size of 3 and uses the ReLU activation function, followed by a max-pooling layer with a pooling size of 2. The second convolutional layer is equipped with 64 convolution filters and a kernel size of 3, also using the ReLU activation function, and is followed by another max-pooling layer with a pooling size of 2. This module is responsible for extracting spatial coupling features from multi-sensor time series data. After the CNN module, one independent LSTM layer is deployed to capture long-term temporal dependencies of accident transient data. This LSTM layer is configured with 128 hidden units. The self-attention layer is placed directly after the LSTM layer, which means the output features of the LSTM layer are taken as the input of the self-attention layer. The self-attention layer works together with the entropy-driven weighting module to correct feature weights and suppress high-uncertainty noise information. Two fully connected layers are set at the end of the network for regression prediction of break size. The first fully connected layer contains 64 neurons and applies the ReLU activation function. The second fully connected layer serves as the output layer with only 1 neuron and no additional activation function, which outputs the final predicted break size value. All above layer configurations remain consistent throughout all comparison experiments.
4. Experimental Results
Accurately assessing the size of the LOCA breach is central to evaluating algorithm performance. This paper employs five statistical metrics, namely Mean Absolute Error (MAE), Mean Relative Error (MRE), Mean Absolute Percentage Error (MAPE), Mean Square Error (MSE), and Correlation Coefficient (CC), to quantify prediction accuracy and comprehensively evaluate performance, as shown in Equations (1)–(4) [28]. MAE reflects the average level of absolute deviation between predicted and actual values; its units are consistent with the original data, but it has limitations in that it loses directional information and lacks sensitivity to scale. MRE is the average of relative deviations; after normalization, it allows for comparison of prediction accuracy across data of different magnitudes, but it fails to compute accurately when actual values approach zero; MAPE avoids the issue of positive and negative errors canceling each other out by taking the absolute value of the relative error and then averaging it; the smaller the value, the higher the accuracy. MSE is the average of the sum of squared errors; the larger the value, the lower the accuracy, and it is a commonly used accuracy metric in regression analysis and least squares methods. CC is used to characterize the correlation relationship and degree between actual and predicted values, with a range of (−1, 1); the closer the absolute value is to 1, the higher the correlation. In LOCA breach size prediction, MAE and MRE are used to reflect the error between predicted and actual values, while the prediction evaluation module employs MSE, MAPE, and CC. Among these, CC is independent of the data scale and can serve as an absolute evaluation metric for different prediction objects, whereas MSE and MAPE are dependent on the data scale and are primarily used to compare the performance of different prediction methods for the same prediction object. Key hyperparameters, including the historical time step T, batch size, and initial learning rate, are determined by grid search combined with the characteristics of LOCA time-series data and practical experience to balance model performance and computational efficiency.
| (6) |
| (7) |
| (8) |
| (9) |
where represents the actual value, stands for the predicted value, and n is the total sample size.
The training loss function is used to quantify the error between the model’s predictions on the training data and the actual results under the current parameters. Figure 7 shows the training loss curves for four models: CNN, LSTM, CNN-LSTM, and CNN-LSTM-Attention. While all models exhibit good convergence performance, there are significant differences in their convergence behavior and training stability; the curves intuitively reflect the dynamic characteristics of the optimization process for each model.
Figure 7.
Model Training Loss Function.
As illustrated in Figure 1, for the CNN model, the loss rapidly decreased to around 0.4 during the first 40 iterations before entering a plateau phase, eventually stabilizing near 0.25. While the convergence rate was fast, further optimization was limited in the later stages, reflecting the insufficient ability of a single convolutional network to model temporal dependencies and its difficulty in capturing long-range dynamic correlations among accident parameters. The LSTM model exhibited significant fluctuations during convergence, with a rebound in loss occurring between iterations 80 and 120, eventually stabilizing around 0.3. This phenomenon is related to the training instability of recurrent neural networks; while they can capture temporal features, they are sensitive to local abrupt signals such as sudden pressure drops at the breach, which can easily cause oscillations in the loss function. The loss of the CNN-LSTM hybrid model rapidly decreased to 0.3 within the first 60 iterations and subsequently converged steadily to 0.2–0.25. Its overall stability outperforms that of standalone models, as the local feature extraction capability of the convolutional layers and the temporal dependency capture capability of the LSTM form an initial synergy. However, the rate of loss reduction slowed after 100 iterations, indicating that the model’s ability to focus on key features still has room for improvement. The CNN-LSTM-Attention model exhibited the smoothest convergence process. After 120 iterations, the loss dropped below 0.1 and eventually stabilized around 0.08, with the minimum loss reduced by more than 60% compared to other models. The introduction of the attention mechanism allows the model to continue optimizing even in the later stages of training. It dynamically adjusts feature weights, amplifying the influence of key parameters related to breach scenarios, such as pressure drop rates and sudden changes in coolant flow, while reducing interference from redundant information, thereby achieving more precise gradient descent.
As shown in Table 1, the CNN-LSTM-Attention hybrid model demonstrates a significant advantage in terms of absolute error performance, with an MAE of 0.096311. Compared to CNN (0.282422), LSTM (0.326316), and CNN-LSTM (0.270665), representing reductions of 66.2%, 70.5%, and 64.4%, respectively, demonstrating a substantial improvement in the ability to control absolute deviations in break size. Particularly in the detection of breaks with areas < 1 cm2, the model’s MAE is consistently maintained within 0.05 cm2, fully meeting the high-precision requirements for detecting minute leaks in engineering applications. In relative error evaluation, the fusion model also performed excellently, with an MRE of +0.11%, which is near zero, indicating no systematic prediction bias; in contrast, the CNN, LSTM, and CNN-LSTM models exhibited positive, negative, and significant negative biases of +2.96%, −0.78%, and −6.95%, respectively, all showing varying degrees of prediction offset. Under the MAPE metric, the fusion model achieved 2.81%, significantly outperforming the CNN’s 6.72%, the LSTM’s 8.24%, and the CNN-LSTM’s 14.56%; for extreme breach conditions, this model can stably maintain MAPE within 3%, effectively resolving the issue of excessive prediction bias in traditional models under such scenarios. In terms of volatility, the fusion model’s MSE is 0.085162, the lowest among all models, representing a 38.1% reduction compared to the best-performing baseline model, CNN-LSTM (0.137684), and demonstrating superior stability in prediction results. Furthermore, the correlation coefficient (CC) between the fusion model’s predicted values and the actual values reaches 0.994902, approaching the ideal value of 1, indicating the strongest linear correlation between the two. This demonstrates that the model can more effectively capture the complex nonlinear mapping relationship between break size and monitoring parameters.
Table 1.
Evaluation Metrics Table for CNN, LSTM, CNN-LSTM, and CNN-LSTM-Attention Models.
| Models | MAE | MRE | MAPE | MSE | CC |
|---|---|---|---|---|---|
| CNN | 0.282422 | 2.96% | 6.72% | 0.217054 | 0.990032 |
| LSTM | 0.326316 | −0.78% | 8.24% | 0.181952 | 0.989213 |
| CNN-LSTM | 0.270665 | −6.95% | 14.56% | 0.137684 | 0.992443 |
| CNN-LSTM-Attention | 0.096311 | 0.11% | 2.81% | 0.085162 | 0.994902 |
The histogram of percentage error distribution reveals, from a statistical perspective, the characteristics of the prediction error distribution for each model under different operating conditions (Figure 8). The CNN model exhibits a right-skewed error distribution, primarily concentrated in the −10% to 20% range, with an average error of +2.96%. Samples in the 10–20% range account for approximately 35%, indicating a systematic overestimation of break in the 1–5 cm2 range; The LSTM model’s error distribution extends from −20% to 30%, with an average error of −0.78%. Samples in the −10% to 0% range account for over 60%. Due to overfitting of temporal dependencies, predictions for breaks larger than 5 cm2 are generally underestimated. The CNN-LSTM model exhibits significant dispersion in its error distribution, ranging from −100% to 40%, with an abnormal peak in the −20% to −60% range (accounting for approximately 25% of the samples); with an average error of −6.95%. Due to insufficient capture of multi-parameter coupled features, it is prone to extreme deviations under complex operating conditions where the breach location and initial power interact. In contrast, the CNN-LSTM-Attention model exhibits a narrow-peak error distribution, with over 90% of samples concentrated within the −5% to 5% range and an average error of 0.11%. The distribution is nearly unbiased and approximates a normal distribution. The attention mechanism effectively suppresses interference from irrelevant features and reduces the probability of extreme errors by dynamically focusing on key parameters such as the rate of pressure change in the loop 10 s after a rupture. The model demonstrates excellent predictive stability across various operating conditions. From the perspective of nuclear thermal hydraulics, small-break LOCA produces faint transient signals easily masked by noise; the attention mechanism captures subtle thermal-hydraulic variations and enhances identification accuracy. Meanwhile, the model achieves fast inference speed, satisfactory real-time performance, good noise robustness, and acceptable few-shot generalization ability for engineering applications.
Figure 8.
Model Error Percentage Histogram.
Figure 9 shows a scatter plot of the actual and predicted values for the four models, providing a visual representation of the consistency of the model evaluations. Ideally, the data points should be closely clustered around the 45° reference line. The data points for the CNN model show significant dispersion in the region where the breach is <1 cm2, deviating considerably from the reference line; over 30% of the samples fall outside the ±15% error band, indicating insufficient ability to identify faint leakage signals from small breaches; The LSTM model’s data points deviate markedly in the >8 cm2 rupture area and systematically shift below the reference line (averaging 12.7% lower), indicating a deficiency in modeling the strong transient characteristics of large ruptures; The CNN-LSTM model’s point cloud generally aligns more closely with the reference line, showing significant improvement over the standalone base model. However, it suffers from localized failures, exhibiting significant fluctuations in the 2–4 cm2 range. The point cloud displays a “butterfly-shaped” distribution with a lateral spread of up to ±20%, indicating insufficient stability in capturing the parameter coupling characteristics of leaks in this range. In contrast, the point cloud of the CNN-LSTM-Attention model almost perfectly aligns with the 45° reference line, with 98.2% of samples falling within a ±5% error margin, maintaining high consistency across the entire breach size range of 0.05–10 cm2. This confirms the reinforcing role of the attention mechanism’s key features, which effectively enhance the model’s evaluation accuracy across the full range of gaps by focusing on core parameters strongly correlated with gap size, such as the rate of change in the stabilizer water level and the decay rate of coolant flow.
Figure 9.
Scatter Plot of Models’ Predictions and True Values.
Based on the above experimental conclusions, an analysis across four dimensions, training stability, quantitative metric performance, error distribution characteristics, and evaluation consistency, reveals that all four models can effectively assess SMR-LOCA breach sizes. However, the CNN-LSTM-Attention model demonstrates comprehensive performance advantages: Its training convergence process is stable, all quantitative evaluation metrics significantly outperform those of other models, the error distribution is concentrated and close to unbiased, and it demonstrates excellent consistency in breach size assessment across the entire range. The model’s superior performance stems from the synergistic interaction and efficient integration of its three major components: the CNN layer precisely extracts local spatial coupling features among multiple parameters, such as the transient interdependence between the pressurizer water level and primary loop pressure; the LSTM layer effectively captures the dynamic evolution of features over time, such as the decay trend of coolant flow within 300 s after a breach; and the attention mechanism dynamically allocates feature weights to focus on critical periods and core parameters like the rate of pressure drop, thereby forming a triple feature extraction mechanism of “spatial feature extraction-temporal evolution capture-key information focus.” This mechanism effectively overcomes the modeling bottlenecks of traditional models regarding highly nonlinear and multi-parameter coupled characteristics, providing a high-precision technical solution for the intelligent diagnosis of LOCA accidents in SMRs.
5. Conclusions
Accurate break size assessment under loss-of-coolant accidents (LOCAs) is essential to the safety mitigation and emergency response of small modular reactors (SMRs). The strong spatiotemporal coupling, rapid transient evolution, and high uncertainty characteristics of SMR-LOCA lead to significant challenges for traditional assessment methods, which suffer from low accuracy and poor stability. To tackle these issues, this study developed an entropy-driven intelligent diagnosis framework based on a CNN-LSTM-Attention hybrid model for high-precision break size evaluation. A high-quality time-series dataset covering break sizes from 0.05 cm2 to 10 cm2 was established using the PCTRAN/SMART platform. The proposed model integrates the spatial feature extraction capability of CNN, the temporal dependency learning ability of LSTM, and the adaptive key information focusing of the attention mechanism, forming a unified spatiotemporal learning architecture that effectively suppresses uncertainty and improves prediction robustness.
Experimental results demonstrate that the CNN-LSTM-Attention model outperforms standalone CNN, LSTM, and CNN-LSTM models in all metrics. It achieves a mean absolute error (MAE) of 0.096311, with error reduction exceeding 64.4% relative to baseline models. Over 90% of prediction errors are controlled within ±5%, and the correlation coefficient reaches 0.994902, indicating excellent consistency between predicted and actual break sizes. The entropy-driven weighting strategy enhances the model’s sensitivity to critical transient features and reduces the impact of redundant information, enabling stable and high-precision full-range assessment across all break sizes. Distinct from the existing CNN-LSTM-Attention hybrid structures widely applied in nuclear accident diagnosis, the proposed entropy-driven framework is the major advancement of this research. By quantifying data uncertainty via information entropy and combining entropy-adaptive weighting with loss regularization, this method effectively solves the problem that traditional models cannot distinguish valid signals from uncertain noise under SMR-LOCA conditions. This is the exclusive contribution of the entropy-driven design in this study.
This work provides an intelligent tool for uncertainty quantification, accident diagnosis, and safety assessment of SMRs. Although the current research is based on the simulation data of PCTRAN/SMART, this simulation platform has passed the certification of multiple nuclear safety institutions and can accurately reproduce the actual operating and accident characteristics of the SMART reactor, which ensures the validity of the model verification results. Different from previous SMR-LOCA diagnosis methods that only focus on model structure optimization, this work takes data uncertainty as the core optimization direction and forms a complete set of spatiotemporal feature learning + entropy constraint technical scheme. In future research, the model will be further validated against experimental data and multiple thermal-hydraulic simulation platforms, extended to multitype and complex accident conditions, and optimized toward real-time engineering applications in nuclear power plant monitoring and emergency operation support.
Author Contributions
Conceptualization, L.Y. and J.L.; methodology, L.Y.; software, L.Y.; validation, J.L.; formal analysis, J.L.; investigation, L.Y.; resources, J.L.; data curation, L.Y.; writing—original draft preparation, L.Y.; writing—review and editing, J.L.; visualization, L.Y.; supervision, J.L.; project administration, J.L.; funding acquisition, L.Y. All authors have read and agreed to the published version of the manuscript.
Data Availability Statement
Data are available on request due to restrictions.
Conflicts of Interest
The authors declare no conflicts of interest.
Funding Statement
We gratefully acknowledge the support provided by the Open Fund of Hunan Institute of Technology (XK20260904, XK20260902), the Hengyang Social Science Fund Project (2025B(I)011), the science and technology innovation Program of Hunan Province (2023RC3195) and the College Students’ Innovation Plan Projects of Hunan Province (S202511528242, S202511528261X).
Footnotes
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.
References
- 1.Vinoya C.L., Ubando A.T., Culaba A.B., Chen W.-H. State-of-the-art review of small modular reactors. Energies. 2023;16:3224 [Google Scholar]
- 2.Juarsa M., Putra N., Koestoer R.A. An alternative cooling solution during loss of coolant accident with emergency core cooling system failure in NUSCALE nuclear reactor. Prog. Nucl. Energy. 2024;169:105063. doi: 10.1016/j.pnucene.2024.105063. [DOI] [Google Scholar]
- 3.Song C.H., Song J., Kim S.J. Evaluation of accident mitigation capability of passive core and containment cooling systems of i-SMR under representative LOCA and non-LOCA conditions. Nucl. Eng. Technol. 2025;57:103556. [Google Scholar]
- 4.Nazmul H.S., Mugabi J., Lee D., Jeong J.H. Study on Regulatory Gap Analysis of LOCA for the RCPB in SMR in South Korea. Nucl. Eng. Technol. 2026;58:104308. doi: 10.1016/j.net.2026.104308. [DOI] [Google Scholar]
- 5.Fan G.F., Han Y.Y., Li J.W., Peng L.L., Yeh Y.H., Hong W.C. A hybrid model for deep learning short-term power load forecasting based on feature extraction statistics techniques. Expert Syst. Appl. 2024;238:122012. [Google Scholar]
- 6.Lei J., Ni Z., Peng Z., Hu H., Hong J., Fang X., Yi C., Ren C., Wasaye M.A. An intelligent network framework for driver distraction monitoring based on RES-SE-CNN. Sci. Rep. 2025;15:6916. doi: 10.1038/s41598-025-91293-5. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Li C., Liu X., Wang H., Peng M. Fault diagnosis method for centrifugal pumps in nuclear power plants based on a Multi-Scale convolutional Self-Attention network. Sensors. 2025;25:1589. doi: 10.3390/s25051589. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Zhang C., Chen P., Jiang F., Xie J., Yu T. Fault diagnosis of nuclear power plant based on sparrow search algorithm optimized CNN-LSTM neural network. Energies. 2023;16:2934. doi: 10.3390/en16062934. [DOI] [Google Scholar]
- 9.Caixeta B.M., Santos M.C., de Lima A.M.M., Pinheiro V.H., Schirru R. LSTM and transformer-based approach for nuclear reactor event sequence forecasting and TRIP detection. Prog. Nucl. Energy. 2026;196:106354. doi: 10.1016/j.pnucene.2026.106354. [DOI] [Google Scholar]
- 10.Borré A., Seman L.O., Camponogara E., Stefenon S.F., Mariani V.C., Coelho L.D.S. Machine fault detection using a hybrid CNN-LSTM attention-based model. Sensors. 2023;23:4512. doi: 10.3390/s23094512. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Lin T.H., Chen C., Wu S.C., Wang T.C., Ferng Y.M. Localization and size estimation for breaks in nuclear power plants. Nucl. Eng. Technol. 2022;54:193–206. doi: 10.1016/j.net.2021.07.007. [DOI] [Google Scholar]
- 12.Martin R.P., Bradbury M.S. Independent Verification of Transient Phenomena in RELAP5-3D Leveraging Reduced-Order Model. Nucl. Technol. 2025:1–20. [Google Scholar]
- 13.Prianka S.E.A., Prodhan M.M.H. Evaluation of neutronic characteristics of accident tolerant fuel concepts in SMART reactor fuel assemblies using DRAGON. Nucl. Eng. Des. 2024;421:113100. doi: 10.1016/j.nucengdes.2024.113100. [DOI] [Google Scholar]
- 14.Qi B., Xiao X., Liang J., Po L.-C.C., Zhang L., Tong J. An open time-series simulated dataset covering various accidents for nuclear power plants. Sci. Data. 2022;9:766. doi: 10.1038/s41597-022-01879-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Wan S., Lei J. Research on a Small Modular Reactor Fault Diagnosis System Based on the Attention Mechanism. Energies. 2025;18:3621. doi: 10.3390/en18143621. [DOI] [Google Scholar]
- 16.Abdellatif H.H., Bhowmik P.K., Arcilesi D., Sabharwall P. Analysis of AP1000 small-break loss-of-coolant accident using reactor transient simulator. Nucl. Technol. 2025;211:531–547. [Google Scholar]
- 17.Zubair M., Al Suwaidi R.R., Al Souqi A.A. Behavior of Emergency Core Cooling System (ECCS) during the early stage of Loss of Coolant Accident (LOCA) for APR 1400 with Flownex software. Prog. Nucl. Energy. 2021;141:103949. doi: 10.1016/j.pnucene.2021.103949. [DOI] [Google Scholar]
- 18.Luo R., Li Y., Guo H., Wang Q., Wang X. Cross-operating-condition fault diagnosis of a small module reactor based on CNN-LSTM transfer learning with limited data. Energy. 2024;313:133901. [Google Scholar]
- 19.Zubair M., Abushady M.S., Alzarooni A.H. Classification of LOCA events in pressurized water reactors using neural networks. Ann. Nucl. Energy. 2026;227:111909. [Google Scholar]
- 20.Abuthahir S.S., Peter J.S.P. Novel multi-dimensional task offloading techniques for vehicular edge computing networks. Int. J. Syst. Assur. Eng. Manag. 2025;16:59–72. [Google Scholar]
- 21.Salehi A.W., Khan S., Gupta G., Alabduallah B.I., Almjally A., Alsolai H., Siddiqui T., Mellit A. A study of CNN and transfer learning in medical imaging: Advantages, challenges, future scope. Sustainability. 2023;15:5930. doi: 10.3390/su15075930. [DOI] [Google Scholar]
- 22.Arkin E., Yadikar N., Xu X., Aysa A., Ubul K. A survey: Object detection methods from CNN to transformer. Multimed. Tools Appl. 2023;82:21353–21383. [Google Scholar]
- 23.Lei J., Ren C., Li W., Fu L., Li Z., Ni Z., Li Y., Liu C., Zhang H., Chen Z., et al. Prediction of crucial nuclear power plant parameters using long short-term memory neural networks. Int. J. Energy Res. 2022;46:21467–21479. [Google Scholar]
- 24.Sang S., Li L. A novel variant of LSTM stock prediction method incorporating attention mechanism. Mathematics. 2024;12:945. doi: 10.3390/math12070945. [DOI] [Google Scholar]
- 25.Guo M.-H., Xu T.-X., Liu J.-J., Liu Z.-N., Jiang P.-T., Mu T.-J., Zhang S.-H., Martin R.-R., Cheng M.-M., Hu S.-M. Attention mechanisms in computer vision: A survey. Comput. Vis. Media. 2022;8:331–368. doi: 10.1007/s41095-022-0271-y. [DOI] [Google Scholar]
- 26.Li X., Li M., Yan P., Li G., Jiang Y., Luo H., Yin S. Deep learning attention mechanism in medical image analysis: Basics and beyonds. Int. J. Netw. Dyn. Intell. 2023;2:93–116. doi: 10.53941/ijndi0201006. [DOI] [Google Scholar]
- 27.de Santana Correia A., Colombini E.L. Attention, please! A survey of neural attention models in deep learning. Artif. Intell. Rev. 2022;55:6037–6124. doi: 10.1007/s10462-022-10148-x. [DOI] [Google Scholar]
- 28.Serefoglu Cabuk K., Cengiz S.K., Guler M.G., Topcu H., Cetin Efe A., Ulas M.G., Poslu Karademir F. Chasing the objective upper eyelid symmetry formula; R2, RMSE, POC, MAE, and MSE. Int. Ophthalmol. 2024;44:303. doi: 10.1007/s10792-024-03157-y. [DOI] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Data Availability Statement
Data are available on request due to restrictions.










