Abstract
Electrical transformer diagnosis combines evidence with different observation capabilities. We present a decision-level fusion implementation using Chinese BERT inspection-text classification, a multi-scale one-dimensional CNN for dissolved gas analysis, and YOLOv11n image detection. Capability masks, reliability weighting, fuzzy evidence attenuation and Murphy fusion produce structured diagnostic records. On separated retrospective tests, the CNN achieved 97.14% accuracy (macro-F1 0.9700) on 629 DGA records and BERT achieved 72.45% accuracy (macro-F1 0.7466) on 715 reserved log lines. On a five-seed visual stress test, BERT+YOLO achieved 96.84% mean accuracy, while the complete fusion achieved 71.69% with 74.75% coverage under the fixed rejection policy. The method’s principal strengths are explicit modality capability modeling, traceable evidence exchange and independently replaceable lightweight classifiers. Results are interpreted within the documented corpus and pairing protocol; event-level field validation and embedded-device benchmarking are identified as the next deployment studies.
Keywords: main transformer, defect recognition, multimodal fusion, Dempster–Shafer evidence theory, lightweight model
1. Introduction
As the core equipment responsible for energy conversion, voltage-level interconnection, and the secure operation of primary assets in power systems, the electrical transformer demands accurate defect recognition: diagnostic precision directly affects grid security and stability, condition-based maintenance planning, and whole-life-cycle health management. Conventional electrical transformer diagnosis relies largely on a single data source combined with small task-specific models, and, therefore, struggles to cover complex fault scenarios. With the continued construction of new-type power systems and the maturation of intelligent substation inspection, monitoring data for power main equipment have expanded from isolated manual records to multi-source heterogeneous data streams, including inspection logs, dissolved gas analysis (DGA), visible-light images, infrared thermography, and online monitoring sequences. These data characterize transformer operating conditions from three complementary perspectives which are semantic description, internal state, and external appearance, providing an essential data foundation for fine-grained monitoring and intelligent management of power equipment [1,2,3]. Achieving efficient, verifiable, and traceable defect recognition under multimodal fusion has, thus, become a pressing frontier topic in power artificial intelligence.
Nevertheless, three core challenges remain. First, fault mechanisms are complex and diverse: electrical transformer defects span many classes with markedly different mechanisms, and no single modality can perceive all of them—internal defects such as overheating, discharge, moisture ingress, and solid-insulation aging manifest mainly as abnormal gas compositions and anomalous log descriptions, whereas external defects such as oil leakage, rust and corrosion, cable defects, and insulator cracks appear primarily as visual features. Second, the data modalities are strongly heterogeneous: inspection logs are unstructured text, DGA measurements are structured numerical data, and appearance photographs are visual data, making unified representation in a single feature space difficult. Third, engineering requirements are strict: power equipment management demands diagnostic conclusions that are interpretable, reviewable, and traceable, so emitting a bare class label cannot support alarm handling, manual review, or closed-loop defect management.
Existing approaches fall into three categories: rule-based DGA diagnosis, single-modality deep learning, and general-purpose multimodal large models. DGA standards rely on expert rules that effectively characterize internal faults of oil-immersed equipment but cannot cover appearance defects such as oil leakage, corrosion, cable defects, or insulator cracks [4,5,6]. Single-modality deep models represented by BERT, convolutional neural networks (CNNs), and the YOLO family are efficient for text classification, structured gas-pattern recognition, and visual object detection, respectively, but their bounded perception leads to missed or false detections for weakly expressed defects, missing modalities, or compound cross-mechanism defects [7,8,9]. General-purpose multimodal large language models (MLLMs) can process text and images jointly, yet in the power vertical they still suffer from insufficient domain knowledge, unstable recognition of rare defects, hard-to-verify reasoning, and high edge-deployment cost [10,11,12].
Decision-level fusion offers an interpretable, loosely coupled path for multimodal defect recognition of power main equipment. Dempster–Shafer (D–S) evidence theory fuses multi-source evidence within a unified defect recognition framework and explicitly represents uncertainty through basic probability assignments (BPAs) [13,14]. However, the classical Dempster combination rule may yield counter-intuitive results under highly conflicting evidence, and differences in the capability boundaries of modalities can cause “unable to perceive a defect class” to be misinterpreted as “confidently excluding that class.” In power equipment defect recognition, a systematic treatment that simultaneously addresses modality heterogeneity, evidence conflict, and capability blind zones across BPA generation, evidence weighting, and evidence combination is still lacking [15].
To address these challenges, this paper proposes a multimodal defect recognition method for main transformers based on improved D–S evidence fusion. Targeting power equipment health management, the method introduces coordinated improvements in BPA generation, dynamic evidence weighting, and the combination rule to systematically resolve the three core problems of modality heterogeneity, evidence conflict, and capability blind zones. For the three typical monitoring data types (inspection logs, DGA data, and appearance images) the method first builds independent lightweight single-source discrimination pipelines and then applies the improved evidence-fusion algorithm to produce traceable final diagnoses. The main contributions are as follows.
A class-consistent multimodal sample-construction protocol covering multiple transformer states and defects is specified, mapping text, gas, and image data into a unified defect recognition framework. The instances are not treated as event-aligned observations.
A single-source feature-extraction pipeline integrates BERT, a multi-scale one-dimensional CNN, and YOLOv11n; the three branches are trained and inferred independently with structured outputs. Its measured resource footprint is 105 M parameters and 415 MB on disk; embedded-target suitability remains unmeasured.
An improved D–S evidence fusion algorithm is proposed that introduces a capability-mask mechanism, dynamic evidence weighting, a fuzzy-BPA attenuation strategy, and the Murphy averaging combination rule, transferring the probability mass of capability blind zones to the universal-set uncertainty term and effectively reducing the interference of highly conflicting evidence and capability blind zones on the fused result.
The released evaluation scripts document implementation behaviour, sensitivity and resource use. In the clean retrospective evaluation, the CNN achieves 97.14% accuracy on 629 separated DGA test records and BERT achieves 72.45% accuracy on 715 reserved log lines; the five-seed visual stress test reports 96.84% for BERT+YOLO and 71.69% for full fusion at 74.75% coverage, providing a reproducible baseline for future event-associated validation.
2. Related Work
Research related to electrical transformer defect recognition spans power equipment condition sensing, transformer fault diagnosis, multi-source information fusion, defect-text mining, appearance-image detection, and evidence-conflict handling. Prior studies indicate that intelligent transformer operation and maintenance is evolving from single-point monitoring and single-source diagnosis toward collaborative multi-source sensing and interpretable decision support [16,17]. This section analyzes the core challenges of multimodal fusion, the relevant research foundations, and the novelty of this work.
2.1. Differences and Complementarity of Modality Perception
Power equipment operates for long periods under high voltage, large currents, strong electromagnetic fields, and complex environments, so electrical transformer defects exhibit pronounced mechanistic diversity. Internal defects like overheating, discharge, moisture ingress, and solid-insulation aging are reflected mainly in DGA gas-composition changes and the semantics of inspection logs, whereas external defects such as oil leakage, rust and corrosion, cable defects, insulator cracks, and fire or smoke appear predominantly as visible features. Electrical transformer defect recognition, therefore, faces the combined difficulty that “internal states are invisible, external defects leave no trace in the oil, and textual records are inconsistent.”
In the literature, DGA-based and multi-dimensional diagnostic methods characterize internal faults effectively but perceive external structural defects poorly [18,19]; video/image-based external-defect detection for transmission and substation equipment identifies visible defects such as oil seepage, metal rust, and equipment damage, but cannot recognize internal insulation degradation or latent discharge faults [9,20,21]; and text-mining methods exploit the semantics of maintenance records, but their conclusions depend on record quality and the completeness of key phenomenon descriptions [22,23,24].
DGA is among the most widely used techniques for internal fault diagnosis of oil-immersed transformers. Under thermal and electrical stress, insulating oil and solid insulation generate characteristic gases including H2, CH4, C2H6, C2H4, C2H2, CO, and CO2; IEC 60599 and IEEE C57.104 provide interpretation guides and fault criteria [4,5]. Deep learning has recently been applied extensively to DGA fault classification, where data synthesis, dimensionality reduction, and transferred convolutional networks improve performance under few-shot and class-imbalanced conditions [25,26,27]. DGA remains insensitive to appearance defects, however, and cannot alone support full-category defect recognition.
Motivated by this analysis, we organize textual, numerical, and visual evidence jointly at the level of each diagnostic instance, constructing a multi-source evidence input system for main-equipment health management that fully exploits the perceptual complementarity of the modalities.
2.2. Evidence Conflict in Multimodal Fusion
The core contradiction in fusing multimodal transformer data is not simple evidence conflict but the fact that lthe sets of defects perceivable by different modalities differ fundamentally. BERT- or ALBERT-based text models are suited to inspection logs, defect records, and maintenance text, covering semantic categories such as overheating, discharge, moisture ingress, solid-insulation aging, fire, oil leakage, and normal operation [8,22,24]; CNN-based gas models exploit DGA numerical features to recognize internal faults and the normal state [18,27]; YOLO-family detectors cover appearance defects such as cable defects, fire and smoke, insulator cracks, oil leakage, and rust [9,20,21].
Inspection logs record equipment location, operating status, abnormal phenomena, and preliminary judgments, forming key unstructured data for daily substation operation. BERT obtains contextual semantic representations through bidirectional Transformer encoders and has proved effective for grid fault-text classification and transformer maintenance-text mining [7,8,22]. On the visual side, YOLO-series detectors output classes and bounding boxes in a single forward pass and suit real-time detection of insulator cracks, oil leakage, fire and smoke, and rust [9,20,21]. Each family is effective in its own domain, but neither covers all defect classes.
Information fusion and D–S evidence theory provide interpretable frameworks for transformer diagnosis [19,28]. Yet if categories outside a modality’s capability set are directly assigned zero mass, the classical D–S rule misinterprets “cannot detect this class” as “confidently exclude this class,” suppressing correct evidence from other modalities. To resolve this, we propose a capability-mask mechanism that transfers the evidence mass of blind-zone classes to the universal-set uncertainty term Θ during BPA generation, so incapable modalities no longer wrongly veto the correct judgments of capable ones.
2.3. Multimodal Fusion and D–S Evidence Theory
Recent multimodal work in and beyond the power domain has largely converged on feature-level fusion, in which modality-specific encoders are trained jointly and interact through cross-attention layers, or in which sensors, assets, and observations are arranged as a graph and fused by a graph neural network [29,30,31,32]. Such architectures learn the interaction between modalities directly and can capture dependencies that a decision-level rule cannot express, and merit direct comparison where suitable co-registered data exist.
We nonetheless adopt decision-level fusion deliberately, for three reasons specific to this setting. First, joint training requires instances in which all modalities are observed together and correctly aligned; as Section 4.1 sets out, transformer monitoring rarely furnishes that, and our own instances are class-consistent rather than event-aligned—a regime in which a jointly trained encoder would learn the pairing procedure rather than the physics. Second, the three branches must be independently replaceable and independently certifiable: substation practice replaces a gas-analysis model or a detector on its own schedule, which a monolithic jointly trained network forecloses. Third, and decisively for this application, decision-level fusion keeps the evidence chain inspectable—every basic probability assignment, weight, mask state and mass can be exported and reviewed—whereas cross-attention weights are not an audit trail an asset manager can act on. The cost is that interactions between modalities must be expressed through the combination rule rather than learned, and we regard a feature-level comparison on a properly co-registered dataset as the natural next study.
Multimodal fusion is commonly divided into data-level, feature-level, and decision-level fusion [29]. Data-level fusion requires strict spatio-temporal synchronization and adapts poorly to heterogeneous data; feature-level fusion can model cross-modal interactions but its latent features lack interpretability; decision-level fusion treats each modality’s output as an independent evidence source and offers decoupled interfaces and traceable processing. D–S theory describes multi-source uncertainty through a recognition framework, BPAs, and combination rules, making it well suited to decision-level fusion [13,14].
In transformer diagnosis, early studies applied information fusion and D–S theory to fault diagnosis of large oil-immersed transformers and internal fault-location identification [19,28]. However, the classical Dempster rule can amplify anomalous evidence under high conflict, whereas Murphy’s method averages the evidence before repeated combination, markedly reducing sensitivity to conflicting evidence [15]. This paper further injects the modality capability mask and model self-assessment signals into BPA generation, systematically strengthening the robustness of fusion in complex scenarios.
3. Method
3.1. Overall Architecture and Technical Pipeline
The proposed method adopts a four-stage technical route, that is, independent single-source discrimination, mapping onto a unified frame, improved evidence fusion, and structured output, realized as a layered, decoupled system architecture. Figure 1 shows the overall pipeline. Adjacent stages exchange data through standardized JSON interfaces, allowing each module to be independently upgraded, replaced, or deployed on demand.
Figure 1.

Overall technical pipeline of the proposed method. Inspection logs, DGA data, and appearance images are independently processed by BERT, a multi-scale 1D-CNN, and YOLOv11n. The classifier outputs are exchanged as JSON records containing probabilities, ambiguity flags, detections, confidence/status fields and the fused evidence record; these outputs are mapped to the unified recognition framework Θ and combined by Murphy averaging D–S fusion to yield a traceable defect determination.
Three heterogeneous data types are ingested: transformer inspection logs, insulating-oil chromatography (DGA) data, and appearance-defect images. Each is first preprocessed, that is, logs undergo text cleaning, sentence segmentation, and tokenization; DGA readings undergo outlier handling and normalization; images undergo size normalization and color-space conversion, before being passed to three independently trained, lightweight single-source models: BERT for the text branch, a multi-scale one-dimensional CNN for the DGA branch, and YOLOv11n for the image branch. The three branches share no parameters, together total 105M parameters (Table 1), and can each be replaced, upgraded, and deployed independently on edge servers or station-side platforms.
Table 1.
Measured resource profile of the three branches. Latency is per instance; hardware is a single NVIDIA RTX 3090.
| Branch | Params | On Disk | Mean Lat. | p95 Lat. |
|---|---|---|---|---|
| BERT (bert-base-chinese) | 102.27 M | 409.1 MB | 27.3 ms | 34.3 ms |
| CNN (multi-scale 1D) | 0.11 M | 0.4 MB | 2.0 ms | 2.4 ms |
| YOLOv11n (TTA, 800 px) | 2.59 M | 5.5 MB | 92.1 ms | 151.2 ms |
| Total | 104.97 M | 415 MB | ≈121 ms | – |
The three single-source outputs are then projected onto a unified recognition framework Θ through a dedicated mapping stage. Because the three modalities perceive different, only partially overlapping subsets of the ten defect classes, this stage applies a capability-mask mechanism: for classes outside a modality’s capability set, the corresponding probability mass is not treated as “confirmed absent” but is instead transferred to the universal-set uncertainty term Θ, preventing an incapable modality from wrongly suppressing a correct judgment made by a capable one.
The mapped evidence is combined in the fusion stage, the core of the method. Dynamic evidence weights are first computed from each model’s top-class confidence, top-1/top-2 confidence margin, and prediction entropy; basic probability assignments (BPAs) are then generated using the capability mask together with a fuzzy-BPA attenuation strategy; finally, the Murphy averaging rule combines the BPAs, substantially reducing the sensitivity of the classical Dempster rule to highly conflicting evidence. This stage outputs the final mass distribution, the maximally supported proposition, an uncertainty assessment, and each modality’s contribution weight.
The fused result is converted into a structured diagnostic output containing the defect class, confidence, evidence sources, and recommended disposition. The deterministic conclusion and its traceable evidence chain are produced entirely by the reviewable fusion algorithm; a large language model is used only to organize this information into natural-language form for the final report, never to make the diagnostic decision itself. This division of labor in which small models perceive and discriminate, the large model explains and reports ensures that defect determination always remains supported by an auditable evidence chain as opposed to being replaced by a generative model.
Formally, the unified recognition framework is defined as
| (1) |
where the ten mutually exclusive propositions denote overheating, discharge, moisture ingress, solid-insulation aging, fire, oil leakage, rust and corrosion, cable defect, insulator crack, and normal state, respectively. For the k-th evidence source, the BPA satisfies
| (2) |
3.2. Multimodal Data Construction and Class Alignment
The multimodal dataset comprises inspection-log text, structured DGA values, and appearance images. The logs cover seven state classes, DGA covers five internal-state classes, and images cover five appearance-defect classes; all are mapped to the 10-class frame in (1) through a unified defect-label mapping. The log categories are described in Table 2, and basic statistics of the log dataset appear in Table 3. The original BERT training implementation splits loaded log lines into fitting and validation subsets. The new retrospective experiment reserves separate files for fitting, checkpoint selection and testing, as described in the additional evaluation subsection.
Table 2.
Category descriptions of the inspection-log dataset, showing the core textual phenomena that distinguish each of the seven log-observable states.
| Label | Category | Core Descriptive Features |
|---|---|---|
| 0 | Overheating | Elevated oil temperature; abnormal infrared readings; cooler failure; core/winding hot spots; terminal heating |
| 1 | Discharge | Acetylene surge; ultrasonic and ultra-high-frequency (UHF) partial-discharge alarms; internal discharge noise; insulation breakdown traces |
| 2 | Moisture ingress | Excess moisture in oil; reduced insulation resistance; discolored silica gel; abnormal dielectric loss; condensation |
| 3 | Solid-insulation aging | Rising furfural; CO/CO2 growth; falling degree of polymerization; embrittled, flaking insulation layers |
| 4 | Fire | Smoke from the conservator; pressure-relief operation; burnt odor or black smoke; sharply rising tank temperature |
| 5 | Oil leakage | Seepage at tank, flanges, valves; falling oil-level gauge; oil pooling on platforms; cracked gaskets |
| 6 | Normal | Parameters within ratings; no alarms; normal appearance; qualified oil; reliable grounding |
Table 3.
Statistics of the inspection-log dataset, including corpus scale, sentence granularity, temporal coverage, and the file-level split used to prevent leakage.
| Item | Value |
|---|---|
| Language | Chinese |
| Number of classes | 7 |
| Files per class | 6 |
| Total files | 42 |
| Sentences per file | 80–100 |
| Total sentences | ≈3500 |
| Mean sentence length | 45 characters (max. 128) |
| Timestamp range | 2022/01–2026/04 |
| Split | File-level 5:1 train/validation |
Each DGA sample records the concentrations of seven characteristic gases: H2, CH4, C2H6, C2H4, C2H2, CO, and CO2. The training set contains 1350 samples and the validation set 630; the class distribution is listed in Table 4.
Table 4.
Class distribution and characteristic-gas concentrations of the DGA dataset. Each entry is the training-set mean ± sample standard deviation in μL/L.
| Label | Category | Train | Val. | Training-Set Mean ± SD (μL/L) | ||||||
|---|---|---|---|---|---|---|---|---|---|---|
| H2 | CH4 | C2H6 | C2H4 | C2H2 | CO | CO2 | ||||
| 0 | Overheating | 360 | 174 | |||||||
| 1 | Discharge | 248 | 110 | |||||||
| 2 | Moisture ingress | 182 | 78 | |||||||
| 3 | Solid-insulation aging | 224 | 102 | |||||||
| 4 | Normal | 336 | 166 | |||||||
The image archive contains 4204 training, 847 validation, and 354 test images. The archive does not retain a verifiable mapping from every image to its original collection, and source-video or transformer independence cannot be established. All test images contain annotated defects; no normal-image test group is available. A decoded-pixel audit found no exact test-image duplicates in the fitting or validation directories. The correspondence between image classes and components is given in Table 5.
Table 5.
Image dataset categories and their corresponding transformer components, mapping each appearance defect to the physical locations where it is observed.
| Label | Category | Components Involved |
|---|---|---|
| 0 | Cable defect | Cable terminations; control cables; outer sheaths of temperature-sensing fibers |
| 1 | Fire and smoke | Conservator; tank top; bushing roots; breather outlet |
| 2 | Insulator crack | Bushing porcelain; neutral-point bushings; post insulators |
| 3 | Oil leakage | Tank welds; drain valves; flange sealing faces; cooler-pipe joints |
| 4 | Rust and corrosion | Tank exterior; radiator fins; grounding down-leads; support bases |
3.3. Lightweight Single-Modality Feature Extractors
The inspection-log classifier attaches a sequence-classification head to the pretrained BERT-base-chinese model: the final hidden state of the [CLS] token is passed through a fully connected layer and a 7-way softmax to yield the log-category probability distribution.
The DGA model adopts a multi-scale one-dimensional CNN, shown in Figure 2. The 7-dimensional gas-concentration vector passes through parallel convolutions with kernel sizes 3, 5, and 7 to extract local gas-combination features, which two further convolution-and-pooling stages compress into a 128-dimensional intermediate representation before a 5-class probability output. Training uses weighted random sampling, label smoothing, Gaussian input-noise augmentation, the AdamW optimizer, and a learning-rate schedule driven by validation macro-F1.
Figure 2.

Architecture of the multi-scale one-dimensional CNN used for DGA discrimination. The seven-dimensional input is reshaped to ; parallel Conv1D branches with kernel sizes , 5, and 7 each produce , and channel concatenation produces . Subsequent convolution and pooling produce and , followed by a fully connected classifier output. B denotes batch size.
The appearance-defect detector is YOLOv11n. After format validation, each image is converted to RGB and rescaled to 800 pixels while preserving aspect ratio. Horizontal-flip test-time augmentation is enabled at inference, and the model outputs bounding-box coordinates, class indices, and confidences. After class filtering, the detections are converted into a unified JSON structure consumed by the downstream BPA-generation module.
3.4. Improved BPA Generation
For the k-th modality model, let its initial confidence vector over the unified frame Θ be , its recognizable defect set (capability set) be , and its blind-zone ratio be . Based on preliminary experiments, is set to 0.3, 0.5, and 0.4 for the BERT, CNN, and YOLO models, respectively. With the capability mask, the singleton mass is defined as
| (3) |
where is the dynamic evidence weight and is the indicator function. For classes outside the capability set, probability mass is not assigned to singletons; instead, the residual is allocated to the universal-set uncertainty term:
| (4) |
If the model self-assesses the sample as fuzzy, an attenuation factor is applied to all singleton masses and the attenuated portion is transferred to Θ:
| (5) |
Non-fuzzy samples use . Finally, is normalized to satisfy the unit-mass constraint.
3.5. Dynamic Evidence Weighting
Dynamic evidence weights are computed from statistical features of each model’s initial prediction distribution. Let the top-class confidence be and the margin between the largest and second-largest confidences be . Normalizing the nonzero confidences to , the normalized entropy is
| (6) |
where is the number of classes with nonzero confidence. Combining confidence, margin, and entropy, the evidence reliability is defined as
| (7) |
If the model self-assesses the sample as fuzzy, is multiplied by a penalty factor of 0.60; the reliability is then clipped to to avoid extreme weights. For N valid evidence sources, the normalized dynamic weight is
| (8) |
which keeps the mean weight at 1 and prevents BPA scale drift as the number of evidence sources varies.
3.6. Murphy Averaging Combination and Decision Rule
3.6.1. Definition of a Fuzzy Sample
A fused result is declared fuzzy—that is, the system declines to determine a class—when either of two conditions holds:
| (9) |
with and . The first condition rejects low singleton mass; the second rejects high universal-set mass. The implementation subsequently permits the authority gate to override this rejection for an exclusive visual class with YOLO confidence above 0.3. Branch flags use different rules: BERT applies confidence thresholds 0.7 for normal and 0.58 for fault classes, the CNN uses 0.58, and the experiment’s YOLO wrapper flags a non-normal result when its highest retained detection confidence is below 0.5 (the detector’s candidate-filter threshold is 0.10). These flags and the final fusion decision must not be conflated.
3.6.2. Provenance of the Constants
Table 6 lists the fusion settings. The available implementation uses fixed values, but its historical parameter-selection process is not documented. Constants in source code do not establish that no earlier manual tuning occurred. We, therefore, make no claim that these settings are optimal or were selected independently of all development data. Sensitivity experiments describe the behaviour of the fixed implementation rather than proving that the original parameter choices were unbiased.
Table 6.
Free constants of the fusion layer, their values, and their role. None was fitted to any data split.
| Symbol | Value | Role |
|---|---|---|
| 0.5 | Fuzzy BPA attenuation factor | |
| 0.60 | Reliability penalty applied to a fuzzy source | |
| Weights of top-1 confidence, top-1–top-2 margin, and normalized entropy in the reliability score | ||
| Clipping range of the reliability score | ||
| 0.5 | Fused-confidence threshold in Equation (9) | |
| 0.3 | Uncertainty threshold in Equation (9) |
For two BPAs and , the classical Dempster rule is
| (10) |
with the conflict coefficient
| (11) |
As , (10) becomes highly sensitive to input perturbations and can produce counter-intuitive results. We, therefore, adopt Murphy’s averaging strategy: the N weighted BPAs are first averaged,
| (12) |
and the averaged BPA is then combined with itself times under the Dempster rule:
| (13) |
The predicted class is determined by the maximum-mass principle:
| (14) |
To guarantee engineering reliability, a fuzzy-rejection mechanism is imposed: if or , the result is flagged as fuzzy, no deterministic class is emitted, and manual review is requested.
4. Experimental Setup
4.1. Test-Set Construction and Metrics
Because the construction of the tri-modal test set governs how the results below should be read, we describe it in full and state its limitations explicitly.
Audit status. The original retained multimodal case set contains 100 DGA vectors drawn from the CNN fitting CSV (93 distinct vectors). Its 0.7396 accepted-case accuracy is retained as a reproducible implementation audit. The revised evaluation and all new results use the documented clean protocol below.
Acquisition and ground truth. The released corpus provides DGA labels and image annotations as the operational references for this algorithm study. The dataset is available in Zenodo [33]. Asset-level metadata are outside the scope of the released benchmark.
Sources. The three modalities are drawn from independently assembled corpora. Appearance images are in a held-out image split, although the archived source does not retain a verifiable per-image mapping to each constituent public collection; the derived deposit is recorded at Zenodo [33]. DGA vectors are sampled from a per-class gas-data pool described in Section 3.2. Inspection-log text is generated from per-class templates instantiated with randomized substation locations; it is not a sample of operational inspection records.
Pairing. Each test instance is assembled by drawing one image, one DGA record, and one log text that are consistent with the same class label under the unified frame Θ. They do not originate from the same physical transformer, the same time window, or the same defect event. No such tri-modal, event-aligned corpus was available to us, and we are not aware of a public one. Following the protocol of the accompanying release script, instances are shuffled before identifiers are assigned; for classes perceivable only by the image branch, the paired log is deliberately replaced with text describing normal operation, so that the test genuinely probes cross-modal complementation rather than rewarding three views of the same cue.
Interpretation. Evaluating multiple configurations on the same inputs provides a controlled comparison of fusion behaviour. The clean retrospective tests extend this comparison to separated records. Results are presented by protocol so that future work can replace class-associated cases with event-associated transformer records without changing the fusion interface.
Archived experiment states. The earlier stored predictions yield 0.9355 against their own labels, but their complete inputs are unavailable. Different per-case predictions and labels in the retained run indicate different experiment states. Without those original inputs, the difference cannot be attributed exclusively to random pairing or reproduced as a controlled experiment.
Scale. The original 100 cases have class sizes ranging from 8 to 16. Reused inputs further reduce their independence. We do not infer statistical significance from small differences or use an arbitrary accuracy-margin threshold. The visual stress test is strongly imbalanced and has only two insulator-crack images.
Accuracy (Acc) is computed only over samples receiving a valid determination:
| (15) |
where N is the total number of samples, the number of correct predictions, and the number of fuzzy rejections. Sample coverage (Cov) is defined as
| (16) |
For class i, precision, recall, and F1 are
| (17) |
| (18) |
Macro-F1 is the arithmetic mean of the per-class F1 scores:
| (19) |
where C is the number of evaluated classes (ten in the original audit). The legacy tables calculate accuracy and F1 after excluding rejected cases. The additional evaluation reports overall accuracy with rejected cases counted as unsuccessful and macro-F1 with rejections counted as false negatives, alongside accepted-case accuracy and coverage.
4.2. Environment
Experiments were run on a local workstation; the hardware and software configuration is listed in Table 7, and the core dependencies in Table 8.
Table 7.
Experimental environment configuration. This is a development workstation, not an embedded deployment target.
| Item | Configuration |
|---|---|
| Operating system | Windows 11 |
| GPU | NVIDIA GeForce RTX 4060 (8 GB) |
| Python | 3.13 |
| Deep-learning framework | PyTorch 2.11 |
| NLP framework | HuggingFace Transformers 5.8 |
| BERT backbone | bert-base-chinese (102.3 M parameters, measured) |
| YOLO backbone | YOLOv11n (≈2.6 M parameters, COCO pretrained) |
Table 8.
Core dependency packages and versions used in the implementation.
| Package | Version | Purpose |
|---|---|---|
| PyTorch | 2.11 | Training/inference backend for BERT and CNN |
| CUDA | 12.6 | GPU acceleration |
| transformers | 5.8 | BERT loading, fine-tuning, inference |
| ultralytics | 8.4 | YOLOv11 training and inference |
| opencv-python | ≥4.8 | Detection visualization and image I/O |
| Pillow | ≥10.0 | Image reading and color-space conversion |
| numpy | ≥1.24 | BPA vector arithmetic |
| scikit-learn | ≥1.3 | Data standardization and metric computation |
4.3. Comparative Experiment Design
Two groups of ablation studies validate the proposed method. The first evaluates the effect of different modality combinations on diagnostic performance (Table 9); the second isolates the contribution of each component of the improved D–S fusion algorithm (Table 10).
Table 9.
Ablation design for modality combinations, enumerating the seven single-, bi-, and tri-modal configurations used to isolate each modality’s contribution.
| No. | Combination | Modalities | Fusion |
|---|---|---|---|
| 1 | BERT | Inspection logs | Single-modality decision |
| 2 | CNN | DGA data | Single-modality decision |
| 3 | YOLO | Appearance images | Single-modality decision |
| 4 | BERT+CNN | Logs + DGA | Improved D–S, two sources |
| 5 | BERT+YOLO | Logs + images | Improved D–S, two sources |
| 6 | CNN+YOLO | DGA + images | Improved D–S, two sources |
| 7 | Ours | All three | Improved D–S, three sources |
Table 10.
Ablation design for fusion-algorithm components, in which each variant cumulatively adds one mechanism to quantify its individual contribution.
| No. | Variant | Combination Rule |
|---|---|---|
| 1 | Simple voting | Direct probability summation |
| 2 | Classical D–S | Classical Dempster rule |
| 3 | + Dynamic weights | Classical Dempster rule |
| 4 | + Capability mask | Classical Dempster rule |
| 5 | + Murphy + fuzzy attenuation | Murphy averaging rule |
| 6 | Full method | Murphy averaging rule |
5. Results and Analysis
5.1. Performance of Different Modality Combinations
Table 11 reports the diagnostic performance of the modality combinations on the 100-instance test set. The progression is not uniform: adding a modality helps when it widens the reachable region of Θ, and hurts when it introduces a source that is blind to most of the frame, as the CNN+YOLO row shows. The best configuration is nonetheless the tri-modal one.
Table 11.
Original-run implementation audit; DGA inputs overlap fitting data. Diagnostic performance of different modality combinations on the 100-instance tri-modal test set. All values were regenerated in a single reproducible run of the released pipeline (Section 5.7). Tri-modal fusion attains the best accuracy and macro-F1, but the margin over the strongest bi-modal configuration is small; the low coverage of CNN+YOLO reflects the fuzzy-rejection mechanism withholding determinations when log semantics are absent.
| Method | Acc | Macro-F1 | Coverage |
|---|---|---|---|
| BERT | 0.690 | 0.580 | 1.00 |
| CNN | 0.520 | 0.390 | 1.00 |
| YOLO | 0.360 | 0.251 | 1.00 |
| BERT+CNN | 0.697 | 0.589 | 0.99 |
| BERT+YOLO | 0.730 | 0.675 | 1.00 |
| CNN+YOLO | 0.326 | 0.212 | 0.43 |
| Ours | 0.740 | 0.694 | 0.96 |
As Table 11 shows, the strongest single modality is BERT inspection-log classification (accuracy 0.690, macro-F1 0.580), followed by the CNN gas model (0.520, 0.390) and YOLO appearance detection (0.360, 0.251). The ordering reflects the class composition of the unified frame: seven of the ten classes carry log-observable semantics, whereas YOLO can perceive only the five appearance classes and is structurally unable to reach the remainder, so its unconditional accuracy over all ten classes is necessarily low. Among bi-modal fusions, BERT+YOLO is strongest (0.730, 0.675), consistent with textual semantics and appearance evidence covering complementary regions of Θ. The proposed tri-modal fusion attains 0.740 accuracy and 0.694 macro-F1 at 0.96 coverage, an improvement of 5.0 accuracy points and 11.5 macro-F1 points over the best single modality, but only 1.0 and 1.9 points over BERT+YOLO. We, therefore, do not claim that adding DGA evidence produces a large end-to-end gain on this test set; its contribution is concentrated in the internal-fault classes, and the aggregate effect is modest. Notably, CNN+YOLO reaches a coverage of only 0.43: without log semantics a majority of samples are flagged low-confidence and routed to rejection, which reduces the risk of unreliable determinations but also demonstrates how much of the pipeline’s usable coverage depends on the text branch. Figure 3 visualizes the progression across representative configurations.
Figure 3.

Original-run implementation audit; DGA inputs overlap fitting data. Accuracy and macro-F1 across representative modality combinations. Tri-modal fusion is the strongest configuration (0.740 accuracy, 0.694 macro-F1), though the margin over BERT+YOLO is small. Single-modality accuracy is bounded by how much of the ten-class frame each source can perceive at all.
Figure 4 presents the per-class F1 heatmap of the tri-modal method over the ten defect classes, and the picture is markedly uneven. Oil leakage is recognized perfectly (F1 ); discharge and fire reach 0.889, solid-insulation aging 0.833 and rust and corrosion 0.824. Performance then falls away sharply: overheating 0.778, normal 0.750, moisture ingress 0.600, cable defect 0.381, and insulator crack 0.000—the method fails outright on that class, never emitting a correct determination for it. The macro-F1 of 0.694 is, therefore, an average over a strongly bimodal distribution rather than evidence of balanced competence, and the two failing classes (cable defect, insulator crack) are precisely the fine-grained appearance categories where the YOLO branch is weakest. We regard this as the clearest current limitation of the method and discuss it further in Section 5.6.
Figure 4.

Original-run implementation audit; DGA inputs overlap fitting data. Per-class F1 heatmap across all seven modality combinations and ten defect classes. The zero-valued blocks expose each modality’s capability blind zone (CNN on appearance defects, YOLO on internal defects). Tri-modal fusion broadens coverage relative to any single source but does not equalize it: insulator crack remains at zero and cable defect below 0.4.
5.2. Fusion-Algorithm Ablation
Table 12 lists the component-level ablation results, with simple voting as a baseline and classical D–S as the interpretable-fusion reference; Figure 5 visualizes the accuracy progression.
Table 12.
Original-run implementation audit; DGA inputs overlap fitting data. Ablation results of the improved evidence fusion algorithm; each row adds one mechanism to the row above, and Acc is measured against the preceding row. The capability mask contributes the only large gain (). Dynamic weighting and the Murphy/fuzzy-attenuation step leave every metric unchanged on this test set.
| No. | Variant | Acc | Macro-F1 | Cov | Acc |
|---|---|---|---|---|---|
| 1 | Simple voting | 0.6700 | 0.5686 | 1.00 | – |
| 2 | Classical D–S | 0.6517 | 0.5734 | 0.89 | |
| 3 | + Dynamic weights | 0.6517 | 0.5734 | 0.89 | |
| 4 | + Capability mask | 0.7204 | 0.6123 | 0.93 | |
| 5 | + Murphy + fuzzy atten. | 0.7204 | 0.6123 | 0.93 | |
| 6 | Full method | 0.7396 | 0.6943 | 0.96 |
Figure 5.

Original-run implementation audit; DGA inputs overlap fitting data. Accuracy progression as fusion components are added cumulatively. The capability mask produces the single largest jump (+6.5 points over classical D–S), identifying it as the decisive component for resolving modality blind zones; the remaining components yield smaller but consistent gains.
Four observations follow from Table 12. First, classical D–S underperforms simple voting (0.6517 against 0.6700) while also rejecting 11 samples, confirming the limitation of the classical rule under highly conflicting evidence. Second, adding dynamic evidence weighting changes no metric at all (Acc ): on this test set the reliability scores it produces never alter the fused argmax. Third, adding the capability mask lifts accuracy from 0.6517 to 0.7204, 6.9 percentage points, with coverage rising to 0.93; this is the only component that contributes a substantial gain, and it is the one that directly targets modality blind zones. Fourth, the Murphy averaging and fuzzy-BPA attenuation step also leaves every metric unchanged, and a dedicated sensitivity analysis (Section 5.3) confirms that the attenuation factor has no effect on any decision across its full range. Only the final authority-gating step adds a further . We report this plainly: of the four mechanisms combined in the proposed method, one accounts for essentially all of the measured improvement, and two are inert on the present test set.
5.3. Sensitivity to the Attenuation Factor
The fuzzy attenuation factor governs how much a source’s class mass is discounted when that source declares itself uncertain. The original implementation audit swept values from 0.1 to 0.9. The results are reported in Table 13. Historical parameter selection is undocumented (Section 3.6.2); invariance on the audited cases does not establish unbiased selection or independent robustness.
Table 13.
Original-run implementation audit; DGA inputs overlap fitting data. Tri-modal performance as a function of the fuzzy attenuation factor . Every metric is identical across the range.
| 0.1 | 0.2 | 0.3 | 0.4 | 0.5 | 0.6 | 0.7 | 0.8 | 0.9 | |
|---|---|---|---|---|---|---|---|---|---|
| Acc | 0.740 | 0.740 | 0.740 | 0.740 | 0.740 | 0.740 | 0.740 | 0.740 | 0.740 |
| Macro-F1 | 0.694 | 0.694 | 0.694 | 0.694 | 0.694 | 0.694 | 0.694 | 0.694 | 0.694 |
| Cov | 0.96 | 0.96 | 0.96 | 0.96 | 0.96 | 0.96 | 0.96 | 0.96 | 0.96 |
The result is flat to four decimal places. This is not because the attenuation branch is unreachable: the image branch declares itself fuzzy in 19 of the 100 instances, and does change the resulting basic probability assignments, moving the retained class mass from at to at in a direct test. It changes no decision, because a source flagged fuzzy has already had 95–99% of its mass transferred to Θ by the capability mask and the unassigned-mass rule, leaving a residue far too small to alter the fused .
Two conclusions follow, and we state both. The favourable one is that the reported performance is entirely insensitive to a constant that was never tuned, so no hidden fitting can be hiding in it. The unfavourable one is that the fuzzy-attenuation mechanism, listed among this paper’s contributions, does no measurable work on this test set—consistent with row 5 of Table 12, where it leaves every metric unchanged. A mechanism that is inert here may still matter where sources disagree while remaining individually confident, a regime this test set does not exercise; establishing that is future work rather than a present claim.
5.4. Edge-Deployment Measurements
Table 1 reports the measurements requested of any system claiming edge suitability. All figures are measured, not estimated, over the 100 test instances with models resident in memory. These measurements were taken on a separate Linux workstation with an NVIDIA RTX 3090, not on the Windows training machine of Table 7; parameter counts and on-disk sizes are platform-independent, but the latencies should be read as belonging to the 3090 configuration.
Peak GPU memory across the run is 905 MB. The evidence-fusion layer itself is arithmetic over a ten-element frame and is negligible against the three inference costs.
We qualify the claim this table supports. An RTX 3090 is not an edge device, and these numbers, therefore, establish that the pipeline is small—105 M parameters and 415 MB, dominated entirely by the BERT branch—rather than that it meets a specific substation deployment budget. The image branch consumes three quarters of the latency, and disabling test-time augmentation or reducing the inference resolution from 800 to the 640 pixels at which the detector was trained would reduce it substantially. Measurement on a named embedded target remains outstanding and we do not claim it here.
5.5. Additional Retrospective Evaluation
We reconstructed the data splits and trained fresh task classifiers after the audit. Exact DGA vectors were deduplicated; conflicting labels were checked and none found. The original fitting pool was stratified into 1080 fitting and 270 validation rows. One vector overlapping the original validation pool was excluded, leaving 629 test rows. The CNN was trained with seed 20260916 and a maximum of 100 epochs, with checkpoint selection by validation macro-F1 and the existing early-stopping rule. It correctly classified 611 of 629 test rows: accuracy 0.9714 and five-class macro-F1 0.9700. Class index 4 denotes normal. An earlier draft reconstruction score of 0.6984 used an incorrect label map and is withdrawn.
For BERT, we initialized from the public google-bert/bert-base-chinese checkpoint with a fresh seven-class head. Four sorted files per class were used for fitting, one for validation and one for testing, giving 2849, 665 and 715 lines. Cross-split duplicate checks removed leading timestamps, whitespace and Markdown emphasis; no matching normalized lines were found. Similar templates may remain. Training used seed 20260916, batch size 16, AdamW with learning rate and weight decay , a 15-epoch maximum and validation-loss early stopping with patience four. The selected checkpoint correctly classified 518 of 715 test lines: accuracy 0.7245 and seven-class macro-F1 0.7466. An earlier reconstruction initialized from already fine-tuned weights and is excluded from independent-test claims. These new tests are retrospective checks of existing corpora; they do not establish independence by transformer or source event.
Visual pairing protocol. The image test set has 297 fire, 28 oil-leakage, 18 cable-defect, nine corrosion and two insulator-crack images, with no normal images. We used these 354 singly labelled images and reserved normal DGA records. Fire and leakage images were paired with reserved log lines of those classes; other visual classes used reserved normal logs. Five fixed pairing seeds (20260916–20260920) were evaluated with the same model checkpoints and original fusion defaults. Records can recur across pairs and seeds. This is an imposed five-class visual association test, not a full ten-class or event-associated benchmark. We did not invent normal-image or internal-fault triplets by assigning defective images to them. The results are summarized in Table 14.
Table 14.
Retrospective visual-defect stress test: mean over five pairing seeds, each using the same 354 images. Overall accuracy counts rejections as unsuccessful; macro-F1 includes rejected cases as false negatives over the five visual classes. Pairing variability is not an independent-sample confidence interval.
| Method | Overall Accuracy | Macro-F1 | Coverage |
|---|---|---|---|
| BERT | 0.9107 | 0.3978 | 0.9898 |
| CNN | 0.0000 | 0.0000 | 1.0000 |
| YOLO | 0.9124 | 0.8506 | 0.9322 |
| BERT+CNN | 0.0045 | 0.0071 | 0.1164 |
| BERT+YOLO | 0.9684 | 0.9410 | 0.9893 |
| CNN+YOLO | 0.0684 | 0.5582 | 0.1412 |
| Full method | 0.7169 | 0.8210 | 0.7475 |
The full method’s overall accuracy ranges from 0.6893 to 0.7316 across pairings, compared with 0.9661–0.9689 for BERT+YOLO. Thus, adding DGA does not improve this visual-defect test. The CNN’s zero visual-class accuracy reflects the protocol’s normal DGA inputs and its internal-state vocabulary; it does not contradict its separate five-class DGA result. BERT’s high overall accuracy but low macro-F1 reflects the predominance of fire cases. These observations limit interpretation of aggregate accuracy.
Component checks. At seed 20260916, overall accuracy for voting, classical D–S, addition of dynamic weighting, addition of the capability mask, addition of Murphy/fuzzy attenuation, and the full method is respectively 0.8955, 0.0028, 0.0028, 0.7542, 0.6215 and 0.6893. The mask changes behaviour substantially, but subsequent components do not yield a monotonic improvement. The full-method component replay reproduces the main run’s predictions exactly. This supports consistency of the new experiment, not the superiority of every component.
Sensitivity. Replaying fixed evidence at leaves the decisions unchanged across all five pairings. At seed 20260916, varying the reliability penalty over , lower clipping bound over and upper bound over also leaves the reported metrics unchanged. Rejection thresholds matter strongly: confidence thresholds 0.3, 0.5 and 0.7 give overall accuracy 0.9576, 0.6893 and 0.0678, with coverage 0.9972, 0.7203 and 0.0847. Universal-set thresholds 0.1, 0.3 and 0.5 give overall accuracy 0.0678, 0.6893 and 0.6893. These are sensitivity observations, not test-based parameter selection; the default configuration remains the reported main result. The attenuation and confidence-threshold sweeps are shown in Figure 6.
Figure 6.

Sensitivity on fixed retrospective visual evidence (pairing seed 20260916). The fuzzy attenuation sweep leaves overall accuracy and coverage unchanged; the confidence rejection threshold strongly changes both. The test uses imposed class association and does not establish deployment performance.
5.6. Limitations
Test-set scale and composition. The original 100 cases and the image-based stress test are controlled benchmark samples with deliberately reported class counts. Their distributions motivate the per-class results and five-seed pairing analysis; broader class-distribution studies are a natural extension.
Pairing, not co-occurrence. As set out in Section 4.1, the three modalities of an instance are class-consistent but not event-aligned. This is the single largest threat to external validity in this work.
Unequal per-class competence. Insulator crack is never recognized (F1 ) and cable defect reaches only 0.381. Reporting a macro-average over such a distribution obscures more than it reveals, which is why the per-class results are given in full.
Single-label formulation. The ten states are treated as mutually exclusive. Mass on Θ expresses unresolved uncertainty and does not identify concurrent faults. Multi-label diagnosis requires an explicit output formulation, suitable labels and separate validation; none is provided by the current data.
Component behaviour. Dynamic weighting and fuzzy attenuation leave the audited metrics unchanged under the reported test conditions (Table 12, Section 5.3), while the capability mask provides the principal measurable gain.
5.7. Reproducibility
The original-run modality table and component table were checked against retained experiment artifacts, with the sensitivity sweep and resource measurements obtained in separate runs. The code and reconstruction protocol retain checkpoint hashes, split definitions, per-record predictions and explicit metric denominators for the additional evaluation. This makes the experiment states and their intended scope transparent and reproducible.
5.8. Discussion
The intended benefit is to combine evidence with different observation capabilities. The retrospective results show that this benefit depends on the source combination and rejection settings. The superior visual-test result of BERT+YOLO relative to the full method demonstrates that adding evidence can reduce useful coverage.
The original modality-combination differences describe the audited cases. The added retrospective experiments extend the comparison with separated standalone tests and quantify how fusion behaves under the controlled visual pairing protocol.
The capability mask changes the treatment of classes outside each modality’s scope. In the new ablation it provides the principal measured improvement relative to the classical rule; Murphy/fuzzy attenuation and authority gating then expose the tradeoff between coverage and precision under the fixed protocol.
The structured records and independently replaceable models provide a candidate interface to maintenance software. Interoperability with a named utility platform, closed-loop maintenance benefits and embedded resource requirements have not been validated.
6. Conclusions
We present an inspectable decision-level fusion implementation with explicit modality capabilities, independently replaceable classifiers and structured evidence records. The revised evaluation consolidates the experiment states, reports clean standalone DGA and text tests, and quantifies fusion behaviour under controlled visual pairing. The results establish a reproducible algorithmic baseline and identify the protocol required for future event-associated validation. Extending the benchmark to asset-linked records, concurrent labels and embedded hardware is the natural next deployment stage.
Acknowledgments
AI assistants were used for translation and language editing, LaTeX and figure preparation, and revision-stage data audits, evaluation scripting and execution, and assistance with interpretation. Numerical results were computed from the documented code and retained artifacts. The authors are responsible for verifying the manuscript and its conclusions.
Abbreviations
The following abbreviations are used in this manuscript:
| BPA | Basic probability assignment |
| CNN | Convolutional neural network |
| DGA | Dissolved gas analysis |
| D–S | Dempster–Shafer |
| MLLM | Multimodal large language model |
Author Contributions
Conceptualization, W.Z., W.W. and S.L.; software, J.L., A.U., G.Q., L.R. and L.X.; investigation, W.Z., W.W., J.L., A.U., G.Q., S.L., L.R. and L.X.; formal analysis, W.Z., W.W., J.L., A.U., G.Q., S.L., L.R. and L.X.; writing—original draft preparation, W.Z., W.W., J.L., A.U., G.Q., S.L., L.R. and L.X.; supervision, L.R. and L.X.; project administration, L.R. and L.X. All authors have read and agreed to the published version of the manuscript.
Institutional Review Board Statement
Not applicable.
Informed Consent Statement
Not applicable.
Data Availability Statement
The data presented in this study are openly available in Zenodo at https://doi.org/10.5281/zenodo.21981927. The dataset comprises inspection-log text, dissolved gas analysis measurements, appearance images with annotations, and the extracted single-source and fused feature files described in this paper. The image data were assembled from publicly available substation-inspection datasets, power-equipment defect-detection competition datasets, publicly released academic data, and manually annotated frames extracted from public videos; annotations were produced by the authors.
Conflicts of Interest
Authors Weijian Zhang, Wanxin Wang, and Shanfeng Liu are employed by State Grid Henan Electric Power Company Electric Power Research Institute, which also funded this research under grant number 52170225001F. The remaining authors declare no conflicts of interest. The funder had no role in the design of the study; in the collection, analysis, or interpretation of data; in the writing of the manuscript; or in the decision to publish the results.
Funding Statement
This research was funded by State Grid Henan Electric Power Company, grant number 52170225001F (Research on Key Artificial Intelligence Technologies for Improving the Intelligence Level of Main Equipment Health Management).
Footnotes
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.
References
- 1.Qi B., Zhu K., Luo Y., Shi G., Zhang P., Huang M., Zhang S., Zhao L., Li C. Research status and future prospects of intelligent sensing and assessment technologies for power transformer health condition. High Volt. Eng. 2025;51:4395–4416. (In Chinese) [Google Scholar]
- 2.Zhang H., Du R., Zhong H., Cao Y., Wang Y. Key technologies and applications of multimodal fine-grained robotic inspection for power facilities. Acta Autom. Sin. 2025;51:20–42. (In Chinese) [Google Scholar]
- 3.Hou X. Ph.D. Thesis. Beijing University of Posts and Telecommunications; Beijing, China: 2024. Transformer Fault Diagnosis Based on Multimodal Data Fusion. (In Chinese) [Google Scholar]
- 4.IEEE Guide for the Interpretation of Gases Generated in Mineral Oil-Immersed Transformers. IEEE Standards Association; Piscataway, NJ, USA: 2019. [Google Scholar]
- 5.Mineral Oil-Filled Electrical Equipment in Service: Guidance on the Interpretation of Dissolved and Free Gases Analysis. International Electrotechnical Commission; Geneva, Switzerland: 2022. [Google Scholar]
- 6.Duval M. A review of faults detectable by gas-in-oil analysis in transformers. IEEE Electr. Insul. Mag. 2002;18:8–17. doi: 10.1109/mei.2002.1014963. [DOI] [Google Scholar]
- 7.Cai X., Zhang Z., Chen G., Wu L., Zhu J. Proceedings of the 2024 IEEE 2nd International Conference on Power Science and Technology. IEEE; Piscataway, NJ, USA: 2024. Multi-scale semantic collaborative power grid fault text classification model combined with Chinese BERT; pp. 1229–1233. [Google Scholar]
- 8.Devlin J., Chang M.W., Lee K., Toutanova K. Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) Association for Computational Linguistics; Stroudsburg, PA, USA: 2019. BERT: Pre-training of deep bidirectional transformers for language understanding; pp. 4171–4186. [Google Scholar]
- 9.Farooq U., Yang F., Shaikh J.A. Transformer enhanced based on YOLOv8 integration: A hybrid deep learning framework for intelligent insulator defect detection in high-voltage transmission systems. Front. Artif. Intell. 2025;8:1732616. doi: 10.3389/frai.2025.1732616. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Qu X., Yang Y., Lai J., Xiong Z., Mai X. Proceedings of the 2024 6th International Conference on Electronic Engineering and Informatics (EEI) IEEE; Piscataway, NJ, USA: 2024. Exploring the application and effectiveness of current large models in power inspection; pp. 574–583. [Google Scholar]
- 11.Wang J., Li M., Luo H., Zhu J., Yang A., Rong M., Wang X. Proceedings of the 2024 IEEE International Conference on Image Processing (ICIP) IEEE; Piscataway, NJ, USA: 2024. Power-LLaVA: Large language and vision assistant for power transmission line inspection; pp. 963–969. [Google Scholar]
- 12.Wang J., Song Q., Qian L., Li H., Peng Q., Zhang J. SubstationAI: Multimodal large model-based approaches for analyzing substation equipment faults. arXiv. 20242412.17077 [Google Scholar]
- 13.Dempster A.P. Upper and lower probabilities induced by a multivalued mapping. Ann. Math. Stat. 1967;38:325–339. doi: 10.1214/aoms/1177698950. [DOI] [Google Scholar]
- 14.Shafer G. A Mathematical Theory of Evidence. Princeton University Press; Princeton, NJ, USA: 1976. [Google Scholar]
- 15.Murphy C.K. Combining belief functions when evidence conflicts. Decis. Support Syst. 2000;29:1–9. doi: 10.1016/s0167-9236(99)00084-6. [DOI] [Google Scholar]
- 16.Liu Y., Liu Y., Liu G., Zhao T., Xu Z., Yang N., Jia P. Conception of digital twin for intelligent operation and maintenance of power transformers. Proc. CSEE. 2023;43:8636–8651. (In Chinese) [Google Scholar]
- 17.Tang W., Niu Z., Zhao B., Ji T., Li M., Wu Q. Research and application of data-driven artificial intelligence technologies for condition analysis of power equipment. High Volt. Eng. 2020;46:2985–2999. (In Chinese) [Google Scholar]
- 18.Li D., Zhang Y., Feng J., Wang S. Multi-dimensional diagnosis of transformer fault samples and credibility analysis of the results. Trans. China Electrotech. Soc. 2022;37:667–675. (In Chinese) [Google Scholar]
- 19.Shang Y., Yan C., Yan Z., Cao J. Fault diagnosis of large oil-immersed power transformers based on information fusion. Proc. CSEE. 2002;22:115–118. (In Chinese) [Google Scholar]
- 20.Qi D., Han Y., Zhou Z., Yan Y. Video/image-based external defect detection technologies for power transmission and transformation equipment and their application status. J. Electron. Inf. Technol. 2022;44:3709–3720. (In Chinese) [Google Scholar]
- 21.Zhang Z., Xia J., Wen Y., Weng L., Ma Z., Yang H., Yang H., Dou J., Wang J., Zhao P. Detection method for inter-turn short circuit faults in dry-type transformers based on an improved YOLOv8 infrared image slicing-aided hyper-inference algorithm. Energies. 2024;17:4559. doi: 10.3390/en17184559. [DOI] [Google Scholar]
- 22.Jiang Y., Li L., Li Z., Su C., Wang G., Peng X. Deep semantic learning based text information mining method for power transformer operation and maintenance. Proc. CSEE. 2019;39:4162–4172. (In Chinese) [Google Scholar]
- 23.Zhang P., Zheng Y., Li H., Liu H., Li G., Ge L. A review of intelligent identification and operation-maintenance of defect texts for distribution network power equipment. Electr. Power Constr. 2022;43:90–99. (In Chinese) [Google Scholar]
- 24.Xie Q., Cai Y., Xie J., Wang C., Zhang Y., Xu Z. Construction method and application of a knowledge graph for power transformer operation and maintenance based on ALBERT. Trans. China Electrotech. Soc. 2023;38:95–106. (In Chinese) [Google Scholar]
- 25.Kumar D., Dutta S., Illias H.A. Streamlining fault classification of dissolved gases in transformer using data synthesis and dimension reduction. IEEE Trans. Dielectr. Electr. Insul. 2024;31:2451–2460. doi: 10.1109/tdei.2024.3387416. [DOI] [Google Scholar]
- 26.Abdelwahab S.A.M., Taha I.B.M., Fahim R., Ghoneim S.S.M. Transformer fault diagnose intelligent system based on DGA methods. Sci. Rep. 2025;15:8263. doi: 10.1038/s41598-024-78293-7. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27.Tao W., Sun Z., Yang Z., Liang B., Wang G., Xiao S. Transformer fault diagnosis technology based on AdaBoost enhanced transferred convolutional neural network. Expert Syst. Appl. 2025;264:125972. doi: 10.1016/j.eswa.2024.125972. [DOI] [Google Scholar]
- 28.Sima L., Shu N., Li Z., Huang Y., Luo X. Internal fault location identification of power transformers based on SVM and D-S evidence theory. Electr. Power Autom. Equip. 2012;32:72–77. (In Chinese) [Google Scholar]
- 29.Ramachandram D., Taylor G.W. Deep multimodal learning: A survey on recent advances and trends. IEEE Signal Process. Mag. 2017;34:96–108. doi: 10.1109/msp.2017.2738401. [DOI] [Google Scholar]
- 30.Vaswani A., Shazeer N., Parmar N., Uszkoreit J., Jones L., Gomez A.N., Kaiser Ł., Polosukhin I. Advances in Neural Information Processing Systems. Volume 30 Curran Associates, Inc.; Red Hook, NY, USA: 2017. Attention is all you need. [Google Scholar]
- 31.Sun Y., Zhao T., Gao L., Liu Y. An Attention-Guided Semi-Supervised Model for Power Transformer Fault Diagnosis via Vibration-Acoustic Data Fusion. IET Electr. Power Appl. 2025;19:e70062. doi: 10.1049/elp2.70062. [DOI] [Google Scholar]
- 32.Liu R., Zhang Q., Lin D., Zhang W., Ding S.X. Causal Disentangled Graph Neural Network for Fault Diagnosis of Complex Industrial Process. IEEE Trans. Ind. Inform. 2025;21:386–395. doi: 10.1109/TII.2024.3452246. [DOI] [Google Scholar]
- 33.Zhang W., Wang W., Luhwago J., Ullah A., Qian G., Liu S., Ruan L., Xiao L. Multimodal Transformer Defect Recognition Dataset. Zenodo, Dataset. 2026. [(accessed on 20 September 2026)]. Available online: https://zenodo.org/records/21981927.
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Data Availability Statement
The data presented in this study are openly available in Zenodo at https://doi.org/10.5281/zenodo.21981927. The dataset comprises inspection-log text, dissolved gas analysis measurements, appearance images with annotations, and the extracted single-source and fused feature files described in this paper. The image data were assembled from publicly available substation-inspection datasets, power-equipment defect-detection competition datasets, publicly released academic data, and manually annotated frames extracted from public videos; annotations were produced by the authors.
