Skip to main content
Journal of Imaging logoLink to Journal of Imaging
. 2026 Oct 12;12(10):504. doi: 10.3390/jimaging12100504

GeoSieveNet: An Image Classification Network with Geometry-Adaptive Sampling and Hierarchical Feature Sifting

Haixu Chen 1, Zhen Wang 1,*, Yang Liu 1, Mingzhe Yang 1, Gaoquan Ming 1, Lujia Yang 2
PMCID: PMC13705721  PMID: 42930654

Abstract

Standard convolution samples features on a fixed grid whose locations do not adapt to the input content. We develop the Geometry-Adaptive Sampling and Hierarchical Feature-Sifting Network (GeoSieveNet) based on a 34-layer residual network (ResNet-34). The rotational deformable convolution module (RDCM) assigns predefined offsets with different orientations to individual channel groups and combines them with input-predicted dynamic offsets to adjust sampling locations. Its feature preservation module (FPM) fuses responses from the fixed-grid and rotational deformable branches. Hierarchical gated attention (HGA) combines directional statistics with local convolutional responses to generate spatial gating weights within each channel group. GeoSieveNet achieved classification accuracies of 96.95%, 81.86%, 94.71%, and 89.79% on CIFAR-10, CIFAR-100, Imagenette, and Imagewoof, respectively. Across three independent runs, these results exceeded ResNet-34 under the same training settings by 0.66, 3.06, 4.73, and 5.19 percentage points, respectively. All paired tests were significant at the 0.001 level. Ablation experiments attributed gains of 0.36–1.89 percentage points to FPM alone, with larger gains on datasets exhibiting greater geometric variation. At the same floating-point operation budget as ResNet-34, GeoSieveNet retained an accuracy advantage of 0.54–3.96 percentage points.

Keywords: image classification, residual network, geometry-adaptive sampling, rotational deformable convolution, hierarchical gated attention

1. Introduction

Changes in object pose and viewing direction alter the locations of edges, textures, and local parts in feature maps. AlexNet, VGG, the 34-layer residual network (ResNet-34), DenseNet, and EfficientNet differ in architecture and scale, but their main convolutions still sample on regular grids [1,2,3,4,5]. Data augmentation introduces variations in orientation and scale into the training set, while the sampling procedure of the convolution operator remains unchanged.

Group-equivariant convolutional neural networks (G-CNNs) and harmonic networks constrain feature transformations through symmetry [6,7]. Deformable convolutional networks (DCNs) learn sampling offsets from the input, allowing the sampling region to adapt to image content [8,9]. These approaches address geometric variation through transformation constraints and sampling locations, respectively. They motivate combining predefined orientations with input-dependent offsets in convolution.

Sampling coordinates determine where convolution reads features, whereas attention within residual blocks adjusts response magnitudes. Squeeze-and-excitation (SE) modules generate weights from channel statistics [10]. The convolutional block attention module (CBAM) computes channel and spatial weights [11], while coordinate attention preserves positional information along two spatial directions [12].

We propose the Geometry-Adaptive Sampling and Hierarchical Feature-Sifting Network (GeoSieveNet), which combines direction-dependent dynamic sampling with within-group feature weighting in ResNet-34. The rotational deformable convolution module (RDCM) adjusts sampling locations, while hierarchical gated attention (HGA) generates feature weights from directional statistics and local responses.

The main contributions are as follows:

  1. We propose RDCM, which assigns direction-dependent predefined offsets to channel groups and combines them with input-predicted dynamic offsets to adjust sampling locations. Its feature preservation module (FPM) fuses responses from the fixed-grid and rotational deformable branches. Independent ablations attribute gains of 0.36–1.89 percentage points to FPM, with larger gains on datasets exhibiting greater geometric variation.

  2. We design HGA to combine horizontal and vertical statistics with local convolutional responses within channel groups. The resulting spatial gating weights reweight the residual features.

  3. We construct GeoSieveNet by integrating RDCM and HGA into ResNet-34. On four primary classification datasets, we report means and standard deviations across 3 independent runs, paired significance tests, comparisons at matched floating-point operation and parameter budgets, module ablations, and computational cost and inference-speed measurements. Accuracy is significantly higher than that of ResNet-34 under the same training settings on all four datasets, and the advantage persists at the same floating-point operation budget.

2. Related Work

2.1. Geometry-Adaptive Convolution and Deformable Sampling

Geometric adaptation extends standard convolution primarily through transformation constraints and sampling locations. G-CNNs generalize convolution to groups comprising translations, discrete rotations, and reflections. Weight sharing across transformations preserves the correspondence between input and feature transformations [6]. Harmonic networks use circular harmonic filters to relate rotation angles to the phase of feature responses, yielding representations equivariant to continuous rotations [7]. These approaches incorporate selected geometric transformations into the architecture, with response behavior constrained by the transformation group or filter formulation.

Deformable convolution adapts to local geometric variation by changing sampling locations. The first generation of deformable convolutional networks (DCNv1) augments a regular grid with two-dimensional offsets predicted from the input features. This allows a single convolutional layer to use different sampling patterns at different locations [8]. Deformable ConvNets V2 (DCNv2) further introduces a modulation coefficient for each sampling point, jointly adjusting its location and contribution to the output. It also expands the use of deformable convolution in the backbone [9]. Both versions learn offsets through the target task without prescribing the transformation type for each local region.

InternImage uses the third generation of deformable convolution (DCNv3) as its core operator, extending input-dependent spatial aggregation to large-scale vision backbones [13]. DCNv3 uses group-wise aggregation, with each group learning its own sampling offsets and modulation weights, which are normalized over sampling points. Projection weights are shared across sampling points within each group, so projection parameters perform channel mapping while sampling weights govern spatial aggregation. Standard convolution assigns separate projection weights to different kernel locations. The fourth generation of deformable convolution (DCNv4) simplifies spatial aggregation and improves operator efficiency. It shows that shared within-group projections and grouped sampling can jointly support accuracy and speed in large-scale backbones [14]. Geometry-adaptive methods differ in whether transformation relationships are prescribed and how location adjustment and response weighting jointly contribute to aggregation. Rotation-equivariant representations emphasize explicit transformation correspondences, whereas deformable sampling emphasizes input-dependent local sampling locations. These approaches provide distinct ways to model geometry. RDCM retains grouped sampling and shared within-group projections, but explicitly assigns a predefined orientation offset to each channel group; dynamic offsets refine this displacement. Beyond geometric adaptation, recent classification methods have explored attention architectures, frequency-domain enhancement, and robustness distillation. Couplformer reorganizes coupled attention in vision Transformers [15], while MMA-CCT strengthens global modeling through multi-stream hybrid attention [16]. ViT-Lite investigates pretraining lightweight Transformers on small datasets [17]. Fast multi-attention dynamic convolution (FMDConv) balances speed and accuracy [18], and cyclic iterative adversarial robustness distillation (CIARD) improves representation quality [19]. DenseNet with channel-wise and feature-point reweighting (CAPR-DenseNet) adjusts the weights of channels and feature points [20]. These methods focus on weight computation or feature transformation while retaining fixed-grid sampling, providing a comparison with our joint adjustment of sampling locations and response weights.

2.2. Attention Mechanisms and Feature Reweighting

Attention mechanisms use input-dependent weights to select and aggregate features. Self-attention computes weights from query–key similarities and forms weighted combinations of values, establishing dependencies across positions [21]. In convolutional networks, SE modules aggregate spatial information into channel descriptors and use them to generate channel weights [10]. Global average pooling summarizes each channel by its mean response over the feature map, discarding the spatial origin of individual responses. Self-attention directly organizes interactions between positions, whereas SE primarily adjusts relative channel response magnitudes. All positions within a channel share the same scaling coefficient.

CBAM sequentially computes channel and spatial attention, distinguishing responses across spatial locations in addition to selecting channels [11]. Its channel weights are shared across spatial locations, while its spatial weights are shared across channels. To generate channel weights, CBAM applies spatial average and max pooling to summarize mean and strongest responses, respectively. A shared multilayer perceptron processes both descriptors. To generate spatial weights, it computes the same statistics along the channel dimension and applies convolution to produce position-specific weights. The two branches use the same statistical operations but preserve information along different dimensions. Coordinate attention decomposes two-dimensional global pooling into one-dimensional encodings along the two spatial directions. Aggregation along one direction preserves positional indices along the other, producing direction-aware and position-sensitive weights [12]. These designs reflect different trade-offs among global channel statistics, spatial responses, and directional positional encoding.

Reweighting modules primarily use spatial information to estimate response magnitudes. Even when weights vary across positions, features retain their original coordinates, whereas deformable convolution directly shifts sampling points. DCNv2 modulation also applies weighting, but its weights act on sampling points during convolutional aggregation. SE, CBAM, and coordinate attention instead generate channel or positional weights for existing features. This study combines dynamic sampling with predefined orientations and within-group feature reweighting for image classification.

3. Methods

3.1. Problem Formulation and GeoSieveNet Architecture

Let the input image be I∈R3×H0×W0 and the number of classes be M. The classification network is denoted by f(I;Θ), with a fully connected layer and softmax producing class probabilities. GeoSieveNet retains the four-stage residual structure of ResNet-34, as shown in Figure 1a. RDCM is used at the input and in the first residual block of each stage. Each stage begins with a rotational hierarchical block (RH-Block), which replaces the first conventional convolution with RDCM, as shown in Figure 1b. The remaining residual blocks within each stage retain two conventional convolutions, as shown in Figure 1c. Both block types place HGA after the second convolution and before residual addition. The shortcut branch uses either an identity mapping or a projection mapping.

Figure 1.

Figure 1

GeoSieveNet architecture and residual blocks. (a) Input, four-stage residual structure and classification head. GAP and FC denote global average pooling and the fully connected layer, respectively. (b) Rotational hierarchical block (RH-Block) at the beginning of each stage. The rotational deformable convolution module (RDCM) contains the feature preservation module (FPM). Hierarchical gated attention (HGA) is placed after the second convolution and before residual addition. (c) The remaining residual blocks within each stage retain conventional convolutions, with HGA in the same position.

A 1×1 convolution adjusts the input image channels, followed by batch normalization (BN) before RDCM. Global average pooling (GAP) compresses the final-stage features, and a fully connected (FC) layer maps them to classes. Softmax converts the outputs into class probabilities.

3.2. Rotational Deformable Convolution Module

RDCM samples the input in parallel through a fixed-grid branch and a rotational deformable branch, as shown in Figure 2a. The fixed-grid branch samples at regular grid locations. The deformable branch partitions the output channels into D groups, each assigned an initial direction. Dynamic offsets predicted from the input features further adjust the sampling locations. The responses of all direction groups are first concatenated along the channel dimension, yielding the deformable branch output Frot=Concat(Y1,…,YD). This output is then concatenated with the fixed-grid branch output Ffix along the channel dimension. The resulting features F=Concat(Ffix,Frot) are passed to FPM.

Figure 2.

Figure 2

RDCM architecture and sampling procedure. (a) Response concatenation and FPM fusion for the fixed-grid branch and the rotational deformable branch with four direction groups. (b) Rotational offset initialization about the convolutional kernel center and offset scaling, with s0=0.1. (c) Learned offsets, final sampling offsets and convolution with bilinear sampling for direction group d. GN and GELU denote group normalization and the Gaussian error linear unit, respectively.

For a K×K convolutional kernel, let pk denote the kth regular-grid coordinate and c the geometric center. Direction group d has an initial angle θd and an initial offset scale s0. The predefined rotational offset is

opre,kd=s0R(θd)(pk−c)+c−pk, (1)

where R(θd) is the two-dimensional rotation matrix. The grid coordinate after rotation about the kernel center is rkd=R(θd)(pk−c)+c. Scaling the displacement rkd−pk by s0 gives the predefined offset, as illustrated in Figure 2b. Configuration experiments compare angle sets with two, four, and eight direction groups. The model uses four directions: 0°, 45°, 90°, and 135°.

Dynamic offsets are generated from the input features X∈RB×C×H×W. For offset features with spatial dimensions H′×W′, the offset-prediction convolution produces 2DK2 channels. The raw offsets Oraw∈RB×2DK2×H′×W′ are written as

Oraw=Wo∗X+bo. (2)

The raw offsets are processed by group normalization (GN) and a Gaussian error linear unit (GELU) to obtain the learned offsets

Olearn=GELUGN(Oraw). (3)

We partition Olearn into D groups along the channel dimension, with K2 two-dimensional offsets per group. The learned offsets for direction group d, denoted by Olearnd, are added to the corresponding predefined rotational offsets to form the final sampling offsets

Ofinald=Opred+Olearnd. (4)

Figure 2c illustrates offset generation and sampling for direction group d. The predefined rotational offsets and learned offsets jointly determine the sampling locations.

For output location p0, the kth sampling location in direction group d is

qkd=p0+pk+ofinal,kd. (5)

Features at non-integer locations are read using bilinear interpolation. Let g00, g01, g10, and g11 be the four neighboring integer grid points of q=(qx,qy). Their interpolation weights are

w00=(1−α)(1−β),w01=(1−α)β,w10=α(1−β),w11=αβ, (6)

where α=qx−⌊qx⌋ and β=qy−⌊qy⌋ are the fractional parts. The interpolated value is

X(q)=∑i∈{0,1}∑j∈{0,1}wijX(gij), (7)

Grid points outside the feature map are assigned zero values. The output of each direction group is

Yd(p0)=∑k=1K2WkdX(qkd). (8)

The convolutional responses of all direction groups are concatenated along the channel dimension to form Frot, corresponding to the first concatenation node in Figure 2a.

The implementation details of RDCM are as follows. Offset prediction uses a 3×3 depthwise separable convolution with padding 1 and stride 1. The offset features therefore retain the input spatial dimensions, H′=H and W′=W. A 3×3 convolution with stride 2 precedes the input-stage RDCM, where H′=W′=H0/2=16. The offset-prediction convolution produces 2DK2=2×4×9=72 channels in our configuration. These channels are divided equally into D groups, each containing 2K2=18 channels. Within each group, the channels are arranged as K2=9 two-dimensional offsets in sampling-point order. Each pair follows the order (Δx,Δy), corresponding to channels 2k−1 and 2k in Equation (3). Projection weights are not shared across the D direction groups: group d uses its own Wkd. The offset-prediction convolution parameters are shared throughout the network. Non-integer sampling locations qkd are evaluated by bilinear interpolation with zero padding outside the feature map. A custom automatic differentiation function implements the forward and backward passes. Table 1 summarizes these settings.

Table 1.

Implementation details of RDCM, FPM, and HGA. K is the kernel size, D is the number of direction groups, N is the number of channel groups, and Cg=C/N is the number of channels per group. PWConv and DWConv denote pointwise convolution and depthwise convolution, respectively.

Module Item Value Description
RDCM Kernel size K 3 Regular 3×3 grid
RDCM Direction groups D 4 0°, 45°, 90°, 135°
RDCM Offset-prediction convolution 3×3, depthwise separable Padding 1, stride 1
RDCM Offset channels 2DK2=72 Equally divided into 4 groups
RDCM Offset-channel arrangement 18 channels per group Paired as (Δx,Δy)
RDCM Weight sharing across groups No Offset-prediction convolution shared
RDCM Output spatial dimensions H×W 16×16 at the input stage
RDCM Interpolation Bilinear, zero padding Equations (6) and (7)
FPM Weight branch 1×1, GN, GELU, 3×3, Sigmoid Produces A
FPM Preservation branch 3×3, BN, GELU Produces P
FPM Output Fout=F⊙A+P Same dimensions as the input
HGA Channel groups N 8 Independent gating in each group
HGA Channels per group Cg C/8 Determined by the stage channel count
HGA Local branch PWConv 1×1, DWConv 3×3 Produces H×W gating maps
HGA Normalization GN Computed independently per group

3.3. Feature Preservation Within RDCM and Input-Stage Feature Extraction

RDCM uses FPM to process the concatenated features from its two branches. Figure 3 shows the weight and preservation branches of FPM. Let its input be F∈RB×CF×H×W. In the weight branch, a 1×1 convolution reduces the channel count, followed by GN and GELU. A 3×3 convolution restores the channels, and Sigmoid produces the weights

A=SigmoidW2∗GELUGN(W1∗F+b1)+b2. (9)

The weights A have the same dimensions as F. The preservation branch applies a 3×3 convolution, BN, and GELU:

P=GELUBN(W3∗F+b3). (10)

The output of FPM is

Fout=F⊙A+P. (11)

Equation (11) adds the convolutional branch output to the gated concatenated features. Fout retains the spatial dimensions of F and serves as the output of RDCM.

Figure 3.

Figure 3

FPM architecture. The input F contains the concatenated features from the two branches. The weight branch produces A through a 1×1 convolution, GN, GELU, a 3×3 convolution, and Sigmoid. The preservation branch produces P through a 3×3 convolution, BN, and GELU. The output is Fout=F⊙A+P.

3.4. Hierarchical Gated Attention and the Rotational Hierarchical Block

HGA receives features Z∈RB×C×H×W and partitions the channels into N groups, each containing Cg=C/N channels. The reshaped features are denoted by ZN∈RB×N×Cg×H×W. Gating is computed independently for each group before the original channel order is restored, as shown in Figure 4a. Figure 4b shows how directional statistics and local convolutional responses contribute to spatial gating.

Figure 4.

Figure 4

HGA architecture. (a) Channel grouping, independent gating within each group, and restoration of the original channel order. (b) Directional statistics produce within-group channel weights. Batch matrix multiplication (BMM) combines these weights with local convolutional responses to form spatial gates, which reweight the original grouped features. PWConv and DWConv denote pointwise convolution and depthwise convolution, respectively.

Directional pooling retains statistics along a single spatial axis, as shown in the directional-statistics branch of Figure 4b. Averaging over width and height while retaining the pooled dimensions gives Sw∈RB×N×Cg×H×1 and Sh∈RB×N×Cg×1×W:

Sw=AvgPoolW(ZN),Sh=AvgPoolH(ZN). (12)

The first BMM combines the two statistics along their last two dimensions, forming two-dimensional statistics for each channel in each group. After Sigmoid, these statistics are multiplied elementwise by the original grouped features ZN:

Satt=ZN⊙SigmoidBMM(Sw,Sh). (13)

GN is applied to Satt, and GAP compresses its spatial dimensions. Softmax normalizes the channel dimension within each group, producing within-group channel weights a∈RB×N×Cg:

a=SoftmaxGAP(GN(Satt)). (14)

The local path extracts spatial responses, corresponding to the local convolutional branch in Figure 4b. A 1×1 PWConv mixes channels within each group, and a 3×3 DWConv extracts information from spatial neighborhoods:

D=VecDWConv3×3(PWConv1×1(ZN)). (15)

Flattening the spatial dimensions gives D∈RB×N×Cg×HW. The within-group channel weights a are expanded to B×N×1×Cg and combined with the local responses through a second BMM. Reshaping yields an H×W gating map for each group:

T=ReshapeH×WBMM(unsqueeze(a),D), (16)

Sigmoid converts the gating map T∈RB×N×1×H×W into spatial weights, which are broadcast across channels within each group. These weights are multiplied elementwise by the original grouped features ZN, and the original channel order is restored:

Zout=ReshapeZN⊙Sigmoid(T). (17)

Each stage begins with an RH-Block, which replaces the first convolution with RDCM and places HGA after the second convolution. The other residual blocks retain their conventional first convolution and use HGA at the same position. Let R denote the mapping formed by RDCM and the second convolution, and let H denote HGA. The residual output of the RH-Block is

y=H(R(x))+S(x), (18)

where S is an identity mapping or a projection mapping for matching dimensions. Figure 1b shows the main path and shortcut connection of the RH-Block, while Figure 1c shows the other residual blocks within each stage.

4. Experiments and Results

4.1. Datasets and Experimental Scope

We used six datasets: CIFAR-10, CIFAR-100, Flowers-102, STL-10, Imagenette, and Imagewoof. Each was obtained in its default version from the official distribution channel, without additional version selection or custom splitting. Table 2 lists the input dimensions, class counts, split sizes, and actual usage in this study. Table 3 identifies the experiments performed on each dataset. CIFAR-10 and CIFAR-100 use the official training and test sets. Flowers-102 uses the official training, validation, and test sets, containing 1020, 1020, and 6149 images, respectively; all compared models use the same splits. STL-10 uses 5000 labeled training images and 8000 test images; its 100,000 unlabeled images are not used. Imagenette and Imagewoof use the training and validation sets provided by fastai, with the validation sets serving as test sets in this study. Training uses only the training sets, and test sets are excluded from model selection.

Table 2.

Datasets and splits used in this study. The training and test columns give the numbers of images actually used, and all compared models use the same test sets. Flowers-102 additionally contains 1020 official validation images, separate from the training and test sets.

Dataset Input Size Classes Training Test
CIFAR-10 32×32 10 50,000 10,000
CIFAR-100 32×32 100 50,000 10,000
Flowers-102 96×96 102 1020 6149
STL-10 96×96 10 5000 8000
Imagenette 224×224 10 9469 3925
Imagewoof 224×224 10 9025 3929

Table 3.

Experiments performed on each dataset. A checkmark (✓) indicates inclusion, and a dash indicates non-inclusion. Configuration experiments cover the predefined rotation-angle sets and initial offset scale s0; a dataset is marked if it is used in either experiment. Module ablations include the independent FPM ablation.

Experiment CIFAR-10 CIFAR-100 Flowers-102 STL-10 Imagenette Imagewoof
Configuration ✓ ✓ – – ✓ ✓
HGA placement – ✓ ✓ ✓ ✓ –
Main comparisons ✓ ✓ ✓ ✓ ✓ ✓
Module ablations ✓ ✓ – – ✓ ✓
Cost and speed ✓ ✓ – – ✓ ✓
Feature visualization – – – – ✓ –

4.2. Training Configuration

Experiments ran on Ubuntu 22.04 with a single NVIDIA RTX 3090 graphics processing unit (GPU) with 24 GB of memory. The software environment comprised PyTorch 2.1.0, the Compute Unified Device Architecture (CUDA) 12.1, and the CUDA Deep Neural Network library (cuDNN) 8.6. All models trained in this study used 200 epochs. Batch sizes were 128 for CIFAR-10, CIFAR-100, Flowers-102, and STL-10, and 32 for Imagenette and Imagewoof. We used stochastic gradient descent with an initial learning rate of 0.1, momentum of 0.9, and weight decay of 5×10−4. The learning rate followed cosine annealing with linear warm-up during the first 5 epochs. Training images underwent random horizontal flipping and random cropping after padding, together with TrivialAugmentWide. Mixed precision, exponential moving averages, and early stopping were disabled to maintain comparable training conditions.

4.3. Evaluation Metrics and Statistical Methods

The primary metric is classification accuracy on the test set. The three-model comparison on CIFAR-100 also reports precision, recall, and F1 score. Each metric is computed separately for all 100 classes and then macro-averaged by taking its arithmetic mean across classes. To assess the stability of accuracy gains, the main comparisons and ablations on the four primary datasets were repeated independently using 3 random seeds (0, 1, and 2). We report means and standard deviations. All architectures use identical splits, augmentation procedures, and random seeds on a given dataset. Their prediction errors are therefore highly correlated, and the standard deviation of paired differences is smaller than the individual standard deviations. We use a one-sided t-test on seed-matched results for the directional hypothesis that GeoSieveNet outperforms ResNet-34, and report Cohen’s dz as the effect size. Significance conclusions across the 4 datasets use Holm correction.

4.4. Baseline Sources and Reproduction Protocol

The comparison results are divided into two groups. The first contains models reproduced in the same hardware and software environment: ResNet-34, ResNet-D, WideResNet-28-10, ConvNeXt-T, InternImage-T, DCNv4-S, HO-ResNet, and Multi-ResNet. These models use the same data splits, input dimensions, training epochs, optimizer settings, and augmentation pipeline as GeoSieveNet, allowing direct comparison. The second group contains results reported in the corresponding publications, including FAVOR+, ABNet-2G-R3, DAMSNet, SSCNet, MSMDFormer, ATONet, QKFormer, and some of the previously discussed Transformer baselines. Their backbones, input resolutions, and training procedures differ from our protocol. These values indicate the performance range of different approaches on the same datasets and are not used for a model-by-model ranking against GeoSieveNet. The table labels the groups as “Reproduced results” and “Literature-reported results,” and its caption specifies the input resolutions and training epochs for each group. InternImage-T represents modern DCNv3-based geometry-adaptive networks and provides a principal comparison with RDCM, which follows the same broad technical approach. Its original design targets 224×224 inputs and large-scale pretraining. At 32×32 resolution, its floating-point operation count is considerably higher than those of the other models; its accuracy and cost are compared only within the reproduced group. Multi-ResNet, an early residual-network improvement from 2016, is retained to show the gains achievable by stacking residual structures without changing sampling locations.

4.5. Network Configuration Selection

Predefined rotation-angle sets determine the direction groups in RDCM. Table 4 compares four configurations on CIFAR-100. Configuration 1 uses 0° and 90° and has the lowest parameter count and computational cost. Configuration 2 uses 0°, 45°, 90°, and 135°, whereas Configuration 3 uses 0°, 60°, 120°, and 180°. Configuration 4 uses eight directions from 0° to 157.5° at 22.5° intervals. Configuration 2 achieved the highest accuracy, 80.73%, and was used in the remaining RDCM configuration experiments. HGA placement was evaluated on CIFAR-100, Flowers-102, STL-10, and Imagenette. Flowers-102 and STL-10 were used for placement comparisons and the main comparisons, but not for module ablations. Table 3 summarizes the experimental role of each dataset.

Table 4.

Comparison of rotation-direction configurations on CIFAR-100. FLOPs denotes floating-point operations.

Configuration Accuracy/% FLOPs/G Parameters/M
1 79.88 1.432 25.462
2 80.73 1.463 25.630
3 80.48 1.463 25.630
4 80.69 1.534 25.971

Bold indicates the highest accuracy among the compared configurations.

The initial offset scale s0 scales the predefined rotational displacement in Equation (1). With the angle set fixed to Configuration 2, we compared s0 values from 0 to 1, as shown in Table 5. The value s0=0.1 achieved the highest accuracy in this comparison on all four datasets and was adopted for RDCM.

Table 5.

Effect of the initial offset scale s0 on classification accuracy.

s0 CIFAR-10/% CIFAR-100/% Imagenette/% Imagewoof/%
0.0 96.49 80.73 94.34 88.75
0.1 96.72 80.84 94.42 88.97
0.2 96.66 80.12 94.26 88.75
0.3 96.66 79.86 94.34 88.69
0.4 96.60 80.17 94.39 88.62
0.5 96.46 80.58 94.36 88.87
0.6 95.53 80.79 94.26 88.67
0.7 96.55 80.50 94.34 88.34
0.8 96.52 80.43 94.31 88.69
0.9 96.49 80.43 93.88 88.26
1.0 96.56 80.39 94.29 87.96

Bold values indicate the highest accuracy in each accuracy column.

Figure 5 compares four HGA insertion positions. Let f1 and f2 denote the first and second convolutions, and let S denote the identity or projection shortcut mapping. Position A places HGA between the two convolutions; B places it after the second convolution and before residual addition. Position C places HGA after the shortcut mapping, and D places it after residual addition.

Figure 5.

Figure 5

Candidate HGA insertion positions in a basic residual block. (A) After the first convolution. (B) After the second convolution and before residual addition, as adopted in this study. (C) After the shortcut mapping. (D) After residual addition. f1 and f2 denote the two convolutions, and S denotes an identity or projection shortcut mapping.

In Table 6, Position B achieved higher accuracy than the other candidates on all four datasets. HGA is therefore placed after the second convolution and before residual addition.

Table 6.

Hierarchical gated attention (HGA) insertion-position experiments.

Position CIFAR-100/% Flowers-102/% STL-10/% Imagenette/%
A 79.74 90.35 80.37 92.20
B 80.37 91.20 82.86 92.86
C 79.88 86.44 75.62 91.03
D 80.09 88.76 79.78 91.54

Bold values indicate the highest accuracy in each accuracy column.

4.6. Classification Performance and Computational Cost

Table 7 reports the mean classification accuracies and standard deviations across 3 runs on CIFAR-10, CIFAR-100, Imagenette, and Imagewoof. GeoSieveNet achieved 96.95%, 81.86%, 94.71%, and 89.79%, respectively, exceeding ResNet-34 under the same training settings by 0.66, 3.06, 4.73, and 5.19 percentage points. The seed-wise paired differences were [+0.64,+0.64,+0.70] for CIFAR-10, [+3.01,+3.06,+3.12] for CIFAR-100, [+4.61,+4.66,+4.93] for Imagenette, and [+4.88,+5.30,+5.39] for Imagewoof. One-sided paired t-tests yielded p<0.001 on all four datasets, with Cohen’s dz values of 19.1, 55.6, 27.5, and 19.1, respectively. The largest gains occurred on Imagewoof and Imagenette, and the smallest on CIFAR-10, whose baseline accuracy of 96.29% already leaves less room for improvement.

Table 7.

Classification accuracy of different networks. The first group contains results reproduced in the same environment and with the same training settings as GeoSieveNet. Input sizes are 32×32 for CIFAR-10 and CIFAR-100, 96×96 for Flowers-102 and STL-10, and 224×224 for Imagenette and Imagewoof; all models are trained for 200 epochs. The second group contains literature-reported results obtained with different backbones, input resolutions, and training procedures. These values illustrate the performance range of different approaches and are not used for a model-by-model ranking against GeoSieveNet. A dash indicates that the cited source does not report the corresponding value.

Network CIFAR-10 CIFAR-100 Flowers-102 STL-10 Imagenette Imagewoof
Reproduced results (same protocol as GeoSieveNet; means of 3 runs)
ResNet-34 [3] 96.29 78.80 89.41 78.62 89.98 84.60
ResNet-D [22] 96.35 79.24 90.12 79.48 90.21 84.92
WideResNet-28-10 [23] 95.87 80.50 91.06 80.15 88.34 78.71
ConvNeXt-T [24] 96.58 80.71 91.83 81.02 90.86 82.14
InternImage-T [13] 96.44 80.16 91.15 81.36 90.94 83.27
DCNv4-S [14] 96.52 80.38 91.62 81.71 91.27 83.84
HO-ResNet [25] 96.32 77.12 88.94 77.85 87.23 79.74
Multi-ResNet [26] 94.56 78.69 87.42 76.90 87.71 81.26
GeoSieveNet 96.95 81.86 92.47 83.29 94.71 89.79
Literature-reported results (original training protocols)
FAVOR+ [27] 91.42 72.56 – – 88.16 77.57
ABNet-2G-R3 [28] 96.08 80.83 – – – –
DAMSNet [29] 96.51 80.50 – – – –
SSCNet [30] 96.69 80.63 – – 88.75 82.09
MSMDFormer [31] 95.65 77.46 – – – –
ATONet [32] 94.51 78.56 – – 86.68 80.21
QKFormer [33] 96.18 80.27 – – 88.42 81.67

Bold values indicate the highest accuracy in each dataset column within the reproduced group.

On CIFAR-100, GeoSieveNet achieved higher precision, recall, and F1 score than ResNet-34 and WideResNet-28-10 in Table 8. The improvements over ResNet-34 were 3.60, 3.53, and 3.60 percentage points, respectively.

Table 8.

Precision, recall, and F1 score on CIFAR-100. All three metrics are computed per class and then macro-averaged.

Network Precision/% Recall/% F1/%
ResNet-34 78.31 78.28 78.20
WideResNet-28-10 80.51 80.42 80.39
GeoSieveNet 81.91 81.81 81.80

Bold values indicate the highest value in each metric column.

Table 9 reports parameter counts, FLOPs, and inference speed. Speed was measured on a single RTX 3090 using 32-bit floating point (FP32) and the channels_last memory format. Batch sizes were 128 for CIFAR datasets and 32 for Imagenette and Imagewoof, with the same input resolutions used for training. We performed 50 warm-up iterations followed by 200 timed iterations, with explicit synchronization every 50 iterations, and averaged 5 repetitions. Timing includes the forward pass and Softmax and top-k postprocessing, but excludes data loading and augmentation. GeoSieveNet has 25.65 M parameters, requires 5.73 G FLOPs, and has an inference latency of 4.12 ms, corresponding to 242.7 images/s. Relative to ResNet-34, parameters and FLOPs increase by 20.25% and 58.73%, respectively, while latency increases by 41.10%.

Table 9.

Parameter counts, FLOPs, inference throughput, and latency. Throughput and latency are measured under the same conditions. Timing includes Softmax and top-k postprocessing and excludes data loading and augmentation.

Network Parameters/M FLOPs/G Throughput/
(Images·s−1)
Latency/ms
ResNet-34 [3] 21.33 3.61 342.5 2.92
ResNet-D [22] 21.85 3.68 336.1 2.98
WideResNet-28-10 [23] 36.50 5.96 216.4 4.62
ConvNeXt-T [24] 28.59 4.46 268.9 3.72
InternImage-T [13] 29.87 22.53 128.4 7.79
DCNv4-S [14] 31.20 18.96 151.7 6.59
HO-ResNet [25] 50.26 11.05 178.2 5.61
Multi-ResNet [26] 51.23 11.73 160.3 6.24
GeoSieveNet 25.65 5.73 242.7 4.12

Table 10 relates computational cost to accuracy gains using relative changes. GeoSieveNet uses 1.20 times the parameters, 1.59 times the FLOPs, and 1.41 times the inference latency of the baseline. The absolute increases are 4.32 M parameters, 2.12 G FLOPs, and 1.20 ms. The corresponding relative accuracy increases are 0.69% on CIFAR-10, 3.88% on CIFAR-100, 5.26% on Imagenette, and 6.13% on Imagewoof. Cost multipliers are similar across the four datasets, whereas relative accuracy gains increase with the extent of geometric variation. The average cost per unit gain therefore decreases: the ratio of relative latency increase to relative accuracy increase is approximately 60 on CIFAR-10 and 10.6 on CIFAR-100, compared with 7.8 on Imagenette and 6.7 on Imagewoof. The same computational cost thus yields larger accuracy gains on datasets with substantial geometric variation. CIFAR-10 yields the smallest gain, so its deployment suitability depends on the available resources.

Table 10.

Computational cost and accuracy gains of GeoSieveNet relative to ResNet-34. A relative increase is the percentage change from the baseline value. The relative cost ratio divides the relative latency increase by the relative accuracy increase. Absolute accuracy gains are expressed in percentage points (pp).

Dataset Relative Latency
Increase/%
Relative Accuracy
Increase/%
Relative 
Cost Ratio
Absolute Accuracy
Gain/pp
CIFAR-10 41.10 0.69 59.96 0.66
CIFAR-100 41.10 3.88 10.57 3.06
Imagenette 41.10 5.26 7.81 4.73
Imagewoof 41.10 6.13 6.70 5.19

To determine whether the gains at these costs arise from the sampling mechanism itself, we constructed two controls under the same protocol (Table 11). The first, ResNet-34-W1.28, increases network width to reach 5.71 G FLOPs, closely matching the 5.73 G FLOPs of GeoSieveNet. At this budget, GeoSieveNet still improves accuracy by 0.54, 2.51, and 3.96 percentage points, showing that increased capacity alone does not explain the gains. The second, ResNet-34-W1.10, matches parameter count: its 25.81 M parameters are close to GeoSieveNet’s 25.65 M. Its accuracy remains 2.33–3.37 percentage points lower, while its FLOPs are also lower. Reducing the number of direction groups to 2 gives GeoSieveNet-Lite, which achieves accuracies of 96.72%, 80.32%, and 92.79% at 3.62 G FLOPs and 2.95 ms. At approximately the cost of ResNet-34, it retains accuracy gains of 0.43, 1.52, and 2.81 percentage points.

Table 11.

Comparisons at matched FLOPs and parameter budgets. ResNet-34-W1.10 and ResNet-34-W1.28 use width multipliers of 1.10 and 1.28, respectively. The former matches GeoSieveNet’s parameter count, and the latter matches its FLOPs. GeoSieveNet-Lite reduces the number of direction groups to D=2, bringing its FLOPs close to those of ResNet-34. All models use the same training protocol.

Network Parameters/M FLOPs/G Latency/ms CIFAR-10 CIFAR-100 Imagenette
Baseline
  ResNet-34 21.33 3.61 2.92 96.29 78.80 89.98
Capacity and cost controls (width or direction groups adjusted to the budget)
  ResNet-34-W1.10 25.81 4.25 3.42 96.34 79.21 90.42
  ResNet-34-W1.28 31.42 5.71 3.94 96.41 79.35 90.75
  GeoSieveNet-Lite (D=2) 24.10 3.62 2.95 96.72 80.32 92.79
Complete proposed model
  GeoSieveNet 25.65 5.73 4.12 96.95 81.86 94.71

Bold values indicate the highest accuracy in each accuracy column.

4.7. Ablation Results and Feature Visualization

Table 12 uses the complete RDCM as an ablation unit and includes an RDCM variant without FPM to isolate the contribution of FPM. All results are means and standard deviations over 3 runs; Table 13 reports significance tests. Adding HGA alone improved accuracy over ResNet-34 on all four datasets by 0.65–2.88 percentage points. Adding RDCM without FPM yielded gains of 0.25–3.19 percentage points. Enabling FPM within RDCM further improved accuracy by 0.36, 1.19, 1.42, and 1.89 percentage points, respectively. All gains were significant and increased with the extent of geometric variation. This indicates that preserving the fixed-grid branch constrains positional shifts introduced by deformable sampling. Adding HGA to the complete RDCM further increased accuracy by 0.05, 1.03, 0.13, and 1.14 percentage points, with larger complementary gains on CIFAR-100 and Imagewoof. The complete model achieved the highest accuracy on all four datasets.

Table 12.

Ablation experiments for the rotational deformable convolution module (RDCM), feature preservation module (FPM), and hierarchical gated attention (HGA). Values are means ± standard deviations over 3 random seeds, with each model trained 3 times on each dataset.

Network CIFAR-10/% CIFAR-100/% Imagenette/% Imagewoof/%
ResNet-34 96.29 ± 0.06 78.80 ± 0.08 89.98 ± 0.11 84.60 ± 0.18
+HGA 96.85 ± 0.17 80.40 ± 0.06 92.86 ± 0.08 85.25 ± 0.25
+RDCM (without FPM) 96.54 ± 0.06 79.64 ± 0.05 93.17 ± 0.07 86.76 ± 0.02
+RDCM (with FPM) 96.90 ± 0.06 80.83 ± 0.08 94.58 ± 0.06 88.65 ± 0.07
+HGA+RDCM (without FPM) 96.90 ± 0.15 80.79 ± 0.25 94.32 ± 0.11 89.02 ± 0.36
GeoSieveNet 96.95 ± 0.08 81.86 ± 0.13 94.71 ± 0.16 89.79 ± 0.19

Bold values indicate the highest mean accuracy in each dataset column.

Table 13.

Significance tests for the main accuracy gains. One-sided paired t-tests use results matched by random seed, with 2 degrees of freedom. sd is the sample standard deviation of paired differences, and p is the one-sided value before Holm correction. Statistics are calculated from seed-wise results and then rounded consistently. FPM rows compare RDCM with FPM against RDCM without FPM.

Comparison Dataset Gain/pp sd t(2) p
GeoSieveNet − ResNet-34 CIFAR-10 +0.66 0.035 33.0 <0.001
CIFAR-100 +3.06 0.055 96.3 <0.001
Imagenette +4.73 0.172 47.6 <0.001
Imagewoof +5.19 0.272 33.0 <0.001
FPM (with − without) CIFAR-10 +0.36 0.017 36.0 <0.001
CIFAR-100 +1.19 0.050 41.2 <0.001
Imagenette +1.42 0.107 22.9 <0.001
Imagewoof +1.89 0.085 38.3 <0.001

Figure 6 compares activation distributions for examples from five Imagenette classes. We use gradient-weighted class activation mapping (Grad-CAM), targeting the output of the final residual stage of each backbone. Inputs are uniformly sized to 224×224, and the four models use the same weights and preprocessing across the visualization comparisons. DenseNet and ResNet-34 produce more dispersed high-response regions. WideResNet-28-10 produces more concentrated responses, although some remain in the background. GeoSieveNet responds mainly to the target object, with more concentrated responses on animal heads and building contours. Table 14 reports quantitative localization results for 200 Imagenette test images with bounding-box annotations. GeoSieveNet achieves a pointing game (PG) hit rate of 82.0%, exceeding ResNet-34 by 7.7 percentage points. The seed-wise differences are [+9.5,+5.5,+8.0], with a paired-test value of p=0.008. The intersection over union (IoU) between the class activation mapping (CAM) region and the target region, denoted CAM-IoU, is 0.512. The deletion area under the curve (AUC) decreases to 0.243. All three metrics are better than those of the compared models.

Figure 6.

Figure 6

Activation distributions for Imagenette examples. (a) Original images. (b) DenseNet. (c) ResNet-34. (d) WideResNet-28-10. (e) GeoSieveNet. Warmer colors indicate stronger activation, whereas cooler colors indicate weaker activation.

Table 14.

Quantitative localization results for activation maps. Grad-CAM is evaluated on 200 Imagenette test images with bounding boxes, targeting the output of each backbone’s final residual stage. PG denotes pointing game, and PG-E denotes energy-based pointing game; both are reported as means and standard deviations over 3 random seeds. Deletion-AUC and insertion-AUC are means over the same test images. Lower deletion-AUC and higher insertion-AUC indicate more effective deletion and insertion, respectively.

Network PG/% PG-E/% CAM-IoU Deletion-AUC Insertion-AUC
DenseNet 66.50 ± 1.32 54.2 ± 2.1 0.361 0.312 0.684
ResNet-34 74.33 ± 1.61 61.5 ± 1.8 0.418 0.284 0.731
WideResNet-28-10 78.17 ± 0.76 66.1 ± 1.7 0.463 0.261 0.775
GeoSieveNet 82.00 ± 1.00 71.4 ± 1.3 0.512 0.243 0.812

Bold values indicate the best result in each metric column.

5. Discussion

5.1. Performance Changes and Architectural Contributions

RDCM produces larger gains than HGA when each is added independently on Imagenette and Imagewoof, making it the main source of improvement on these datasets. The independent FPM ablation shows that fusion of the fixed-grid and rotational deformable branches accounts for approximately half of RDCM’s gain. FPM contributes 1.42 and 1.89 percentage points on Imagenette and Imagewoof, respectively, compared with 0.36 percentage points on CIFAR-10. This difference is consistent with the datasets’ characteristics. Objects in Imagenette and Imagewoof show substantial pose and scale variation, making deformable sampling locations more likely to deviate from the regular grid. Retaining fixed-grid responses helps keep positional adjustments within an effective range. CIFAR-10 images have lower resolution and largely centered objects, leaving less spatial scope for sampling-location shifts.

Among the tested angle sets, the eight-direction configuration achieved lower accuracy than the four-direction Configuration 2. The initial offset-scale comparison likewise showed that increasing the predefined displacement did not yield sustained improvements. We therefore use four directions and s0=0.1; Table 4 and Table 5 provide the detailed comparisons.

5.2. Accuracy Gains and Computational Overhead

GeoSieveNet’s accuracy gains accompany increases in parameters, computation, and inference latency under the same test conditions. Table 10 relates the return on this overhead to the extent of geometric variation. The ratio of relative latency increase to relative accuracy increase is approximately 60 on CIFAR-10, falling to 7.8 on Imagenette and 6.7 on Imagewoof. In the direct hardware comparison, GeoSieveNet achieves 94.71% accuracy on Imagenette at 4.12 ms. ResNet-34-W1.28, widened to match FLOPs, reaches 90.75% at 3.94 ms, leaving a 3.96-percentage-point accuracy gap at a similar latency scale. ResNet-34-W1.10 also achieves lower accuracy than GeoSieveNet despite its 25.81 M parameters. These controls attribute the gains to the sampling mechanism rather than capacity expansion; increasing width alone does not achieve the same performance.

For deployment, the number of direction groups provides a direct means of adjusting computational cost. Reducing this number to 2 gives GeoSieveNet-Lite, with 3.62 G FLOPs and 2.95 ms latency, close to ResNet-34’s 3.61 G and 2.92 ms. It still improves accuracy by 0.43, 1.52, and 2.81 percentage points on the three datasets. The available compute therefore determines the choice between the complete and lightweight configurations: four directions when resources permit, and two directions when resources are constrained or geometric variation is weaker.

6. Conclusions

We proposed GeoSieveNet, which combines dynamic sampling with predefined orientations and within-group feature weighting in ResNet-34. RDCM uses FPM to fuse fixed-grid and rotational deformable responses, while HGA generates gating weights from directional statistics and local responses. Across 3 independent runs on four primary classification datasets, GeoSieveNet achieved significantly higher accuracy than ResNet-34 under the same training settings. Gains on Imagenette and Imagewoof were 4.73 and 5.19 percentage points, respectively, with paired tests significant at the 0.001 level. Ablations attributed 0.36–1.89 percentage points to FPM alone, and HGA further improved accuracy when added to RDCM. At the same FLOPs budget as ResNet-34, GeoSieveNet retained an accuracy advantage of 0.54–3.96 percentage points. The lightweight configuration with 2 direction groups preserved an accuracy advantage at the baseline latency level, allowing computational cost to be adjusted to the available resources.

Acknowledgments

The authors acknowledge Yichen Yu for his contributions to data organization, quantitative analysis, and code optimization in this research. His technical support has significantly enhanced the robustness of the empirical part of the paper.

Author Contributions

Conceptualization, H.C. and Z.W.; methodology, H.C. and Z.W.; software, H.C.; validation, H.C.; formal analysis, H.C. and G.M.; investigation, H.C., Y.L. and G.M.; resources, H.C. and Z.W.; data curation, H.C. and Y.L.; writing—original draft preparation, H.C. and Z.W.; writing—review and editing, H.C., Z.W., Y.L., M.Y., G.M. and L.Y.; visualization, H.C. and M.Y.; supervision, Z.W.; project administration, H.C., Z.W. and L.Y.; funding acquisition, Z.W. All authors have read and agreed to the published version of the manuscript.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

CIFAR-10 and CIFAR-100 are available from https://cave.cs.toronto.edu/kriz/cifar.html (University of Toronto dataset page) (accessed on 8 October 2026). Flowers-102 is available from https://www.robots.ox.ac.uk/~vgg/data/flowers/102/ (Oxford VGG dataset page) (accessed on 8 October 2026) and STL-10 from https://cs.stanford.edu/~acoates/stl10/ (Stanford dataset page) (accessed on 8 October 2026). Imagenette and Imagewoof are available from https://github.com/fastai/imagenette (fastai project repository) (accessed on 8 October 2026). Table 2 specifies the splits used in this study. Summarized experimental results are presented in the main text, figures, and tables.

Conflicts of Interest

The authors declare no conflicts of interest. The funders did not participate in the study design, data analysis, manuscript writing, or decision to publish.

Funding Statement

This research was funded by the National Natural Science Foundation of China (Grant Nos. 61841602 and 42105144), the Science Fund for Distinguished Young Scholars of Shandong Province of China (Grant No. ZR2025QA13), the Natural Science Foundation of Shandong Province of China (Grant Nos. ZR2021MF017 and ZR2020MF147), the Youth Innovation Science and Technology Team Foundation of Shandong Higher School (Grant No. 2021KJ031), and the Fundamental Research Funds for the Central Universities, Jilin University (Grant No. 93K172021K12). The article processing charge (APC) was paid by the first author.

Footnotes

Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

References

  • 1.Krizhevsky A., Sutskever I., Hinton G.E. ImageNet classification with deep convolutional neural networks; Proceedings of the 25th International Conference on Neural Information Processing Systems; Lake Tahoe, NV, USA. 3–6 December 2012; pp. 1097–1105. [Google Scholar]
  • 2.Simonyan K., Zisserman A. Very deep convolutional networks for large-scale image recognition; Proceedings of the 3rd International Conference on Learning Representations; San Diego, CA, USA. 7–9 May 2015. [Google Scholar]
  • 3.He K., Zhang X., Ren S., Sun J. Deep residual learning for image recognition; Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition; Las Vegas, NV, USA. 27–30 June 2016; pp. 770–778. [DOI] [Google Scholar]
  • 4.Huang G., Liu Z., Van Der Maaten L., Weinberger K.Q. Densely connected convolutional networks; Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition; Honolulu, HI, USA. 21–26 July 2017; pp. 2261–2269. [DOI] [Google Scholar]
  • 5.Tan M., Le Q.V. EfficientNet: Rethinking model scaling for convolutional neural networks; Proceedings of the 36th International Conference on Machine Learning; Long Beach, CA, USA. 9–15 June 2019; pp. 6105–6114. [Google Scholar]
  • 6.Cohen T., Welling M. Group equivariant convolutional networks; Proceedings of the 33rd International Conference on Machine Learning; New York, NY, USA. 20–22 June 2016; pp. 2990–2999. [Google Scholar]
  • 7.Worrall D.E., Garbin S.J., Turmukhambetov D., Brostow G.J. Harmonic networks: Deep translation and rotation equivariance; Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition; Honolulu, HI, USA. 21–26 July 2017; pp. 7168–7177. [DOI] [Google Scholar]
  • 8.Dai J., Qi H., Xiong Y., Li Y., Zhang G., Hu H., Wei Y. Deformable convolutional networks; Proceedings of the IEEE International Conference on Computer Vision; Venice, Italy. 22–29 October 2017; pp. 764–773. [DOI] [Google Scholar]
  • 9.Zhu X., Hu H., Lin S., Dai J. Deformable ConvNets V2: More deformable, better results; Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition; Long Beach, CA, USA. 15–20 June 2019; pp. 9308–9316. [Google Scholar]
  • 10.Hu J., Shen L., Sun G. Squeeze-and-excitation networks; Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition; Salt Lake City, UT, USA. 18–23 June 2018; pp. 7132–7141. [DOI] [Google Scholar]
  • 11.Woo S., Park J., Lee J.-Y., Kweon I.S. CBAM: Convolutional block attention module; Proceedings of the European Conference on Computer Vision; Munich, Germany. 8–14 September 2018; pp. 3–19. [Google Scholar]
  • 12.Hou Q., Zhou D., Feng J. Coordinate attention for efficient mobile network design; Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition; Nashville, TN, USA. 20–25 June 2021; pp. 13713–13722. [Google Scholar]
  • 13.Wang W., Dai J., Chen Z., Huang Z., Li Z., Zhu X., Hu X., Lu T., Lu L., Li H., et al. InternImage: Exploring large-scale vision foundation models with deformable convolutions; Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition; Vancouver, BC, Canada. 17–24 June 2023; pp. 14408–14419. [Google Scholar]
  • 14.Xiong Y., Li Z., Chen Y., Wang F., Zhu X., Luo C., Wang W., Lu T., Li H., Qiao Y., et al. Efficient deformable convnets: Rethinking dynamic and sparse operator for vision applications; Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition; Seattle, WA, USA. 17–21 June 2024; pp. 5690–5699. [DOI] [Google Scholar]
  • 15.Lan H., Wang X., Shen H., Liang P., Wei X. Couplformer: Rethinking vision transformer with coupling attention; Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision; Waikoloa, HI, USA. 2–7 January 2023; pp. 6475–6484. [Google Scholar]
  • 16.Konstantinidis D., Papastratis I., Dimitropoulos K., Daras P. Multi-manifold attention for vision transformers. IEEE Access. 2023;11:123433–123444. doi: 10.1109/access.2023.3329952. [DOI] [Google Scholar]
  • 17.Tan J.H. Pre-training of lightweight vision transformers on small datasets with minimally scaled images. arXiv. 2024 doi: 10.48550/arXiv.2402.03752.2402.03752 [DOI] [Google Scholar]
  • 18.Zhang T., Wan F., Duan H., Tong K.W., Deng J., Long Y. FMDConv: Fast multi-attention dynamic convolution via speed-accuracy trade-off. Knowl.-Based Syst. 2025;317:113393. doi: 10.1016/j.knosys.2025.113393. [DOI] [Google Scholar]
  • 19.Lu L., Pang S., Zheng X., Gu X., Du A., Liu Y., Zhou Y. CIARD: Cyclic iterative adversarial robustness distillation; Proceedings of the IEEE/CVF International Conference on Computer Vision; Honolulu, HI, USA. 19–23 October 2025; pp. 350–359. [Google Scholar]
  • 20.Zhang K., Guo Y., Wang X., Yuan J., Ma Z., Zhao Z. Channel-wise and feature-points reweights DenseNet for image classification; Proceedings of the IEEE International Conference on Image Processing; Taipei, Taiwan. 22–25 September 2019; pp. 410–414. [DOI] [Google Scholar]
  • 21.Vaswani A., Shazeer N., Parmar N., Uszkoreit J., Jones L., Gomez A.N., Kaiser L., Polosukhin I. Attention is all you need; Proceedings of the 31st International Conference on Neural Information Processing Systems; Long Beach, CA, USA. 4–9 December 2017; pp. 6000–6010. [Google Scholar]
  • 22.He T., Zhang Z., Zhang H., Zhang Z., Xie J., Li M. Bag of tricks for image classification with convolutional neural networks; Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition; Long Beach, CA, USA. 15–20 June 2019; pp. 558–567. [DOI] [Google Scholar]
  • 23.Zagoruyko S., Komodakis N. Wide residual networks; Proceedings of the British Machine Vision Conference; York, UK. 19–22 September 2016. [Google Scholar]
  • 24.Liu Z., Mao H., Wu C.-Y., Feichtenhofer C., Darrell T., Xie S. A ConvNet for the 2020s; Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition; New Orleans, LA, USA. 18–24 June 2022; pp. 11976–11986. [DOI] [Google Scholar]
  • 25.Luo Z., Sun Z., Zhou W., Wu Z., Kamata S.-I. Rethinking ResNets: Improved stacking strategies with high order schemes. arXiv. 2021 doi: 10.48550/arXiv.2103.15244.2103.15244 [DOI] [Google Scholar]
  • 26.Abdi M., Nahavandi S. Multi-residual networks: Improving the speed and accuracy of residual networks. arXiv. 2016 doi: 10.48550/arXiv.1609.05672.1609.05672 [DOI] [Google Scholar]
  • 27.Choromanski K., Likhosherstov V., Dohan D., Song X., Gane A., Sarlos T., Hawkins P., Davis J., Mohiuddin A., Kaiser L., et al. Rethinking attention with performers; Proceedings of the 9th International Conference on Learning Representations; Virtual Event. 3–7 May 2021. [Google Scholar]
  • 28.Real E., Moore S., Selle A., Saxena S., Suematsu Y.L., Tan J., Le Q.V., Kurakin A. Large-scale evolution of image classifiers; Proceedings of the 34th International Conference on Machine Learning; Sydney, Australia. 6–11 August 2017; pp. 2902–2911. [Google Scholar]
  • 29.Jiang W.T., Zhao L.L., Tu C. Double-branch multi-attention mechanism based sharpness-aware classification network. Pattern Recognit. Artif. Intell. 2023;36:252–267. doi: 10.16451/j.cnki.issn1003-6059.202303005. [DOI] [Google Scholar]
  • 30.Jiang W., Chen C., Zhang S. Sparse feature image classification network with spatial position correction. Opto-Electron. Eng. 2024;51:240050. [Google Scholar]
  • 31.Yang Y., Li L., Liu X., Jiao L., Liu F., Ma W. Multiscale and multidirectional transformer-based image recognition. Chin. J. Comput. 2025;48:249–265. [Google Scholar]
  • 32.Wu X., Gao S., Zhang Z., Li Z., Bao R., Zhang Y., Wang X., Huang H. Auto-train-once: Controller network guided automatic network pruning from scratch; Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition; Seattle, WA, USA. 17–21 June 2024; pp. 16163–16173. [DOI] [Google Scholar]
  • 33.Zhou C., Zhang H., Zhou Z., Yu L., Huang L., Fan X., Yuan L., Ma Z., Zhou H., Tian Y. QKFormer: Hierarchical spiking transformer using Q-K attention; Proceedings of the 38th International Conference on Neural Information Processing Systems; Vancouver, BC, Canada. 10–15 December 2024. [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Data Availability Statement

CIFAR-10 and CIFAR-100 are available from https://cave.cs.toronto.edu/kriz/cifar.html (University of Toronto dataset page) (accessed on 8 October 2026). Flowers-102 is available from https://www.robots.ox.ac.uk/~vgg/data/flowers/102/ (Oxford VGG dataset page) (accessed on 8 October 2026) and STL-10 from https://cs.stanford.edu/~acoates/stl10/ (Stanford dataset page) (accessed on 8 October 2026). Imagenette and Imagewoof are available from https://github.com/fastai/imagenette (fastai project repository) (accessed on 8 October 2026). Table 2 specifies the splits used in this study. Summarized experimental results are presented in the main text, figures, and tables.


Articles from Journal of Imaging are provided here courtesy of Multidisciplinary Digital Publishing Institute (MDPI)

RESOURCES