Skip to main content
NIHPA Author Manuscripts logoLink to NIHPA Author Manuscripts
. Author manuscript; available in PMC: 2026 Oct 1.
Published in final edited form as: Proc Mach Learn Res. 2026;306:155857–155873.

GenUnfold: Rapidly Predict Protein Mechanical Unfolding Trajectory via a Physics-Guided Diffusion Model

Yiyuan Zhang 1, Cailong Hua 2, Vinitendra Singh 2, Joseph M Muretta 3, James M Ervasti 3, Murti V Salapaka 2
PMCID: PMC13626394  NIHMSID: NIHMS2197020  PMID: 42820154

Abstract

Many fundamental biological processes are governed by mechanical forces, with proteins acting as the key molecular mediators. Elucidating how protein unfolding responds to force is critical for understanding the mechano-pathologies, such as cardiomyopathy and muscular dystrophy. While the unfolding trajectories measured by Single-Molecule Force Spectroscopy (SMFS) map the instantaneous force response against molecular extension, its broader application is limited by time-consuming data collection and high operational costs. Here, we present the first scalable generative diffusion framework for full unfolding trajectory prediction, which integrates protein encoders for multi-scale conditioning. Beyond establishing the field’s first systematic benchmark using existing models, we propose GenUnfold, a novel physics-guided diffusion model that combines global coevolutionary context with a local mechanical representation of the protein. The representation is derived from a novel physics-biased attention mechanism, which steers the generative diffusion process by modeling dynamic residue dependencies as a function of both structural topology and interaction stiffness. The benchmark for this task is built upon the biomolecule stretching database and several representative baseline models. Empirical results demonstrate that GenUnfold achieves state-of-the-art performance, reducing distributional error (FID) by 30% and 54% compared to pretrained Evolutionary Scale Model (ESM)-2 and standard transformer, respectively. Beyond statistical curve similarity, GenUnfold demonstrates superior physical consistency; in downstream mechanical property prediction, it reduces prediction errors for unfolding force and energy distributions by 6% and 36% over the ESM-2 baseline. These results indicate that while existing generative AI approaches can alleviate the need for predicting representative force curves, GenUnfold further improves performance by leveraging the synergy between protein structure and evolutionary information. By enabling proteome-wide screening to identify mechanical candidates before costly physical validation, our approach is promising to accelerate the discovery of force-targeted therapeutics.

1. Introduction

The controlled mechanical unfolding of protein molecules is a critical biological process in vivo (Bustamante et al., 2004; Beedle & Garcia-Manyes, 2023), particularly within load-bearing tissues such as muscle and the cytoskeleton (Marszalek et al., 1999). The stability and function of these mechanical proteins heavily depend on how forces are transmitted and dissipated through their topological structures (Fernandez & Li, 2004; Stacklies et al., 2009). For example, in the protein dystrophin, the central spectrin-like repeat domains with a three-helix bundle structure act as molecular shock absorbers. By unfolding during muscle contraction, these domains dissipate mechanical energy to protect the myofiber membrane from damage (Ervasti, 2007). Furthermore, understanding the relationship between protein structure and mechanical response is fundamental to modern therapeutic design. For instance, in Duchenne Muscular Dystrophy (a fatal disease affecting 1 in 5,000 births born in the U.S.), identifying mechanically resilient analogs to replace missing or defective dystrophin remains a critical strategy for effective therapy but is still under study (Mendell et al., 2012; Ervasti, 2007).

Single-molecule force spectroscopy (SMFS) currently serves as the main technique to probe the mechanical unfolding of protein molecules (Viljoen et al., 2021). Instruments such as Atomic Force Microscopy (AFM) and optical tweezers apply external force to the protein of interest, driving it from a native equilibrium state to probe non-equilibrium unfolding dynamics (Neuman & Nagy, 2008). The measured force-extension (F-x) trajectories provide rich insights into the protein’s free energy landscape (captured by total unfolding energy) and mechanical stability (characterized by the unfolding force) (Sengupta & Rief, 2021). However, the unfolding process is inherently stochastic and heterogeneous (Schönfelder et al., 2016), which necessitates thousands of F-x curves from repetitive pulling experiments to obtain statistically reliable ensembles (Hua et al., 2025). This requirement renders SMFS labor-intensive and time-consuming, creating a significant bottleneck in studying large-scale proteins.

Molecular Dynamics (MD) simulations offer a computational alternative, providing atomic-level resolution of unfolding dynamics and structural changes (Li & Makarov, 2003). The high-fidelity data generated by MD simulations can be exploited for data-driven, learning-based methodologies. However, the utility of MD for high-throughput research is constrained by the imperfections of current force fields (Lewis et al., 2025) and the prohibitive computational cost of sampling the thousands of trajectories required for statistical robustness. While coarse-grained alternatives offer improved computational efficiency, their ability to model complex unfolding pathways is often limited and remains an active area of development (Joshi & Deshmukh, 2021).

The emerging data-driven machine learning, particularly generative diffusion models, have been widely used in protein structure prediction and design (Jumper et al., 2021; Gruver et al., 2023). Recent works, such as BioEmu (Lewis et al., 2025), have demonstrated the capability to generate diverse structural ensembles and can be coupled with MD to mitigate sampling limitations. Moreover, Large-scale Protein Language Models (PLMs) such as Evolutionary Scaling Modeling (ESM)-2 (Lin et al., 2023) reveal that coevolutionary patterns in amino acid sequence data encode rich structural and functional information and provide identity of the protein. Despite these advances, current machine learning methods focus primarily on predicting equilibrium states of protein structures and fail to account for the directional, non-equilibrium dynamics driven by external force. Currently, there is no scalable, learning-based method capable of predicting full F-x trajectories and the specific mechanical properties they encode.

To address this gap, we present the first generative diffusion framework for predicting full protein unfolding trajectories conditioned on protein sequence and structure. We begin by building the benchmark with a suite of current State-of-the-Art deep learning approaches, e.g., standard Transformers and pretrained ESM-2. These models are used for encoding protein features as conditioning signals. Moreover, we propose GenUnfold, a novel physics-guided diffusion model that integrates multi-scale physical priors. The approach integrates coevolutionary information from the amino acid sequence for high-level semantic guidance, and structure-derived topology priors that explicitly capture residue-residue dependencies and force propagation pathway critical for modeling mechanical response. Our contributions include:

Evolution-Topology Co-Conditioning.

We propose a diffusion backbone that effectively routes information through two parallel streams: high-level coevolutionary context via Adaptive Layer Normalization (adaLN) and detailed mechanical representation via cross-attention. This architecture enables the model to generate trajectories that are both biologically plausible and mechanically consistent.

Physics-biased Attention Mechanism.

We introduce a novel attention mechanism that fuses multi-scale structural topology priors into a learnable attention bias to model residue-residue dependencies and force propagation pathways. A lightweight CNN learns nonlinear combinations of these priors, while a temporal gating mechanism modulates their influence in different diffusion timesteps.

Empirical validation.

We establish the first comprehensive benchmark for protein unfolding trajectory prediction. GenUnfold achieves state-of-the-art results, reducing distributional error by over 30% to 54% compared to strong baselines (ESM-2 and standard Transformers). Furthermore, it demonstrates high physical fidelity, reducing prediction error for unfolding force and energy distributions by 6% and 36%, respectively, offering a robust computational complement to physical SMFS.

2. Related Work

Generative Modeling of Molecular dynamics.

Current generative modeling in biology mainly focuses on sampling 3D conformational ensembles or de novo design. Diffusion models, e.g., RFdiffusion (Watson et al., 2023), Chroma (Ingraham et al., 2023), and Flow Matching methods have achieved remarkable success in generating protein backbones by reversing a noise process on 3D coordinates. Similarly, Boltzmann Generators (Noé et al., 2019) and Torsional Diffusion (Jing et al., 2022) learn to sample equilibrium distributions to characterize metastable states. More recently, generative models have also been explored for directly predicting folding trajectories (Cheng et al., 2025); however, their temporal horizons remain limited and are still far from the million-step scale typically required for force-driven protein unfolding. Whereas existing models generate 3D geometric coordinates to sample equilibrium states, our model aims to generate 1D functional signals (F-x trajectories) representing a stochastic, non-equilibrium process. We repurpose the diffusion framework not only to design or sample a 3D structure of a protein, but to simulate the dynamic response of a structure under external force.

Physics-Guided Inductive Biases.

Injecting physical constraints into the learning process is a key strategy for improving generalization in scientific ML. Common approaches include enforcing E(n)-equivariance that model predictions ensure are invariant to global translations and equivariant to rotations and reflections (Garcia Satorras et al., 2021) or constraining outputs to satisfy Hamiltonian mechanics (Greydanus et al., 2019). In the context of protein mechanics, classical Elastic Network Models (ENM) (Atilgan et al., 2001) define harmonic interactions based on geometric proximity. We argue that geometric proximity alone is insufficient for modeling force propagation. GenUnfold introduces a novel physics-biased attention mechanism that integrates multi-scale physical priors directly into the attention bias. Our model routes information along stiff mechanical pathways, mimicking the physical transmission of stress through the polypeptide chain.

To the best of our knowledge, GenUnfold is the first generative framework designed to predict mechanical unfolding trajectories directly from protein sequence and structure. By bridging the gap between high-fidelity MD simulations and scalable generative deep learning, it offers a new framework for characterizing protein properties.

3. Preliminary

3.1. Problem Statement

As shown in Fig. 1, in a typical steered MD simulation, the N-terminus (beginning end) of the studied protein molecule is anchored, and the C-terminus (end) is tethered to a moving harmonic spring with stiffness k (Sikora et al., 2010). The free end of this spring (dummy atom) moves away at a constant velocity v. The instantaneous pulling force is computed via Hooke’s law based on the spring’s extension Δx,F=k(Δx). This process continues until the end-to-end extension, Lac, reaches the protein’s theoretical contour length, Lcon=L×3.6Å for a protein of L residues (Ainavarapu et al., 2007). The resulting F-x trajectories F=F1,F2,…,FN⊤∈RN (Fig. 1d) capture the mechanical unfolding dynamics, and the unfolding force Fi represents the mechanical stability of the protein.

Figure 1.

Figure 1.

Overview of the protein unfolding process and the proposed modeling framework. Protein is represented as a spring network for visualization. (a-d) In the MD simulation, a tethered protein is mechanically stretched, yielding a F-x trajectory that encodes the unfolding dynamics. (e) GenUnfold extracts structure prior maps and residue features from the amino acid sequence and native structure of the protein as a conditional signal to predict the full unfolding trajectory.

In this study, a protein molecule is defined by its amino acid sequence S, and a coarse-grained structure X∈RL×3 (one 3D coordinate per Cα atom of the residue). A key challenge is that the static structure X does not explicitly encode the mechanical pathways or force propagation networks that govern unfolding. To bridge this gap, we transform the raw static inputs (S and X) into two mechanics-aware feature sets to serve as inductive biases: (1) Residue-level Features Rf: A set of 17 chemical features, e.g, residue type, hydrophobic and charge category, describing the local properties of each residue (details in Appendix A.2). (2) Physical Topology Priors (𝒢): A multi-channel graph representation derived from X that explicitly encodes long-range residue interaction by geometric adjacency, residue-residue interaction strength, and global mechanical coupling. (The derivation of 𝒢 will be introduced in Section 4.2.) The resulting dataset denotes as 𝒟=Fi,Si,Xi,Rf,i,𝒢ii=1M with M samples.

Our objective is the conditional generative modeling of the full protein mechanical unfolding trajectories F. Formally, we seek to learn the parameters θ of a neural network to approximate the conditional distribution pθF∣S,X,Rf,𝒢.

3.2. Diffusion Model

Diffusion Probabilistic Model.

For generative modeling, the diffusion model involves a forward process that incrementally adds noise to a data point x0~q(x) until it reaches a noise-only state xT~𝒩(0,I) (Sohl-Dickstein et al., 2015). The transition at step t is governed by qxt∣xt−1=𝒩xt;1−βtxt−1,βtI, where constants βt are hyperparameters. The core of the model lies in learning a reverse generative process pθxt−1∣xt=𝒩μθxt,t,σθxt,t by a neural network with parameters θ. By reparameterizing μθ as a noise prediction network ϵθ, the model can be trained using simple mean-squared error between the predicted noise ϵθxt,t and the ground truth sampled Gaussian noise ϵt (Ho et al., 2020):

ℒx0=∑t=1TEqxt∣x0ϵθxt,t−ϵt22. (1)

Transformer-based Diffusion Backbones.

Diffusion Transformer (DiT) (Peebles & Xie, 2023) demonstrated the superior potential of Transformer-based architectures in terms of scalability and performance. To incorporate conditioning into the generation process, DiT proposed an efficient modulation mechanism through adaLN. It maps scalar or vector conditions (such as the diffusion timestep t and class labels y) through a small Multilayer Perceptron (MLP) to generate the parameters (γ,β) for an affine transformation. These parameters are then applied in the layer norm before self-attention, thereby modulating the network’s behavior to guide the denoising process. However, the adaLN mechanism is primarily suited for global, single-vector conditions with compressed information (Podell et al., 2023). To handle more complex, sequential conditioning, such as textual descriptions, subsequent works, e.g., PIXART-α (Chen et al., 2023), introduced a key extension to the DiT architecture. They insert a cross-attention layer within each Transformer block, positioning it between the self-attention layer and the feed-forward (FFN) layer. This design allows the model to actively “query” the external condition sequence (e.g., sequential text embeddings) after processing its own tokens (i.e., the noisy xt), enabling finer-grained guidance.

The following subsections detail the extraction of these conditions and their integration into the generative backbone.

4. GenUnfold

As illustrated in Fig. 2, we introduce GenUnfold, a physics-guided diffusion framework tailored to predict dynamics protein mechanical unfolding (F-x) trajectories from protein sequence and structure. The core challenge in this task is bridging the modality gap: mapping a static, equilibrium structure to a stochastic, non-equilibrium unfolding process. To address this, GenUnfold employs a co-conditioning architecture of DiT with cross-attention to integrate two complementary streams of information:

Figure 2.

Figure 2.

The Diffusion Backbone of GenUnfold. Coevolutionary context yt modulates DiT blocks via adaptive layer norm (adaLN), and mechanical representations ct are injected directly through Cross-Attention layers.

  1. Coevolutionary context yt by adaLN: A high-level semantic representation of protein sequence derived from coevolutionary language models, capturing the protein’s global identity.

  2. Mechanical Representation ct by cross-attention: A fine-grained, mechanically informed structure embedding. This is generated by a novel Physics-biased Attention that guides the attention mechanism using physical topology priors.

4.1. Coevolutionary Context

To capture coevolutionary information crucial for protein mechanics, we employ the ESM-2, a large-scale PLM trained on millions of diverse protein sequences (Lin et al., 2023). Our motivation is that the coevolutionary patterns learned by ESM-2 serve as a powerful proxy for the structural and functional relationships that govern mechanical stability.

Given a protein sequence, we extract residue-level embeddings from the last hidden layer of ESM-2 and apply meanpooling to derive a global semantic vector yseq∈RH, where H is the hidden size of the neural network. Concurrently, the diffusion timestep t is embedded via sinusoidal encoding and an MLP to form temb∈RH. Then, they are pointwise connected to form the final coevolutionary context vector yt=yseq+temb. In the diffusion backbone, yt modulates the generation process via adaLN-Zero, effectively steering the global distribution of the generated curves based on protein identity and noise level.

4.2. Mechanical Representation via Multi-head Physics-biased Attention

While standard Transformer architectures excel at processing sequence data (Vaswani et al., 2017), they treat residues purely as tokens, may lack the explicit inductive biases required to model the long-range residue independencies and complex, heterogeneous force propagation pathways in protein unfolding. To bridge this gap, we introduce the Multi-head Physics-biased Attention (Fig. 3), which injects multi-scale physical topology priors directly into the attention mechanism, ensuring the learned local representation c respects the protein’s native topology and elasticity.

Figure 3.

Figure 3.

Architecture of the Multi-head Physics-Biased Attention. A CNN extracts features from the structural graph (𝒢), which are temporally gated and added to attention logits to constrain the learned mechanical representation (ct).

Physics-Guided Multi-Channel Priors.

To derive mechanically meaningful features from the 3D structure X, we model the protein structure as a harmonic spring network (Atilgan et al., 2001). Under this setting, residues act as nodes, which are fully interconnected by simple harmonic springs that approximate the interaction stiffness and topological elasticity.

From static structure X, We construct a multi-channel graph 𝒢=[D,K,R]∈R3×L×L comprising: (1) Distance Map (D): The pairwise Euclidean distance dij between residues i and j. (2) Stiffness Map (K): Modeling local interaction strength. The spring constant is defined by kij=dij−2 (for i≠j) or 0 (for i=j) (Yang et al., 2009) to approximate contact stiffness. (3) Resistance Map (R): Quantifying global mechanical coupling and elasticity. We compute the Graph Laplacian L=Ddeg−K, where the degree Ddegii=∑jkij, and its pseudoinverse G=L+. The effective resistance distance is given by Rij=Gii+Gjj−2Gij. Intuitively, low Rij indicates a “stiff corridor” efficient for force transmission, providing a global topological prior that complements local neighborhood information.

Learnable Physical Bias and Temporal gating

Rather than using the priors 𝒢 as fixed features, we employ a CNN-based Bias Module to learnable attention bias (see Fig. 3). The graph 𝒢 is processed by a 3 × 3 convolutional layer followed by a residual block consisting of two stacked 3 × 3 convolutions with interleaved Batch Normalization and ReLU activations. A final projection maps the fused features to h distinct bias maps, Bcnn∈Rh×L×L, matching the number of attention heads. This design promotes attentional specialization that one head may learn to focus on local rigidity (dominated by K), while another attends to long-range coupling pathways (informed by R).

Crucially, the relevance of extracted features Bcnn changes as the diffusion process reconstructs the trajectory. For instance, while D and K provide structural priors for the initial denoising step, R offers essential guidance for capturing the unfolding events as force propagates through topological bottlenecks in the final fine-tuning denoising stage. To model this, we introduce a Time-Dependent Gating mechanism. The diffusion time embedding temb is projected via an MLP to a scaling vector g(t)∈RH, which allows the model to dynamically upweight or downweight physical constraints as the generative denoising progresses. The final attention bias for the i-th head is a dynamically modulated version of the physical map:

Bfinal(i)(t)=g(i)(t)⋅Bcnn(i) (2)

Protein Encoder Block

The encoder processes residue features Rf via a stack of tranformer blocks with physics-biased attention. We modify the standard self-attention mechanism by injecting the learned physical bias into the softmax logits:

Attn(i)(X)=softmaxQ(i)K(i)⊤dk+Bfinal(i)(t)V(i) (3)

where Q,K,V are linear projections of the layer-normalized input. This biased attention output is then processed by a standard FFN with pre-normalization to produce the final physical representation c. This embedding is subsequently fed into the cross-attention layers of the DiT backbone, enabling the generator to attend to mechanically critical residues during trajectory generation. More details of the model architecture are provided in the Appendix B.

5. Experiments

5.1. Dataset

We train and validate GenUnfold primarily using high-quality MD data sourced from the Bio-molecule Stretching Database (BSDB) (Sikora et al., 2010). We cross-referenced BSDB with the Protein Data Bank (PDB) to filter for proteins with available high-resolution experimental structures. The final curated dataset comprises 16,495 unique proteins and 32,990 F-x curves (each protein has two curves). The orginal F-x curves were preprocessed by two standardization steps to facilitate neural network training. First, to handle variable protein lengths, extension values are normalized by the theoretical contour length x′=x/Lcon of corresponding protein and subsequently resampled onto a fixed-resolution grid of N points via linear interpolation. Second, to standardize the force range while preserving the relative mechanical strength between different proteins, force magnitudes are normalized using a global Min-Max scaling. Specifically, all force values are scaled to [0, 1] based on the maximum orce observed across the training set of the dataset 𝒟, rather than on a per-protein basis.

Conditioning signals are derived directly from PDB structures. Specifically, We precompute: (1) Coevolutionary Context: Coevolutionary embeddings of amino acid sequence via ESM-2. (2) Residue-level Features: A residue-level matrix Rf containing physicochemical properties (charge, polarity), geometric descriptors (secondary structure, SASA), and B-factors via DSSP (Kabsch & Sander, 1983). 3) Physical Topology Priors: The precomputed geometric and mechanical maps (𝒢) described in Sec. 4.2. Moreover, We employ a strict protein-level split (80:10:10) to create the training, validation, and test sets. Crucially, we ensure that all trajectories associated with a specific protein sequence are confined to a single split. More data and preprocessing details are provided in Appendix A.

5.2. Evaluation Metrics

We evaluate performance across three complementary dimensions: signal reconstruction, distributional fidelity, and biophysical consistency. We adopt the following evaluation metrics (see Appendix C. for the detailed descriptions): (1) Relative l2 Error (Rel l2) (Ni et al., 2024) to quantify trajectory accuracy; (2) Fréchet Inception Distance (FID) (Jeha et al., 2022) to assess whether the generated trajectories capture the realistic, high-dimensional statistics of real unfolding curves; (3) Jensen–Shannon distance (JSD) to evaluate whether the model reproduces the distributions of two physically salient properties (Ni et al., 2024): unfolding force Funfold=maxx{F(x)⋅1(unfoldingeventatx)} (Force-JSD) and unfolding energy W=∫LconFdLac (Energy-JSD). All metrics are computed on the test set for three independent runs, with means and variance reported.

5.3. Benchamark

Since no prior methods aim to generate full F-x trajectories, we design a comprehensive benchmark to evaluate the contributions of our key components: the evolution-topology co-conditioning architecture and the physics-biased attention. We evaluate two classes of models:

  1. Global-Conditioned Baselines (Standard DiT). These models use a standard DiT backbone conditioned solely via adaLN with context y∈RH, testing if a single global vector is sufficient to capture unfolding dynamics: (1) DiT-SelfAtten (baseline): Uses a standard transformer to process residue-level features Rf and pools the output globally. (2) DiT-ESM: Uses pooled ESM-2 embeddings, testing the sufficiency of pure sequence/coevolutionary data. (3) DiT-PhyAtten: Uses our physics-biased attention but pools the output globally, testing the value of structural topology priors without coevolutionary guidance.

  2. Co-Conditioning Models (CrossDiT). These models utilize the full diffusion backbone, injecting global context (y) via adaLN and fine-grained local context (c∈RL×H) via Cross-Attention: (1) CrossDiT-ESM-SelfAtten: Combines global ESM context with a standard transformer. (2) CrossDiT-ESM-ESM: A pure sequence variant using ESM-2 for both full embeddings (global) and pooled embeddings (local), ignoring explicit physics. (3) CrossDiT-ESM-PhyAtten (GenUnfold): The proposed model combines global coevolutionary guidance with local physical mechanics. (4) CrossDiT-PhyAtten-PhyAtten: A physics-only variant excluding ESM, testing the necessity of evolutionary signals.

All variants share identical hyperparameters for the diffusion schedule, token budget, training epochs, and optimization.

6. Results

6.1. Performance Evaluation

We evaluate the performance of our model components using the metrics summarized in Table 1. Relative to the baseline (DiT-SelfAtten), injecting coevolutionary information from ESM-2 (DiT-ESM) significantly improves reconstruction, reducing Rel l2 by 50.6% and FID by 14.1%. This confirms that the global sequence context effectively acts as a high-level semantic guide for the trajectory’s overall shape. On the other hand, while DiT-PhyAtten shows a more moderate improvement in Rel l2 (43.1%) compared to the DiT-ESM, it achieves a competitive FID of 0.0219, representing a 14.5% reduction from the baseline. Crucially, DiT-PhyAtten reduces the Force-JSD by 29.8% and Energy-JSD by 22.6% compared to the baseline, outperforming DiT-ESM on these physics-sensitive metrics. The result indicates that explicit mechanical constraints are essential for steering the generation toward physically valid unfolding pathways.

Table 1.

Main results on the BSDB test set. Lower is better.

Model Rel l2↓ FID ↓ Force_JSD ↓ Energy_JSD ↓
DiT-SelfAtten 0.4384 ± 0.0078 0.0256 ± 0.0106 0.0832 ± 0.0076 0.0638 ± 0.0055
DiT-ESM 0.2165 ± 0.0080 0.0220 ± 0.0083 0.0828 ± 0.0046 0.0575 ± 0.0053
DiT-PhyAtten 0.2494 ± 0.0045 0.0219 ± 0.0079 0.0584 ± 0.0075 0.0494 ± 0.0032
CrossDiT-ESM-SelfAtten 0.2117 ± 0.0199 0.0215 ± 0.0133 0.0668 ± 0.0136 0.0517 ± 0.0192
CrossDiT-ESM-ESM 0.2017 ± 0.0007 0.0168 ± 0.0090 0.0590 ± 0.0031 0.0533 ± 0.0097
CrossDiT-ESM-PhyAtten 0.2070 ± 0.0050 0.0117 ± 0.0011 0.0553 ± 0.0032 0.0338 ± 0.0038
CrossDiT-PhyAtten-PhyAtten 0.2274 ± 0.0050 0.0165 ± 0.0055 0.0564 ± 0.0026 0.0370 ± 0.0100

Furthermore, the co-conditioning architecture yields the strongest performance. While the pure-sequence variant (CrossDiT-ESM-ESM) achieves the lowest point-wise error (Rel l2: 0.2017), it lags in distributional fidelity. The proposed model, GenUnfold (CrossDiT-ESM-PhyAtten), achieves the optimal balance by fusing global coevolutionary guidance with local mechanical representation turning. It sets a new state-of-the-art on the critical generative metrics, achieving the lowest FID (0.0117), a 54.3% reduction from baseline. CrossDiT-ESM-PhyAtten also yields the most physically accurate ensembles, lowering Force-JSD by 33.5% and Energy-JSD by 47.0% (from 0.0638 to 0.0338). The dramatic improvement in Energy-JSD underscores the model’s ability to maintain long-range mechanical consistency.

6.2. Structural Generalizability and Diversity

We further assess whether GenUnfold captures the structure-function relationship governing mechanostability. We classify the test set by CATH topology (Waman et al., 2025), including Mainly alpha (composed primarily of alpha-helices), Mainly beta (primarily beta-sheets), Mixed alpha and beta, and Few Secondary Structures (irregular or loop-dominated folds). As illustrated in Fig. 4, the model successfully treats the 3D structure as a fingerprint for mechanical phenotype. For beta-sheet rich proteins, which resist unfolding via cooperative hydrogen bond shearing, the model generates characteristic sawtooth patterns with high-force peaks (> 100 pN). Conversely, for alpha-helical domains, it synthesizes compliant, noisy profiles typical of “unzipping” mechanisms. This capability confirms that GenUnfold conditions its generation on specific geometric constraints rather than memorizing a mean trajectory.

Figure 4.

Figure 4.

Representative examples from the test set showing the correspondence between 3D structure (left) and F-x curve (right).

As shown in Fig. 5, we also compared the distributions of downstream mechanical properties (unfolding Force Funfold and Energy W) between predicted and ground-truth ensembles across all structural classes. It can be observed that the generated distributions (orange) closely overlay the ground truth (blue). This visual alignment is confirmed by Mann-Whitney U tests (McKnight & Najab, 2010), which yield high p-values across all categories (e.g., p=0.54 for Mainly alpha, p=0.83 for Mainly beta). These high p-values (p≫0.05) indicate that the generated and simulated ensembles are statistically indistinguishable.

Figure 5.

Figure 5.

Statistical validation of mechanical properties across structural classes. Violin plots show normalized force and energy distributions for ground truth (blue) and model (orange). High p-values across CATH classes demonstrate topological generalizability and physical consistency of predicted unfolding trajectories.

To evaluate out-of-distribution generalization, we curated a challenging sub-testset of 43 proteins belonging to superfamilies that were only present in the test set. As shown in Table 3, GenUnfold consistently outperforms sequence-based diffusion baselines on this strictly held-out subset. The improvement is particularly pronounced for distributional and physical metrics: compared with the strongest sequence-only baseline, GenUnfold reduces FID from 0.378 to 0.088 and Energy-JSD from 0.203 to 0.106. These results indicate that the model does not merely interpolate between proteins or trajectories seen during training. Instead, the integration of explicit structure-derived physical priors improves its ability to extrapolate mechanical unfolding behavior to unseen structural superfamilies. Additional robustness experiments under noisy and partially masked structural priors are provided in Appendix E.1, showing that GenUnfold maintains stable physical metrics even when the geometric priors are substantially corrupted.

Table 3.

Performance on the unseen-superfamily test subset. All proteins in this subset belong to CATH superfamilies absent from the training set. Lower is better for all metrics.

Model FID ↓ Force-JSD ↓ Energy-JSD ↓
DiT-ESM 0.706 0.176 0.267
CrossDiT-ESM-ESM 0.378 0.150 0.203
GenUnfold 0.088 0.111 0.106

6.3. Ablation Study of Physics-biased Attention

To isolate the source of our performance gains, we conducted a systematic ablation of the proposed physics-biased attention, with results presented in Table 2. The results show that removing the graph components (K,R) from physical topological priors 𝒢 leads to a severe degradation in generative quality, increasing FID by 52.1% and Energy-JSD by 53.8%. Interestingly, removing K and R marginally improves point-wise Rel l2(0.2070→0.2053) but destroys the physical realism of the curves. This highlights a critical trade-off: without mechanistic priors, the model collapses toward a mean trajectory that minimizes error but fails to capture the complex, stochastic energy landscape of unfolding. Removing the CNN-based feature learning (“Remove CNN”) or the time-dependent gating (“Remove time gate”) results in consistent performance drops. This confirms that allowing the model to learn the dynamic optimal representation of the physical priors is beneficial.

Table 2.

Performance comparison across model variants of the proposed physics-biased attention. Lower is better.

Variant Rel l2 FID Fmax_JSD Energy JSD
Remove K and R 0.2053±0.0036 0.0178±0.0010 0.0656±0.0101 0.0520±0.0206
Remover R 0.2104±0.0039 0.0167±0.0027 0.0596±0.0086 0.0396±0.0008
Remove time gate 0.2063±0.0015 0.0128±0.0005 0.0557±0.0033 0.0390±0.0025
Remove CNN learning 0.2079±0.0048 0.0132±0.0025 0.0569±0.0037 0.0378±0.0067

6.4. Scalability and Runtime Efficiency

A central motivation of GenUnfold is to provide a scalable method for predicting the heterogeneous force-extension ensemble with thousands of curves. We therefore quantified both training and inference efficiency on a single consumer-grade GPU, as shown in Figure. 6. GenUnfold was trained for 100 epochs on one NVIDIA RTX 4090 GPU, requiring approximately 2 hours in total. Generating one full force–extension trajectory requires only 1–3 seconds using DDIM-accelerated sampling. In contrast, producing one comparable unfolding trajectory with simulation-based approaches remains substantially more expensive. All-atom steered MD typically requires tens of hours for a single trajectory, while coarse-grained SMD still requires hours under the same hardware settings. This runtime difference is particularly important because reliable mechanical characterization often requires many repeated pulling trajectories to estimate the stochastic distribution of unfolding forces and energies.

Figure 6.

Figure 6.

Runtime comparison for generating one force–extension trajectory. Bars indicate the geometric mean of the reported runtime range, and error bars denote the minimum and maximum runtime. GenUnfold generates a full trajectory within seconds, whereas simulation-based methods require hours to days.

7. Conclusion

While protein mechanical responses are fundamental to biological function, capturing their dynamic unfolding trajectories has historically relied on labor-intensive SMFS experiments or computationally expensive simulations that cannot scale to the whole proteome. We addressed this limitation by introducing the first scalable generative diffusion framework for unfolding trajectory prediction. We formalize this domain by introducing a comprehensive benchmarking suite, adapting current state-of-the-art protein language models and transformers. Moreover, we propose GenUnfold, a physics-guided diffusion model that fuses global coevolutionary context and local structural stiffness to accurately reconstruct complex force-extension profiles. The empirical results on our newly established benchmark confirm that GenUnfold achieves a new state-of-the-art in distributional accuracy, outperforming standard transformer baselines and pretrained protein language models by significant margins. Crucially, our model does not merely mimic the mean shape of the data; it exhibits high physical fidelity in predicting force and energy distributions, proving that deep generative models can internalize the fundamental physics guided by appropriate structural priors. In conclusion, GenUnfold provides a powerful tool for discovering force-targeted therapeutics and exploring the mechanical proteome.

Acknowledgements

This project was supported by funding from NIH (5R01AR042423).

A. Data and Preprocessing

This section provides detailed descriptions of the datasets used for training and validating GenUnfold, including the simulation-derived training set, the experimental benchmark set, and the feature extraction pipeline.

A.1. BSDB Data Source and Preprocessing

The primary training data are sourced from the Bio-molecule Stretching Database (BSDB), which contains Steered Molecular Dynamics (SMD) simulations of protein unfolding under constant-velocity stretching.

Data Composition.

We cross-referenced BSDB entries with the Protein Data Bank (PDB) to ensure that high-resolution experimental structures were available for every entry. The final curated dataset comprises 16,495 unique proteins.

Trajectory Details.

Since the database typically provides two pulling traces per protein, the total dataset consists of 32,990 force–extension (F-x) trajectories.

Standardization Pipeline.

To ensure that the model learns mechanical principles independent of protein size, each trajectory undergoes the following preprocessing steps:

  • Extension Normalization. The extension axis is rescaled by the theoretical contour length,
    Lcon=N×3.6Å,

    where N is the number of residues.

  • Interpolation. Each trajectory is interpolated to a fixed resolution of T=512 points on the normalized interval [0, 1].

  • Force Normalization. Force magnitudes are normalized to the unit interval [0, 1] using min–max scaling to stabilize model training based on the maximum unfolding force observed across the training set.

Event Selection.

Successful unfolding events are identified by characteristic saw-tooth patterns in the force–extension curves.

A.2. PDB Processing for Local Chemical Features

GenUnfold incorporates a comprehensive residue-level feature matrix Rf∈RL×df extracted directly from experimental PDB structures to provide the chemical and structural context necessary for predicting mechanical unfolding trajectories.

Extraction Method.

The structural coordinates of the protein backbone and side chains are processed using the Dictionary of Protein Secondary Structure (DSSP) algorithm. This allows for the deterministic mapping of three-dimensional atomic arrangements into a set of localized physicochemical and geometric descriptors.

Feature Components.

The feature vector for each residue consists of 17 distinct descriptors, categorized as follows:

  • Identity and Physicochemical Properties. To capture the chemical nature of the polypeptide chain, we include the amino acid identity (res_name), net charge, and hydropathy index. We further include binary indicators for specific chemical classes: hydrophobic, aromatic, positive, and negative residues. A specific flag, pro_or_gly, is used to denote residues with unique conformational constraints (Proline and Glycine) that significantly impact backbone flexibility.

  • Geometric and Conformational Descriptors. Local fold topology is represented by the secondary structure assignment (sec_type), solvent-accessible surface area (sasa), and the backbone torsion angles (phi, psi). Additionally, the volume of each residue is included to account for local packing density and steric effects within the protein core.

  • Dynamics and Interaction Potential. To account for structural stability and the likelihood of bond rupture, we incorporate the b_factor as a proxy for local fluctuations. The hbond_density is calculated to quantify the local hydrogen-bonding network. Finally, we include binary markers for a residue’s propensity to participate in salt_bridge interactions or pi_stack formations, both of which serve as critical ”mechanical clamps” during forced unfolding.

B. Model Architecture

B.1. Noise Prediction Pipeline: From xt to ϵt

In the GenUnfold framework, the core objective of the neural network ϵθ is to approximate the added noise at a given diffusion timestep t. GenUnfold utilizes a dual-stream conditioning strategy to modulate the latent features.

  • Global Modulation (Evolutionary): The continuous timestep t is transformed into a frequency-based embedding followed by a two-layer MLP to obtain the temporal feature vector et∈RH with the hidden size H:
    et=MLP(SiLU(Linear(Sinusoidal(t)))) (4)
    The evolutionary context yESM (extracted from pretrained ESM-2) is concatenated with time embedding et to get gobal context yt and processed to produce scaling and shifting parameters {γ,β,α} for the Adaptive Layer Normalization (adaLN) units:
    [γ,β,α,…]=Linearyt,yt=et+MLPyESM. (5)
  • Local Modulation (Physics-Biased Attention): The details of calculating local physical representation c are described in the following subsection B.2.

Given the noisy force-extension trajectory xt∈RN×1, the global coevolutionary context yESM, and physical reprensentation c, the computation of the predicted noise ϵˆt proceeds through the following stages:

1. Input Embedding

The normalized noisy trajectory xt is first projected into a high-dimensional latent space via a linear layer, yielding the initial sequence representation z0∈RN×H.

2. Diffusion Transformer with adaLN-Zero and cross-attention.

Integrating these adaptive parameters γ,β and α, the Transformer block updates the representation z0 as follows:

z1=z0+α1⋅SelfAttenadaLNz0,yt,adaLNz0,yt,adaLNz0,yt (6)
z2=z1+α2⋅CrossAttenadaLNz1,yt,ct,ct (7)
z3=z2+α3⋅MLPadaLNz2,yt (8)

In this formulation, the gating factors α1 and α2 are initialized to zero. This ”adaLN-Zero” strategy ensures that each residual block initially acts as an identity function, significantly stabilizing the early stages of diffusion training by preventing large gradient variances from uninitialized attention weights.

The adaLN operation is defined as a conditioned linear transformation of the standard layer-normalized features:

adaLNz,yt=γyt⋅x−μσ+βyt,[γ,β]=LinearSiLUyt (9)

where μ and σ are the mean and variance of data z along feature dimension.

For the standard Self-Attention,

SelfAttn(Q,K,V)=SoftmaxQK⊤dkV (10)

where query Q, key K and value V are from the same input Z∈RN×d

Q=ZWQ,K=ZWK,V=ZWV. (11)

For the standard Cross-Attention,

CrossAttn(Q,K,V)=SoftmaxQK⊤dkV (12)

where Q is from hidden state Z∈RN×d, but K and V are from physical representation C∈RM×dc

Q=ZWQ,K=CWK,V=CWV (13)

3. Final Projection

After the final Transformer block, the refined latent features zL undergo a linear projection to map the d-dimensional features back to the trajectory space:

ϵˆt=Linearz3 (14)

The predicted noise ϵˆt∈RN×1 is then used in the reverse diffusion step to update xt→xt−1.

B.2. Mechanical Representation Extraction Pipeline

Physics-Guided Multi-Channel Priors

Inspired by the Elastic Network Model (ENM) (Atilgan et al., 2001), we model the protein as a residue-level spring network. This allows us to derive a set of physical priors that capture distinct aspects of the mechanical landscape from the 3D structure X.

The spring network consists of a set of nodes fully connected to each other by simple harmonic springs to model the interaction among residues. The weighted adjacency matrix K∈RL×L defines the spring constant kij between residues i and j, which inversely proportional to their squared Euclidean distance, dij (Yang et al., 2009):

kij=dij−2ifi≠j0ifi=j (15)

This matrix K represents the local stiffness of intramolecular interactions (both covalent and non-covalent) between residue pairs. From K, we can compute the Graph Laplacian L (also known as the Kirchhoff matrix) from the stiffness matrix:

L=Ddeg−K,Ddegii=∑jkij. (16)

To quantify the global mechanical coupling across the entire network, we compute the effective resistance Rij. This is derived from the pseudoinverse of the Laplacian, G=L+:

Rij=Gii+Gjj−2Gij, (17)

Intuitively, Rij quantifies how strongly residues i and j are mechanically coupled within the protein’s elastic network. A small Rij value identifies ”stiff corridors” that serve as efficient pathways for force transmission.

Learnable Physical Bias and Temporal gating

We aggregate the above priors into a multi-channel graph 𝒢=[G,K,R]∈R3×L×L, comprising the Euclidean distance map D, stiffness map K, and resistance map R. Rather than directly injecting the graph 𝒢, we employ a CNN-based Bias Module to learn optimal mechanical features (see Fig. 3). The graph 𝒢 is processed by a 3 × 3 convolutional layer followed by a ResNet block consisting of two stacked 3 × 3 convolutions. Specifically, each convolutional layer is followed by Batch Normalization (BN) to stabilize training, with a Rectified Linear Unit (ReLU) activation applied after the first BN. A shortcut connection performs an element-wise addition between the block’s input and the output of the second BN, followed by a final ReLU non-linearity to facilitate gradient flow. A final projection maps the fused features to h distinct bias maps, Bcnn∈Rh×L×L, matching the number of attention heads. This design promotes attentional specialization that one head may learn to focus on local rigidity (dominated by K), while another attends to long-range allosteric pathways (informed by R).

Crucially, the relevance of extracted static features Bcnn changes as the diffusion process reconstructs the trajectory (e.g., native contacts are more relevant at low force/early time steps). To model this, we introduce a Time-Dependent Gating mechanism. The diffusion time embedding temb is projected via an MLP to a scaling vector g(t)∈RH. The final attention bias for the i-th head is a dynamically modulated version of the static map:

Bfinal(i)(t)=g(i)(t)⋅Bcnn(i) (18)
Protein Encoder Block

The encoder processes the sequence of residue features Rf∈RL×df. The core operation is Multi-Head Physical Attention as shown in Fig. 3. First, we apply Layer Normalization of the projection of residue tokens Rf, and the normalized tokens Rnorm∈RL×dk are used to compute the attention output of each head h:

Rnorm=LayerNormLinearRf (19)
Attn(i)=softmaxQ(i)K(i)⊤dk+Bfinal(i)(t)V(i) (20)

where Q(i)=RnormWQ(i),Q(i)=RnormWQ(i), and Q(i)=RnormWQ(i)⋅WQ(i);WK(i),WV(i)∈Rdk×dk, are query, key, and value weights, respectively; dk is the head dimension. The outputs of all heads are concatenated and passed through a linear projection WO, followed by the first residual connection:

R′=LinearRf+ConcatAttn(1),…,Attn(H)WO (21)

Second, this intermediate representation is passed through a position-wise Feed-Forward Network (FFN), again using pre-normalization, to compute the local representaion c that is fed into the cross-attention layers of the diffusion backbone:

c=R′+FFNLayerNormR′ (22)

where FFN(x)=SiLUxW1+b1W2+b2.

Technical Configurations.

The denoising backbone consists of 2 processing layers with a hidden dimension of 256 and 4 attention heads, utilizing a patch size of 2 to process the force-extension trajectories. The Physical Encoder employs a Bias-based architecture that fuses multi-channel structural maps (including the distance map D, Laplacian stiffness Γ, and effective resistance R) via a CNN-based Bias Module with a width of 32. Global sequence context is provided by a pre-trained ESM-2 model with an embedding dimension of 1280, while local residue-level context is captured through a 24-dimensional feature matrix. The diffusion process is defined by 1000 training steps using a linear noise schedule, with inference accelerated via DDIM respacing to 100 steps. Training is conducted for 100 epochs with a batch size of 64 using the AdamW optimizer (learning rate 5 × 10−4, weight decay 1 × 10−5) and a cosine learning rate scheduler.

C. Evaluation metrics

We evaluate models at three complementary levels: (i) point-wise reconstruction, (ii) distributional fidelity, and (iii) biophysical consistency of derived mechanical properties.

Point-wise reconstruction (Rel l2)

To quantify the precise reconstruction of the unfolding pathway, we compute the Root Mean Squared Error (Rel l2) between the ground-truth (Ftrue) and predicted (Fpred) trajectories. Both are sampled on the same normalized extension grid xmm=1T (where T=512):

Rell2=1T∑m=1TFpredxm−Ftruexm2Ftruexm2. (23)

We report the mean of per-curve RMSE over the test set.

Distributional fidelity (FID).

To assess whether the generated trajectories capture the realistic, high-dimensional statistics of real unfolding curves, we calculate the Fréchet Inception Distance (FID). Denote means and covariances of test curves by μreal,Σreal and μgen,Σgen. The FID is

FID=μreal−μgen22+trΣreal+Σgen−2ΣrealΣgen1/2. (24)

A lower FID indicates that the generative distribution is statistically closer to the real data manifold.

Biophysics consistency (JSD).

Beyond raw signal matching, it is critical that the model reproduces the distributions of physically salient properties. We extract two key properties: unfolding force Funfold=maxxF(x)⋅1(unfoldingeventatx) (Force-JSD) and unfolding energy W=∫LconFdLac (Energy-JSD). We fit one-dimensional Gaussian Kernel density estimations (KDEs) of these scalars for both real (P) and generated (Q) samples of Fmax and W. The divergence is measured via the Jensen–Shannon distance (JSD):

JSD(P‖Q)=12KL(P‖M)+12KL(Q‖M),M=12(P+Q). (25)

Low JSD values indicate that the model correctly captures the stochastic ensemble properties of the protein’s energy landscape.

D. Benchamark

Given the novelty of generating full force–extension trajectories directly from static structure, no established external benchmarks exist. Therefore, we design a comprehensive suite of internal baselines to isolate the contributions of our architectural components: the coevolutionary priors (ESM-2), the physics-guided bias (PhyAtten), and the co-conditioning strategy (CrossDiT).

We evaluate two classes of diffusion backbones:

1. Global-Conditioned Baselines (Standard DiT).

These models utilize a standard DiT conditioned solely via adaLN using a global context vector y∈RH.

  • DiT-SelfAtten: A baseline using a lightweight self-attention encoder to aggregate residue features into a global vector.

  • DiT-ESM: Replaces the encoder with the pretrained ESM-2 model. The global vector y is the mean-pooled ESM-2 embedding, testing the value of pure coevolutionary information.

  • DiT-PhyAtten: Uses our proposed Physical Encoder (with bias maps B(h)) to process the structure, but pools the output into a global vector y. This tests the physics priors in a global-only context.

2. Co-Conditioning Models (CrossDiT).

These models employ the full “GenUnfold” architecture, receiving both global guidance (y) via adaLN and fine-grained local guidance (c∈RL×H) via Cross-Attention.

  • CrossDiT-ESM-SelfAtten: Combines global ESM-2 context with a standard (unbiased) self-attention local encoder.

  • CrossDiT-ESM-ESM: A “pure PLM” variant where both global and local contexts are derived from ESM-2 embeddings, ignoring explicit physics priors.

  • CrossDiT-ESM-PhyAtten: The proposed full model. It combines global ESM-2 context with the local, physics-biased representation c derived from structural priors.

  • CrossDiT-PhyAtten-PhyAtten: A physics-only variant that uses the Physical Encoder for both global (pooled) and local conditioning, excluding ESM-2 entirely.

All variants share identical hyperparameters for the diffusion schedule, token budget, training epochs, and optimization (details in Appendix). Evaluation metrics (RMSE, FID, JSD) follow the protocols defined in §C.

Table 4.

Summary of model variants. The Global Context modulates the noise prediction via adaLN-Zero, while the Local Context is injected via Cross-Attention layers. “—” indicates the module is absent.

Model Name Backbone Global Context (y) Local Context (c)
DiT-SelfAtten DiT SelfAtten —
DiT-ESM DiT ESM —
DiT-PhyAtten DiT PhyAtten —
CrossDiT-ESM-SelfAtten CrossDiT ESM SelfAtten
CrossDiT-ESM-ESM-2 CrossDiT ESM ESM
CrossDiT-ESM-PhyAtten CrossDiT ESM PhyAtten
CrossDiT-PhyAtten-PhyAtten CrossDiT PhyAtten PhyAtten

E. More Results

E.1. Robustness to Perturbed or Incomplete Structural Priors

We further evaluate the sensitivity of GenUnfold to inaccuracies or incompleteness in the assumed structural and geometric priors. This analysis is motivated by practical settings in which the input structure may be noisy, partially resolved, or derived from predicted models rather than high-resolution experimental structures. Since GenUnfold does not directly generate 3D coordinates, such uncertainty mainly affects the derived physical topology priors used by the physics-biased attention module.

Table 5.

Robustness analysis under perturbed or incomplete structural priors. Gaussian noise is injected into the physical topology priors to simulate inaccurate geometric constraints, while block masking removes contiguous regions of the physics-biased attention map to simulate incomplete structural information. Mean and standard deviation are reported over three independent runs. Lower is better for all metrics.

Condition / Model FID ↓ Force-JSD ↓ Energy-JSD ↓
5% noise 0.0162 ± 0.0015 0.0586 ± 0.0019 0.0421 ± 0.0011
10% noise 0.0168 ± 0.0016 0.0586 ± 0.0017 0.0430 ± 0.0013
20% noise 0.0211 ± 0.0018 0.0565 ± 0.0031 0.0449 ± 0.0004
5% mask 0.0222 ± 0.0013 0.0577 ± 0.0036 0.0465 ± 0.0016
10% mask 0.0239 ± 0.0012 0.0584 ± 0.0034 0.0485 ± 0.0017
20% mask 0.0278 ± 0.0011 0.0603 ± 0.0029 0.0526 ± 0.0017
CrossDiT-ESM-ESM 0.0168 ± 0.0089 0.0590 ± 0.0030 0.0532 ± 0.0097
GenUnfold 0.0117 ± 0.0011 0.0552 ± 0.0031 0.0338 ± 0.0037

We consider two perturbation settings. First, to simulate inaccurate geometric constraints, we inject Gaussian noise into the derived physical topology priors, including the distance, stiffness, and effective-resistance maps. Specifically, we perturb the physical prior tensor with noise levels of 5%, 10%, and 20% relative to the normalized prior magnitude. Second, to simulate incomplete structural information or partially resolved domains, we apply continuous block masking to the physics-biased attention matrix, dropping 5%, 10%, and 20% of the structural prior map. This masking setting is more challenging than random element-wise dropout because it removes contiguous regions of the structural manifold, thereby disrupting local mechanical pathways.

Table 5 shows that GenUnfold remains physically consistent under substantial corruption of the structural priors. Even with 20% Gaussian noise, the model maintains Force-JSD and Energy-JSD values of 0.0565 and 0.0449, respectively, both of which remain competitive with or better than the unperturbed sequence-only baseline CrossDiT-ESM-ESM. Under the more challenging block-masking setting, performance gradually degrades as larger contiguous regions of the structural prior are removed, but the model still preserves reasonable physical accuracy. In particular, with 20% block masking, GenUnfold achieves an Energy-JSD of 0.0526, which remains comparable to the unperturbed sequence-only baseline.

These results indicate that the proposed dual-conditioning design is not overly dependent on perfectly specified geometric constraints. The global ESM-based context provides a robust protein-level prior, while the local physics-biased representation improves physical consistency when structural information is available. As expected, FID is more sensitive to geometric corruption and structural masking because it measures the full trajectory distribution rather than only derived mechanical properties. Nevertheless, the degradation is gradual rather than catastrophic, suggesting that GenUnfold can tolerate moderate inaccuracies or incompleteness in the structural manifold. This supports the potential applicability of the framework to higher-dimensional or partially known systems, where exact constraint manifolds may be unavailable, although further scaling to more complex manifolds remains an important direction for future work.

Footnotes

Proceedings of the 43rd International Conference on Machine Learning, Seoul, South Korea. PMLR 306, 2026.

Impact Statement

GenUnfold addresses a long-standing bottleneck in biophysics: the inability to rapidly and accurately characterize how proteins respond to mechanical force. By establishing the first scalable generative framework for predicting non-equilibrium unfolding trajectories, this work transitions protein mechanics from a labor-intensive, single-molecule experimental endeavor to a proteome-wide computational science.

References

  1. Ainavarapu SRK, Brujić J, Huang HH, Wiita AP, Lu H, Li L, Walther KA, Carrion-Vazquez M, Li H, and Fernandez JM. Contour length and refolding rate of a small protein controlled by engineered disulfide bonds. Biophysical journal, 92(1):225–233, 2007. [DOI] [PMC free article] [PubMed] [Google Scholar]
  2. Atilgan AR, Durell S, Jernigan RL, Demirel MC, Keskin O, and Bahar I. Anisotropy of fluctuation dynamics of proteins with an elastic network model. Biophysical journal, 80(1):505–515, 2001. [DOI] [PMC free article] [PubMed] [Google Scholar]
  3. Beedle AE and Garcia-Manyes S. The role of single-protein elasticity in mechanobiology. Nature Reviews Materials, 8(1):10–24, 2023. [DOI] [PMC free article] [PubMed] [Google Scholar]
  4. Bustamante C, Chemla YR, Forde NR, and Izhaky D. Mechanical processes in biochemistry. Annual review of biochemistry, 73(1):705–748, 2004. [DOI] [PubMed] [Google Scholar]
  5. Chen J, Yu J, Ge C, Yao L, Xie E, Wu Y, Wang Z, Kwok J, Luo P, Lu H, et al. Pixart-α: Fast training of diffusion transformer for photorealistic text-to-image synthesis. arXiv preprint arXiv:2310.00426, 2023. [Google Scholar]
  6. Cheng K, Liu C, Su Q, Wang J, Zhang L, Tang Y, Yao Y, Zhu S, and Qi Y. 4d diffusion for dynamic protein structure prediction with reference and motion guidance. In Proceedings of the AAAI Conference on Artificial Intelligence, volume 39, pp. 93–101, 2025. [Google Scholar]
  7. Ervasti JM. Dystrophin, its interactions with other proteins, and implications for muscular dystrophy. Biochimica et Biophysica Acta (BBA)-Molecular Basis of Disease, 1772(2):108–117, 2007. [DOI] [PubMed] [Google Scholar]
  8. Fernandez JM and Li H. Force-clamp spectroscopy monitors the folding trajectory of a single protein. Science, 303(5664):1674–1678, 2004. [DOI] [PubMed] [Google Scholar]
  9. Garcia Satorras V, Hoogeboom E, Fuchs F, Posner I, and Welling ME (n) equivariant normalizing flows. Advances in Neural Information Processing Systems, 34: 4181–4192, 2021. [Google Scholar]
  10. Greydanus S, Dzamba M, and Yosinski J. Hamiltonian neural networks. Advances in neural information processing systems, 32, 2019. [Google Scholar]
  11. Gruver N, Stanton S, Frey N, Rudner TG, Hotzel I, Lafrance-Vanasse J, Rajpal A, Cho K, and Wilson AG. Protein design with guided discrete diffusion. Advances in neural information processing systems, 36: 12489–12517, 2023. [Google Scholar]
  12. Ho J, Jain A, and Abbeel P. Denoising diffusion probabilistic models. Advances in neural information processing systems, 33:6840–6851, 2020. [Google Scholar]
  13. Hua C, Rajaganapathy S, Slick RA, Vavra J, Muretta JM, Ervasti JM, and Salapaka M. A physics-augmented deep learning framework for classifying single molecule force spectroscopy data. In Forty-second International Conference on Machine Learning, 2025. [PMC free article] [PubMed] [Google Scholar]
  14. Ingraham JB, Baranov M, Costello Z, Barber KW, Wang W, Ismail A, Frappier V, Lord DM, Ng-Thow-Hing C, Van Vlack ER, et al. Illuminating protein space with a programmable generative model. Nature, 623(7989):1070–1078, 2023. [DOI] [PMC free article] [PubMed] [Google Scholar]
  15. Jeha P, Bohlke-Schneider M, Mercado P, Kapoor S, Nirwan RS, Flunkert V, Gasthaus J, and Januschowski T. Psa-gan: Progressive self attention gans for synthetic time series. In The tenth international conference on learning representations, 2022. [Google Scholar]
  16. Jing B, Corso G, Chang J, Barzilay R, and Jaakkola T. Torsional diffusion for molecular conformer generation. Advances in neural information processing systems, 35: 24240–24253, 2022. [Google Scholar]
  17. Joshi SY and Deshmukh SA. A review of advancements in coarse-grained molecular dynamics simulations. Molecular Simulation, 47(10–11):786–803, 2021. [Google Scholar]
  18. Jumper J, Evans R, Pritzel A, Green T, Figurnov M, Ronneberger O, Tunyasuvunakool K, Bates R, Žídek A, Potapenko A, et al. Highly accurate protein structure prediction with alphafold. nature, 596(7873):583–589, 2021. [DOI] [PMC free article] [PubMed] [Google Scholar]
  19. Kabsch W and Sander C. Dictionary of protein secondary structure: pattern recognition of hydrogen-bonded and geometrical features. Biopolymers: Original Research on Biomolecules, 22(12):2577–2637, 1983. [DOI] [PubMed] [Google Scholar]
  20. Lewis S, Hempel T, Jiménez-Luna J, Gastegger M, Xie Y, Foong AY, Satorras VG, Abdin O, Veeling BS, Zaporozhets I, et al. Scalable emulation of protein equilibrium ensembles with generative deep learning. Science, 389(6761):eadv9817, 2025. [DOI] [PubMed] [Google Scholar]
  21. Li P-C and Makarov DE. Theoretical studies of the mechanical unfolding of the muscle protein titin: bridging the time-scale gap between simulation and experiment. The Journal of chemical physics, 119(17):9260–9268, 2003. [Google Scholar]
  22. Lin Z, Akin H, Rao R, Hie B, Zhu Z, Lu W, Smetanin N, Verkuil R, Kabeli O, Shmueli Y, et al. Evolutionary-scale prediction of atomic-level protein structure with a language model. Science, 379(6637): 1123–1130, 2023. [DOI] [PubMed] [Google Scholar]
  23. Marszalek PE, Lu H, Li H, Carrion-Vazquez M, Oberhauser AF, Schulten K, and Fernandez JM. Mechanical unfolding intermediates in titin modules. Nature, 402 (6757):100–103, 1999. [DOI] [PubMed] [Google Scholar]
  24. McKnight PE and Najab J. Mann-whitney u test. The Corsini encyclopedia of psychology, pp. 1–1, 2010. [Google Scholar]
  25. Mendell JR, Shilling C, Leslie ND, Flanigan KM, al Dahhak R, Gastier-Foster J, Kneile K, Dunn DM, Duval B, Aoyagi A, et al. Evidence-based path to newborn screening for duchenne muscular dystrophy. Annals of neurology, 71(3):304–313, 2012. [DOI] [PubMed] [Google Scholar]
  26. Neuman KC and Nagy A. Single-molecule force spectroscopy: optical tweezers, magnetic tweezers and atomic force microscopy. Nature methods, 5(6):491–505, 2008. [DOI] [PMC free article] [PubMed] [Google Scholar]
  27. Ni B, Kaplan DL, and Buehler MJ. Forcegen: End-to-end de novo protein generation based on nonlinear mechanical unfolding responses using a language diffusion model. Science Advances, 10(6):eadl4000, 2024. [DOI] [PMC free article] [PubMed] [Google Scholar]
  28. Noé F, Olsson S, Köhler J, and Wu H. Boltzmann generators: Sampling equilibrium states of many-body systems with deep learning. Science, 365(6457):eaaw1147, 2019. [DOI] [PubMed] [Google Scholar]
  29. Peebles W and Xie S. Scalable diffusion models with transformers. In Proceedings of the IEEE/CVF international conference on computer vision, pp. 4195–4205, 2023. [Google Scholar]
  30. Podell D, English Z, Lacey K, Blattmann A, Dockhorn T, Müller J, Penna J, and Rombach R. Sdxl: Improving latent diffusion models for high-resolution image synthesis. arXiv preprint arXiv:2307.01952, 2023. [Google Scholar]
  31. Schönfelder J, Perez-Jimenez R, and Munoz V. A simple two-state protein unfolds mechanically via multiple heterogeneous pathways at single-molecule resolution. Nature communications, 7(1):11777, 2016. [DOI] [PMC free article] [PubMed] [Google Scholar]
  32. Sengupta A and Rief M. Energy landscapes of fast-folding proteins pushing the limits of atomic force microscope (afm) pulling. Proceedings of the National Academy of Sciences, 118(19):e2102946118, 2021. [DOI] [PMC free article] [PubMed] [Google Scholar]
  33. Sikora M, Sułkowska JI, Witkowski BS, and Cieplak M. Bsdb: the biomolecule stretching database. Nucleic acids research, 39(suppl_1):D443–D450, 2010. [DOI] [PMC free article] [PubMed] [Google Scholar]
  34. Sohl-Dickstein J, Weiss E, Maheswaranathan N, and Ganguli S. Deep unsupervised learning using nonequilibrium thermodynamics. In International conference on machine learning, pp. 2256–2265. pmlr, 2015. [Google Scholar]
  35. Stacklies W, Vega MC, Wilmanns M, and Gräter F. Mechanical network in titin immunoglobulin from force distribution analysis. PLoS computational biology, 5(3): e1000306, 2009. [DOI] [PMC free article] [PubMed] [Google Scholar]
  36. Vaswani A, Shazeer N, Parmar N, Uszkoreit J, Jones L, Gomez AN, Kaiser Ł, and Polosukhin I. Attention is all you need. Advances in neural information processing systems, 30, 2017. [Google Scholar]
  37. Viljoen A, Mathelié-Guinlet M, Ray A, Strohmeyer N, Oh YJ, Hinterdorfer P, Müller DJ, Alsteens D, and Dufrêne YF. Force spectroscopy of single cells using atomic force microscopy. Nature Reviews Methods Primers, 1(1):63, 2021. [Google Scholar]
  38. Waman VP, Bordin N, Lau A, Kandathil S, Wells J, Miller D, Velankar S, Jones DT, Sillitoe I, and Orengo C. Cath v4. 4: major expansion of cath by experimental and predicted structural data. Nucleic Acids Research, 53(D1):D348–D355, 2025. [DOI] [PMC free article] [PubMed] [Google Scholar]
  39. Watson JL, Juergens D, Bennett NR, Trippe BL, Yim J, Eisenach HE, Ahern W, Borst AJ, Ragotte RJ, Milles LF, et al. De novo design of protein structure and function with rfdiffusion. Nature, 620(7976): 1089–1100, 2023. [DOI] [PMC free article] [PubMed] [Google Scholar]
  40. Yang L, Song G, and Jernigan RL. Protein elastic network models and the ranges of cooperativity. Proceedings of the National Academy of Sciences, 106(30): 12347–12352, 2009. [DOI] [PMC free article] [PubMed] [Google Scholar]

RESOURCES