Abstract
Unravelling protein-folding mechanisms and kinetics is a key challenge to biochemical science. The variational approach for Markov processes (VAMP) is a powerful tool to build Markov Models that capture key kinetic and structural information despite the conformational complexity and long time scales associated with protein folding. However, VAMP-based Markov models use data from exhaustive molecular dynamics (MD) simulations to construct an underlying basis set describing the “coarse-grained” kinetics; the same MD data can be used to predict transition probabilities between partitioned configuration space, enabling the extraction of folding time scales and mechanism. Here, we propose an alternative strategy for Markov model construction that does not rely on extensive, computationally demanding MD data for configuration space partitioning. Specifically, we show that graph-driven sampling (GDS) can generate a complete “landscape” of intermediate contact-maps linking unfolded and folded protein conformations; importantly, extensive MD simulations are not required in GDS. When combined with a physically intuitive shortest-contact-hop metric to discriminate different intermediate states, GDS mapping of protein-folding configuration space generates a reliable “structurally aware” partitioning for VAMP model construction. To demonstrate this strategy, we show that a GDS-constructed Markov model variationally improves folding time scale estimates for all-atom models of the WW domain proteinand has the additional advantage of easily resolving kinetic traps in the folding landscape that have proven challenging to confirm otherwise. Together, the combination of GDS and VAMP opens a new route toward rapid characterization of protein-folding intermediates and kinetics traps to help address frontier challenges such as protein misfolding, aggregation, and protein design.


Introduction
Protein structure prediction has recently been successfully addressed with the development of deep learning techniques using mined protein-sequence alignment data. , On the other hand, understanding the dynamic pathways by which proteins obtain their folded native state remains an important open problem that is critical for better understanding of important biophysical phenomena such as ligand-binding interactions, protein–protein interfaces, protein misfolding, and allosteric regulation. “Foldability” is also an often-neglected feature in contemporary computational protein design workflowsa drawback that could be addressed with better access to computational insights into folding mechanism and kinetics. ,
In general, the time scale separation between fast local fluctuations encoded in atomistic models of proteins and the slow relevant conformational transitions gives rise to a rare event problem that hinders the computational study of protein-folding. Advances in both algorithms and hardware have provided some limited access to extremely long molecular dynamics (MD) trajectories of folding events, with a particularly prominent example being the microsecond-long MD simulations generated for several fast folding proteins using the custom-made ANTON computing architecture. However, extracting kinetic and mechanistic properties from this collection of dataspanning over 1 ms with MD snapshots taken every 2.5 ps for systems containing up to 561 protein atoms (alongside ≈ 4300 water molecules)is a daunting task, albeit an important one for the study of protein dynamics.
Markov State Models (MSMs) have emerged as a powerful frameworkk for modeling protein folding dynamics by discretizing conformational space into metastable states, and subsequently estimating the transition probabilities between them. − By leveraging existing collections of MD simulations, MSMs are linear models of protein dynamics which enable an efficient and straightforward reconstruction of folding pathways and the computation of long-time scale kinetics. Constructing accurate MSMs requires careful state discretization and sufficient a priori MD sampling, making this approach sensitive to a number of user-specified parameters as well as the nature of the available MD data. ,
To address the choice of state discretization, the variational approach to conformational dynamics (VAC) and the more general variational approach for Markov processes (VAMP) were introduced as frameworks to optimize MSMs by maximizing a variational score, offering a principled way to compare different discretizations. , Furthermore, these variational strategies allow for the generalization of MSMs to Markov models defined with “soft states”functions that act as a basis to express conformational probability densities and dynamical models. This paved the way for neural networksVAMPNetsto replace traditional state selection methods with neural-network-parametrized “soft states” that maximize the variational score, improving state-space resolution and kinetic accuracy. However, these variational approaches still have a high dependency on MD data generationa severe computational bottleneck that hinders their broader applicability. MD simulations for fitting both discrete-state MSMs and “soft state” Markov models is an active area of research, with current approaches making use of active, adaptive and enhanced sampling techniques. −
Recently, we have proposed a simulation strategy to generate protein folding pathways using a contact-map-based representation, termed graph-driven sampling (GDS). , Crucially, we are able to generate a folding pathway ensemble without performing extensive MD simulations or using predefined order parameters. The GDS approach directly identifies and characterizes those regions of the protein structural landscape that are explored in the dynamic folding processinformation that could provide an alternative route to constructing a suitable state definition for a Markov model.
In this work, we hypothesize that the intermediate states defined by the contact-map–based folding trajectories available from GDS can inform the construction of an ideal basis set for building a Markov modelwithout resorting to any a priori MD simulations. Specifically, each contact map in our GDS trajectories represents a distinct “state” of the protein that reflects significant conformational changes in the protein structure. As the protein folds, the sequential transformation captured in its contact map traces a pathway through a reduced conformational space that is both physically interpretable and computationally tractable. By using this set of states as a basis, a Markov model can be constructed to (i) propagate probability densities defined on contact map states; (ii) identify slow transition modes in the contact map representation, and; (iii) quantify kinetic parameters such as relaxation time scales and metastable state residence times.
The key advantage with this approach is that, unlike the popular VAMPNet and the earlier MSM approach, a basis for a Markov Model can be built without any MD data a priori. Generating such data usually incurs a considerable cost; in fact, VAMPNets are currently trained on an initial smaller MD data set that are then used to seed further MD simulations in an iterative fashion. ,− However, given that our approach identifies a suitable basis without the need of any MD data to begin with, it can enable either strategic use of enhanced MD simulations or rate estimates from path sampling and optimization techniques. , This would represent a paradigm shift in how future Markov models for protein folding are constructed.
The proposed approach therefore bridges the gap between discrete structural protein conformational transitions and continuous kinetic modeling of protein dynamics. The discrete contact-map representation used in GDS circumvents many challenges encountered in direct MD simulations. For example, the demand for long simulation times to sample rare transitions and the difficulty in selecting an appropriate order parameter are circumvented in GDS by providing an alternative “coordinate system” in which the most significant folding events are emphasized. In turn, as shown below, the Markov model built upon this basis offers a systematic and quantitative description of the folding kinetics that is not only predictive but also interpretable in terms of underlying molecular events.
Furthermore, the residue–residue graph representation of a protein conformation, known as a contact map, is thought to encode the structurally relevant information defining the protein’s topology. They have historically been a key representation used in seminal works in protein folding. − Therefore, contact maps, as employed in GDS, provide an efficient reduced representation that captures large-scale structural rearrangements. Despite not being suited to the study of localized conformational changes, such as side-chain rotations, GDS can reveal details of the folding mechanism and associated time scales.
The remainder of this article is organized as follows. First, we apply the GDS workflow outlined above to a toy 2D protein folding landscape modeled as a rugged funnel. We confirm that one can define a suitable basis set for Markov model construction, without resorting to long MD trajectories beforehand; this basis is generated using intermediate configurations from a path-sampling algorithm defined on a discrete grid, in a similar fashion to our (more general) GDS algorithm. Second, we use our GDS/VAMP methodology to investigate folding of the designed GTT variant of the FIP35 WW domain, a single chain protein with 35 residues with a folding topology defined by two β hairpins. We find that using GDSin conjunction with a physically motivated structure similarity metric defined in protein contact-map spaceenables construction of a suitable basis set for a Markov model; we subsequently demonstrate the accuracy of this model by parametrization and kinetic evaluation using existing ANTON MD trajectory data. Importantly, this process definitively identifies a ‘kinetic trap’ within the folding pathway(s) of the FIP35 WW domain which previous conventional VAMP-based approaches struggled to resolve. As such, our results clearly highlight the potential of this combined GDS/VAMP approach to redefine exploration of protein folding dynamics, simultaneously offering a route to rapidly identifying elusive folding intermediates and kinetic bottlenecks that escape detection by more traditional partitioning methods.
Methods
Markov State Models and the Variational Approach
MSMs are discrete Markov chain models used to examine long-time dynamics of complex high-dimensional systems. Building an MSM starts with a partitioning (or discretization) of state space Ω, labeled {A i ⊂ Ω}, from which a transition matrix P τ describing the transition probability between any of the two states, i and j, is defined as
| 1 |
where x(t) = x t ∈ Ω is the system configuration at time t. For the typical use-case of studying long time scale biomolecular dynamics for an N-atom system, x(t) represents a point in 3N-dimensional Cartesian space. The lagtime τ is chosen so that the system is approximately Markovian or “memoryless”, such that the state partitions {A i } are quasi-equilibrated across all nonrelevant “fast” modes (relative to τ).
Given that eq is a linear model, we benefit from a range of results from spectral analysis. The transition matrix P τ can be decomposed via its eigenvalues and eigenvectors,
where ρ is a vector
describing
probability density associated with each state-space partition (such
that
), and (λ
i
, ϕ
i
) are eigenvalue/eigenvector pairs of the matrix P
τ (in descending magnitude). The leading eigenvalue
is always λ0 = 1 (corresponding to the stationary
distribution), and the subdominant eigenvalues λ1, λ2,... characterize the time scales of the slowest
relaxation processes in the system. These eigenvalues are related
to relaxation times through t
i
= −τ/ln λ
i
, and the associated eigenvectors describe the collective modes
through which the system relaxes toward equilibrium. This spectral
insight allows us to identify metastable states, construct coarse-grained
few-state kinetic models, and understand dynamical bottlenecks through
tractable transition path analysis within the system.
−
A brief explanation of how the parameters of a MSM are fitted from
MD trajectories is provided in the Supporting Information.
Selecting the partitioning of conformational space is integral to the quality of the MSMs. Early MSM approaches applied clustering algorithms to previously generated MD data to partition configuration space. ,, The impact of both the clustering technique and the metric used to group kinetically connected configurations together has been the subject of several previous studies. −
In an effort to evaluate the choice of state-space partitioning, variational approaches were used to quantify and compare state-partition quality. The problem of building an accurate model of P τ can be reformulated as seeking a finite-rank approximation to the Perron-Frobenius (transfer) operator defined as
where (x, y) are system configurations, π(y) is the stationary distribution, and u(y) is a state-space distribution weighted against the stationary distribution. A brief elaboration and demonstration of this operator’s properties is presented in the Supporting Information. More specifically, we demonstrate that a MSM is a finite-rank approximation to when using an indicator-function basis.
Importantly, the transfer operator obeys a variational principle analogous to that in operation for ground-state quantum chemistry. Instead of finding the lowest energy ground-state, however, here we aim to find eigenvectors that capture the slowest relaxation processes (see Supporting Information). In other words, we seek the eigenvector ϕ slowest such that
offering a route toward assessing the validity and accuracy of a given state-space partition. However, the variational principle is not restricted to use of indicator functions as state-space basis functions, as is the case in traditional MSMs. Exploiting this variational principle is now a well-known framework for studying slow chemical processes, referred to as the variational approach to conformational dynamics (VAC). ,
Estimating the transfer operator directly from MD data can lead to errors arising from off-equilibrium sampling effects. From a practical point-of-view, it is often preferable to instead estimate the closely related Koopman operator, , that propagates observables of a system in time, rather the probability densities. For an observable f, the Koopman operator is defined by
For a reversible system, the Koopman and transfer operator formalisms can be shown to be equivalent (see Supporting Information). The key strength of the Koopman operator, however, is that it makes no reference to the equilibrium distribution and is therefore more general. Furthermore, the Koopman operator (represented in some chosen basis) can be estimated directly from MD trajectory dataeven if the data are short, sparse, or out of equilibriummaking it significantly more practical for data-driven methods. As for the transfer operator, a variational principle applies for Koopman operators, referred to as the “Variational Approach to Markov Processes” (VAMP). ,,
One particularly successful and popular approach to address this problem is the use of VAMPNets. This approach seeks neural-network-parametrized basis functions, χ i that maximize the variational score, improving state-space resolution and kinetic accuracy. Whether an MSM or a VAMPNet is used, the problem can be categorized as (A) constructing an effective and accurate state-space partitioning or basis, and (B) estimating the elements of the transition matrix P ij , transfer operator or the Koopman operator from a given collection of MD trajectories. As noted, (A) has been the subject of many studies employing clustering or optimizing basis functions from previously generated MD data; this in essence couples the choice the of basis functions with the expensive generation of MD data for problem (B). The coupling introduces an undesirable trade-off; if one were to choose too large of an initial basis set (either discrete or continuous) in an attempt to accurately resolve configurational space, then it may be too difficult to generate a sufficiently large MD data set for statistical computation of transition probabilities. On the other hand, basis sets that do not capture essential conformations and associated kinetics could overlook important slow transitions, metastable states, and kinetic traps.
Existing work now attempts to tackle the issue of requiring initial large MD data sets by iteratively building a Koopman model with some existing MD data, subsequently using the model to inform further MD simulations in areas of poor sampling. , While less demanding that converged MD simulations of slow systems, this iterative approach still represents a computational-time barrier. Alternatively, there has been work on estimating parameters for an MSM (i.e., using discrete state partitions) without the need for any MD simulations, − but such efforts are restricted to either specific simple partitions that suffer the curse-of-dimensionality, or Voronoi partitions which are nontrivial to implement for complex systems like proteins.
Based on this discussion, one would ideally seek an approach to identify minimal important regions of configuration space, before calculating the relevant statistical properties for MSM construction. The approach discussed below addresses this challenge.
Graph Driven Sampling
In this article, we propose to replace MD simulations for configuration space partitioning with an alternative, order-parameter-free scheme that enables fast, accurate and physically interpretative sampling of relevant protein-folding configurations. We have recently shown how the ensemble of physically realizable protein-folding pathways can be generated using directed walks in the space of inter-residue contact-maps. Combined with a back-transformation scheme to move from protein contact-maps to Cartesian coordinates, we have demonstrated how this approach can generate protein-folding ensembles without resorting to extensive MD simulations. , Here, we propose that this GDS scheme can be used to create a compact and accurate basis for Koopman model construction, circumventing the need for MD simulations or order-parameter-based partitioning, and therefore providing a significant advantage for targeted simulation strategies.
In the following, for an N-residue protein, the contact-map G is an N × N square matrix that defines whether or not two residues in the protein structure are in close-contact according to a predefined distance criteria:
| 2 |
Here, r ij is the distance between residues (i, j) (defined using the coordinates of their respective Cα carbon atoms) and r c is an appropriately chosen cutoff distance (typically 8 Å, but a range of cutoff distances up to 11 Å have shown to be similarly sufficient). This representation offers several advantages. Most importantly, because contact-maps encode secondary and tertiary structure information while remaining invariant to rotations and translations, they provide a compact and physically meaningful description of the folding process, as exploited in previous work. , Furthermore, employing this discretization, a protein-folding pathway can be represented as a sequence of ‘hops’ between contact-maps, where each consecutive hop represents an elementary conformational transition; we refer to this path representation as a graph sequence, [G 0, G 1,..., G N ], where G 0 is an “unfolded” contact-map (such that G ij = 0 ∀ i, j) and G N is the folded state.
Here, we briefly recap our initial strategy to identify graph sequences thatwhen back-transformed into a corresponding Cartesian-coordinate representationpropose physically viable folding pathways. We start with an initial (typically random) sequence of graphs [G 0, G 1,..., G N ], and an objective function F assessing path connectivity and continuity. Following our previous study, we use:
where the contact-map-dependent function f̅(G i ) is
| 3 |
Here, H is the Heaviside step function, k c is a parameter that seeks to enforce path continuity in contact-map space (with k c = 0.15, following our previous studies), and f SCH is the shortest contact hop (SCH) metric introduced in our previous study as
| 4 |
Here, S ij is the shortest-distance between two residues (i, j) as calculated using Seidel’s algorithm for contact-map G A . Importantly, we note that the SCH metric only requires contact-map informationnot real-space Cartesian coordinates. As such, it is fast to evaluate, contributing to the overall efficiency of GDS. Equation is a key component of our approach: we have have previously demonstrated that the SCH metric captures structural similarity between different protein contact-maps more accurately than the more commonly used Hamming distance, a feature which ultimately leads to better MSM resolution, as shown later. Discrete optimization of the folding-path sequence under the influence of F seeks to steer the search away from violation of connectivity criteria; the third term in eq seeks to ensure that an intermediate contact-map G i is approximately equidistant between neighboring contact maps (i + 1) and (i – 1), while the first two terms punish significant discontinuities in adjacent contact-maps.
Starting from an initial contact-map sequence, the GDS algorithm performs Markov chain Monte Carlo updates using F as an objective function for Metropolis-Hastings updates. The update “moves” involve randomly selecting a contact-map G i (i ≠ (0, N)) and performing a small random number of “bit flips” (which perturb G ij ∈ [0,1]). A linearly decreasing simulated annealing (SA) temperature schedule is used to encourage initial path searching before refining F in later iterations. Given that every contact map generated in this procedure is not necessarily physically realizable (due to, for example, violations of the triangle inequality), a reconstruction of the Cartesian coordinates from the contact map is attempted after each bit flip; further details of this back-transformation are given in our previous work. Overall, the GDS path-generation algorithm is very fast; each path typically requiring less than a minute of calculation time on a standard laptop.
In protein folding, slow dynamic motions are often directly related to the formation of native contacts and the organization of key secondary structures. In previous work, we used energy barriers computed using nudged elastic band (NEB) calculations on coarse-grained interaction models to select a small set of “likely” folding pathways. We further clustered this set of pathways using the Frechét metric to identify common motifs among pathways. In principle, however, there is a great deal of freedom in selecting pathways of interest during a postprocessing procedure. As noted above, the variational approach to decomposing dynamical systems can yield direct insight into the slow modes and relaxation time scales governing the kinetics. Therefore, we expect a basis informed with intermediates extracted from GDS simulations to serve well in decomposing our dynamical system under the VAMP framework; this is the key idea of this article.
Markov Models in Contact-Map Space
Many computational studies of protein folding have made use of the assumption that the formation of native contacts categorizes the folding mechanism. , However, simply using the fraction of native contacts, Q, as a reaction coordinate for folding has been shown to have severe non-Markovian artifacts. − It also lacks structure specificity; a particular Q can be obtained from several topologically distinct conformations, such that this approach may struggle to resolve multiple pathways or trapped intermediates. It has been shown thatby finding optimal weightings for different contacts in a similar reaction coordinate to Qone can better interpret the resulting modified reaction coordinate and gain insight into critical events within the folding path. However, the same work also found that the highly cooperative nature of contacts lead to a degeneracy over the optimal reaction coordinates. This finding is not surprising in the context of our discussion on the choice of metrics to measure structural similarity of contact maps, where the influence of a specific contact on the structural similarity of protein structure can vary, and depends on the environment described by the rest of the topology. Instead, a Markov model constructed with state definitions that can both minimally cover and successfully distinguish the relevant parts of state space would be anticipated to be expressive enough to identify different pathways and intermediates.
Given that our previously reported SCH metric (eq ) is able to effectively capture structurally similarity, we argue that using SCH-based radial Gaussian basis functions centered around significant intermediates (i.e., contact-maps) should serve as a “good” set of basis functions for construction of a Markov model describing protein folding. Indeed, contact-maps serve as a compact descriptor with great specificity for protein-folding topologies, and we have shown already that the SCH metric is effective in identifying collections of correlated structures during folding. In turn, this approach offer a good balance between dealing with the high-dimensional fully atomistic description of a protein and the often-too-simplified native contacts coordinate Q that can fail to capture important complexities of the folding process.
The GDS framework presented above is an ideal approach for generating intermediate folding structures {G i } to define a set of basis functions evaluated on the space of contact maps. In other words, we propose here to choose the basis {χ j } for our Koopman expansion to be
| 5 |
where the f SCH is given by eq and γ is chosen depending on the required resolution for the problem. These basis functions are readily and efficiently generated by GDS without the need for large numbers of potential energy surface (PES) evaluations or long time scale MD trajectories, and can be subject to several postprocessing steps such as thermodynamic or kinetic filtering. ,,− Furthermore, the enforced connectivity of paths guarantees sufficient coverage to compute transition-rate statistics starting from the unfolded to folded state of the protein, as we demonstrate below. Most importantly, by construction, the GDS-generated paths would be expected to account for the smallyet importantfraction of state-space that is directly relevant to the folding mechanism. Thus, the GDS framework should provide a significant sampling advantage over randomly selected basis functions, while constructing a localized basis set using GDS represents a more feasible computational task than constructing a basis set spanning all state-space.
To summarize, the overall workflow for kinetic model construction proposed here is shown in Figure , alongside a representation of the “standard” MD-based workflow. As shown in the next section, we find that the GDS-based route to kinetic model construction more accurately captures folding time-scales (in the variational sense) compared to previous MD-based studies, yet provides an intuitive and physically interpretable model for complex protein-folding processes.
1.

MSM construction demands both (A) model construction and (B) parametrization. (i) outlines the common MD-based strategy, in which MD trajectory data is used as input for structure featurization and VAMPnet basis-learning. In contrast, model-construction pathway (ii) proposed in this work employs direct sampling in contact-map spacealong with a physically intuitive basis- to provide a reduced (yet accurate) kinetic model of protein folding. In both MSM construction pathways considered here, kinetic parametrization (iii) is obtained from existing MD trajectory data, enable direct comparison of different (iv) few-state models on an equal footing.
Results and Discussion
To demonstrate how GDS can be used to construct an accurate MSM for complex dynamic processes, we begin here by presenting a illustrative example for a model two-dimensional (2D) “folding funnel” representative of the rugged landscapes traversed by more realistic protein-folding paths. Following this proof-of-concept, we turn to construction of a Markov model for a much more realistic protein-folding process, namely folding of the 35-residue WW domain protein (described by an atomistic force-field with explicit water). We demonstrate that GDS constructs a basis set for Markov modeling that is accurate, interpretable, and capable of resolving featuressuch as important kinetic trapsthat have proven difficult to sufficiently resolve using previous partitioning approaches. Furthermore, we subsequently demonstrate that the time scales and mechanism of folding extracted from our GDS-based MSM agree with (and, indeed, improve upon) previous estimates.
A Rugged 2D Protein-Folding Landscape
We first illustrate our GDS-based approach to construct a Markov model for a 2D energy landscape that is qualitatively reminiscent of the “rugged funnels” associated with protein folding. The model PES used here is defined as
| 6 |
The model is expressed in arbitrary reduced units of t 0 (time), l 0 (length), and m 0 (mass). The first term, with A = 1, defines a harmonic funnel centered at the origin, representing the overall thermodynamic bias toward the folded (native) state. The second term, a Gaussian well, with C = −30 and α = 3, introduces a deep, narrow minimum at the origin, mimicking the energetic stabilization of the native structure. An additional Gaussian ridge term, centered at radius r 0 = 2 with inverse-width k = 2 and height S = 30 creates a circular barrier around the native basin, emulating an entropic bottleneck.
To model the rugged nature of real protein-folding surfaces, we superimpose N = 50 randomly positioned local perturbations. Each perturbation is modeled as a Gaussian centered at (x i , y i ) ∼ U[−3, 3]2, with depth D i ∼ U[−20, 5] and inverse-width β i ∼ U[1, 3]. These randomly distributed traps are designed to resemble metastable intermediate or misfolded stateslocal basins into which the system can become transiently trapped for long periods of time. They also create low or barrier-less routes for the system to bypass the entropic bottleneck term.
As illustrated in Figure , the typical landscapes generated using eq are comparable to reduced-dimensional representations of real protein folding PESs, where the energy surface is typically dominated by a few low-lying minima separated by high barriers and several narrow transition paths. Thus, it captures the key dynamical challenge in realistic systems, namely investigation and characterization of rare-event transitions and long-lived traps within a rugged energy landscape.
2.

Contour plots of of the 2D PES V(x, y) (see eq ) and the corresponding Boltzmann distribution for β = 0.1. The left panel (A), a contour plot of the PES, has features reminiscent of low-dimensional projections of protein folding landscapes, which are typically dominated by a few low-lying minima separated by high barriers and several narrow transition paths. The right panel (B), shows a contour plot of the Boltzmann distribution with inverse temperature β = 0.1. The distribution is heavily dominated by the folded conformation −x, y = (0, 0).
To generate an ensemble of folding paths that are discretized in a similar fashion to the GDS scheme, we first define a discrete grid on the 2D PES. We note that, for general protein systems as studied below, the residue–residue contact map offers an ideal motivated discretization. However, in this 2D model case, a simple square grid tessellating space serves as a sufficient discretization. The square grid centers, C i , were chosen to be 11 × 11 points equally displaced across [−4, 4]2, as shown in Panel C of Figure .
3.

GDS exploration of pathways on a rugged 2D folding funnel. Panel (A) shows 100 Langevin trajectories of length 50 time-units each. Panel (B) presents the 200 GDS paths used to build a basis for a Markov model. Panels (C) and (D) present the locations of the basis centers for Markov model construction; the centers are marked with a cross, and a faint circle of radius 1 illustrates space coverage. Panel (C) presents the 121 centers of a uniform space-covering basis. Panel (D) shows the sparse basis generated from GDS simulations.
An initial guess for a sequence of squares (i.e., configurations) to visit is made with C 0 = C 1 = ... = C N–1 = (x, y)boundary where (x, y)boundary is a uniformly sampled point on the boundary. The final square C N = (0, 0) represents the folded state. Just as in our GDS framework, we perturb a randomly selected C i with a move to an adjacent cell and accept or reject the move with a Metropolis-Hastings criteria based on the simplified objective function, f̃ defined as
We note that this objective function is comparable to that employed in GDS simulations in seeking to generate directed walks through configuration space that end at the folded state. In total, 103 sequences of length N = 20 were generated by minimization of this objective function (with k cont = 1 in all cases). To generate each path, 105 SA iterations were performed, with the temperature linearly cooled from T = 10 to T = 0.1. Once this procedure was completed, each sequence was “back-mapped” into a piecewise-linear path in R 2; the “back-mapping” consists of linearly interpolating the minima of each of the visited square. Finally, we selected the 200 paths with lowest total uphill energy change as representative examples of folding trajectories with which to construct a Markov model partitioning.
To generate a point of comparison, we also used classical MD trajectories to sample the 2D configuration space of the folding landscape. Using classical MD simulations to sample trajectories can be expensive from a time scale point view, because the system can spend a large fraction of time trapped in metastable states. For the 2D potential studied here, we initiated 1000 Langevin trajectories, each for a total time t = 50 time-units, starting from (x, y) ∼ U[−4, 4]2. All trajectories were simulated with a Boltzmann factor β = 0.1, a damping coefficient of 1 (mass/time)-units, and a time-step of 0.001 time-units. As shown in Figure , this provides sufficient dynamical sampling of the configuration space, but the vast majority of the exploration lies trapped within the metastable areas (as expected based on temperature and landscape characteristics).
MD data sets like that illustrated in Figure A would normally be used to identify clusters and state definitions before calculating and parametrizing a corresponding MSM. Instead, to illustrate the utility of our approach, we first select a basis set derived from discrete paths generated using GDS; furthermore, we show that this approach to generating a basis does not undermine accuracy. We choose to build a “ground truth” model using a basis that systematically covers the whole space of interest; specifically, we use a Gaussian basis centered around the 11 × 11 = 121 points uniformly distributed across the domain [−4, 4]2. In contrast, to select a suitable basis using GDS, we selected intermediates from the GDS discrete paths, and pruned centers that were within a distance d = 0.8. This approach ultimately selected 50 Gaussian centers that were distributed over the expected regions of interest. We note thatwith increasing dimensionalitythe ratio between the number of centers required to cover all configuration space (rather than transition-path-associated space) is expected to grow dramatically.
Before building a Markov model, we selected the lagtime τ. Typically, τ is chosen to capture slow processes and equilibrate fast processes; in other words, the lagtime τ should be selected so that the system behaves in a Markovian fashion. However, no reliable method currently exists to achieve this a priori. We use a simple heuristic discussed in the Supporting Information, from which we find that 1.5 time-units was a suitable decision.
Following selection of lagtime τ, we fit a reversible Koopman model using the unbiased Koopman reweighting algorithm. We then compared the two modelsspecifically the model generated using GDS basis selection and the model generated using a grid basisby evaluating the eigenvalues of the three slowest modes (which, according to the variational principle, should be maximized). We find that the model built with the GDS basis yields eigenvalues of (0.748, 0.670, 0.590), in excellent agreement with those found with using the complete space-covering basis (0.750, 0.672, 0.594). For a more detailed validation, we compared the three corresponding eigenfunctions of both models (Figure ). Again, these are in excellent agreement with each other; most importantly, the characteristic dynamics associated with each reaction-coordinate (RC) are clearly aligned. For example, for the slowest RC (Figure A1 and B1), there is a clear “diagonal bias” in both eigenmodes, indicating that the slowest RC reflects the presence of the inner PES barrier to the folded-state (Figure ) and the lowered energetic barriers in the lower left-hand corner of the PES (Figure ).
4.

Comparison of contour plots representing the three slowest reaction coordinates (RCs) expanded in the complete-space-covering basis (Panels A1–A3) or the GDS basis (Panels B1–B3). We observe excellent agreement between RCs obtained by the two different approaches, despite using a much smaller basis set in the GDS case.
To summarize, the results presented here for a rugged 2D model of a protein-folding landscape demonstrate that the GDS framework can be used to generate a compact and accurate basis for Markov model construction. In other words, we have shown that efficient GDS simulations canin principlereplace extensive MD trajectory sampling in the search for a Markov basis. However, the broader utility of GDS in this context must clearly be demonstrated for a more realistic, higher-dimensional problem. In the following section, we demonstrate that the success of GDS for model construction readily carries over to constructing accurate Markov models for a fully atomistic model of a folding protein in a solvent environment.
GDS-Constructed Markov Model for WW Domain Folding
To demonstrate the wider applicability of our GDS methodology in the context of an actual protein-folding problem, we investigated the folding of the GTT variant of the FIP35 WW Domain (Figure a). This 35-residue protein represents a prototypical folding example, being one of 12 “fast folders” that have been studied by long-time scale MD simulations using the dedicated ANTON computer. The available MD data for this protein comprises two MD trajectories totalling a simulation time of more than 1 ms. The folded state was chosen as a configuration with a high value of the Q DESRES parameter constructed in the initial ANTON study; this order parameter measures structural similarity to the known folded state.
5.

Folded state of the FIP35 WW domain protein (left), with β-sheet secondary structures highlighted in red. On the right, the corresponding contact map of the folded WW domain is shown, where black pixels indicate a contact between two residues (eq ). Arbitrarily, we also define the diagonal elements as G ii = 1. As expected, two perpendicular regions are seen in the native-state contact-map of the FIP35 WW domain, corresponding to interactions between the β-sheets.
To proceed, we initiated 100 GDS runs starting from a “null” contact-map representing an entirely unfolded configuration of the protein sequence; the contact-map of the folded protein was used as the target end-point for all GDS trajectories. The GDS graph sequences were chosen to be of length N = 10, inclusive of unfolded and folded end points, and the target objective function of eq used the parameter k cont = 0.05. This choice was made based on Figure S2 in the Supporting Information (SI), where it is clear that structures within this distance are kinetically accessible. Our SA procedure employed 104 iterations of single-contact perturbation proposal moves, with a Metropolis-Hasting acceptance-rejection scheme starting with a temperature of 10–3 decreasing linearly (we note that the temperature scale does not map on to typical physical temperatures because the units and scale of the objective function in eq are somewhat arbitrary; instead, the initial temperature used here was chosen using initial test simulations). Each single-contact perturbation proposal involves randomly selecting a graph from the current sequence, selecting a random contact for “bit-flipping” (breaking or forming a contact), then proceeding to attempt to reconstruct the proposed graph.
The reconstruction is key hereotherwise, the GDS optimization encounters a large number of nonphysical graphs with distance restraints that cannot be satisfied in 3D space. Reconstruction involves the minimization (using LBFGS) of a simple polymer-chain empirical PES combined with a so-called Graph Restraining Potential (GRP):
| 7 |
Here, r α refers to the positions of the C α atoms and V poly is a polymer-chain PES comprising harmonic bonding terms with k = 115.6 kJ mol–1 nm–2 and σ = 0.38 nm (the typical distance between neighboring C α). The artificial PES V GRP is a function of both coordinates and a specific contact map that is the target for reconstruction. Given a contact map, G = (G ij ) (defined according to eq with a cutoff distance of 8 Å), we use the following distance restraint potential on C α atomic positions:
where k GRP = 1000 kJ mol–1 nm–2, r steric = 2 Å and r con = 8 Å. Previous work has shown that minimization of the GRP can lead to contact maps that are “close” to the target contact map when measured with the SCH metric. As a result, when each GDS run is complete, a pathway of intermediate “physical” contact maps from unfolded to folded graphs is produced. Overall, the GDS algorithm for generating folding paths and intermediate structures is very fast; for example, each path-generation simulations requires less than 5 min run-time on a standard laptop.
The resulting contact-maps obtained from the GDS procedure sample possible physical pathways of intermediate structures connecting the unfolded and folded states. However, given the simple nature of eq , the sampled contact-maps might correspond to structures that are not stable on the relevant atomistic PES. To address this, we back-transformed from contact maps to fully solvated protein structures in Cartesian space, and subsequently allowed these structures to relax on the PES using short MD runs. This process biases the generated path-ensemble toward sampling more stable intermediates on the folding landscape. Here, intermediate contact maps were ”back-mapped” into an all-atom, explicit solvent system modeled via the GROMACS MD package using the CHARMM36m-TIP3P force-field. , In this “back-mapping” procedure, we first obtain a biased structures in the fully atomistic protein–water system that is consistent with the current target contact map. This is achieved by running a high temperature MD simulation with a strong V GRP bias applied, resulting in quickly decorrelated configurations that respect the GRP restraints. We subsequently cool this configuration (again, still applying V GRP bias) to obtain a more thermodynamically stable representative structure. Finally, we remove V GRP restraints and perform a short MD simulation in which the representative solvated protein structure relaxes further (noting that the contact-map is now free to “drift” from the original target). Notably, this simple procedure only requires around 1 ns of MD simulation time, which itself only requires a few minutes of ‘real-world’ time. Further details of this procedure are given in the SI. In total, relaxing the 800 GDS intermediates requires approximately 800 ns of aggregate MD. Importantly, these simulations are not used to construct the basis itself, which is already generated by GDS, but only to obtain locally relaxed atomistic representations. In comparison, Kleiman and Shukla used approximately 1, μs of aggregate MD in an iterative VAMPbased adaptive sampling scheme for a similarly sized fast-folding protein. Despite showing significant improvements over previous schemes, Kleiman and Shukla’s scheme was not able to explore more than small conformational changes from the folded structure. The goal in these schemes is similar to our goal here: constructing a basis such that MD can be sampled efficiently. However, Kleiman and Shukla’s results highlights both the key distinction and advantage of our GDS scheme has over the iterative approaches; iterative approaches still require non-negligible MD simulations to progressively learn the relevant configurational representation, whereas GDS provides a suitable basis a priori with negligible MD costs.
In total, GDS sampling yielded 800 physically relevant intermediate contact-maps; this number was further pruned to 608 by removing closely similar structures (specifically, a structure was pruned if it had a SCH distance metric value of less than 0.1 to any other existing structure). Finally, the overall Koopman model basis set was doubled in size to 1216 basis functions by placing two basis functions (eq ) at each retained contact-map; these basis functions used different γ-values of 0.1 and 0.2, respectively. While not essential, we find that using this approach ensures better coverage of configuration space and a more accurate Koopman model.
We note that GDS does not rely on time scale separation; instead, GDS generates nonbiased folding pathways thatby constructionconnect unfolded and target folded structures through pathways in “contact-map space”. The concepts of rates and time-scales emerge after GDS construction of a MSM basis; here, we obtain this kinetic data using available ANTON MD trajectories as a proxy, enabling model comparison against previous work. GDS does not guarantee sampling over slow dynamic modes, but does (by construction) generate paths that definitively fold from an unfolded structure to the final target structure. We expect that such paths would a priori contain intermediate structures associated with the slowest dynamic modes.
As noted above, fitting the Koopman operator requires selection of an appropriate lagtime over which the “fast” degrees-of-freedom in the system effectively equilibrate. We perform a similar heuristic analysis to that of the 2D model potential above, which is presented in the Supporting Information. We find that a lagtime of τ = 100 ns was an appropriate choice. A Koopman operator represented in the GDS basis was subsequently fit with that lagtime. For this purpose, we used the Koopman reweighting algorithm implemented in the deeptime package. Here, we generated a Koopman model describing the three slowest relaxing modes of interest. The resulting time scales were 10.6, 0.6, and 0.2 μs, computed by , where τ is the lagtime. The projections of the MD data along these three slowest Koopman modes are shown in Figure .
6.

Free energy projections of the WW domain protein along the three slowest modes, RC1–C3. Along the diagonal, panels {A, E, I}, are the free energy curves along the separate reaction coordinates. The off-diagonal panels show 2D Free energy surfaces projected along two of the modes. Panels D, G, and H are the free energy surface plots for RC2 against RC1, RC3 against RC1, and RC3 against RC2, respectively. The upper triangular off-diagonal panels B, C, and F are reflections of panels D, G, and H, respectively, but with samples of the MD trajectory data overlaid. As further examined in Figure , we see that RC1 (the slowest mode) corresponds to the folding coordinate. RC2 distinguishes a stable kinetic trap that must unfold to enable progress to the native folded structure.
The slowest reaction coordinate (RC), corresponding to the folded-unfolded transition, correlates well with findings from previous studies. ,, In Figure A, the free energy calculated along RC1 reveals two deep minima, simply corresponding to the folded and unfolded states; diagonal plots along RC2 and RC3 confirm that these RCs correspond to motion in the direction of specific higher-energy minima of the free-energy surface. However, the two-dimensional plots of RC pairs reveal further underlying structure to the free-energy surface. For example, plotting the free energy in the space spanned by (RC1, RC2) reveals the presence of an additional metastable state, as described in further detail below; similarly, projection onto (RC1, RC3) reveals a range of paths from unfolded to folded. As an aside, we note that the ANTON MD trajectoriesas expectedcorrelate strongly with the predictions of this GDS-derived Koopman model. This is confirmed in Figure B, C, and F, which show the MD trajectory data projected onto the GDS/Koopman RCs.
In Figure , we have a closer look an interpreting the physical meaning of the RCs identified. The average contact map of regions identified with red boxes are displayed alongside the respective stable regions in both panels of Figure . We can see from Panel A, which is the FES expanded in RC1-RC2 space, that RC1 is indeed the unfolded to folded transition. The additional state projected by RC2, appears to be a kinetic misfolded trap. Orthogonal lines to the diagonal on a contact map indicate the location of the β turn residue. The kinetic trap here shows that these β turns are shifted by a residue. Panel A also reveals that this misfolded conformation cannot then enter the folded state, it would need to unravel and unfold to refold. Panel B is a similar FES plot but this time expanded in RC1-RC3 space. Its clear form examining this, there are 2 routes, each of which is corresponds to which β strands connect first. The more dominant route appears to be the folding of the first pair of β strands. The alternative route, appears to contain an extended β strand pair that forms that can hinder the folding process.
7.

A closer look at the free energy surfaces from panels D and G of Figure . Red boxes outline stable regions; corresponding averaged contact maps of the structures inside the boxes are shown nearby, labeled “U”-Unfolded, “T”-Trap, “I”-Intermediate, and “F”-Folded. (A) shows the free energy surface in the (RC1, RC2) plane; we see that RC1 corresponds to the unfolding–folding transition, whereas RC2 distinguishes between a stable trapped state and the rest of the configurational space. Panel (B) shows the free energy surface in the (RC1, RC3) plane, more clearly distinguishing the presence of multiple intermediate states. Finally, panel (C) shows representative structures for each identified state; although cartoon representations are shown highlighting secondary structure, these structures were obtained by back-mapping to fully atomistic, solvated protein configurations.
The GDS-generated Koopman model is very effective in identifying slow-dynamics, and enables further investigation in terms of metastable states and transition pathways. In fact, it is also quite common to use identified RCs from Koopman models to define a discrete state partition and resulting MSM. , Specifically, in previous studies of the GTT WW domain data set, , a basis of Cα and Cβ pairwise distances was employed (following a range of other previous studies ,,− ), resulting in predicted folding time scales between 6 and 10 μs. ,, Curiously, however, we find that the projected modes obtained from our GDS-based model do not correspond well to these previous studies, despite good correspondence of the slowest time scale. Specifically, we find that the time scales for equilibration with the trapped state are much longer than those associated with the folding intermediates, contrary to previous mode projection studies. The time scales, reported previously were a result of an MSM built using a 100 ns lagtime after clustering with Koopman modes expanded in the basis of Cα and Cβ pairwise distances; however, those Koopman modes were themselves built with a 10 ns lagtime.
To understand this discrepancy, and provide a more complete comparison between our approach and previous work, we proceeded to build an MSM by discretizing the space spanned by our GDS-informed Koopman modes. Here, we partitioned our Koopman model data using regular space clustering, a Voronoi partitioning scheme that ensures that no two Voronoi centers lie within a defined threshold. We chose the kinetic threshold to be 40 ns as measured by the commute map computed using the five slowest modes found from our Koopman model. This threshold was chosen to balance accuracy with number of discrete states, whichin this caseamounted to 232. An implied time scale (ITS) convergence plot is presented in the Supporting Information, showing that 100 ns is a suitable time scales.
From analysis of our simplified MSM, we obtain a folding time scale of 13.8 μs with a standard error of 0.9 μs; this is longer that the 10.2 μs obtained in previous work, , even though our discretized MSM only uses 232 states rather than the 1000-state model employed previously. This observation represents a very strongly supportive result for our GDS-based strategy; the variational principle for MSM construction suggests that an optimal approximation of the transfer operator maximizes the time scales (subject to use of a consistent lagtime), so the observation that our MSM exhibits longer time scales than previous studies supports the GDS approach for MSM construction proposed here.
The eigenvectors obtained from our MSM may not necessarily correspond to the Koopman modes identified earlier. To investigate whether the two “slow” processes obtained in our Koopman model correspond to folding-unfolding and trapping, respectively, we visualized the corresponding MSM right-eigenvectors; these act as natural corresponding reaction-coordinates in MSMs. As shown in Figure , our interpretation of the slowest modes from our Koopman models aligns well with our MSM. The eigenvector associated with the slowest time scale (Figure A) corresponds to the transition between unfolded and folded protein states, whereas the eigenvector associated with the second slowest time scale corresponds to transitions between the trapped and nontrapped states (Figure B). Furthermore, we see that our MSM identifies the trapped state as the “kinetically furthest” unfolded state away from the folded state; in other words, our MSM reflects the observation that the trapped state is required to transition back to an unfolded state before proceeding to the folded state, as one would naturally expect.
8.

Scatter plots of MD data set projected along the slowest two Koopman modes, RC1 and RC2. Here, points are colored according to to their components in the second and third eigenvector of the MSM, respectively, providing information about the dynamic “flow” between MSM-defined states. The folded state is at (RC1, RC2) = (0.5, 0), the trapped state is at (RC1, RC2) = (−1, −12.5), and the unfolded states lie around (RC1, RC2) = (−2, 0).
To complete the picture of WW domain folding dynamics, we present results of employing the Perron-cluster cluster analysis (PCCA) clustering algorithm , on our MSM in Figure . The goal of PCCA clustering is to automatically identify a few ‘important’ metastable states from MSMs constructed with many states (such as our MSM built using ∼200 states). This is achieved with a further coarse-graining of an MSM by forming “membership functions” as linear combinations of the MSM indicator basis functions. , Given the utility of analyzing contact maps, , this provides an interpretable and physically meaningful decomposition of the conformational rates with the relevant kinetics too. As expected, application of PCCA clustering further simplifies the MSM obtained from our original GDS-derived Koopman model, resulting in a reduced model comprising three PCCA states corresponding to the folded, unfolded and trapped regions of configuration space.
9.

Results obtained after clustering MSM with PCCA. The three states obtained are the trapped, unfolded, and folded states, respectively colored red, green, and blue. Average contact maps for PCCA memberships of over 80% are highlighted with the same colors. Arrows and corresponding labels represent the probability of transition between PCCA states after 100 ns.
Markov Model of NTL9
To demonstrate the wider applicability of our GDS-based approach, we have repeated the entire simulation and analysis workflow for a separate protein also available in the ANTON data set, namely NTL9. Data for this additional example are shown in the SI; we find that the predicted folding landscapes and observed intermediates align well with previous reduced models. Here, however, we highlight the fact that the estimated folding time-scale of 18.5 μs is in good agreement with previous estimates , with some evidence to suggest that our implied time-scales may represent a variational improvement (as described in the SI, direct numerical estimates for NTL9 folding time-scales are infrequently reported, to the best of our knowledge).
We also provide further comparisons for both proteins between our results and the use of Q fraction of native contacts in the SI. We find that Q expectedly corresponds well to the slowest Koopman modes for both proteins, but cannot capture the intermediates, traps, and heterogeneity in the pathways. We also report, when using Q to define unfolded and folded regions of space, we compute a mean first passage time (MFPT) of of 18 μs for WW Domain and 22 μs for NTL9. These are inline with results from Lindorff-Larsen et al. which report an MFPT of 21(6) μs for WW Domain and 29(7) μs for NTL9 protein.
Conclusion
In this work, we have introduced a new strategy for constructing effective basis sets for Markov models by sampling discrete protein-folding pathways, rather than relying on extensive MD simulations. For a fully atomistic (and solvated) protein-folding problem, we have demonstrated how a graph-based representation of the folding landscapeas provided by the simple and efficient GDS algorithmcan be used to identify key intermediate structures in contact-map space. This approach bypasses the need for extensive, pre-existing MD data in basis construction for Markov models, opening a route toward targeted simulations or rate approximations to be performed more efficiently once an informative basis has been established by GDS. We strongly
We first illustrated this strategy using a 2D model that is reminiscent of a rugged protein-folding funnel. We then demonstrated the approach for the folding the GTT variant of the FIP35 WW domain protein in explicit water. The basis sets constructed using GDS were found to provide an accurate and efficient representation of folding kinetics, boosted by the use of the topologically informed SCH distance metric. The resulting Koopman models and MSMs readily identify the important slow dynamical processes, identify key folding intermediates, and even reveal kinetic traps that were not clearly resolved through ‘standard’ order parameters such as the fraction of native contacts. These findings validate the effectiveness of GDS as a complex-landscape exploration strategy, and provide strong evidence for the use of GDS in defining a structurally meaningful basis for Markov models of protein folding. We emphasize that the approach taken here is quite general, and could equally be applied to study protein–protein interaction networks, drug–protein binding, protein misfolding, and other complex transient biophysical processes.
We emphasize again that our focus here is explicitly on addressing step (A)basis generation (or model construction)in deploying MSMs, rather than kinetic parametrization (B). As such, kinetic information for GDS-constructed few-state models is obtained using the available ANTON trajectory data, enabling a direct comparison to previous few-state models on a consistent kinetic footing. We restate that, in future studies where a direct comparison is no longer necessary, targetted enhanced sampling methods can utilized effectively with a preconstructed basis.
By using the variational principle for Markov processes, we have shown that our model captures folding dynamics more accurately than previous comparable studies of the GTT variant. In high-dimensional systems, where MD sampling of the entire conformational space is typically not feasible, leveraging our GDS-generated basis becomes advantageous over iterative active sampling methods. Simply put, we can achieve accurate coverage and kinetic connectivity from cheap GDS simulations, rather than extensive MD simulations. A further interesting direction for future research is to consider whether unbiased GDS simulations could be used to automatically generate a set of reaction-coordinates for further biased simulations based on metadynamics, for example, potentially offering a further analysis route for complex free-energy landscapes associated with protein folding and similar processes. The contact map representation is well suited to enhanced sampling for large conformational changes such as exploring intermediates for drug targetting.
The path forward from this work is clear; we now need to develop efficient estimates of free energies and conformational transition rates in the space of contact-maps to effectively extract mechanisms and kinetics for the whole folding process, without relying on exhaustive MD sampling. This is not an intractable problem; free energies of contact maps have been studied previously. , Emerging methods for computing committor functions can make calculation of neighboring-contact-map transition rates fast and accessible. , Koopman reweighting is now being applied to enhanced sampling trajectories, which can be utilized effectively with a preconstructed basis. Combining such approaches with GDS is an exciting avenue for future work.
Supplementary Material
Acknowledgments
Z.F. thanks the EPSRC Heterogeneous Systems Modelling Centre for Doctoral Training at the University of Warwick for the award of a studentship (EP/S022848/1). All authors thank the Scientific Computing Research Technology Platform at the University of Warwick for provision of high-performance computing facilities. The authors thank D. E. Shaw Research for the provision and use of the MD trajectory data from Anton.
Code implementing the GDS protein-folding and MSM construction strategy described here can be found at https://github.com/HabershonLab/GDS-fold. This repository includes both Python scripts to run and analyze GDS simulations, as well as scripts to obtain the results plotted in the Figures above. The Anton MD data sets used for model construction were kindly provided by D. E. Shaw Research; further details can be found in ref .
The Supporting Information is available free of charge at https://pubs.acs.org/doi/10.1021/acs.jcim.6c01905.
Further details of Koopman model construction and analysis, as well as further analysis of time scales from Markov models (PDF)
The authors declare no competing financial interest.
References
- Jumper J., Evans R., Pritzel A., Green T., Figurnov M., Ronneberger O., Tunyasuvunakool K., Bates R., Žídek A., Potapenko A.. et al. Highly accurate protein structure prediction with AlphaFold. Nature. 2021;596:583–589. doi: 10.1038/s41586-021-03819-2. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Baek, M. ; Anishchenko, I. ; Humphreys, I. R. ; Cong, Q. ; Baker, D. ; DiMaio, F. . Efficient and accurate prediction of protein structure using RoseTTAFold2 bioRxiv 2023. 10.1101/2023.05.24.542179. [DOI]
- Hu G., Doruker P., Li H., Demet Akten E.. Understanding protein dynamics, binding and allostery for drug design. Front. Mol. Biosci. 2021;8:681364. doi: 10.3389/fmolb.2021.681364. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Listov D., Lipsh-Sokolik R., Rosset S., Yang C., Correia B. E., Fleishman S. J.. Assessing and enhancing foldability in designed proteins. Protein Sci. 2022;31:e4400. doi: 10.1002/pro.4400. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Privett H. K., Kiss G., Lee T. M., Blomberg R., Chica R. A., Thomas L. M., Hilvert D., Houk K. N., Mayo S. L.. Iterative approach to computational enzyme design. Proc. Natl. Acad. Sci. U.S.A. 2012;109:3790–3795. doi: 10.1073/pnas.1118082108. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Lindorff-Larsen K., Piana S., Dror R. O., Shaw D. E.. How fast-folding proteins fold. Science. 2011;334:517–520. doi: 10.1126/science.1208351. [DOI] [PubMed] [Google Scholar]
- Prinz J.-H., Keller B., Noé F.. Probing molecular kinetics with Markov models: metastable states, transition pathways and spectroscopic observables. Phys. Chem. Chem. Phys. 2011;13:16912–16927. doi: 10.1039/c1cp21258c. [DOI] [PubMed] [Google Scholar]
- Chodera J. D., Noé F.. Markov state models of biomolecular conformational dynamics. Curr. Opin. Struct. Biol. 2014;25:135–144. doi: 10.1016/j.sbi.2014.04.002. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Husic B. E., Pande V. S.. Markov state models: From an art to a science. J. Am. Chem. Soc. 2018;140:2386–2396. doi: 10.1021/jacs.7b12191. [DOI] [PubMed] [Google Scholar]
- Prinz J.-H., Wu H., Sarich M., Keller B., Senne M., Held M., Chodera J. D., Schütte C., Noé F.. Markov models of molecular kinetics: Generation and validation. J. Chem. Phys. 2011;134:174105. doi: 10.1063/1.3565032. [DOI] [PubMed] [Google Scholar]
- Singhal N., Pande V. S.. Error analysis and efficient sampling in Markovian state models for molecular dynamics. J. Chem. Phys. 2005;123:204909. doi: 10.1063/1.2116947. [DOI] [PubMed] [Google Scholar]
- Sarich M., Noé F., Schütte C.. On the approximation quality of Markov state models. Multiscale Model. Simul. 2010;8:1154–1177. doi: 10.1137/090764049. [DOI] [Google Scholar]
- Nüske, F. The Variational Approach to Conformational Dynamics. Ph.D. thesis 2017. [Google Scholar]
- Wu H., Noé F.. Variational approach for learning Markov processes from time series data. J. Nonlinear Sci. 2020;30:23–66. doi: 10.1007/s00332-019-09567-y. [DOI] [Google Scholar]
- Mardt A., Pasquali L., Wu H., Noé F.. VAMPnets for deep learning of molecular kinetics. Nat. Commun. 2018;9:5. doi: 10.1038/s41467-017-02388-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kleiman D. E., Shukla D.. Active learning of the conformational ensemble of proteins using maximum entropy VAMPNets. J. Chem. Theory Comput. 2023;19:4377–4388. doi: 10.1021/acs.jctc.3c00040. [DOI] [PubMed] [Google Scholar]
- Sidky H., Chen W., Ferguson A. L.. Machine learning for collective variable discovery and enhanced sampling in biomolecular simulation. Mol. Phys. 2020;118:e1737742. doi: 10.1080/00268976.2020.1737742. [DOI] [Google Scholar]
- Wan H., Voelz V. A.. Adaptive Markov state model estimation using short reseeding trajectories. J. Chem. Phys. 2020;152:024103. doi: 10.1063/1.5142457. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Marques S. M., Kouba P., Legrand A., Sedlar J., Disson L., Planas-Iglesias J., Sanusi Z., Kunka A., Damborsky J., Pajdla T.. et al. CoVAMPnet: comparative Markov state analysis for studying effects of drug candidates on disordered biomolecules. JACS Au. 2024;4:2228–2245. doi: 10.1021/jacsau.4c00182. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Nadeem, H. ; Shukla, D. . Optimizing adaptive sampling via Policy Ranking. arXiv preprint arXiv:2410.15259, 2024.
- Liu B., Boysen J. G., Unarta I. C., Du X., Li Y., Huang X.. Exploring transition states of protein conformational changes via out-of-distribution detection in the hyperspherical latent space. Nat. Commun. 2025;16:349. doi: 10.1038/s41467-024-55228-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Fakhoury Z., Sosso G. C., Habershon S.. Generating protein folding trajectories using contact-map-driven directed walks. J. Chem. Inf. Model. 2023;63:2181–2195. doi: 10.1021/acs.jcim.3c00023. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Fakhoury Z., Sosso G. C., Habershon S.. Contact-Map-Driven Exploration of Heterogeneous Protein-Folding Paths. J. Chem. Theory Comput. 2024;20:8340–8353. doi: 10.1021/acs.jctc.4c00878. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Hanni, J. ; Ray, D. . Data efficient learning of molecular slow modes from nonequilibrium metadynamics. J. Chem. Phys. 2025, 162. 10.1063/5.0258483. [DOI] [PubMed] [Google Scholar]
- Noé F., Fischer S.. Transition networks for modeling the kinetics of conformational change in macromolecules. Curr. Opin. Struct. Biol. 2008;18:154–162. doi: 10.1016/j.sbi.2008.01.008. [DOI] [PubMed] [Google Scholar]
- Chong L. T., Saglam A. S., Zuckerman D. M.. Path-sampling strategies for simulating rare events in biomolecular systems. Curr. Opin. Struct. Biol. 2017;43:88–94. doi: 10.1016/j.sbi.2016.11.019. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Chan H. S., Dill K. A.. “Sequence space soup”of proteins and copolymers. J. Chem. Phys. 1991;95:3775–3787. doi: 10.1063/1.460828. [DOI] [Google Scholar]
- Tanaka S., Scheraga H. A.. Model of protein folding: inclusion of short-, medium-, and long-range interactions. Proc. Natl. Acad. Sci. U.S.A. 1975;72:3802–3806. doi: 10.1073/pnas.72.10.3802. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Levitt M., Warshel A.. Computer simulation of protein folding. Nature. 1975;253:694–698. doi: 10.1038/253694a0. [DOI] [PubMed] [Google Scholar]
- Piana S., Sarkar K., Lindorff-Larsen K., Guo M., Gruebele M., Shaw D. E.. Computational design and experimental testing of the fastest-folding β-sheet protein. J. Mol. Biol. 2011;405:43–48. doi: 10.1016/j.jmb.2010.10.023. [DOI] [PubMed] [Google Scholar]
- Röblitz S., Weber M.. Fuzzy spectral clustering by PCCA+: application to Markov state models and data classification. Adv. Data Anal. Classif. 2013;7:147–179. doi: 10.1007/s11634-013-0134-6. [DOI] [Google Scholar]
- Vanden-Eijnden E., Vanden-Eijnden E.. et al. Towards a theory of transition paths. J. Stat. Phys. 2006;123:503–523. doi: 10.1007/s10955-005-9003-9. [DOI] [Google Scholar]
- Metzner, P. ; Schütte, C. ; Vanden-Eijnden, E. . Transition path theory for Markov jump processes. Multiscale Model. Simul. 2009. 7, 1192–1219. 10.1137/070699500. [DOI] [Google Scholar]
- Vanden-Eijnden E., Vanden-Eijnden E.. et al. Transition-path theory and path-finding algorithms for the study of rare events. Annu. Rev. Phys. Chem. 2010;61:391–420. doi: 10.1146/annurev.physchem.040808.090412. [DOI] [PubMed] [Google Scholar]
- Chennubhotla C., Bahar I.. Markov methods for hierarchical coarse-graining of large protein dynamics. J. Comput. Biol. 2007;14:765–776. doi: 10.1089/cmb.2007.R015. [DOI] [PubMed] [Google Scholar]
- Li Y., Dong Z.. Effect of clustering algorithm on establishing Markov state model for molecular dynamics simulations. J. Chem. Inf. Model. 2016;56:1205–1215. doi: 10.1021/acs.jcim.6b00181. [DOI] [PubMed] [Google Scholar]
- McGibbon R. T., Pande V. S.. Learning kinetic distance metrics for Markov state models of protein conformational dynamics. J. Chem. Theory Comput. 2013;9:2900–2906. doi: 10.1021/ct400132h. [DOI] [PubMed] [Google Scholar]
- Tan Q., Duan M., Li M., Han L., Huo S.. Approximating dynamic proximity with a hybrid geometry energy-based kernel for diffusion maps. J. Chem. Phys. 2019;151:105101. doi: 10.1063/1.5100968. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Evans, A. L. Mahalanobis Diffusion Maps for Quantifying Rare Events: Theory and Application to Molecular Dynamics. Ph.D. thesis, University of Maryland: College Park, 2023. [Google Scholar]
- Kellogg E. H., Lange O. F., Baker D.. Evaluation and optimization of discrete state models of protein folding. J. Phys. Chem. B. 2012;116:11405–11413. doi: 10.1021/jp3044303. [DOI] [PubMed] [Google Scholar]
- Arbon R. E., Zhu Y., Mey A. S.. Markov state models: to optimize or not to optimize. J. Chem. Theory Comput. 2024;20:977–988. doi: 10.1021/acs.jctc.3c01134. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Nüske F., Keller B. G., Pérez-Hernández G., Mey A. S., Noé F.. Variational approach to molecular kinetics. J. Chem. Theory Comput. 2014;10:1739–1752. doi: 10.1021/ct4009156. [DOI] [PubMed] [Google Scholar]
- Klus, S. ; Koltai, P. ; Schütte, C. . On the numerical approximation of the Perron-Frobenius and Koopman operator. arXiv preprint arXiv:1512.05997, 2015.
- Wu H., Nüske F., Paul F., Klus S., Koltai P., Noé F.. Variational Koopman models: Slow collective variables and molecular kinetics from short off-equilibrium simulations. J. Chem. Phys. 2017;146:154104. doi: 10.1063/1.4979344. [DOI] [PubMed] [Google Scholar]
- Donati L., Heida M., Keller B. G., Weber M.. Estimation of the infinitesimal generator by square-root approximation. J. Phys.: Condens. Matter. 2018;30:425201. doi: 10.1088/1361-648X/aadfc8. [DOI] [PubMed] [Google Scholar]
- Lie H. C., Fackeldey K., Weber M.. A square root approximation of transition rates for a Markov state model. SIAM J. Matrix Anal. Appl. 2013;34:738–756. doi: 10.1137/120899959. [DOI] [Google Scholar]
- Donati L., Weber M., Keller B. G.. A review of Girsanov reweighting and of square root approximation for building molecular Markov state models. J. Math. Phys. 2022;63:123306. doi: 10.1063/5.0127227. [DOI] [Google Scholar]
- Duarte J. M., Sathyapriya R., Stehr H., Filippis I., Lappe M.. Optimal contact definition for reconstruction of contact maps. BMC Bioinf. 2010;11:1–10. doi: 10.1186/1471-2105-11-283. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Mercadante D., Gräter F., Daday C.. CONAN: a tool to decode dynamical information from molecular interaction maps. Biophys. J. 2018;114:1267–1273. doi: 10.1016/j.bpj.2018.01.033. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Illig A.-M., Strodel B.. Performance of Markov State Models and Transition Networks on Characterizing Amyloid Aggregation Pathways from MD Data. J. Chem. Theory Comput. 2020;16:7825–7839. doi: 10.1021/acs.jctc.0c00727. [DOI] [PubMed] [Google Scholar]
- Seyler S. L., Kumar A., Thorpe M. F., Beckstein O.. Path similarity analysis: a method for quantifying macromolecular pathways. PLoS Comput. Biol. 2015;11:e1004568. doi: 10.1371/journal.pcbi.1004568. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Onuchic J. N., Wolynes P. G., Luthey-Schulten Z., Socci N. D.. Toward an outline of the topography of a realistic protein-folding funnel. Proc. Natl. Acad. Sci. U.S.A. 1995;92:3626–3630. doi: 10.1073/pnas.92.8.3626. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Šali A., Shakhnovich E., Karplus M.. How does a protein fold? Nature. 1994;369:248–251. doi: 10.1038/369248a0. [DOI] [PubMed] [Google Scholar]
- Best R. B., Hummer G.. Coordinate-dependent diffusion in protein folding. Proc. Natl. Acad. Sci. U.S.A. 2010;107:1088–1093. doi: 10.1073/pnas.0910390107. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Plotkin S. S., Wolynes P. G.. Non-Markovian configurational diffusion and reaction coordinates for protein folding. Phys. Rev. Lett. 1998;80:5015. doi: 10.1103/PhysRevLett.80.5015. [DOI] [Google Scholar]
- Dalton B. A., Ayaz C., Kiefer H., Klimek A., Tepper L., Netz R. R.. Fast protein folding is governed by memory-dependent friction. Proc. Natl. Acad. Sci. U.S.A. 2023;120:e2220068120. doi: 10.1073/pnas.2220068120. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Best R. B., Hummer G.. Reaction coordinates and rates from transition paths. Proc. Natl. Acad. Sci. U.S.A. 2005;102:6732–6737. doi: 10.1073/pnas.0408098102. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Ismail I., Chantreau Majerus R., Habershon S.. Graph-driven reaction discovery: progress, challenges, and future opportunities. J. Phys. Chem. A. 2022;126:7051–7069. doi: 10.1021/acs.jpca.2c06408. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Ismail I., Stuttaford-Fowler H. B., Ochan Ashok C., Robertson C., Habershon S.. Automatic proposal of multistep reaction mechanisms using a graph-driven search. J. Phys. Chem. A. 2019;123:3407–3417. doi: 10.1021/acs.jpca.9b01014. [DOI] [PubMed] [Google Scholar]
- Robertson C., Habershon S.. Fast screening of homogeneous catalysis mechanisms using graph-driven searches and approximate quantum chemistry. Catal. Sci. Technol. 2019;9:6357–6369. doi: 10.1039/C9CY01997A. [DOI] [Google Scholar]
- Dill K. A., Ozkan S. B., Shell M. S., Weikl T. R.. The protein folding problem. Annu. Rev. Biophys. 2008;37:289–316. doi: 10.1146/annurev.biophys.37.092707.153558. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Liu D. C., Nocedal J.. On the limited memory BFGS method for large scale optimization. Math. Program. 1989;45:503–528. doi: 10.1007/BF01589116. [DOI] [Google Scholar]
- Van Der Spoel D., Lindahl E., Hess B., Groenhof G., Mark A. E., Berendsen H. J.. GROMACS: fast, flexible, and free. J. Comput. Chem. 2005;26:1701–1718. doi: 10.1002/jcc.20291. [DOI] [PubMed] [Google Scholar]
- Huang J., Rauscher S., Nawrocki G., Ran T., Feig M., de Groot B. L., Grubmüller H., MacKerell A. D.. CHARMM36m: an improved force field for folded and intrinsically disordered proteins. Nat. Methods. 2017;14:71–73. doi: 10.1038/nmeth.4067. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Jo S., Kim T., Iyer V. G., Im W.. CHARMM-GUI: a web-based graphical user interface for CHARMM. J. Comput. Chem. 2008;29:1859–1865. doi: 10.1002/jcc.20945. [DOI] [PubMed] [Google Scholar]
- Hoffmann M., Scherer M., Hempel T., Mardt A., de Silva B., Husic B. E., Klus S., Wu H., Kutz N., Brunton S. L., Noé F.. Deeptime: a Python library for machine learning dynamical models from time series data. Mach. Learn.: Sci. Technol. 2022;3:015009. doi: 10.1088/2632-2153/ac3de0. [DOI] [Google Scholar]
- Beauchamp K. A., McGibbon R., Lin Y.-S., Pande V. S.. Simple few-state models reveal hidden complexity in protein folding. Proc. Natl. Acad. Sci. U.S.A. 2012;109:17807–17813. doi: 10.1073/pnas.1201810109. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Wan H., Zhou G., Voelz V. A.. A maximum-caliber approach to predicting perturbed folding kinetics due to mutations. J. Chem. Theory Comput. 2016;12:5768–5776. doi: 10.1021/acs.jctc.6b00938. [DOI] [PubMed] [Google Scholar]
- Sidky H., Chen W., Ferguson A. L.. High-resolution Markov state models for the dynamics of Trp-cage miniprotein constructed over slow folding modes identified by state-free reversible VAMPnets. J. Phys. Chem. B. 2019;123:7999–8009. doi: 10.1021/acs.jpcb.9b05578. [DOI] [PubMed] [Google Scholar]
- Wang D., Qiu Y., Beyerle E. R., Huang X., Tiwary P.. Information bottleneck approach for Markov model construction. J. Chem. Theory Comput. 2024;20:5352–5367. doi: 10.1021/acs.jctc.4c00449. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Noé F., De Fabritiis G., Clementi C.. Machine learning for protein folding and dynamics. Curr. Opin. Struct. Biol. 2020;60:77–84. doi: 10.1016/j.sbi.2019.12.005. [DOI] [PubMed] [Google Scholar]
- Zhang S., Ge Y., Voelz V. A.. Improved Estimates of Folding Stabilities and Kinetics with Multiensemble Markov Models. Biochemistry. 2024;63:3045–3056. doi: 10.1021/acs.biochem.4c00573. [DOI] [PubMed] [Google Scholar]
- Noé F., Banisch R., Clementi C.. Commute maps: Separating slowly mixing molecular configurations for kinetic modeling. J. Chem. Theory Comput. 2016;12:5620–5630. doi: 10.1021/acs.jctc.6b00762. [DOI] [PubMed] [Google Scholar]
- Weber M.. Implications of PCCA+ in molecular simulation. Computation. 2018;6:20. doi: 10.3390/computation6010020. [DOI] [Google Scholar]
- Barah P., Sinha S.. Analysis of protein folds using protein contact networks. Pramana. 2008;71:369–378. doi: 10.1007/s12043-008-0170-5. [DOI] [Google Scholar]
- Ghorbani M., Prasad S., Klauda J. B., Brooks B. R.. GraphVAMPNet, using graph neural networks and variational approach to Markov processes for dynamical modeling of biomolecules. J. Chem. Phys. 2022;156:184103. doi: 10.1063/5.0085607. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Spagnolli G., Massignan T., Astolfi A., Biggi S., Rigoli M., Brunelli P., Libergoli M., Ianeselli A., Orioli S., Boldrini A.. et al. Pharmacological inactivation of the prion protein by targeting a folding intermediate. Commun. Biol. 2021;4:62. doi: 10.1038/s42003-020-01585-x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Park K., Vendruscolo M., Domany E.. Toward an energy function for the contact map representation of proteins. Proteins: Struct. Funct. Bioinform. 2000;40:237–248. doi: 10.1002/(SICI)1097-0134(20000801)40:2<237::AID-PROT60>3.0.CO;2-P. [DOI] [PubMed] [Google Scholar]
- Berrera M., Molinari H., Fogolari F.. Amino acid empirical contact energy definitions for fold recognition in the space of contact maps. BMC Bioinf. 2003;4:8. doi: 10.1186/1471-2105-4-8. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kang P., Trizio E., Parrinello M.. Computing the committor with the committor to study the transition state ensemble. Nat. Comput. Sci. 2024;4:451–460. doi: 10.1038/s43588-024-00645-0. [DOI] [PubMed] [Google Scholar]
- Trizio E., Kang P., Parrinello M.. Everything everywhere all at once: a probability-based enhanced sampling approach to rare events. Nat. Comput. Sci. 2025;5:582–591. doi: 10.1038/s43588-025-00799-5. [DOI] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
Data Availability Statement
Code implementing the GDS protein-folding and MSM construction strategy described here can be found at https://github.com/HabershonLab/GDS-fold. This repository includes both Python scripts to run and analyze GDS simulations, as well as scripts to obtain the results plotted in the Figures above. The Anton MD data sets used for model construction were kindly provided by D. E. Shaw Research; further details can be found in ref .
