Abstract
The catalytic activity of enzymes is intricately determined by their amino acid sequences and assay conditions, particularly temperature. Navigating the complex interplay among sequence, temperature, and catalytic function is crucial for unlocking a multitude of enzyme applications. Machine learning has recently emerged as a tool for quantitative prediction of enzyme activity from protein sequences. Unfortunately, ML models designed to predict the comprehensive enzyme activity parameter, k cat/K m, from protein sequences are rare compared to those predicting k cat or K m alone. Combining both protein sequence and temperature as input features further challenges predictions; no current ML models capture the nonlinear relationship between k cat/K m and temperature for a protein sequence of interest. In this study, we developed a unique three-module ML framework that predicts β-glucosidase k cat/K m values based on protein sequence and temperature. Each module was designed to capture a distinct aspect of the interplay among protein sequence, temperature, and k cat/K m for β-glucosidase activity; when integrated, they formed an ML framework that maps the sequence and temperature spaces associated with β-glucosidase k cat/K m. This modular approach allowed for optimizations of ML models within each module, collectively achieving notable generalization performance when predicting temperature-dependent k cat/K m values for protein sequences not encountered during training. Our findings underscore the advantages of the three-module framework over traditional single-module methods, particularly by reducing prediction variability due to data splitting and mitigating overfitting. We anticipate that our multimodule ML framework will be directly applicable to other complex systems, enabling quantitative exploration of their property domains.
Keywords: enzyme, k cat/K m , machine learning, β-glucosidase


Introduction
Establishing sequence–function relationships is key to annotating and evolving enzymes for specific applications. In particular, catalytic functions are primarily considered in the search for enzymes suitable for specific applications. Unfortunately, interrogating the functional outcomes of enzymes across sequence variations is highly challenging due to the high dimensionality of sequence space. For example, there are 20320 possible sequence variations for enzymes with 320 amino acids, which is a typical size for bacterial proteins. Even enzymes with the same catalytic functions originate from a diverse range of species and vary in amino acid sequence, composition, and length. Besides the sequence space, functional landscapes of enzymes are also shaped by environmental factors (e.g., temperature). Thus, an intricate interplay between intrinsic and extrinsic factors is involved, as demonstrated with thermal adaptation of thermophilic, mesophilic, and psychrophilic enzymes.
Experimental exploration of an enzyme’s sequence space typically involves point mutations. Unfortunately, navigating nonlocal sequence space experimentally is highly resource-intensive. , Typical mutagenesis-based experiments utilize only a few mutational steps within a small region of latent sequence space. Functional evaluations within such narrow sequence spaces often fail to extrapolate when establishing sequence–function relationships due to the nonadditivity of functional mutations and/or epistatic mutational effects. , Instead, computational searches can efficiently map nonlocal sequence space, extending beyond the reach of experimental methods confined to local sequence space. , However, despite advances in computing protein stability, solubility, and expression levels, developing a computational tool for predicting the catalytic functions of enzymes remains challenging. This is due to the limited understanding of how an enzyme’s sequence impacts its catalytic function. Catalytic function involves complex multistep mechanisms and molecular interactions, which are encoded globally across the protein chain. , The catalytic function is also influenced by extrinsic factors, adding complexity to the prediction of sequence–function–environment relationships.
Over the past decades, machine learning (ML) has emerged as a computational tool for predicting structure, stability, solubility, and function of proteins. ,− Machine learning extracts rich information from raw inputs and provides a good estimate of the functional characteristics. Many ML models were constructed to predict protein functions from protein structures. , However, these structure-based ML approaches face challenges in accurately computing function-relevant conformational dynamics, which are crucial for the catalytic functions of enzymes, , from static structures. Even similarly structured enzymes often display very different enzyme activity. Instead, ML models trained on protein sequences and their functions can infer functional characteristics of unseen sequences without prior knowledge of the protein structures or the underlying molecular mechanisms. , Sequence-based ML models have been shown to determine epistatic interactions, classify protein families, assess protein stability, , and rationalize mutational effects on enzyme activity, enzyme enantioselectivity, and ligand binding affinity from protein sequences as inputs.
To fully utilize the wealth of information with minimal lab-to-lab variations, an ML model would significantly benefit from data on standardized parameters related to key catalytic activities (e.g., k cat, K m, and k cat/K m). Compared to k cat and K m, k cat/K m offers the most comprehensive enzymatic information and serves as a standardized measure of catalytic proficiency. , Unfortunately, ML models for k cat/K m prediction from protein sequence are rare, compared to those for k cat or K m, − likely due to the smaller dataset and the more complex nature of k cat/K m. , Additionally, using separate ML models to estimate k cat and K m individually for calculating the k cat/K m ratio introduces inaccuracies due to error propagation. A previous k cat/K m ML model (named as the UniKP model) was built on a dataset comprising 910 entries curated from the public database, which covers various combinations of enzyme sequences, substrate structures, and their corresponding k cat/K m values. This k cat/K m ML model achieved a coefficient of determination (R 2) of 0.65 when the validation sets contained a number of protein sequences that overlapped with those in the training set. Later, another ML model predicting k cat/K m through transfer learning from k cat and K m models (named as the EITLEM-Kinetics model) was developed using a larger dataset (N = 13 388). This model achieved an R 2 of 0.519 when evaluated on validation sets with no overlapping entries from the training sets used for the k cat and K m models. The R 2 of this model increased to 0.680 after eight iterations of transfer learning among the k cat, K m, and k cat/K m models. CataPro achieved a Pearson correlation coefficient (PCC) of 0.41 in predicting k cat/K m, through transfer learning from its k cat and K m models.
Since environmental conditions (extrinsic factors) often impact catalytic activity more than sequence variations (intrinsic factors), training ML models with both is crucial for accurate functional annotation. Regarding the extrinsic factors, temperature is one of the most significant parameters, as it can change k cat/K m by several orders of magnitude. Additionally, enzyme processes are often carried out at nonoptimum temperatures due to the various advantages (e.g., increased substrate solubility at high temperatures and reduced enzyme aggregation at low temperatures). , Unfortunately, most ML models for k cat, K m, or k cat/K m prediction were built on data measured at a single temperature, limiting their applications. The EF-UniKP model, a derivative of the UniKP model, incorporates temperature as an additional feature for k cat prediction. However, accurately predicting both k cat and its temperature dependency has proven to be highly challenging: the R 2 for the temperature-dependent k cat prediction was 0.38 on the validation set, which further decreased to 0.31 on a subset of validation set that contained either protein sequence or substrate not present in the training set. Additionally, it remains unclear whether this ML model can predict a complete, nonlinear k cat–temperature profile.
In the study presented here, we report on the construction of a three-module ML framework that collectively predicts k cat/K m values as target regression variables from protein sequences and temperature as input variables. To better capture sequence and temperature spaces for specific functions, our model leverages smaller, specifically curated datasets from multiple sources, including literature, public databases, and our own experiments. This contrasts with broad-coverage models trained on large, functionally unrelated protein sequences from public databases, where the scarcity of k cat/K m–temperature data makes accurate modeling challenging. Our ML framework was specifically developed for β-glucosidase (BGL), one of the largest glycoside hydrolase families, as a model enzyme family. Our ML framework consisted of three independent ML modules for predicting (1) the optimum temperature (T opt), (2) k cat/K m at T opt (k cat/K m,max), and (3) the normalized k cat/K m at temperatures relative to T opt (referred to as a relative k cat/K m vs T profile). The ML models in each module showed high generalization performance with BGL sequences that were unseen during the training (R 2 ∼ 0.6–0.85). These three modules were then integrated under the framework for the task of predicting k cat/K m values as a function of the temperature for a protein sequence of interest. Our ML framework exhibited notable predictive performance with BGL sequences not seen during training, achieving an R 2 value of ∼0.38 for k cat/K m values across different temperatures and protein sequences. We also demonstrate that a complete, nonlinear k cat/K m vs temperature profile can be predicted using our ML framework for a given protein sequence. A traditional single-module ML model was constructed as a control using identical protein sequence representations, regression algorithms, and datasets. In comparison, the three-module ML framework provided more consistent prediction accuracy across different datasets while mitigating overfitting issues. Our results highlight that this unique three-module ML framework may serve as a valuable architecture for predicting highly complex catalytic variables across protein sequence and temperature spaces.
Results
Overview of the Three-Module ML Framework
Our three-module ML framework was designed to predict enzyme activity from the amino acid sequence and temperature as inputs. β-Glucosidase was chosen as a target enzyme activity for the ML framework, as this group of enzymes consists of proteins over a diverse sequence space, typically differing by up to hundreds of substitutions, deletions, and/or additions. Moreover, β-glucosidase plays key roles in various biotechnological sectors, including the biofuel, food, beverage, and pharmaceutical industries. Therefore, an ML-based activity prediction model for this enzyme would be highly valuable. An amino acid sequence was taken as a primary intrinsic parameter to determine the enzymatic activity (k cat/K m). Temperature can significantly influence enzymatic activity, often more so than sequence variations. Therefore, both the protein sequence and temperature were considered as input variables, with k cat/K m as the target regression variable. We did not include protein structure as an additional feature, as it does not necessarily improve prediction accuracy. The effect of pH was not considered, primarily because modulating enzyme activity in vitro is more commonly achieved through temperature adjustments than through pH changes.
Our ML framework consisted of three independent modules for machine learning: the first for predicting the optimum temperature (referred to as T opt), the second for predicting k cat/K m at T opt (referred to as k cat/K m,max), and the third for predicting the temperature dependence of k cat/K m relative to the k cat/K m,max at T opt (referred to as a relative k cat/K m vs T profile) (Figure ). For Modules 1 and 2 (i.e., the T opt and k cat/K m,max modules), the input feature was protein sequences. For Module 3 (i.e., the relative k cat/K m vs T profile module), the input features were protein sequences and temperatures, and the output features were normalized k cat/K m values at relative temperatures. Thus, each of the three modules was designed to learn about specific aspects of catalytic properties, collectively providing information about sequence- and temperature-dependent k cat/K m values. For Module 2, logarithmic transformation was applied to the k cat/K m,max values. As a control, we built a single-module framework using the same dataset.
1.
Overview of the three-model ML framework for prediction of k cat/K m from amino acid sequence and temperature. The ML models in each of the three modules were trained to learn specific aspects of catalytic properties. The first model predicts T opt, the second predicts k cat/K m,max, and the third predicts a relative k cat/K m vs T profile. When combined, the ML models in these three modules predict sequence- and temperature-dependent k cat/K m values.
For the ML models in each module, we employed several protein sequence representation methods to convert amino acid sequences of enzymes into numerical vectors as input features. These methods ranged from one-hot-encoding, BLOcks SUbstitution Matrix (e.g., BLOSUM45), and overlapping n-gram representations (where n = 1, 2, and 3) to ESM1b, one of the largest protein language models. , For Module 3, the components of each numerical vector representing an enzyme sequence were concatenated with the temperatures at which the k cat/K m values were determined. The resulting concatenated vector was subsequently used as an input feature. For these ML models, the various regression algorithms such as Least Absolute Shrinkage and Selection Operator (LASSO), Random Forest (RF), and Extreme Gradient Boosting (XGB) were used.
Dataset Construction
Our ML framework was created for β-glucosidase (BGL), an enzyme that hydrolyzes the β-1,4 glycosidic bond of cellobiose and small cellooligosaccharides. The scarcity of k cat/K m–temperature data in public databases containing functionally unrelated protein sequences makes accurate modeling challenging. To better capture sequence and temperature spaces for BGL activity, our model leverages smaller datasets curated from multiple sources (including literature, public databases, and our own experiments) targeted at BGLs from various organisms and biological kingdoms (Supporting Information, Tables S1 and S2 and Figure S1). Among the data reported with various BGL substrates, k cat/K m values measured with p-nitrophenyl β-d-glucopyranoside (pNP-Glc) were collected due to the abundance of available information.
From the entire dataset, a subset was created by listing each protein sequence along with the temperature at which its highest k cat/K m value was reported (Figure S2). This subset, referred to as the T opt dataset (N = 260), was used to construct and validate ML models for predicting T opt values from protein sequences. Another subset was compiled by listing each amino acid sequence and its highest k cat/K m value at T opt (Figure S2). This subset was used to build and validate ML models for predicting k cat/K m,max values from amino acid sequences and was referred to as the k cat/K m,max dataset (N = 260). For a BGL sequence with k cat/K m measured at a single temperature, the measured temperature was taken as T opt and the corresponding k cat/K m value was considered as k cat/K m,max for that sequence. Finally, the entire dataset was converted into one containing k cat/K m values normalized by k cat/K m,max for each protein sequence at temperatures relative to its T opt (referred to as the relative k cat/K m vs T profile dataset; N = 885; Figure S2). This converted dataset was used to develop and validate ML models for predicting relative k cat/K m vs T profiles from protein sequences and temperatures.
Evaluation of the Predictive Power of ML Models in Each Module on Unseen Sequences
To evaluate the robustness of models in each module of the framework, we conducted 5-fold cross-validation on the entire T opt, k cat/K m,max, and relative k cat/K m vs T profile datasets, for all tested combinations of sequence representations and regression algorithms (Figure ). It should be noted that the data entries in the T opt, k cat/K m,max, and relative k cat/K m vs T profile datasets were divided by protein sequence during 5-fold cross-validation (Figure S2). Thus, random splitting of these datasets in this manner during 5-fold cross-validation ensured no overlap in protein sequences between the training and validation sets. This sequence-based data splitting allowed us to test the generalization power of our ML models in predicting T opt, k cat/K m,max, the relative k cat/K m vs T profile, and ultimately the temperature-dependent k cat/K m for sequences that were not seen during training.
2.
Evaluation of the prediction performance of various combinations of sequence representations and regression algorithms for (A) Module 1 (T opt), (B) Module 2 (k cat/K m,max), and (C) Module 3 (relative k cat/K m vs T profile) using 5-fold cross-validation. The coefficient of determination (R 2; blue bars) and the mean absolute error (MAE; red circles) calculated by using the validation sets are shown as the evaluation metrics. For each module, the top ten combinations of sequence representation methods and regression algorithms, ranked by R 2 values, are presented. The R 2 values of the ten ML models shown above for training ranged from (A) 0.94 to 0.99 for T opt, (B) 0.63 to 0.99 for k cat/K m,max, and (C) 0.97 to 0.99 for the relative k cat/K m vs T profile. The evaluation metric values shown here represent the average values from the 5-fold cross-validation. The error bars represent one standard deviation across the 5-fold cross-validation. The unit of MAE in (A) is °C, while it is dimensionless in (B) and (C). The sequence representation methods shown here include ESM1b, Bigram (Bi), One-Hot Encoder (OHE), Bag-of-Words (BoW), Fourgram (Four), Trigram (Tri), BLOSUM45 (B45), and BLOSUM62 (B62). The regression algorithms shown here include Random Forest (RF), LASSO (LA), Extreme Gradient Boosting (XGB), and Support Vector Regression (SVR).
Without any hyperparameter optimization, R 2 and MAE were calculated on the validation sets that contained no overlapping protein sequences with the training set for Modules 1, 2, and 3, and their averages and standard deviations were calculated over five folds. We did not perform hyperparameter optimization initially because the size of the entire dataset is relatively small. Previous studies showed that default hyperparameters can perform comparably to tuned ones, particularly when the tuning process is limited by a small dataset. , Thus, default hyperparameters were used for each algorithm in our study. The accuracies of our top models for each module are notable when judged by the R 2 values calculated using the validation sets (Figure ); R 2 for T opt prediction = 0.84 – 0.88, R 2 for k cat/K m,max prediction = 0.53 – 0.6, and R 2 for relative k cat/K m vs T prediction = 0.67 – 0.74. Our T opt models exhibited higher R 2 values than previously developed ML models for predicting T opt from protein sequences, including both BGL and non-BGL sequences (referred to as broad-coverage models; R 2 = 0.5, when calculated on the validation set). Our top ten T opt models generally showed lower accuracy for BGL sequences with T opt ≥ 50 °C (Figure S3A). This is possibly because of a slight bias in the training data distribution (N = 145 for T opt < 50 °C and N = 115 for T opt ≥ 50 °C in the whole dataset), difficulty in fully capturing the sequence characteristics of thermostable BGLs, and/or increased noise in high T opt data (e.g., resulting from enzyme denaturation). The top five k cat/K m,max models achieved R 2 ∼ 0.6, when measured on the validation sets. A fair comparison between our top k cat/K m,max models and broad-coverage models (e.g., UniKP, EITLEM-Kinetics, and CataPro), which predict a single representative, temperature-independent k cat/K m value from a protein sequence and a substrate, is difficult due to differences in dataset scope: for example, the broad-coverage models considered non-BGL sequences and non-pNP-Glc substrates, unlike ours. Instead, our comparison between the top k cat/K m,max models, and the broad-coverage models focused on BGL activity with pNP-Glc, using protein sequences from our BGL dataset. For the comparison, it was assumed that a representative, temperature-independent k cat/K m value for a BGL sequence in the broad coverage models corresponds to the k cat/K m,max value for the same sequence in our model. Notably, despite using a smaller dataset (N = 260), our top k cat/K m,max models outperformed the broad-coverage k cat/K m models (N = 910, 13 888, and 25 831), at least for BGL activity with pNP-Glc: the broad-coverage models showed R 2 < 0.3 and MAE > 1.00 (Table ), compared with R 2 ≥ 0.53 and MAE ≤ 0.78 for our k cat/K m,max models (Table and Figure B). The implication is that although some broad-coverage models achieved an R 2 of up to 0.68 across diverse enzymes and substrates, ,, they exhibited relatively lower accuracy within BGL-specific sequence space with pNP-Glc. Our top ten k cat/K m,max models generally perform better for BGL sequences with higher k cat/K m,max values (Figure S3B) despite the slightly smaller dataset size for this group (N = 142 for k cat/K m,max < 101.5 mM–1 s–1 and N = 118 for k cat/K m,max ≥ 101.5 mM–1 s–1). This is possibly due to an improved signal-to-noise ratio within this group and/or a model bias toward higher k cat/K m,max values. Our top models for each of the three modules consistently yielded strong performance during 5-fold cross-validation, with small to moderate standard deviations (Figure ). The implication is that our model performance was not significantly dependent on the data splitting for training and validation in each fold. Among the various methods for numerical representation of protein sequences, ESM1b and n-gram encoding were commonly used in the top models across all three modules. The sequence similarity-based BLOSUM matrices were frequently utilized in the top models for Modules 2 and 3. Among various regression algorithms, tree-based ensemble methods, such as Random Forest (RF) and Extreme Gradient Boosting (XGB), generally achieved a strong predictive performance across models for all three modules. Apart from tree-based algorithms, several top models in Module 1 utilized LASSO (LA), while those in Module 2 employed Support Vector Regression (SVR). Our additional analysis showed that five ML models outperformed sequence similarity-based geometric averaging for T opt prediction, while eight models demonstrated statistically superior performance for k cat/K m,max prediction, avoiding potential data leakage (Supporting Information and Figure S4).
1. Prediction Performance of Broad-Coverage Models on Representative, Temperature-Independent BGL k cat/K m Values with pNP-Glc from Protein Sequences in the k cat /K m,max Dataset, Compared with That of Our k cat /K m,max Models .
| R 2 | MAE | ||
|---|---|---|---|
| UniKP | 0.051183 | 1.221249 | |
| EITLEM-Kinetics | 0.194063 | 1.099578 | |
| CataPro | 0.273163 | 1.042840 | |
| Our k cat/K m,max model | ESM1b+RF | 0.596786 | 0.718245 |
| ESM1b+SVR | 0.565559 | 0.748908 |
RF: Random Forest. SVR: Support Vector Regression.
Evaluation of Model Performance across Various Sequence Characteristics
The top ML models for each of the three modules were further evaluated across various sequence characteristics. For this evaluation, the validation set was split into two subsets containing either wild-type or mutant sequences in each round of the sequence-based random data splitting. Generally, most models performed better for mutants than wild-type sequences (Figure A). Among others, the k cat/K m,max prediction for wild-type sequences was the least accurate (Figure A). The low accuracy likely resulted from the limited wild-type sequence data (N = 119) relative to the vast wild-type sequence space for mapping k cat/K m,max. On the other hand, although the mutant dataset was of a comparable size (N = 141), the predictions for mutants were highly accurate, likely due to the locally dense distribution of the mutant sequence space within our dataset.
3.

Prediction performance of the top ML models in each module on the validation subsets, created based on (A) wild-type versus mutant sequences and (B) maximum sequence identity. The R 2 value is presented as an evaluation metric, representing the average calculated from the validation sets across ten rounds of random data splitting by protein sequence. The sequence representation methods shown here include ESM1b, Bigram (Bi), One-Hot-Encoder (OHE), Bag-of-Words (BoW), Fourgram (Four), Trigram (Tri), BLOSUM45 (B45), and BLOSUM62 (B62). The regression algorithms shown here include Random Forest (RF), LASSO (LA), Extreme Gradient Boosting (XGB), and Support Vector Regression (SVR).
We also evaluated model performance using two different validation subsets split according to maximum sequence identity (SI) relative to the training set in each round of sequence-based random data splitting. The maximum SI of a protein sequence in the validation set was determined by the highest value among its pairwise sequence identities calculated with all protein sequences in the training dataset. Due to the sequence-based data splitting, the maximum SI of a protein sequence in the validation set is always less than 100%. Given that the maximum SIs of wild-type sequences are usually lower compared to mutant sequences, similar model performance was observed (Figure B): the prediction performance of the models was generally stronger when the maximum SIs between the target sequences in the validation set and the sequences in the training set were high (>80%), as observed with previous ML models for k cat. ,
Construction of the Three-Module ML Frameworks and Their Performance Comparison with the Single-Module ML Frameworks
The top 20 ML models in each of the three modules were combined for prediction of k cat/K m values and their temperature dependency from protein sequences. It should be noted that the ML models were trained individually as above and then integrated under the three-module framework. For the validation of the entire three-module ML framework, T opt and k cat/K m,max values for a protein sequence of interest were predicted by ML models in Modules 1 and 2, respectively, and then fed to the ML models in Module 3 to calculate k cat/K m values at other temperatures. The various ML model combinations were evaluated based on their R 2 values for predicting k cat/K m values at designated temperatures, calculated on the validation set in each round of the sequence-based random data splitting. The R 2 values for the 8000 combinations ranged from 0.106 to 0.377 (Table S3), with the top ten combinations achieving R 2 values of ≥0.375 (Figure A). All the top ten combinations outperformed the sequence similarity-based geometric averaging calculations (Figure A). Interestingly, while some of the top ten combinations included ML models that also ranked in the top ten individually, the remaining combinations utilized some ML models that did not rank in the top ten individually (Figures , S4, and 4A). This is presumably due to the complex interplay among the three modules in protein-sequence- and temperature-dependent k cat/K m prediction within the combined framework. Notably, ESM1b+SVR was exclusively used for the second module in all the top ten combinations (Figure A). This is likely due to its robust predictive performance, as it exhibited the smallest difference between R 2 values for training (=0.703) and validation (=0.566) among the top five k cat/K m,max models ranked individually (Figures and S4). In contrast, other sequence representation methods and regression algorithms were frequently used in the first and third modules among the top ten combinations. This suggests that our three-module framework enables model optimization within each module without being restricted to specific protein sequence representation methods or regression algorithms.
4.
(A) The R 2 values of the top ten ML model combinations within the three-module framework (blue) and the top ten ML models in the single-module framework (red). (B) Correlation between predicted and reported k cat/K m values across various protein sequences and temperatures, and (C–E) comparison of predicted (red) and reported (blue) k cat/K m values as a function of protein sequence and temperature. In (A), the labels of the ML models in Modules 1, 2, and 3 within the three-module framework (blue) are displayed from the top left to the bottom right, respectively. The ML models that did not rank in the top ten individually are underlined. The R 2 values shown in (A) represent the averages calculated from the validation sets across ten rounds of random data splitting by protein sequence, with error bars indicating one standard deviation. In (A), *: p < 0.05 from a two-sided Wilcoxon signed-rank test, compared to the sequence similarity-based geometric averaging calculations. In (B)–(E), ESM1b+XGB for Module 1, ESM1b+SVR for Module 2, and BoW+RF for Module 3 were used. For the illustrations in (B)–(E), the most representative validation dataset from the ten rounds of data splitting was selected, based on its R 2 value being closest to the average R 2 value calculated from the validation sets across the ten rounds. In (B), the RMSE, MAE, PCC, and p values were calculated from the most representative validation dataset. In (B), the red circles represent data for the two ancestral sequences. The sequence representation methods shown here include ESM1b, Bag-of-Words (BoW), BLOSUM45 (B45), Fourgram (Four), Trigram (Tri), BLOSUM62 (B62), Bigram (Bi), and OHE (One-Hot-Encoder). The regression algorithms shown here include Extreme Gradient Boosting (XGB), Support Vector Regression (SVR), Elastic Net Regression (ENR), Random Forest (RF), and Multilayer Perceptron (MLP).
To evaluate the merits of the three-module ML framework, single-module ML models were constructed as a control using the same protein sequence representations, regression algorithms, and dataset. These single-module ML models were designed to learn and predict protein sequence- and temperature-dependent k cat/K m values directly from the training data, without deconvoluting the three related aspects (i.e., T opt, k cat/K m max, and the relative k cat/K m vs T profile). The R 2 values of the top ten single-module ML models ranged from 0.303 to 0.394, calculated on the validation set in each round of the sequence-based random data splitting (Figure A). It should be noted that the prediction performance of the top ten single-module ML models depended on the data splitting more significantly than the top ten three-module ML combinations, when judged by the standard deviation of R 2 values (Figure A). Of the ten single-module ML models, only five outperformed the sequence similarity-based geometric averaging calculations (Figure A). Among others, the top two three-module ML frameworks and the top three single-module ML models, each with similar evaluation metric values (R 2, PCC, MAE, and root mean square error (RMSE)) for the validation sets, were selected for further comparison. Notably, the single-module models exhibited greater discrepancies in these metrics between training and validation (Tables S4 and S5). These comparisons highlight the strong potential of our three-module ML architecture in reducing data split dependence and mitigating the overfitting observed in single-module models. Additionally, when evaluated on subsets of the validation dataset, the top two three-module ML frameworks generally showed higher prediction accuracy for low-similarity sequences compared to the top three single-module ML models, as judged by the four evaluation metrics (Tables S6 and S7). The implication is that the three-module architecture may facilitate more effective navigation of the distant sequence space formed by BGLs with relatively low sequence similarity.
Protein Sequence- and Temperature-Dependent k cat/K m Prediction by the Three-Module ML Frameworks
The top two three-module combinations were characterized further for their protein sequence- and temperature-dependent k cat/K m predictions. The accuracy of the top two three-module ML frameworks is notable (Table S4), considering that the RMSE of experimental log k cat/K m values is generally around 1. When the predicted values from the top two combinations were compared with the reported values, the k cat/K m predictions were found to be reasonable, spanning several orders of magnitude across a range of protein sequences and temperatures (Figures B and S5). The prediction errors were generally higher at both low and high reported k cat/K m values for the top two combinations (Figures B and S5), presumably due to the limited data available in these categories. Additionally, the observed trend of overestimating lower k cat/K m values and underestimating higher ones may result from regression dilution, a common statistical effect in which noise in the input features flattens the slope of the correlation between predicted and true target values. To explore whether prediction accuracy could be further improved, hyperparameter tuning was performed on the ML models in the top two three-module combinations. Although tuning may help build individual models with minimal overfitting, it led to only modest or no improvement in the performance of the individual modules as well as in the overall combined framework (Supporting Information and Figure S6).
For some BGL sequences, the k cat/K m vs temperature profiles generated from the top two three-module ML frameworks were largely in good agreement with those reported (Figures C, S7, and S8). For certain BGL sequences, the predicted k cat/K m vs temperature profiles were notably shifted compared to the reported profiles, despite their similar shapes and comparable k cat/K m values (Figures D, S7, and S8). This discrepancy is primarily due to inaccuracies in the T opt predictions by the ML model in Module 1. In some cases, although the predicted and reported profiles had similar shapes, the magnitudes of the k cat/K m values differed substantially (Figures S7 and S8). In other cases, the optimum temperatures, profile shapes, and magnitudes of the k cat/K m values all differed substantially (Figures E, S7, and S8). This discrepancy is likely due to error propagation across the three models within the three-module framework. It should also be noted that model combinations should be carefully evaluated for selection rather than relying solely on evaluation metrics (e.g., R 2). For example, the top third and fourth combinations (i.e., BoW+RF for Module 1, ESM1b+SVR for Module 2, and Four or Tri+ENR for Module 3) predicted the relationship between k cat/K m and temperature linearly, failing to capture the nonlinear trend (Figures S9 and S10). In these combinations, where errors occurred in the prediction of k cat/K m,max from ESM1b+SVR in Module 2, the ENR algorithm in Module 3 produced negative linear trends in relative activity for the overall fitting of k cat/K m values.
Testing of the Three-Module ML Frameworks with Ancestral BGL Sequences
To further evaluate whether our three-module ML frameworks generalize well to unseen sequences beyond our original dataset, we tested the three-module ML frameworks using BGL sequences that have not been identified. To generate novel sequences that are likely to possess BGL activity and share some similarity with the BGL sequences in the original dataset, we utilized phylogenetic analysis. Among various BGLs, we constructed a phylogenetic tree involving a highly stable and well-expressed BGL from Pyrococcus furiosus (PfBGL) (Figure S11). This is because this protein can tolerate multiple potentially destabilizing mutations, , which increases the likelihood of generating functional ancestral sequences that are both well-folded and highly expressible. Among several ancestral sequences identified by this analysis, those at Nodes 13 and 15 were selected for further characterization (Figure S11). This is because these two ancestral sequences contain the “NEP” and “TENG” sequence motifs (Figure S12), which are known to be highly conserved among many BGLs. Moreover, these two ancestral sequences have a pairwise sequence identity (SI) of ∼ 80–90% with PfBGL (Table S8), a range where our ML model predictions were relatively accurate (see Figure B and Table S6). The two ancestral sequences also exhibit a similar SI to Thermococcus pacificus β-glucosidase (TpBGL) (Table S8), which was also included in our dataset (Table S1). Compared to PfBGL and TpBGL, these ancestral sequences contain ∼60–80 mutations, which are much higher than the numbers typically introduced during conventional mutagenesis experiments. The two ancestral sequences were expressed in Escherichia coli, purified using a His-tag, and their enzyme activity (k cat/K m) was measured with pNP-Glc at three different temperatures. Notably, the top two three-module ML frameworks described above, which were trained on the original dataset not containing any ancestral sequences, predicted the k cat/K m values of the two ancestral sequences in a temperature dependent manner with reasonable errors (i.e., within an order of magnitude; see red circles in Figures B and S5). Thus, our three-module ML framework demonstrates the generalization power beyond the BGL sequences in the original dataset.
Discussion
In this study, we constructed a unique three-module ML framework that collectively predicts β-glucosidase k cat/K m values as target regression variables based on the protein sequence and temperature. Each module in the framework was designed to capture different aspects of the interplay among protein sequence, temperature, and k cat/K m for β-glucosidase activity. The models within these modules work in concert to predict protein-sequence- and temperature-dependent k cat/K m values, focusing on the functional sequence space for β-glucosidase activity. The modular structure of this framework allows for the optimization of ML models within each of the three modules, collectively offering notable generalization performance in predicting temperature-dependent k cat/K m values for BGL sequences that are unseen during training. No existing ML model predicts k cat/K m as a nonlinear function of temperature, making our approach unique. Our results also highlight the advantages of the three-module ML framework over the conventional single-module approach, particularly in mitigating prediction performance variability due to data splitting and reducing overfitting.
We anticipate that our multimodule ML framework approach can be directly applied to other enzyme systems, facilitating comprehensive functional annotation of proteins for various applications. However, the generalizability of the three-module ML framework depends on several key factors, including the availability of diverse sequence–k cat/K m datasets on a common substrate and k cat/K m data across a broad temperature range. Additional considerations, such as the presence or absence of cofactors or the influence of pH, may also be necessary if enzyme activity is strongly dependent on these biochemical factors. When successfully applied to other protein systems (particularly those where ML models in the top-performing combinations use sequence representations with physically meaningful or biologically interpretable features), feature importance or SHapley Additive exPlanations (SHAP) analysis may offer valuable insights into the key features underlying various aspects of enzymatic properties. Unfortunately, this was not feasible in our current study because the models in the top-performing three-module combinations generally used ESM-1b or BoW in Modules 1 and 2. These representations lack physical or biological interpretability: ESM-1b embeddings are abstract, and BoW ignores context and position. , Although alternative representations were used in Module 3 of the top-performing combinations, its output is the relative k cat/K m–temperature profile shape, which also limits the usefulness of feature importance or SHAP analysis. Beyond enzyme systems, a similar multi-module ML framework approach could be applied for other types of data involving temporal or spatial progression, where one module could predict initial data while another could model its temporal or spatial evolution.
An ML model for accurately predicting k cat/K m values is very useful, as this ratio serves as a measure of catalytic efficiency for direct comparisons across different enzymes. K m is often considered an indicator of the binding affinity between an enzyme and its substrate and might be determined from theoretical thermodynamic calculations by using enzyme and substrate structures for their binding. While this interpretation is acceptable in some cases, it is not valid for many other enzymes, for example, which form multiple complexes with substrates, both noncovalently and covalently. A similar complication is realized with k cat; k cat is a combination of multiple rate constants when a covalent enzyme–substrate complex is formed during catalysis. A previous machine learning model has demonstrated the ability to predict k cat values using active site information, metabolite concentrations, and metabolic flux calculations; however, such data are often available only for a limited number of enzymes. , While conformational dynamics around the active site provide valuable insights into enzyme activity, computational tools that directly capture the relationships between conformations and the chemical steps of catalysis remain scarce. For the previous ML models for k cat, K m, and k cat/K m, the prediction of k cat/K m is less accurate than k cat or K m alone. , Even when k cat and K m are individually predicted with reasonable accuracy, the errors are propagated when their ratio is taken to compute the k cat/K m value. Therefore, an ML model with high prediction accuracy for k cat/K m from the protein sequence as an input would be highly valuable. Importantly, k cat/K m is a function of environmental factors as well; for example, temperature itself can vary k cat/K m by several orders of magnitudes. While empirical rules, such as the Q10 rule, can estimate the increasing trend of k cat/K m with rising temperature to some extent, they do not fully capture the complete k cat/K m vs T profile. Instead, this profile is shaped by a complex balance of kinetic and thermodynamic factors. ,, Unfortunately, accurately predicting the temperature dependence of a standardized enzyme activity parameter remains highly challenging: the EF-UniKP model achieved an R 2 value of 0.31 for temperature-dependent k cat predictions on a validation set, in which either a protein sequence or a substrate did not overlap with those in the training set. Moreover, it is unclear whether the EF-UniKP model can predict nonlinear activity–temperature profiles around the optimal temperature. In contrast, our top two ML model combinations within the three-module framework achieved an R 2 value of ∼0.38 on validation sets containing protein sequences not seen during training and can generate the k cat/K m profiles as a function of the temperature for a BGL sequence of interest. Unfortunately, direct comparisons between the EF-UniKP model and our ML framework are difficult due to differences in data nature and scope (e.g., for BGL-specific k cat/K m vs broad range k cat predictions). Nevertheless, we anticipate that our ML framework would likely outperform other models in quantitatively predicting enzyme activity from protein sequence and temperature, at least for BGL activity with pNP-Glc. This expectation is based on our finding that these models produced relatively inaccurate predictions of BGL k cat/K m values with pNP-Glc, and on the observation that incorporating temperature as an additional feature, beyond sequence, further complicates prediction. Overall, our results suggest that the three-module ML framework could serve as a facile platform for predicting the enzyme activity and its temperature dependence.
Interestingly, despite using a smaller dataset, our top individual ML models, when evaluated independently of the three-module framework, appeared to achieve evaluation metrics that were higher than previous ML models. For example, our top ML models for predicting T opt (N = 260) achieved an R 2 of 0.84–0.88 calculated from the validation sets. In comparison, the broad-coverage models (N > 2600), designed to predict T opt for any protein sequences, showed an R 2 = 0.5 on the validation set. Our top k cat/K m, max models (N = 260) achieved R values of ∼0.6 on the validation sets, outperforming the broad-coverage k cat/K m models (N ≥ 910) with R 2 < 0.3, at least for BGL activity with pNP-Glc. As noted earlier, a fair comparison between our T opt and k cat/K m,max models, and the broad-coverage models is challenging. This is because our models were built on a smaller, specific subset of protein sequences known to exhibit BGL activity with pNP-Glc, whereas the broad-coverage ML models were trained on larger datasets containing a wide variety of proteins and substrates curated in public databases. ,,, Importantly, in these public databases, only a small amount of catalytic data is available for specific enzyme groups, which may limit machine learning in predicting specific enzyme activity. For example, while BRENDA contains data on 8475 different EC numbers, the average number of data entries per EC number is only 10.2 (=86517/8475) for k cat, 20.2 (=170819/8475) for K m , and 4.6 (=39008/8475) for k cat/K m , as of March 2025. These numbers decrease further when a specific substrate is selected. In contrast, our BGL dataset contains 885 entries with pNP-Glc as a substrate, including 260 unique BGL sequences, curated from multiple sources. Thus, our dataset offers a more focused resource, facilitating machine learning within a specific functional sequence space. The implication is that prediction accuracy could be improved by adjusting coverage, as evidenced by the well-documented trade-off between accuracy and coverage in machine learning. ,
Predictive models that perform well on enzyme sequences absent from the training dataset must have learned generalizable information encoded in latent spaces. To assess this generalizability, we split the data by protein sequence for training and validation, ensuring that no data entries with the same protein sequence appeared in both sets. This approach is particularly crucial for evaluating the combined three-module framework’s ability to predict temperature-dependent k cat/K m values for a protein sequence of interest. In sequence-blinded data splitting, data entries for the same amino acid sequence at different temperatures may be distributed across both the training and the validation sets. When k cat/K m data for a given sequence at a specific temperature is included in the training set, predicting k cat/K m values at other temperatures for the same sequence becomes relatively straightforward. In contrast, data splitting by protein sequence prevents such overlaps, allowing for a rigorous assessment of the model’s predictive performance. Our ML models and their combinations demonstrated reasonable predictive power for k cat/K m, not only for BGL sequences excluded from training but also for ancestral protein sequences generated through phylogenetic analysis. This suggests that our ML models and their combinations successfully captured, at least to some extent, generalizable protein sequence attributes that determine the catalytic activity of BGLs in a temperature dependent manner.
Sequence–function–temperature relationships are highly convoluted, making it challenging to develop a computational tool for accurate prediction. While our three-module ML framework demonstrates non-negligible predictive power, further improvements are needed to enhance its accuracy. For example, both our individual ML models and their combinations within the three-module framework exhibited considerably weaker predictive power for wild-type sequences compared with mutant sequences. The inclusion of BGL mutant data in our dataset helped our ML models capture the characteristics of specific regions within narrow sequence spaces. Unfortunately, learning the local sequence space does not necessarily contribute to learning the broader, nonlocal BGL sequence space. A similar limitation in learning the wild-type sequence space was also observed in the previous ML models for k cat prediction. , Given the relatively lower degree of sequence similarity among wild-type BGL sequences compared to mutant BGL sequences, the sequence space occupied by wild-type BGLs is significantly larger than that of mutant BGLs. However, the ability of our ML models to learn the wild-type BGL sequence space is limited by the small number of wild-type data, which are just comparable in size to the mutant dataset. It should also be noted that the predictive power of our three-module ML framework is generally weaker for both high and low k cat/K m values, presumably due to the smaller amount of data in these ranges. The development of more precise ML models and frameworks will undoubtedly benefit from a larger dataset encompassing wild-type BGL enzymes and their mutants across a diverse sequence and activity space. Functional characterizations under various conditions in genomic and metagenomic studies will be especially valuable as these efforts are likely to uncover novel and uncharacterized BGL sequences that may encode catalytic activities. Additionally, incorporating negative data (a set of protein sequences that exhibit no BGL activity) into the learning process could further improve machine learning of the functional landscape and the detection of higher-order relationships across sequences. Several computational strategies could also be considered to expand the effective dataset size. For example, data augmentation through in silico labeling of protein sequences using catalytic information could help enrich the training set. Semisupervised learning methods, which may leverage both labeled k cat/K m data and unlabeled protein sequence data, could also enhance learning from the limited labeled data. Transfer learning from related datasets may improve generalization without requiring large-scale labeled data. Collectively, these efforts will extend the boundaries of knowledge in functional sequence space, ultimately aiding in the development of more accurate ML models and frameworks for precise sequence-function-temperature mapping.
To further improve the prediction accuracy, it is worth considering the evaluation of newly developed protein sequence representation methods. Our ML models in the top-performing three-module combinations, particularly in Modules 1 and 2, utilized ESM-1b. Therefore, ESM-2 is of particular interest, as it has been shown to outperform ESM-1b and other pretrained protein language models through improvements in architecture, training strategies, and the scale of training data. A more systematic evaluation of different sequence representation methods (such as those benchmarked in the Tasks Assessing Protein Embeddings (TAPE)) could help identify the most promising approaches for enhancing predictive performance. In addition, incorporating features beyond protein sequences may also be beneficial. For example, structural features derived from contact maps of protein 3D structures enhanced k cat prediction in DeepEnzyme, particularly for enzymes with low sequence similarity, although similar considerations have not consistently improved accuracy in other studies. Refining regression algorithms (such as modifying ensemble strategies in gradient boosting, as done in Enzyme Catalytic Efficiency Prediction) may also contribute to better performance. More sophisticated learning approaches, such as deep neural networks, are effective at capturing complex nonlinear patterns but were not feasible in our study due to the risk of overfitting with the small sample size. Instead, we employed simpler models with fewer parameters, which are better suited for limited datasets. However, as more k cat/K m data become available, these advanced model architectures may be explored to further enhance the prediction accuracy.
Materials and Methods
Dataset Preparation
Catalytic efficiencies (k cat/K m) of β-glucosidases and temperatures at which their k cat/K m values were measured were manually compiled from relevant sources with protein sequence information extracted from reported accession numbers through GenBank and UniProt databases. The k cat/K m values and assay temperatures archived in BRENDA were reviewed and updated with the linked references as necessary. Some literature reports a k cat/K m value at a specific temperature, along with enzyme activity data at other temperatures measured at a fixed substrate concentration. In such cases, k cat/K m values at the additional temperatures were estimated using the reported reference k cat/K m value and the activity–temperature relationship measured at the fixed substrate concentration. These estimated values were included in our dataset. To establish an approximate normal distribution, log10 transformations were applied to the k cat/K m values. To minimize noise and errors in the data and improve model performance, outliers in the collected k cat/K m values were removed based on the interquartile range of the datasets, as described elsewhere. Consequently, data points with k cat/K m values of <10–2 and >105 mM–1 s–1 were excluded, as these values fall outside the typical range for most enzymes.
From the entire dataset constructed in this manner, a subset was created by selecting each protein sequence and its corresponding temperature at which the highest k cat/K m value was observed. This subset was used to construct and validate ML models for predicting the optimal temperature (T opt) from protein sequences. Similarly, another subset of the entire dataset was generated by selecting each protein sequence along with the highest k cat/K m value at its corresponding T opt. This subset was used for the construction and validation of the ML models for predicting the maximum k cat/K m (k cat/K m,max) from protein sequences. For a protein sequence with a single k cat/K m value measured at a specific temperature, these values were directly assigned as k cat/K m,max and T opt, respectively, for the sequence. Lastly, the entire dataset was transformed by normalizing k cat/K m values by k cat/K m,max for each protein sequence at temperatures relative to its T opt. The resulting dataset was used to develop and validate ML models for predicting relative k cat/K m vs T profiles from protein sequences and temperatures.
Enzyme Sequence Representation
Various methods were employed to represent protein sequences numerically, including ESM1b, one-hot-encoding, bag of words, n-gram (a string of n consecutive amino acids; n = 2, 3, and 4), and BLOSUM scoring matrices (BLOSUM45 and BLOSUM62). For protein sequence representations using BLOSUM scoring matrices, amino acid sequences were aligned using a multiple sequence alignment tool, CustalW.
Regression Algorithms
Various regression algorithms were utilized during the ML model constructions, such as linear regression, the Least Absolute Shrinkage and Selection Operator (LASSO), decision tree, Random Forest (RF), Support Vector Regression (SVR), Multi-Layer Perceptron (MLP), Elastic Net Regression (ENR), and Extreme Gradient Boosting regression (XGB).
5-Fold Cross-Validation
The ML models were constructed by combining each enzyme sequence representation method with various regression algorithms. Their performance and robustness were evaluated through 5-fold cross-validation on the entire dataset, with 80% of the data entries selected as the training set and the remaining 20% as the validation set. During data splitting, entries were divided by protein sequences to ensure that there were no protein sequence overlaps between the training and validation sets. For each ML model, the average R 2 and MAE values were calculated across five validation sets, one for each fold.
Model Training and Validation during 10 Rounds of Random Sequence-Based Data Splitting
To thoroughly evaluate the performance of selected ML models and their combinations, ten rounds of random data splitting for training and validation were performed. In each round, the entire dataset was randomly partitioned into five subsets based on protein sequences, with 80% used for training and the remaining 20% for validation. This data splitting process was independent of the 5-fold cross-validation while ensuring that no identical protein sequences were present in both the training and validation sets. For model performance evaluation using a subset of validation sets based on sequence identity, sequence identity was calculated by aligning each pair of sequences with the pairwise2 module from the Biopython library.
Statistical Analysis
A two-sided Wilcoxon signed-rank test was employed to examine if the differences in performance between the ML models and frameworks, and the sequence similarity-based geometric averaging calculations were statistically significant. A correlation between the reported and predicted values was statistically examined by calculating the p values and Pearson correlation coefficient (PCC) using the SciPy library in Python.
Benchmarking UniKP, EITLEM-Kinetics, and CataPro on the k cat/K m,max Datasets
We benchmarked our k cat /K m, max predictions against UniKP, EITLEM-Kinetics, and CataPro using our BGL dataset. Representative, temperature-independent BGL k cat/K m values were obtained by inputting protein sequences from our k cat /K m,max dataset into these models, using pNP-Glc as the substrate. For UniKP, the models were downloaded from the official GitHub repository (https://github.com/Luo-SynBioLab/UniKP) and executed with the default settings provided by the authors. EITLEM-Kinetics was run through its publicly available Python package (https://github.com/XvesS/EITLEM-Kinetics) with default hyperparameters and without additional optimization. CataPro predictions were obtained using the command-line tool available at https://github.com/zchwang/CataPro, with the standard configuration and no parameter tuning. All models were run in accordance with the protocols recommended in their respective GitHub repositories. The performance of UniKP, EITLEM-Kinetics, and CataPro was evaluated by using R 2 and MAE between reported and predicted values across all 260 BGL sequences.
Supplementary Material
Acknowledgments
This project was supported by grants from the Korea Evaluation Institute of Industrial Technology (Project KEIT/MOTIE-20008416) and the New York University Research Catalyst Grant.
Glossary
Abbreviations
- BGL
β-glucosidase
- Bi
bigram
- BLOSUM
blocks substitution matrix
- BoW
bag-of-words
- B45
BLOSUM45
- B62
BLOSUM62
- ENR
elastic net regression
- Four
fourgram
- k cat/K m,max
k cat/K m at T opt
- k cat/K m vs T
k cat/K m vs temperature
- LA
LASSO
- LASSO
least absolute shrinkage and selection operator
- MAE
mean absolute error
- ML
machine learning
- MLP
multilayer perceptron
- OHE
one-hot-encoder
- PCC
Pearson correlation coefficient
- PfBGL
Pyrococcus furiosus β-glucosidase
- pNP-Glc
p-nitrophenyl β-d-glucopyranoside
- RF
random forest
- RMSE
root-mean-square error
- R 2
coefficient of determination
- SI
sequence identity
- SVR
support vector regression
- T opt
optimum temperature
- TpBGL
Thermococcus pacificus β-glucosidase
- Tri
trigram
- XGB
extreme gradient boosting
The datasets, scripts, and code for the ML models and their combinations described in this study are publicly available at https://github.com/emreerkanli/BGL-kcatKm-predictor.
The Supporting Information is available free of charge at https://pubs.acs.org/doi/10.1021/acssynbio.5c00257.
Data on β-glucosidases (XLSX)
Descriptions of data collection, sequence similarity-based geometric averaging calculations, hyperparameter tuning, experimental reagents, ancestral sequence reconstruction, the expression and purification of Pyrococcus furiosus and Thermoanaerobacterium aotearoense β-glucosidase mutants, enzyme assays, and other tables and figures (PDF)
M.E.E designed research, performed research, contributed new reagents/analytic tools, analyzed data, and wrote the paper. Y.J. designed research, performed research, contributed new reagents/analytic tools, and analyzed data. A.M. performed research, contributed new reagents/analytic tools, analyzed data, and wrote the paper. K.E-H. performed research. C.R. performed research. J.R.K designed research, analyzed data, and wrote the paper. All authors approved the manuscript for publication.
The authors declare the following competing financial interest(s): A provisional patent application has been submitted based on the work described in this manuscript.
References
- Liao J., Warmuth M. K., Govindarajan S., Ness J. E., Wang R. P., Gustafsson C., Minshull J.. Engineering proteinase K using machine learning and synthetic genes. BMC Biotechnol. 2007;7:16. doi: 10.1186/1472-6750-7-16. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Pavlopoulos G. A., Baltoumas F. A., Liu S., Selvitopi O., Camargo A. P., Nayfach S., Azad A., Roux S., Call L., Ivanova N. N.. et al. Unraveling the functional dark matter through global metagenomics. Nature. 2023;622(7983):594–602. doi: 10.1038/s41586-023-06583-7. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Tiessen A., Perez-Rodriguez P., Delaye-Arredondo L. J.. Mathematical modeling and comparison of protein size distribution in different plant, animal, fungal and microbial species reveals a negative correlation between protein size and protein number, thus providing insight into the evolution of proteomes. BMC Res. Notes. 2012;5:85. doi: 10.1186/1756-0500-5-85. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Wintrode P. L., Arnold F. H.. Temperature adaptation of enzymes: lessons from laboratory evolution. Adv. Protein Chem. 2001;55:161–225. doi: 10.1016/S0065-3233(01)55004-4. [DOI] [PubMed] [Google Scholar]
- Elias M., Wieczorek G., Rosenne S., Tawfik D. S.. The universality of enzymatic rate-temperature dependency. Trends Biochem. Sci. 2014;39(1):1–7. doi: 10.1016/j.tibs.2013.11.001. [DOI] [PubMed] [Google Scholar]
- Alley E. C., Khimulya G., Biswas S., AlQuraishi M., Church G. M.. Unified rational protein engineering with sequence-based deep representation learning. Nat. Methods. 2019;16(12):1315–1322. doi: 10.1038/s41592-019-0598-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Yang K. K., Wu Z., Bedbrook C. N., Arnold F. H.. Learned protein embeddings for machine learning. Bioinformatics. 2018;34(15):2642–2648. doi: 10.1093/bioinformatics/bty178. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kitzman J. O., Starita L. M., Lo R. S., Fields S., Shendure J.. Massively parallel single-amino-acid mutagenesis. Nat. Methods. 2015;12(3):203–206. doi: 10.1038/nmeth.3223. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Riesselman A. J., Ingraham J. B., Marks D. S.. Deep generative models of genetic variation capture the effects of mutations. Nat. Methods. 2018;15(10):816–822. doi: 10.1038/s41592-018-0138-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Phillips P. C.. Epistasis - the essential role of gene interactions in the structure and evolution of genetic systems. Nat. Rev. Genet. 2008;9(11):855–867. doi: 10.1038/nrg2452. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Reetz M. T.. The importance of additive and non-additive mutational effects in protein engineering. Angew. Chem., Int. Ed. 2013;52(10):2658–2666. doi: 10.1002/anie.201207842. [DOI] [PubMed] [Google Scholar]
- Clifton B. E., Kozome D., Laurino P.. Efficient Exploration of Sequence Space by Sequence-Guided Protein Engineering and Design. Biochemistry. 2023;62(2):210–220. doi: 10.1021/acs.biochem.1c00757. [DOI] [PubMed] [Google Scholar]
- Marshall L. R., Bhattacharya S., Korendovych I. V.. Fishing for Catalysis: Experimental Approaches to Narrowing Search Space in Directed Evolution of Enzymes. JACS Au. 2023;3(9):2402–2412. doi: 10.1021/jacsau.3c00315. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Frushicheva M. P., Cao J., Chu Z. T., Warshel A.. Exploring challenges in rational enzyme design by simulating the catalysis in artificial kemp eliminase. Proc. Natl. Acad. Sci. U. S. A. 2010;107(39):16869–16874. doi: 10.1073/pnas.1010381107. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Lee J., Goodey N. M.. Catalytic contributions from remote regions of enzyme structure. Chem. Rev. 2011;111(12):7595–7624. doi: 10.1021/cr100042n. [DOI] [PubMed] [Google Scholar]
- Wrenbeck E. E., Azouz L. R., Whitehead T. A.. Single-mutation fitness landscapes for an enzyme on multiple substrates reveal specificity is globally encoded. Nat. Commun. 2017;8:15695. doi: 10.1038/ncomms15695. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Damborsky J., Brezovsky J.. Computational tools for designing and engineering biocatalysts. Curr. Opin Chem. Biol. 2009;13(1):26–34. doi: 10.1016/j.cbpa.2009.02.021. [DOI] [PubMed] [Google Scholar]
- Fox R. J., Davis S. C., Mundorff E. C., Newman L. M., Gavrilovic V., Ma S. K., Chung L. M., Ching C., Tam S., Muley S.. et al. Improving catalytic function by ProSAR-driven enzyme evolution. Nat. Biotechnol. 2007;25(3):338–344. doi: 10.1038/nbt1286. [DOI] [PubMed] [Google Scholar]
- Pucci F., Schwersensky M., Rooman M.. Artificial intelligence challenges for predicting the impact of mutations on protein stability. Curr. Opin Struct Biol. 2022;72:161–168. doi: 10.1016/j.sbi.2021.11.001. [DOI] [PubMed] [Google Scholar]
- Musil M., Konegger H., Hon J., Bednar D., Damborsky J.. Computational Design of Stable and Soluble Biocatalysts. ACS Catal. 2019;9(2):1033–1054. doi: 10.1021/acscatal.8b03613. [DOI] [Google Scholar]
- Li G., Rabe K. S., Nielsen J., Engqvist M. K. M.. Machine Learning Applied to Predicting Microorganism Growth Temperatures and Enzyme Catalytic Optima. ACS Synth. Biol. 2019;8(6):1411–1420. doi: 10.1021/acssynbio.9b00099. [DOI] [PubMed] [Google Scholar]
- Jumper J., Evans R., Pritzel A., Green T., Figurnov M., Ronneberger O., Tunyasuvunakool K., Bates R., Zidek A., Potapenko A.. et al. Highly accurate protein structure prediction with AlphaFold. Nature. 2021;596(7873):583–589. doi: 10.1038/s41586-021-03819-2. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Lu H., Diaz D. J., Czarnecki N. J., Zhu C., Kim W., Shroff R., Acosta D. J., Alexander B. R., Cole H. O., Zhang Y.. et al. Machine learning-aided engineering of hydrolases for PET depolymerization. Nature. 2022;604(7907):662–667. doi: 10.1038/s41586-022-04599-z. [DOI] [PubMed] [Google Scholar]
- Durairaj J., de Ridder D., van Dijk A. D. J.. Beyond sequence: Structure-based machine learning. Comput. Struct Biotechnol J. 2023;21:630–643. doi: 10.1016/j.csbj.2022.12.039. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Nagel Z. D., Dong M., Bahnson B. J., Klinman J. P.. Impaired protein conformational landscapes as revealed in anomalous Arrhenius prefactors. Proc. Natl. Acad. Sci. U. S. A. 2011;108(26):10520–10525. doi: 10.1073/pnas.1104989108. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kaczmarski J. A., Mahawaththa M. C., Feintuch A., Clifton B. E., Adams L. A., Goldfarb D., Otting G., Jackson C. J.. Altered conformational sampling along an evolutionary trajectory changes the catalytic activity of an enzyme. Nat. Commun. 2020;11(1):5945. doi: 10.1038/s41467-020-19695-9. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Romero-Romero S., Kordes S., Michel F., Hocker B.. Evolution, folding, and design of TIM barrels and related proteins. Curr. Opin Struct Biol. 2021;68:94–104. doi: 10.1016/j.sbi.2020.12.007. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Mazurenko S., Prokop Z., Damborsky J.. Machine Learning in Enzyme Engineering. ACS Catal. 2020;10(2):1210–1223. doi: 10.1021/acscatal.9b04321. [DOI] [Google Scholar]
- Li G. Y., Qin Y. C., Fontaine N. T., Chong M. N. F., Maria-Solano M. A., Feixas F., Cadet X. F., Pandjaitan R., Garcia-Borras M., Cadet F., Reetz M. T.. Machine Learning Enables Selection of Epistatic Enzyme Mutants for Stability Against Unfolding and Detrimental Aggregation. ChemBioChem. 2021;22(5):904–914. doi: 10.1002/cbic.202000612. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Gado J. E., Harrison B. E., Sandgren M., Stahlberg J., Beckham G. T., Payne C. M.. Machine learning reveals sequence-function relationships in family 7 glycoside hydrolases. J. Biol. Chem. 2021;297(2):100931. doi: 10.1016/j.jbc.2021.100931. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Quan L. J., Lv Q., Zhang Y.. STRUM: structure-based prediction of protein stability changes upon single-point mutation. Bioinformatics. 2016;32(19):2936–2946. doi: 10.1093/bioinformatics/btw361. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Cadet F., Fontaine N., Vetrivel I., Chong M. N. F., Savriama O., Cadet X., Charton P.. Application of fourier transform and proteochemometrics principles to protein engineering. BMC Bioinformatics. 2018;19:382. doi: 10.1186/s12859-018-2407-8. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Cadet F., Fontaine N., Li G., Sanchis J., Ng Fuk Chong M., Pandjaitan R., Vetrivel I., Offmann B., Reetz M. T.. A machine learning approach for reliable prediction of amino acid interactions and its application in the directed evolution of enantioselective enzymes. Sci. Rep. 2018;8(1):16757. doi: 10.1038/s41598-018-35033-y. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Radzicka A., Wolfenden R.. A proficient enzyme. Science. 1995;267(5194):90–93. doi: 10.1126/science.7809611. [DOI] [PubMed] [Google Scholar]
- Briggs G. E., Haldane J. B.. A Note on the Kinetics of Enzyme Action. Biochem. J. 1925;19(2):338–339. doi: 10.1042/bj0190338. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kroll A., Engqvist M. K. M., Heckmann D., Lercher M. J.. Deep learning allows genome-scale prediction of Michaelis constants from structural features. PLoS Biol. 2021;19(10):e3001402. doi: 10.1371/journal.pbio.3001402. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Li F., Yuan L., Lu H., Li G., Chen Y., Engqvist M. K. M., Kerkhoven E. J., Nielsen J.. Deep learning-based kcat prediction enables improved enzyme-constrained model reconstruction. Nat. Catal. 2022;5:662–572. doi: 10.1038/s41929-022-00798-z. [DOI] [Google Scholar]
- Yu H., Deng H., He J., Keasling J. D., Luo X.. UniKP: a unified framework for the prediction of enzyme kinetic parameters. Nat. Commun. 2023;14(1):8211. doi: 10.1038/s41467-023-44113-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kroll A., Rousset Y., Hu X. P., Liebrand N. A., Lercher M. J.. Turnover number predictions for kinetically uncharacterized enzymes using machine and deep learning. Nat. Commun. 2023;14(1):4139. doi: 10.1038/s41467-023-39840-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Heckmann D., Lloyd C. J., Mih N., Ha Y., Zielinski D. C., Haiman Z. B., Desouki A. A., Lercher M. J., Palsson B. O.. Machine learning applied to enzyme turnover numbers reveals protein structural correlates and improves metabolic models. Nat. Commun. 2018;9(1):5252. doi: 10.1038/s41467-018-07652-6. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Boorla V. S., Maranas C. D.. CatPred: a comprehensive framework for deep learning in vitro enzyme kinetic parameters. Nat. Commun. 2025;16(1):2072. doi: 10.1038/s41467-025-57215-9. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Shen X. W., Cui Z. H., Long J. Y., Zhang S. D., Chen B. Q., Tan T. W.. EITLEM-Kinetics: A deep-learning framework for kinetic parameter prediction of mutant enzymes. Chem. Catalysis. 2024;4(9):101094. doi: 10.1016/j.checat.2024.101094. [DOI] [Google Scholar]
- Wang Z., Xie D., Wu D., Luo X., Wang S., Li Y., Yang Y., Li W., Zheng L.. Robust enzyme discovery and engineering with deep learning using CataPro. Nat. Commun. 2025;16(1):2736. doi: 10.1038/s41467-025-58038-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Bar-Even A., Noor E., Savir Y., Liebermeister W., Davidi D., Tawfik D. S., Milo R.. The moderately efficient enzyme: evolutionary and physicochemical trends shaping enzyme parameters. Biochemistry. 2011;50(21):4402–4410. doi: 10.1021/bi2002289. [DOI] [PubMed] [Google Scholar]
- Vieille C., Zeikus G. J.. Hyperthermophilic enzymes: sources, uses, and molecular mechanisms for thermostability. Microbiol Mol. Biol. Rev. 2001;65(1):1–43. doi: 10.1128/MMBR.65.1.1-43.2001. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Dasetty S., Zajac J. W. P., Sarupria S.. Exploitation of active site flexibility-low temperature activity relation for engineering broad range temperature active enzymes. Mol. Syst. Des Eng. 2023;8(11):1355–1370. doi: 10.1039/D3ME00013C. [DOI] [Google Scholar]
- Erkanli M. E., El-Halabi K., Kim J. R.. Exploring the diversity of beta-glucosidase: Classification, catalytic mechanism, molecular characteristics, kinetic models, and applications. Enzyme Microb Technol. 2024;173:110363. doi: 10.1016/j.enzmictec.2023.110363. [DOI] [PubMed] [Google Scholar]
- Brandes N., Goldman G., Wang C. H., Ye C. J., Ntranos V.. Genome-wide prediction of disease variant effects with a deep protein language model. Nat. Genet. 2023;55(9):1512–1522. doi: 10.1038/s41588-023-01465-0. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Tang L.. Large model predicts variant effects. Nat. Methods. 2023;20(10):1448. doi: 10.1038/s41592-023-02050-3. [DOI] [PubMed] [Google Scholar]
- Tetko I. V., van Deursen R., Godin G.. Be aware of overfitting by hyperparameter optimization! J. Cheminform. 2024;16(1):139. doi: 10.1186/s13321-024-00934-w. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Probst P., Boulesteix A. L., Bischl B.. Tunability: Importance of Hyperparameters of Machine Learning Algorithms. J. Mach. Learn. Res. 2019;20:1–32. [Google Scholar]
- Li G., Hu Y., Zrimec J., Luo H., Wang H., Zelezniak A., Ji B., Nielsen J.. Bayesian genome scale modelling identifies thermal determinants of yeast metabolism. Nat. Commun. 2021;12(1):190. doi: 10.1038/s41467-020-20338-2. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Borger S., Liebermeister W., Klipp E.. Prediction of enzyme kinetic parameters based on statistical learning. Genome Inform. 2006;17(1):80–87. [PubMed] [Google Scholar]
- Hutcheon J. A., Chiolero A., Hanley J. A.. Random measurement error and regression dilution bias. BMJ. 2010;340:c2289. doi: 10.1136/bmj.c2289. [DOI] [PubMed] [Google Scholar]
- Erkanli M. E., El-Halabi K., Kang T. K., Kim J. R.. Hotspot Wizard-informed engineering of a hyperthermophilic beta-glucosidase for enhanced enzyme activity at low temperatures. Biotechnol. Bioeng. 2024;121(7):2079–2090. doi: 10.1002/bit.28732. [DOI] [PubMed] [Google Scholar]
- Bloom J. D., Labthavikul S. T., Otey C. R., Arnold F. H.. Protein stability promotes evolvability. Proc. Natl. Acad. Sci. U. S. A. 2006;103(15):5869–5874. doi: 10.1073/pnas.0510098103. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Finch A. J., Kim J. R.. Thermophilic Proteins as Versatile Scaffolds for Protein Engineering. Microorganisms. 2018;6(4):97. doi: 10.3390/microorganisms6040097. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Ofer D., Brandes N., Linial M.. The language of proteins: NLP, machine learning & protein sequences. Comput. Struct Biotechnol J. 2021;19:1750–1758. doi: 10.1016/j.csbj.2021.03.022. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Zhang Z., Wayment-Steele H. K., Brixi G., Wang H., Kern D., Ovchinnikov S.. Protein language models learn evolutionary statistics of interacting sequence motifs. Proc. Natl. Acad. Sci. U. S. A. 2024;121(45):e2406285121. doi: 10.1073/pnas.2406285121. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Arcus V. L., Prentice E. J., Hobbs J. K., Mulholland A. J., Van der Kamp M. W., Pudney C. R., Parker E. J., Schipper L. A.. On the Temperature Dependence of Enzyme-Catalyzed Rates. Biochemistry. 2016;55(12):1681–1688. doi: 10.1021/acs.biochem.5b01094. [DOI] [PubMed] [Google Scholar]
- Aqvist J., Socan J., Purg M.. Hidden Conformational States and Strange Temperature Optima in Enzyme Catalysis. Biochemistry. 2020;59(40):3844–3855. doi: 10.1021/acs.biochem.0c00705. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kannan A., Fries J. A., Kramer E., Chen J. J., Shah N., Amatriain X.. The accuracy vs. coverage trade-off in patient-facing diagnosis models. AMIA Jt Summits Transl. Sci. Proc. 2020;2020:298–307. [PMC free article] [PubMed] [Google Scholar]
- Isufi E., Pocchiari M., Hanjalic A.. Accuracy-diversity trade-off in recommender systems via graph convolutions. Inform Process Manag. 2021;58(2):102459. doi: 10.1016/j.ipm.2020.102459. [DOI] [Google Scholar]
- Ziegler C., Martin J., Sinner C., Morcos F.. Latent generative landscapes as maps of functional diversity in protein sequence space. Nat. Commun. 2023;14(1):2222. doi: 10.1038/s41467-023-37958-z. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Lin Z., Akin H., Rao R., Hie B., Zhu Z., Lu W., Smetanin N., Verkuil R., Kabeli O., Shmueli Y.. et al. Evolutionary-scale prediction of atomic-level protein structure with a language model. Science. 2023;379(6637):1123–1130. doi: 10.1126/science.ade2574. [DOI] [PubMed] [Google Scholar]
- Rao R., Bhattacharya N., Thomas N., Duan Y., Chen X., Canny J., Abbeel P., Song Y. S.. Evaluating Protein Transfer Learning with TAPE. Adv. Neural Inf. Process Syst. 2019;32:9689–9701. [PMC free article] [PubMed] [Google Scholar]
- Wang T., Xiang G., He S., Su L., Wang Y., Yan X., Lu H.. DeepEnzyme: a robust deep learning model for improved enzyme turnover number prediction by utilizing features of protein 3D-structures. Brief Bioinform. 2024;25(5):bbae409. doi: 10.1093/bib/bbae409. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Alazmi M.. Enzyme catalytic efficiency prediction: employing convolutional neural networks and XGBoost. Front Artif. Intell. 2024;7:1446063. doi: 10.3389/frai.2024.1446063. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Thompson, J. D. ; Gibson, T. J. ; Higgins, D. G. . Multiple sequence alignment using ClustalW and ClustalX. Current Protocols in Bioinformatics; Wiley, 2002; Chapter 2, Unit 2.3. [DOI] [PubMed] [Google Scholar]
- Virtanen P., Gommers R., Oliphant T. E., Haberland M., Reddy T., Cournapeau D., Burovski E., Peterson P., Weckesser W., Bright J.. et al. SciPy 1.0: fundamental algorithms for scientific computing in Python. Nat. Methods. 2020;17(3):261–272. doi: 10.1038/s41592-019-0686-2. [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
Data Availability Statement
The datasets, scripts, and code for the ML models and their combinations described in this study are publicly available at https://github.com/emreerkanli/BGL-kcatKm-predictor.



