Skip to main content
PLOS Computational Biology logoLink to PLOS Computational Biology
. 2022 Jan 24;18(1):e1009818. doi: 10.1371/journal.pcbi.1009818

The structural coverage of the human proteome before and after AlphaFold

Eduard Porta-Pardo 1,2,*, Victoria Ruiz-Serra 1,2, Samuel Valentini 3, Alfonso Valencia 1,4,*
Editor: Silvio C E Tosatto5
PMCID: PMC8812986  PMID: 35073311

Abstract

The protein structure field is experiencing a revolution. From the increased throughput of techniques to determine experimental structures, to developments such as cryo-EM that allow us to find the structures of large protein complexes or, more recently, the development of artificial intelligence tools, such as AlphaFold, that can predict with high accuracy the folding of proteins for which the availability of homology templates is limited. Here we quantify the effect of the recently released AlphaFold database of protein structural models in our knowledge on human proteins. Our results indicate that our current baseline for structural coverage of 48%, considering experimentally-derived or template-based homology models, elevates up to 76% when including AlphaFold predictions. At the same time the fraction of dark proteome is reduced from 26% to just 10% when AlphaFold models are considered. Furthermore, although the coverage of disease-associated genes and mutations was near complete before AlphaFold release (69% of Clinvar pathogenic mutations and 88% of oncogenic mutations), AlphaFold models still provide an additional coverage of 3% to 13% of these critically important sets of biomedical genes and mutations. Finally, we show how the contribution of AlphaFold models to the structural coverage of non-human organisms, including important pathogenic bacteria, is significantly larger than that of the human proteome. Overall, our results show that the sequence-structure gap of human proteins has almost disappeared, an outstanding success of direct consequences for the knowledge on the human genome and the derived medical applications.

Author summary

Protein structures are key to understand many biological phenomena at the molecular scale: from the effects of genetic variation to how different proteins interact with each other to create molecular pathways that, together, have a biological function. Obtaining experimental structures, however, is extremely consuming in terms of both, time and resources.

For this and other reasons, scientists have long worked to develop computational approaches that predict the structure of a protein using only its sequence as input. Recently, a group of scientists at Deepmind have developed AlphaFold2, a computational tool that is extremely accurate at this task. Moreover, they have used this tool to predict the structures of all human proteins.

In this manuscript we provide an overview of the structural coverage of the human proteome before AlphaFold models were released and how much we have gained thanks to these models. We also show how the gain affects our understanding of human pathogenic variants, both germline and somatic. Finally, we provide evidence suggesting that the gain in non-human organisms is larger than for the human proteome, particularly in the case of bacteria.

Introduction

Ever since the first protein structure was published in 1958 [1] it was clear that structure information is essential to understand the biological functions of proteins. In that sense, the last 63 years have witnessed an outstanding progress thanks to several milestones. First and foremost, the Protein Data Bank [2] has emerged, since its creation in 1971, as the key biological database to organize and standardize experimental protein structural data. Also, several groups in the late 1980s and early 1990s observed that the protein structure was much more conserved than its sequence [3], which led to the creation of the first computational tools to predict protein folding [48]. These tools are extremely important, as the growth of protein sequence data has far outpaced that of experimentally-determined protein structures. In order to systematically assess the performance of all these tools and monitor the advances of the protein folding prediction field, the Critical Assessment of protein Structure Prediction (CASP) experiments were established in 1994 [9]. These experiments have held a high-standard in the field and in recent years have witnessed the massive progress that protein structure prediction has made thanks to, among others, the use of artificial intelligence approaches [10].

Protein structures have a wide-array of applications in biotechnology and biomedicine. Understanding the structure of a protein can help in identifying which mutations in enzymes can make them acquire new properties that make them interesting from a biotechnological or environmental perspective [11]. Also, in the case of biomedicine, they can be used to perform in silico experiments to compute the affinity of tens of thousands of small molecules or antibodies for proteins associated with different diseases [12]. Further biomedical application of protein structures involves the study of the consequences of genetic variants, both acquired [13] or inherited [14]. For instance, computational tools based on protein structures are often more accurate [15,16] than those based on linear features [17] when prioritizing relevant protein-coding variations in patients [18], a much needed strategy when experimental characterization of millions of mutations is not realistic.

Over the last two editions of CASP, the computational tool AlphaFold [19], developed by DeepMind, has achieved a performance that suggests that the structure prediction of individual protein domains has virtually been solved [20]. Moreover, in conjunction with the EMBL-EBI, the team behind AlphaFold has recently released a database of predicted protein structures for the whole human proteome [21]. These two outstanding accomplishments, together, have generated a great excitement in the scientific community in general and amongst structural biologists in particular, as it opens a wide-array of research possibilities.

Given the profound transformations that structural biology has recently experienced, the importance of protein structures in biomedicine, and the potential transformation that the field might experience in light of the release of AlphaFold code and models for human proteins, it is important to quantify the contribution of these models in general and of high-quality models in particular. The latter are particularly relevant as they might be able to provide insights into the biochemistry of proteins that had not yet been amenable to experimental structure determination or the effects of mutations in such proteins.

Here we quantified the consequences of the addition of the AlphaFold models to the accumulated knowledge on protein structures and models. Our results show that AlphaFold predictions have significantly increased our coverage for the entire human proteome, particularly in proteins integral to membrane, enzymes involved in lipid metabolism and olfactory receptors. The direct contribution of AlphaFold’s protein models to proteins with biomedical interest is more limited, as these proteins were already better characterized.

Overall, AlphaFold increases the structural coverage from 48% to 76% of all human protein residues and, importantly, the coverage with high-quality models (sequence identity with a PDB chain is ≥ 50%) from 31% to 50%. Moreover, the number of proteins with no structural coverage at all has dramatically decreased from 5,027 proteins to just 29. Together, the combined data from experimental structures, template-based homology modelling with high sequence identity and high-accuracy models from AlphaFold will open a new era in structural biology in particular and human biomedicine in general.

Results

The structural coverage of the human proteome before AlphaFold

Over the last 25 years, the protein structure field has made significant advances. This is evidenced by the fact that the Protein Data Bank (PDB) [2], the main database for protein structure coordinates, in 1995 had 4,455 protein coordinate files, whereas by 2020 the number had increased to 177,806 (Fig 1A). The relative contribution of human proteins (sequence identity of human proteins with PDB chains is >95%) has also increased over these 25 years, now making 27% of all PDB structures, compared to only 17% in 1995 (Fig 1B). These advances, importantly, have translated into a much higher coverage of the human proteome. We quantified it by aligning all the 19,250 protein isoforms of the human protein coding genes from ENSEMBL [22] that also matched exactly UniProt [23] sequences against all the PDB chains (n = 596,542) using BLAST [24]. We considered only hits with an e-value below 1e-8 and sequence identity ≥ 20%, the limit thresholds for template-based homology modelling [3].

Fig 1. Current coverage of the human proteome.

Fig 1

a-b) Barplot showing the absolute (a) or relative (b) number of PDB coordinate files mapping to human proteomes at >95%, 95–50% and 50–20% thresholds of sequence identity. Legends in barplots a and b are the same. c) Evolution of the coverage of the human proteome by three-dimensional coordinate files in the Protein Data Bank (y-axis) according to the minimum percent identity of the BLAST hits (x-axis). Each line represents the coverage using only the coordinate files available in PDB in a given year. d) Barplot showing the coverage of the human proteome by different types of structural features, both linear (PFAM domains and IDRs) and three-dimensional (PDB) (y-axis is the same as in c). e) Coverage of the proteome by different AlphaFold pLDDT score thresholds (y-axis is the same as in c). f) Coverage (y-axis) of different types of regions (x-axis) depending on AlphaFold confidence levels. g) Current coverage (y-axis) of the human proteome.

Additionally, for a more straightforward interpretation of the results, we set in this study 3 different levels of protein structural coverage according to 3 ranges of sequence identity percentages between a protein and a PDB chain. The ranges are: >95%, which includes the real structure of the protein; 95–50%, which contains useful templates to study the impact of mutations [25]; and 50–20%, which contemplates structural coverage of distant related proteins assuming that structure is more conserved than sequence. With this definition our results show that the current structural coverage of the human proteome is 48% of all human protein residues (Fig 1C) when sequence identity ≥ 20%. This is significant progress compared to 1995, when the coverage was 7 times less (6.3%). If we are more stringent and consider only the regions of the proteome with a sequence identity >95% with a PDB protein chain, then the current coverage decreases to 17%, but even so this is 33 times higher than in 1995 (0.47%).

Not all the human proteome has a structure (such as in the case of intrinsically disordered proteins [26]) or its structure has been more difficult to experimentally determine (as in the case of membrane proteins). To further explore this issue, we predicted the presence of two types of linear regions: PFAM domains [27], which are evolutionary conserved functional regions, and intrinsically disordered regions (IDRs) which are proteins that do not have unique equilibrium residue coordinates and instead exist either as conformational ensembles of multiple macro-states or without any equilibrium 3D structure and with relatively flat probability distribution on allowable 3D structures (Fig 1D). The remaining proteins, neither structured nor predicted to be disordered (the dark proteome [28]) were also considered in this analysis (Fig 1D). Moreover, it’s important to notice that some PDB structures could be IDR in physiological conditions and the structure inferred is the result of the crystallization procedure potentially introducing some misclassifications. Results show that for 10% of all residues of the human proteome there is a PFAM domain assigned but no template available to model a structure, 16% of all residues are predicted to be disordered and we have no features for the remaining 26% of all residues.

In summary, in terms of three-dimensional coverage, 17% of all human protein residues currently have experimental structures (sequence identity with a PDB chain is >95%), 14% can be modelled with good accuracy (sequence identity between 95% and 50%) and 17% can be modelled with reasonable accuracy (sequence identity between 50% and 20%). As for the rest of the proteome, without considering IDRs, 36% of residues are missing structural coverage even though 10% of them belong to a known PFAM domain (Fig 1D).

The structural coverage of the human proteome after AlphaFold

We next analyzed the structural predictions of AlphaFold for the human proteome [21]. AlphaFold has, along with the actual three-dimensional coordinates, a measure of how confident one can be about the prediction itself which is the predicted local distance difference test (pLDDT). According to its developers, a pLDDT above 90 is of high confidence, between 90 and 70 of intermediate confidence, between 70 and 50 of low confidence, and the coordinates of any residue with a pLDDT below 50 should be disregarded [21]. At the residue level, AlphaFold models have high confidence predictions for 39% of the human proteome, intermediate-confidence predictions for 24%, low-confidence predictions for 10% and no prediction (i.e. pLDDT < 50) for 27% (Fig 1E).

We calculated the overlap between the distribution of linear and template-based homology regions with the AlphaFold prediction confidence scores (Fig 1F). As expected, there was a correspondence between the sequence identity between proteins and PDB chains and AlphaFold’s pLDDT score. While 72% of all residues with sequence identity to a PDB template >95% had a pLDDT above 90, the percent decreased to 52% of all residues with sequence identity between 20% and 50% (Fig 1F). Consistently, we observe that 78% of all residues that were predicted to be in IDRs (i.e. disordered) had a pLDDT below 50. Overall these results show consistency between the foldability of a protein region and AlphaFold’s pLDDT score.

AlphaFold makes a significant contribution in the portion of the human proteome that lacks structure coverage, i.e. a number of PFAM domains without known experimental structure or template to build homology models and the dark proteome. High-confidence structures (pLDDT >90) are predicted for 37% and 21% of the residues corresponding to PFAM domains without structure or the dark proteome respectively (Fig 1F). Still, 21% and 39% of the residues of PFAM domains without structure and the dark proteome are associated with a pLDDT < 50 (Fig 1F), which could be indicative of truly disordered regions.

The integration of our previous structural knowledge through experimental structures, template-based homology modeling, PFAM domains, IDRs together with AlphaFold predictions, shows that the current overall coverage of the human proteome at the residue levels is excellent (Fig 1G). For the rest of the paper, we consider a region as having a highly accurate protein structure model or prediction if it either has a sequence identity above 50% with a PDB chain or it has an AlphaFold pLDDT score above 90.

With this definition, excellent structures or models are available for 50% of the residues, 31% coming from PDB and 19% from AlphaFold. An additional 26% of the human proteome can be covered with other structural models, either through template based modeling of PDB chains with a sequence identity with the template between 20% and 50% (8%) or through AlphaFold models with intermediate (11%) or low confidence (7%). Approximately 12% of the proteome is predicted as disordered and only 2% of all residues have a PFAM domain without structure nor model. Finally, the fraction of the proteome without any annotation has decreased to only 10%, albeit given the high correlation between regions with pLDDT below 50 and intrinsic disorder, these are likely to also be IDRs, which would put the fraction of disordered proteome to 22%.

Changes in coverage at the protein level

In this section, we analyse how AlphaFold complements our knowledge at the protein level. When comparing the number of human proteins without structural coverage before and after considering AlphaFold predictions, we observe that the number drops from 5,027 to just 29 proteins (Fig 2A). This means that we currently have either experimental or predicted structural data for some region of 99.8% of all the human proteins we considered (19,250 proteins, Methods).

Fig 2. Changes in the structural coverage at the protein level after AlphaFold.

Fig 2

a) Histogram showing the number of proteins (y-axis) according to their structural coverage (x-axis) before (left) and after (right) the release of AlphaFold models. b) Histogram showing the number of proteins for which we previously had less than 1% of structural coverage (y-axis) according to their current structural coverage after AlphaFold. c) Same as b but now including only high-confidence (pLDDT > 90) AlphaFold predictions (x-axis). d) Histogram showing how much AlphaFold high-confidence predictions contribute (x-axis) to our coverage of proteins with >95% structural coverage. e-g) AlphaFold models for previously structureless AGMO, DEGS1 and PEMT proteins. Models are colored in blue-red scale showing the pLDDT score for the residue, with red representing low pLDDT and blue high pLDDT.

We studied in more detail the proteins for which we previously had no structural data, i.e. the aforementioned 5,027 proteins. A GO term enrichment analysis [29] on these proteins reveals a strong enrichment in olfactory receptors (259 genes, OR > 2.3, p < 7e-26), genes integral to membrane (1,917 genes, OR 1.3, p < 1e-35) or genes without any previous GO annotation (2,897 genes, OR > 1.9, p < 1e-100) among many others.

Notably, AlphaFold models provide structural coverage for over 50% of the protein’s length for 4,459 of these 5,027 proteins (Fig 2B). While this number decreases to 1,408 proteins if we only consider high-quality predictions (an AlphaFold model with pLDDT > 90 is covering more than half the protein’s length, Fig 2C), this is still a significant improvement considering that before AlphaFold we had no structural data for these proteins.

Lastly, we quantified how much AlphaFold contributes to the proteins for which our current structural coverage (sequence identity between protein and PDB chain is > 20% or pLDDT > 50) is above 95% of the protein length (n = 5,178, Fig 2D). This revealed that, while in most cases we already had a significant amount of structural data, either experimental (sequence identity > 95%) or through template-based homology (sequence identity > 20%), there are 1,448 proteins with very high structural coverage (PDB sequence identity >20% or pLDDT > 90 for more than 95% of all residues of the protein) where AlphaFold contributes over 50% of the structural data. This is the case of relevant proteins in the biomedical context such as AGMO, an enzyme that has been linked to numerous diseases such as cancer and diabetes [30], DEGS1, another enzyme with a critical role in lipid metabolism [31], or PEMT, another lipid metabolism enzyme and was amongst the first genes associated with non-alcoholic fatty liver disease [32] (Fig 2E–2G respectively). In all three cases no structural information was known nor any template with enough sequence identity to build a model (sequence identity > 20%). However, AlphaFold predicted with high confidence the structures of most of all these proteins (90%, 95% and 91%, respectively).

Structural coverage of regions with biomedical interest

Next, we focused on different subsets of genes of biomedical interest, as their protein structures can be useful in the design of new treatments [33] or to understand the consequences of genetic variants [34,35]. For this purpose, we focused on the protein structural coverage of disease related genes and mutations extracted from DisGeNet [36], OncoKB [37], TCGA [15] and ClinVar [38] databases (Methods).

Based on experimental PDB structures, the structural coverage of disease genes from DisGeNet (25%), cancer driver genes from TCGA (30%) and OncoKB (28%) or genes related to neurological (34%) or autoimmune (36%) diseases is always higher than the average coverage for the human proteome (17%, Fig 3A). This is likely due to an increased effort in determining the structure of disease-associated proteins than for proteins of the rest of the human genome. Therefore, it is not surprising that for these genes, the contribution of AlphaFold is not as high as for the rest of the proteome (Fig 3A). Particularly, DisGeNet genes gain between 14% to 28% of structural coverage, depending if we consider only high confidence results (pLDDT >90) or all AlphaFold predictions (pLDDT >50), reaching a total coverage up to 78%. In the case of cancer driver genes, the contribution is lower, as TCGA and OncoKB genes gain 6% and 8% of high confidence structural coverage. Overall, the contribution from AlphaFold with some degree of confidence together with PDB previous knowledge, sets the current high-quality structural coverage for cancer driver genes (TCGA and OncoKB) to 52% and the overall coverage to 70%.

Fig 3. Changes in structural coverage of biomedical proteins due to AlphaFold models.

Fig 3

a) Current structural coverage (y-axis) of different subsets of proteins (x-axis). Bars are colored according to the source of the structural coverage. b) Same as a but focusing on Clinvar mutations classified by their pathogenicity (x-axis). c) Same as a but focusing on somatic mutations from TCGA, classified by their likely oncogenicity (x-axis). d) Same as a but focusing on oncogenic mutations from BoostDM. e) AlphaFold model for B3GALT6. Residues are colored according to their pLDDT from red (lower values) to blue (higher values). Pathogenic mutations from Clinvar are highlighted in yellow. e) AlphaFold model for MED12. Coloring is the same as for d, but yellow residues indicate oncogenic mutations.

In the context of mutations, we analyzed the structural coverage of Clinvar (Fig 3B) considering their annotated pathogenicity. In the case of mutations annotated as “benign”, before AlphaFold we had high-quality structural data for approximately 17% to 19%, and AlphaFold models add an additional 12%. For pathogenic mutations, instead, we already had a better experimental structural coverage, between 48% and 58%. That being said, AlphaFold models add an additional 13% of high-quality structural data. Considering all structural annotations, we now have structural data for 94% of all pathogenic variants. Notably, the review status of Clinvar mutations does not affect the conclusions of our analysis (S1 Fig). In fact, there seems to be a positive correlation between the PDB coverage of pathogenic variants and their review status: all pathogenic variants with four stars have an experimental PDB structure, whereas only 50% of the pathogenic variants with zero stars do.

In the case of TCGA (Fig 3C), mutations were classified according to whether they were predicted to be either oncogenic, located in cancer driver genes or located in any other protein (likely passengers). Results resemble those observed in the Clinvar dataset. The experimental structural coverage of likely passenger mutations is exactly the same as for the entire proteome, 17%, and high-quality AlphaFold models add an additional 12%. In the case of driver genes, however, we started from a much higher experimental structural coverage (Fig 3C), as we had experimental structures for 32% of the non-oncogenic mutations in these genes, and AlphaFold high-quality models only add an additional 5%. For mutations predicted to be oncogenic in these genes [15], we already had experimental structures for 65% of them, and AlphaFold only added 3%. We observed the same trend for another recent set of predicted oncogenic mutations by in silico mutagenesis of cancer driver genes [39], with experimental structural data from PDB covering 52% of all oncogenic mutations and AlphaFold only adding 4% (Fig 3D). It should be noted, though, that the algorithms predicting the oncogenicity of both sets of somatic mutations use in part structural information, so the results are likely biased towards regions with pre-existing structural data.

In summary, although the additional contribution of AlphaFold models to pathogenic and oncogenic mutations is apparently low, it still provides important structural context for some mutations. This is the case of B3GALT6, a gene without structural information and that, when mutated, can cause a Mendelian disease. Thanks to the high-confidence structural model provided by AlphaFold, it is now possible to appreciate a 3D clustering of the disease-causing mutations in this gene (Fig 3E). Similarly, oncogenic mutations in the cancer driver gene MED12 previously had no structural data at all, but are now covered by a high-confidence model. In fact, the mapping of the three oncogenic somatic mutations in MED12 to the AlphaFold model reveals that, despite being over 600 aminoacids apart (positions 521, 879 and 1138), they form a cluster together according to mutation3D [40] (p < 0.002, 10,000 bootstrapping iterations), suggesting that they potentially share an oncogenic mechanism (Fig 3F).

Comparison with other species

As we have shown before (Fig 1B), protein structures are particularly biased towards human proteins. For this reason we hypothesized that the impact of AlphaFold models could be higher in other organisms. To explore this hypothesis we calculated the structural coverage before and after AlphaFold protein models were released for four organisms: A. thaliana, S. cerevisiae, S. aureus and M. tuberculosis. We selected these four organisms because they cover both, prokaryotes and eukaryotes and also because they include well-studied model organisms (A. thaliana and S. cerevisiae) as well as important bacterial pathogens from a biomedical perspective (S. aureus and M. tuberculosis).

To evaluate the gain in structural coverage we calculated the sequence identity between all the proteins in these organisms with all the chains in experimental structures from PDB and established the same thresholds of identity as in Fig 1. Then, we calculated how many residues were covered by AlphaFold models at different pLDDT thresholds and quantified the gain of structural coverage as in Fig 1. Our results show that the structural coverage of these other four organisms provided by either experimental structures of high-quality template-based homology modeling was lower than for the human proteome (Fig 4A). The most dramatic example is A. thaliana, which only had experimental structures for less than 2% of all the residues in its proteome. Next, we estimated how much high- or intermediate-quality (pLDDT > 90 and pLDDT > 70 respectively) structural coverage is provided by AlphaFold models in these organisms. In all four cases, AlphaFold provides more structural coverage than for the human proteome (Fig 4B). The detailed results per organism can be found in S2 Fig. Notably, when combining both sources of structural data, the final coverage of the human proteome with high- or intermediate quality structural data is lower (60%) than for the other four organisms, which reach coverages of 81% and 85% for M. tuberculosis and S. aureus respectively (Fig 4C).

Fig 4. Changes in protein structural coverage in other organisms.

Fig 4

a) Comparison of the structural coverage (y-axis) of the five different organisms (x-axis) based on PDB sequence identity. b) Additional structural coverage provided by AlphaFold models in the different species, split by pLDDT score. c) Current high quality structural coverage of the five organisms combining PDB and AlphaFold data.

In summary, the improvement of the structural coverage using AlphaFold models in non-human organisms is likely to be even higher than for the human proteome. Here we have presented four good examples that benefit from AlphaFold models data and that, in the case of the prokaryotic organisms (S. aureus and M. tuberculosis), they almost cover 100% of the residues, or, in the case of eukaryotic organisms (S. cerevisiae and A. thaliana), they reach similar structural coverage results to those observed in human.

Discussion

In this study we quantified the contribution of AlphaFold protein models to our already considerable knowledge of the human proteome. Before AlphaFold models were released we had high-quality structural data for a significant fraction of the human proteome (31%), either through experimental structures (17% of all residues) or through homology models built with templates of high sequence identity (14% of all residues). However, there was still a large fraction of the proteome for which, despite enough evidence about its foldable potential (i.e. proteins with good representation in terms of the corresponding PFAM), we had no structural data.

The models from AlphaFold have increased our high-quality coverage by an additional 20%, putting it at half of all human protein residues. Moreover, they have virtually closed the gap of structureless foldable regions, as we now have some structural coverage (either through AlphaFold or PDB low sequence identity models) for 75% of all human residues, including almost all PFAM domains. Regarding the latter, another important dataset that has been recently published are the structural models predicted with RoseTTAFold, another artificial intelligence tool, for all PFAM domains [41]. In fact, our preliminary analysis shows that RoseTTAFold tends to predict the same exact structure as AlphaFold models with high pLDDT [25]. Finally, approximately 23% of all human residues are likely to be disordered, which puts the fraction of the human proteome that can potentially have a structure but for which we have no models or templates at only 2%, a remarkable achievement.

In terms of individual proteins, while before AlphaFold we had no structural coverage at all for 5,027 proteins, this number has been reduced to only 1,499 if one considers only proteins with high-quality AlphaFold models (pLDDT > 90 in more than 10% of the protein) and to 29 if one includes all AlphaFold predictions. Importantly, these previously structureless proteins for which we now have high-accuracy models include several important genes in human disease such as DEGS1, ARID2 or B3GALT6.

Our results also suggest that most of the genuinely new contributions of AlphaFold to the structural coverage are in genes that are olfactory receptors, proteins integral to the membrane or, most importantly, genes that have no Gene Ontology annotations. However, one must also bear in mind that some of these predictions will not be correct, either due to actual errors of the software or, in other cases, due to missannotations of public databases such as in the case of CRIPAK [42]. On the positive side, we also expect AlphaFold predictions to enlighten the function of many of the proteins for which we previously had no GO annotations. Since we now have high-confidence predictions for, at least, some parts of many of these proteins, it should be easier to identify protein domains and begin to assign functions and biological processes to these proteins.

In the specific case of disease-associated genes, our high-quality coverage before AlphaFold models were released was higher (between 25% and 36% of all residues) than the average of the human proteome (17%). This could be, among other reasons, because disease-associated genes are more studied than the rest, as evidenced by their increase in their relative representation in PDB: in 1995 only 2% of all PDB structures were from human cancer genes, whereas by 2020 the fraction has increased to 4%. Therefore, the contribution of AlphaFold to this group of proteins is more limited, between 5% and 14% if one considers high quality models, compared to 19% for all residues in the human proteome.

In the case of mutations the bias is even higher, not only because disease-associated mutations are more studied, but also because they tend to be located in protein regions that form structures. For this reason AlphaFold models only provide high-confidence structural details for an additional 13% and 3% for Clinvar pathogenic and TCGA oncogenic mutations respectively. That being said, AlphaFold models can be used to generate hypotheses behind the pathogenic mechanisms of some of these mutations where we previously had no structure data at all, as we have exemplified for MED12.

The impact of AlphaFold models is clearly not restricted to the human proteome, but also extensible to other organisms. While the detailed study of each of them is out of the scope of the present manuscript, we have provided evidence showing that the contribution of AlphaFold models to coverage of non-human organisms is even higher than for the human proteome, at least in the case of M. tuberculosis, A. thaliana and S. cerevisiae. This is likely to be even more important for bacteria because, unlike eukaryotes, most of their proteome is folded and the experimental structural data is oftentimes lacking. As we have shown for S. aureus and M. tuberculosis, the structural coverage after including AlphaFold models reaches almost 100%, with most of the structural data coming from AlphaFold models of high quality. Based on these results, we believe that an extremely important contribution of AlphaFold models to human biomedicine will be in the fight against antibiotic-resistant bacteria, for example by facilitating new virtual screening analyses that will now be able to cover almost 100% of the proteome of these bacteria.

In conclusion, we now have either experimental data, template-based homology models or artificial intelligence-derived models for virtually all foldable protein regions in the human proteome (76% of the proteome). Moreover, 50% of the human proteome is covered with experimental or high-quality structural data (more than 50% sequence identity to PDB or more than 90 pLDDT for AlphaFold models). While at the end of 2020 we were already in a very good position (31% of the proteome), AlphaFold has greatly contributed in closing the gap of protein structure coverage, providing details in protein families that were not amenable to other structure determination approaches. Overall, we have practically completed our coverage of the human foldable proteome, an outstanding achievement that will open the door to more challenging problems in structural biology in general and in biomedicine in particular, such as the prediction of protein-protein interaction complexes [4345], the relative positioning of protein domains in multi-domain proteins [46], the identification of immunogenic peptides [47] or the prediction of the consequences of different types of mutations.

Methods

Homology search

A BLAST [24] search was performed against 596,542 PDB chains extracted from a total of 253.444 protein bioassemblies deposited in PDB by the date of download (04/03/2021) using the human proteome as a query (Ensembl v103) [24]. We only used one protein isoform per gene, the one that matched exactly the protein sequence from the reference Uniprot human proteome. In the end we used 19,250 protein sequences. Significant hits between ENSEMBL protein sequences and PDB chains were those with e-value lower than 1e-8 and sequence identity percent greater or equal to 20%.

PFAM domains

We used Pfamscan [48] to identify PFAM domains [27] in the 19,250 ENSEMBL / Uniprot sequences. The database of PFAM-A models was downloaded on June 29th 2021 and created on March 19th 2021. We only kept those PFAM domains identified with an e-value below 1e-8.

IUPRed2

To identify intrinsically disordered regions we used IUPRed2 [49] (downloaded on April 17th 2021). We used the “long” disorder option and considered as disordered all those residues with a score above 0.5. We used IUPRed2 because, based on recent benchmarkings, it was a good compromise between speed and accuracy [50].

AlphaFold human models

AlphaFold models for human proteins were downloaded on July 23rd 2021 from https://alphafold.ebi.ac.uk. We extracted the sequences and compared them to the ENSEMBL protein sequences that matched the UniProt reference human proteome used for the PDB analysis. For comparison purposes all the analyses and results presented here are based on the subset of 19,250 protein sequences for which the ENSEMBL, Uniprot and AlphaFold protein sequences were identical. We also extracted pLDDT values for each residue from the AlphaFold models, as these are stored as if they were the B-factor of the protein coordinates file [19,21].

Analysis of non-human models

AlphaFold models for non-human organisms were downloaded on November 15th 2021 from https://alphafold.ebi.ac.uk. We followed the same exact procedure as for the analysis of human proteins.

Gene lists

The list of “All essential genes” includes all those with a pLI score [51] above 0.9. Disease-associated gene annotations come from DisGeNet [36]. The list of “DisGeNet” genes from Fig 3A consists of all DisGeNet genes with a score above 0.45 and where “diseaseType” is “disease”. The list of “Neurological DisGeNet” genes includes all genes from DisGeNet where the score is above 0.45 and the diseaseName is in the following list: "Alzheimer_s Disease", "Amyotrophic Lateral Sclerosis", "Bipolar Disorder", "Schizophrenia", "Depressive disorder", "Mental Depression", "Autistic Disorder", "Major Depressive Disorder" and "Parkinson Disease". The list of “Autoimmune DisGeNet” genes includes all genes from DisGeNet where the score is above 0.45 and the diseaseName is in the following list: "Asthma", "Diabetes Mellitus, Non-Insulin-Dependent", "Lupus Erythematosus, Systemic", "Rheumatoid Arthritis", "Crohn Disease", "diabetes Mellitus, Insulin-Dependent", "Ulcerative Colitis" and "Psoriasis". The list of “Cancer TCGA” genes includes all those found as drivers in the PanCancerAtlas analysis [15]. “Cancer OncoKB” includes all genes annotated as cancer genes in OncoKB [37] (downloaded on July 26th 2021).

Variant datasets

Variant files from TCGA and ClinVar datasets were retrieved from public repositories (https://api.gdc.cancer.gov/data/1c8cfe5f-e52d-41ba-94da-f15ea1337efc and https://ftp.ncbi.nlm.nih.gov/pub/clinvar/vcf_GRCh38/clinvar.vcf.gz). The protein location of all variants was predicted using the Ensembl Variant Effect Predictor (VEP [52]; version 98.3). Annotations regarding the clinical significance of Clinvar variants were extracted from the Clinvar file. Oncogenic mutations from TCGA include all those predicted to be oncogenic in [15]. The list of driver genes used in Fig 3D is from OncoKB. Mutations from BoostDM [39] were obtained from the IntoGen website (www.intogen.org).

Software

All statistical analyses were done using R 4.0.2. Graphical plots were create with the packages “ggplot2” [53], “pacthwork” and “reshape2”. Molecular graphics and analyses performed with UCSF Chimera [54], developed by the Resource for Biocomputing, Visualization, and Informatics at the University of California, San Francisco, with support from NIH P41-GM10331.

Supporting information

S1 Fig

Structural coverage of Clinvar mtuations (y-axis) depending on their pathogenicity (different panels) and their review status (x-axis).

(TIFF)

S2 Fig

Structural coverage (y-axis) of the proteome of the four different organisms before (left) and after (right) including the AlphaFold models.

(TIFF)

Acknowledgments

The authors would like to thank the DeepMind team for sharing their models of human proteins.

Data Availability

PDB data was downloaded from https://rcsb.org AlphaFold data was downloaded from https://alphafold.ebi.ac.uk/ Clinvar data was downloaded from https://ftp.ncbi.nlm.nih.gov/pub/clinvar/vcf_GRCh38/clinvar.vcf.gz TCGA data was downloaded from https://api.gdc.cancer.gov/data/1c8cfe5f-e52d-41ba-94da-f15ea1337efc.

Funding Statement

E.P-P and V.R-S are supported by the La Caixa Junior Leader Fellowship LCF/BQ/PI18/11630003 from La Caixa Foundation (https://fundacionlacaixa.org/ca/home). E.P-P is also supported by a Ramon y Cajal fellowship from the Spanish Ministry of Science (RYC2019-026415-I). A.V. is supported by Institució Catalana de Recerca Avançada (ICREA - https://www.icrea.cat) The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

References

  • 1.Kendrew JC, Bodo G, Dintzis HM, Parrish RG, Wyckoff H, Phillips DC. A three-dimensional model of the myoglobin molecule obtained by x-ray analysis. Nature. 1958;181: 662–666. doi: 10.1038/181662a0 [DOI] [PubMed] [Google Scholar]
  • 2.Berman HM, Westbrook J, Feng Z, Gilliland G, Bhat TN, Weissig H, et al. The Protein Data Bank. Nucleic Acids Res. 2000;28: 235–242. doi: 10.1093/nar/28.1.235 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3.Chothia C, Lesk AM. The relation between the divergence of sequence and structure in proteins. EMBO J. 1986;5: 823–826. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4.Sali A, Blundell TL. Comparative protein modelling by satisfaction of spatial restraints. J Mol Biol. 1993;234: 779–815. doi: 10.1006/jmbi.1993.1626 [DOI] [PubMed] [Google Scholar]
  • 5.Godzik A, Kolinski A, Skolnick J. Topology fingerprint approach to the inverse protein folding problem. J Mol Biol. 1992;227: 227–238. doi: 10.1016/0022-2836(92)90693-e [DOI] [PubMed] [Google Scholar]
  • 6.Göbel U, Sander C, Schneider R, Valencia A. Correlated mutations and residue contacts in proteins. Proteins. 1994;18: 309–317. doi: 10.1002/prot.340180402 [DOI] [PubMed] [Google Scholar]
  • 7.Bowie JU, Lüthy R, Eisenberg D. A method to identify protein sequences that fold into a known three-dimensional structure. Science. 1991;253: 164–170. doi: 10.1126/science.1853201 [DOI] [PubMed] [Google Scholar]
  • 8.Jones DT, Taylor WR, Thornton JM. A new approach to protein fold recognition. Nature. 1992;358: 86–89. doi: 10.1038/358086a0 [DOI] [PubMed] [Google Scholar]
  • 9.Moult J, Pedersen JT, Judson R, Fidelis K. A large-scale experiment to assess protein structure prediction methods. Proteins. 1995;23: ii–v. doi: 10.1002/prot.340230303 [DOI] [PubMed] [Google Scholar]
  • 10.Kryshtafovych A, Schwede T, Topf M, Fidelis K, Moult J. Critical assessment of methods of protein structure prediction (CASP)-Round XIII. Proteins. 2019;87: 1011–1020. doi: 10.1002/prot.25823 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11.Korkegian A, Black ME, Baker D, Stoddard BL. Computational thermostabilization of an enzyme. Science. 2005;308: 857–860. doi: 10.1126/science.1107387 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12.Meng X-Y, Zhang H-X, Mezei M, Cui M. Molecular docking: a powerful approach for structure-based drug discovery. Curr Comput Aided Drug Des. 2011;7: 146–157. doi: 10.2174/157340911795677602 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13.Tokheim C, Bhattacharya R, Niknafs N, Gygax DM, Kim R, Ryan M, et al. Exome-Scale Discovery of Hotspot Mutation Regions in Human Cancer Using 3D Protein Structure. Cancer Res. 2016;76: 3719–3731. doi: 10.1158/0008-5472.CAN-15-3190 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.Mosca R, Tenorio-Laranga J, Olivella R, Alcalde V, Céol A, Soler-López M, et al. dSysMap: exploring the edgetic role of disease mutations. Nat Methods. 2015;12: 167–168. doi: 10.1038/nmeth.3289 [DOI] [PubMed] [Google Scholar]
  • 15.Bailey MH, Tokheim C, Porta-Pardo E, Sengupta S, Bertrand D, Weerasinghe A, et al. Comprehensive Characterization of Cancer Driver Genes and Mutations. Cell. 2018;174: 1034–1035. doi: 10.1016/j.cell.2018.07.034 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16.Tokheim C, Karchin R. CHASMplus reveals the scope of somatic missense mutations driving human cancers. doi: 10.1016/j.cels.2019.05.005 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.Adzhubei I, Jordan DM, Sunyaev SR. Predicting functional effect of human missense mutations using PolyPhen-2. Curr Protoc Hum Genet. 2013;Chapter 7: Unit7.20. doi: 10.1002/0471142905.hg0720s76 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18.Chen H, Li J, Wang Y, Ng PK-S, Tsang YH, Shaw KR, et al. Comprehensive assessment of computational algorithms in predicting cancer driver mutations. Genome Biol. 2020;21: 43. doi: 10.1186/s13059-020-01954-z [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19.Jumper J, Evans R, Pritzel A, Green T, Figurnov M, Ronneberger O, et al. Highly accurate protein structure prediction with AlphaFold. Nature. 2021. doi: 10.1038/s41586-021-03819-2 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20.Callaway E. “It will change everything”: DeepMind’s AI makes gigantic leap in solving protein structures. Nature. 2020;588: 203–204. doi: 10.1038/d41586-020-03348-4 [DOI] [PubMed] [Google Scholar]
  • 21.Tunyasuvunakool K, Adler J, Wu Z, Green T, Zielinski M, Žídek A, et al. Highly accurate protein structure prediction for the human proteome. Nature. 2021. doi: 10.1038/s41586-021-03828-1 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22.Howe KL, Achuthan P, Allen J, Allen J, Alvarez-Jarreta J, Amode MR, et al. Ensembl 2021. Nucleic Acids Res. 2021;49: D884–D891. doi: 10.1093/nar/gkaa942 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 23.Consortium UniProt. UniProt: the universal protein knowledgebase in 2021. Nucleic Acids Res. 2021;49: D480–D489. doi: 10.1093/nar/gkaa1100 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24.Altschul SF, Gish W, Miller W, Myers EW, Lipman DJ. Basic local alignment search tool. Journal of Molecular Biology. 1990. pp. 403–410. doi: 10.1016/S0022-2836(05)80360-2 [DOI] [PubMed] [Google Scholar]
  • 25.Akdel M, Pires DEV, Pardo EP, Jänes J, Zalevsky AO, Mészáros B, et al. A structural biology community assessment of AlphaFold 2 applications. bioRxiv. 2021. p. 2021.09.26.461876. doi: 10.1101/2021.09.26.461876 [DOI] [Google Scholar]
  • 26.Dunker AK, Lawson JD, Brown CJ, Williams RM, Romero P, Oh JS, et al. Intrinsically disordered protein. J Mol Graph Model. 2001;19: 26–59. doi: 10.1016/s1093-3263(00)00138-8 [DOI] [PubMed] [Google Scholar]
  • 27.Mistry J, Chuguransky S, Williams L, Qureshi M, Salazar GA, Sonnhammer ELL, et al. Pfam: The protein families database in 2021. Nucleic Acids Res. 2021;49: D412–D419. doi: 10.1093/nar/gkaa913 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28.Perdigão N, Heinrich J, Stolte C, Sabir KS, Buckley MJ, Tabor B, et al. Unexpected features of the dark proteome. Proc Natl Acad Sci U S A. 2015;112: 15898–15903. doi: 10.1073/pnas.1508380112 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 29.Mi H, Muruganujan A, Casagrande JT, Thomas PD. Large-scale gene function analysis with the PANTHER classification system. Nat Protoc. 2013;8: 1551–1566. doi: 10.1038/nprot.2013.092 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 30.Sailer S, Keller MA, Werner ER, Watschinger K. The Emerging Physiological Role of AGMO 10 Years after Its Gene Identification. Life. 2021;11. doi: 10.3390/life11020088 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 31.Karsai G, Kraft F, Haag N, Korenke GC, Hänisch B, Othman A, et al. DEGS1-associated aberrant sphingolipid metabolism impairs nervous system function in humans. J Clin Invest. 2019;129: 1229–1239. doi: 10.1172/JCI124159 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 32.Song J, da Costa KA, Fischer LM, Kohlmeier M, Kwock L, Wang S, et al. Polymorphism of the PEMT gene and susceptibility to nonalcoholic fatty liver disease (NAFLD). FASEB J. 2005;19: 1266–1271. doi: 10.1096/fj.04-3580com [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 33.Somody JC, MacKinnon SS, Windemuth A. Structural coverage of the proteome for pharmaceutical applications. Drug Discov Today. 2017;22: 1792–1799. doi: 10.1016/j.drudis.2017.08.004 [DOI] [PubMed] [Google Scholar]
  • 34.Wang Z, Moult J. SNPs, protein structure, and disease. Hum Mutat. 2001;17: 263–270. doi: 10.1002/humu.22 [DOI] [PubMed] [Google Scholar]
  • 35.Raimondi F, Singh G, Betts MJ, Apic G, Vukotic R, Andreone P, et al. Insights into cancer severity from biomolecular interaction mechanisms. Sci Rep. 2016;6: 34490. doi: 10.1038/srep34490 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 36.Piñero J, Ramírez-Anguita JM, Saüch-Pitarch J, Ronzano F, Centeno E, Sanz F, et al. The DisGeNET knowledge platform for disease genomics: 2019 update. Nucleic Acids Res. 2020;48: D845–D855. doi: 10.1093/nar/gkz1021 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 37.Chakravarty D, Gao J, Phillips SM, Kundra R, Zhang H, Wang J, et al. OncoKB: A Precision Oncology Knowledge Base. JCO Precis Oncol. 2017;2017. doi: 10.1200/PO.17.00011 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 38.Landrum MJ, Chitipiralla S, Brown GR, Chen C, Gu B, Hart J, et al. ClinVar: improvements to accessing data. Nucleic Acids Res. 2020;48: D835–D844. doi: 10.1093/nar/gkz972 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 39.Muiños F, Martínez-Jiménez F, Pich O, Gonzalez-Perez A, Lopez-Bigas N. In silico saturation mutagenesis of cancer genes. Nature. 2021. doi: 10.1038/s41586-021-03771-1 [DOI] [PubMed] [Google Scholar]
  • 40.Meyer MJ, Lapcevic R, Romero AE, Yoon M, Das J, Beltrán JF, et al. mutation3D: Cancer Gene Prediction Through Atomic Clustering of Coding Variants in the Structural Proteome. Hum Mutat. 2016;37: 447–456. doi: 10.1002/humu.22963 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 41.Baek M, DiMaio F, Anishchenko I, Dauparas J, Ovchinnikov S, Lee GR, et al. Accurate prediction of protein structures and interactions using a three-track neural network. Science. 2021. doi: 10.1126/science.abj8754 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 42.Abascal F, Juan D, Jungreis I, Kellis M, Martinez L, Rigau M, et al. Loose ends: almost one in five human genes still have unresolved coding status. Nucleic Acids Res. 2018;46: 7070–7084. doi: 10.1093/nar/gky587 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 43.Porta-Pardo E, Garcia-Alonso L, Hrabe T, Dopazo J, Godzik A. A Pan-Cancer Catalogue of Cancer Driver Protein Interaction Interfaces. PLoS Comput Biol. 2015;11: e1004518. doi: 10.1371/journal.pcbi.1004518 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 44.Wang X, Wei X, Thijssen B, Das J, Lipkin SM, Yu H. Three-dimensional reconstruction of protein networks provides insight into human genetic disease. Nat Biotechnol. 2012;30: 159–164. doi: 10.1038/nbt.2106 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 45.Evans R, O’Neill M, Pritzel A, Antropova N, Senior A, Green T, et al. Protein complex prediction with AlphaFold-Multimer. bioRxiv. 2021. p. 2021.10.04.463034. doi: 10.1101/2021.10.04.463034 [DOI] [Google Scholar]
  • 46.Xu D, Jaroszewski L, Li Z, Godzik A. AIDA: ab initio domain assembly for automated multi-domain protein structure prediction and domain-domain interaction prediction. Bioinformatics. 2015;31: 2098–2105. doi: 10.1093/bioinformatics/btv092 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 47.De Mattos-Arruda L, Vazquez M, Finotello F, Lepore R, Porta E, Hundal J, et al. Neoantigen prediction and computational perspectives towards clinical benefit: recommendations from the ESMO Precision Medicine Working Group. Ann Oncol. 2020;31: 978–990. doi: 10.1016/j.annonc.2020.05.008 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 48.Mistry J, Bateman A, Finn RD. Predicting active site residue annotations in the Pfam database. BMC Bioinformatics. 2007;8: 298. doi: 10.1186/1471-2105-8-298 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 49.Mészáros B, Erdos G, Dosztányi Z. IUPred2A: context-dependent prediction of protein disorder as a function of redox state and protein binding. Nucleic Acids Res. 2018;46: W329–W337. doi: 10.1093/nar/gky384 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 50.Necci M, Piovesan D, CAID Predictors, DisProt Curators, Tosatto SCE. Critical assessment of protein intrinsic disorder prediction. Nat Methods. 2021;18: 472–481. doi: 10.1038/s41592-021-01117-3 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 51.Lek M, Karczewski KJ, Minikel EV, Samocha KE, Banks E, Fennell T, et al. Analysis of protein-coding genetic variation in 60,706 humans. Nature. 2016;536: 285–291. doi: 10.1038/nature19057 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 52.McLaren W, Gil L, Hunt SE, Riat HS, Ritchie GRS, Thormann A, et al. The Ensembl Variant Effect Predictor. Genome Biol. 2016;17: 122. doi: 10.1186/s13059-016-0974-4 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 53.Wilkinson L. ggplot2: Elegant Graphics for Data Analysis by WICKHAM, H. Biometrics. 2011. pp. 678–679. doi: 10.1111/j.1541-0420.2011.01616.x [DOI] [Google Scholar]
  • 54.Pettersen EF, Goddard TD, Huang CC, Couch GS, Greenblatt DM, Meng EC, et al. UCSF Chimera—a visualization system for exploratory research and analysis. J Comput Chem. 2004;25: 1605–1612. doi: 10.1002/jcc.20084 [DOI] [PubMed] [Google Scholar]
PLoS Comput Biol. doi: 10.1371/journal.pcbi.1009818.r001

Decision Letter 0

Silvio C E Tosatto, Arne Elofsson

20 Oct 2021

Dear Mr Porta-Pardo,

Thank you very much for submitting your manuscript "The structural coverage of the human proteome before and after AlphaFold" for consideration at PLOS Computational Biology.

As with all papers reviewed by the journal, your manuscript was reviewed by members of the editorial board and by several independent reviewers. In light of the reviews (below this email), we would like to invite the resubmission of a significantly-revised version that takes into account the reviewers' comments.

The comments by the reviewers were generally positive, with a few (mainly technical) issues remaining to be fixed. It has been argued that the paper would benefit from using more organisms for a comparative assessment of the distribution of classes. One reviewer also notes that the code used to generate the data is not available.

It has been noted that, while the paper was under review, the authors have contributed to a preprint which covers roughly the same topic. See: https://www.biorxiv.org/content/10.1101/2021.09.26.461876v1

In light of this, the authors should argue why they believe this submission to be different from their contribution to that paper. Expanding the scope of the paper, e.g. by adding more organisms or using additional data, would be an obvious answer. The final call on this will have to be made by the Editorial Office according to journal policy.

We cannot make any decision about publication until we have seen the revised manuscript and your response to the reviewers' comments. Your revised manuscript is also likely to be sent to reviewers for further evaluation.

When you are ready to resubmit, please upload the following:

[1] A letter containing a detailed list of your responses to the review comments and a description of the changes you have made in the manuscript. Please note while forming your response, if your article is accepted, you may have the opportunity to make the peer review history publicly available. The record will include editor decision letters (with reviews) and your responses to reviewer comments. If eligible, we will contact you to opt in or out.

[2] Two versions of the revised manuscript: one with either highlights or tracked changes denoting where the text has been changed; the other a clean version (uploaded as the manuscript file).

Important additional instructions are given below your reviewer comments.

Please prepare and submit your revised manuscript within 60 days. If you anticipate any delay, please let us know the expected resubmission date by replying to this email. Please note that revised manuscripts received after the 60-day due date may require evaluation and peer review similar to newly submitted manuscripts.

Thank you again for your submission. We hope that our editorial process has been constructive so far, and we welcome your feedback at any time. Please don't hesitate to contact us if you have any questions or comments.

Sincerely,

Silvio C. E. Tosatto, PhD

Guest Editor

PLOS Computational Biology

Arne Elofsson

Deputy Editor

PLOS Computational Biology

***********************

The comments by the reviewers were generally positive, with a few (mainly technical) issues remaining to be fixed. It has been argued that the paper would benefit from using more organisms for a comparative assessment of the distribution of classes. One reviewer also notes that the code used to generate the data is not available.

It has been noted that, while the paper was under review, the authors have contributed to a preprint which covers roughly the same topic. See: https://www.biorxiv.org/content/10.1101/2021.09.26.461876v1

In light of this, the authors should argue why they believe this submission to be different from their contribution to that paper. Expanding the scope of the paper, e.g. by adding more organisms, would be an obvious answer. The final call on this will have to be made by the Editorial Office according to journal policy.

Reviewer's Responses to Questions

Comments to the Authors:

Please note here if the review is uploaded as an attachment.

Reviewer #1: Porta-Pardo et al. in the article “The structural coverage of the human proteome before and after AlphaFold” provided an analysis aiming at describing the state-of-the-art about our current capacity of inferring the structure of the human proteome. They compared and measured experimentally-derived structures, template-based homology models and artificial intelligence predictions as provided recently by the AlphaFold2 method and available in AlphaFoldDB.

The manuscript is of interest as it can provide a good reference for all discussions about the available knowledge of human protein structures. The language is simple and clear and the methodology used is fair. However, there are a couple of issues that need to be clarified or modified and that are critical for the presented statistics and in my opinion prevent acceptance of the manuscript in the current form.

Major

My main concern is about the definition of disordered residues which is provided by the IUPred-long tool. That choice is never justified nor is it discussed that the tool tends to underpredict disorder. The authors mentioned CASP results to justify the use of AlphaFold over other prediction tools, however they didn’t do the same for disorder predictors. They could cite the recent Critical Assessment of Intrinsic protein Disorder (CAID) and mention that IUPred is a good compromise between speed and accuracy even though it isn’t in the top ten (PMID: 33875885).

In terms of coverage of the human proteome, a statistic is already available from the following MobiDB page, https://mobidb.org/statistics?proteome=UP000005640. The page provides a comparison with other disorder prediction tools and takes the same proteome reference used by AlphaFoldDB (Proteome ID UP000005640) which includes all expressed human proteins.

The second point is about the definition of the human proteome dataset. The choice of using ENSEMBL proteins and selecting one isoform for each gene is fine but somehow it complicates the reasoning and reproducibility. UniProt offers a great service in managing and cross-referencing ENSEMBL and other databases. Under the human proteome page (https://www.uniprot.org/proteomes/UP000005640) it is possible to retrieve all human proteins which are expressed (78,120 proteins, UniProt version 2021_03). Also, at the same page UniProt provides a link to download representative proteins, one protein per gene (20,600 proteins). The number of representative proteins is very close to the one used by the authors. I suggest using the UniProt definition of the proteome (20,600 representative proteins) in order to be consistent with AlphaFoldDB (https://alphafold.ebi.ac.uk/download). I’m pretty sure that it would not change the overall results.

Minor

In the abstract it is not clear whether AlphaFold promotes to structure a fraction of disordered residues or the actual “dark residues”, or both. In other words it is not clear why the structured residues (75%) does not sum up with the 22% of the dark proteome.

Figure 2. I suggest explaining why the 3 example structures have been selected. That is well explained in the manuscript but not in the caption. Also showing what are the residues which were not covered by any structure before AlphaFold would help to understand why the method was useful for those cases. In the end the pLDDT is not that useful for those examples as they are almost completely predicted with a very high score.

Reviewer #2: The paper by Eduard Porta-Pardo etal is a conceptually straightforward but still well executed exploration of how AlphaFold has changed our ability to have good structural models in the human proteome. It adds to the work done by the AlphaFold team and importantly provides a third party view of this, with a focus on disease causing genes as well as overall statistics.

There is nothing major which causes an issue or concern here (ie, the science is solid), however, I think this sort of exploration would be far more powerful is extended to other organisms with AlphaFold predictions, as I think the contrast between the human scenario (with more experimental focus) and other organisms would be important. As I suspect the big issue will be on just importance/impact of this paper, I think this will make for a more rounded and impactful paper.

Minor issues:

I think the authors could have introduced their >95%, 50-95% and 20-50% identity buckets better in the text; One has to draw lines arbitarily somewhere, but they should be up front about this in the text as well as in the figures. This is more stylistic than anything else.

Another point, the authors use the European convention of . for separator with thousands, whereas I think plos expects the US/UK convention of comma.

Reviewer #3: AlphaFold is a deep learning algorithm developed by Google's DeepMind that predicts protein structure from its amino acid sequence. The AlphaFold database containing the predictions for the human proteome and 20 other organisms has now been released to the community. This paper evaluates the impact of the AlphaFold database on our knowledge of human proteins. It also evaluates the impact on the knowledge of disease-associated genes and mutations. Lastly, the authors provide examples of some disease-associated proteins where AlphaFold provided key insights. They conclude that the AlphaFold has largely closed the gap between the sequence-structure knowledge gap.

Strengths:

i) Extensive evaluation of the coverage of human proteome before and after AlphaFold. Databases used - PDB, ENSEMBL

* The amount of protein for which no structure information was available has reduced from 53% before AllphaFold (Fig. 1d) to 25% after AlphaFold (Fig. 1e)

* AlphaFold reduced the number of proteins without structural coverage from 4,832 to only 29

* GO enrichment analysis on these 4,832 proteins revealed strong enrichment in 269 olfactory receptor genes, 66 lipid metabolism genes, 1700 genes integral to membrane, and 1056 genes without previous information.

ii) Extensive evaluation of the improvement of our knowledge of the disease related genes and mutations extracted from - DisGeNet, OncoKB, TCGA, ClinVar

* The coverage of disease-releated genes based on their PDB structures (50-61%) is higher than that of the average proteome (47%). Thereforefore, it is not surprising that AlphaFold does not contribute as much to them as it does to the rest of the proteome

* AlphaFold increased the percentage of high quality coverage proteins from 31% to 43% for benign mutations of ClinVar, and from 71% to 83% for pathogenic mutations

ii) Good examples of the disease-causing genes B3GALT6, MED12, in which AlphaFold has revealed the specific-clustering due to disease-causing mutations

The authors conclude that the after AlphaFold has "practically completed" our coverage of the human foldable proteome, and this shall open the door for more challenging problems in structural biology.

Weakness:

i) Parts of the paper of were very hard to follow and need relatively extensive re-writing and tightening

ii) The mutations taken from ClinVar were reported as benign or pathogenic. The authors need to provide criteria they used to select those variants. Normally, variants with at least one star would be selected. Otherwise, the results could be polluted by noise.

**********

Have the authors made all data and (if applicable) computational code underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data and code underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data and code should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data or code —e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: No: The code is not available.

Reviewer #2: Yes

Reviewer #3: Yes

**********

PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: No

Reviewer #3: No

Figure Files:

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email us at figures@plos.org.

Data Requirements:

Please note that, as a condition of publication, PLOS' data policy requires that you make available all data used to draw the conclusions outlined in your manuscript. Data must be deposited in an appropriate repository, included within the body of the manuscript, or uploaded as supporting information. This includes all numerical values that were used to generate graphs, histograms etc.. For an example in PLOS Biology see here: http://www.plosbiology.org/article/info%3Adoi%2F10.1371%2Fjournal.pbio.1001908#s5.

Reproducibility:

To enhance the reproducibility of your results, we recommend that you deposit your laboratory protocols in protocols.io, where a protocol can be assigned its own identifier (DOI) such that it can be cited independently in the future. Additionally, PLOS ONE offers an option to publish peer-reviewed clinical study protocols. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols

PLoS Comput Biol. doi: 10.1371/journal.pcbi.1009818.r003

Decision Letter 1

Silvio C E Tosatto, Arne Elofsson

7 Jan 2022

Dear Mr Porta-Pardo,

We are pleased to inform you that your manuscript 'The structural coverage of the human proteome before and after AlphaFold' has been provisionally accepted for publication in PLOS Computational Biology.

Before your manuscript can be formally accepted you will need to complete some formatting changes, which you will receive in a follow up email. A member of our team will be in touch with a set of requests.

Please note that your manuscript will not be scheduled for publication until you have made the required changes, so a swift response is appreciated.

IMPORTANT: The editorial review process is now complete. PLOS will only permit corrections to spelling, formatting or significant scientific errors from this point onwards. Requests for major changes, or any which affect the scientific understanding of your work, will cause delays to the publication date of your manuscript.

Should you, your institution's press office or the journal office choose to press release your paper, you will automatically be opted out of early publication. We ask that you notify us now if you or your institution is planning to press release the article. All press must be co-ordinated with PLOS.

Thank you again for supporting Open Access publishing; we are looking forward to publishing your work in PLOS Computational Biology. 

Best regards,

Silvio C. E. Tosatto, PhD

Guest Editor

PLOS Computational Biology

Arne Elofsson

Deputy Editor

PLOS Computational Biology

***********************************************************

Reviewer's Responses to Questions

Comments to the Authors:

Please note here if the review is uploaded as an attachment.

Reviewer #1: The authors responded to all my answers and modified the manuscript. I think it is now suitable for publication

Reviewer #2: The authors have responded to my concerns well, and I appreciate the new section on other species (it would be churlish to ask for more, but I wonder if they should do figure 4 over everything in a years time!).

It is a sound paper, and the other changes have improved it.

Reviewer #3: The authors have provided good responses. I noticed this time an additional issue that I hope the authors can fix before this paper proceeds to production.

*) IDR are defined as "protein regions predicted not to have any tertiary structure in their native state". I think this definition is somewhat loose because disordered regions do have 3D structure, it's just that it's time-changing. IDRs may also exist as conformational ensembles such that multiple macro-states are simultaneously present in a population of molecules and one cannot obtain a unique fixed 3D structure using traditional X-ray crystallography or NMR spectroscopy. The authors can hopefully improve on their definition, perhaps something like "IDRs do not have unique equilibrium residue coordinates and instead exist either as conformational ensembles of multiple macro-states or without any equilibrium 3D structure and with relatively flat probability distribution on allowable 3D structures".

* Wrt IDR, a number of protein structures in PDB might be disordered when under physiological conditions. Multiple proteins have been crystalized under conditions of high salt, with binding partners, etc. but in fact may be disordered when in isolation. The paper cannot fix these problems, but this might be something to mention as limitations because this work does not focus on monomers only.

**********

Have the authors made all data and (if applicable) computational code underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data and code underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data and code should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data or code —e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

Reviewer #3: Yes

**********

PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: No

Reviewer #3: No

PLoS Comput Biol. doi: 10.1371/journal.pcbi.1009818.r004

Acceptance letter

Silvio C E Tosatto, Arne Elofsson

20 Jan 2022

PCOMPBIOL-D-21-01536R1

The structural coverage of the human proteome before and after AlphaFold

Dear Dr Porta-Pardo,

I am pleased to inform you that your manuscript has been formally accepted for publication in PLOS Computational Biology. Your manuscript is now with our production department and you will be notified of the publication date in due course.

The corresponding author will soon be receiving a typeset proof for review, to ensure errors have not been introduced during production. Please review the PDF proof of your manuscript carefully, as this is the last chance to correct any errors. Please note that major changes, or those which affect the scientific understanding of the work, will likely cause delays to the publication date of your manuscript.

Soon after your final files are uploaded, unless you have opted out, the early version of your manuscript will be published online. The date of the early version will be your article's publication date. The final article will be published to the same URL, and all versions of the paper will be accessible to readers.

Thank you again for supporting PLOS Computational Biology and open-access publishing. We are looking forward to publishing your work!

With kind regards,

Agnes Pap

PLOS Computational Biology | Carlyle House, Carlyle Road, Cambridge CB4 3DN | United Kingdom ploscompbiol@plos.org | Phone +44 (0) 1223-442824 | ploscompbiol.org | @PLOSCompBiol

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Supplementary Materials

    S1 Fig

    Structural coverage of Clinvar mtuations (y-axis) depending on their pathogenicity (different panels) and their review status (x-axis).

    (TIFF)

    S2 Fig

    Structural coverage (y-axis) of the proteome of the four different organisms before (left) and after (right) including the AlphaFold models.

    (TIFF)

    Attachment

    Submitted filename: Revision_letter.docx

    Data Availability Statement

    PDB data was downloaded from https://rcsb.org AlphaFold data was downloaded from https://alphafold.ebi.ac.uk/ Clinvar data was downloaded from https://ftp.ncbi.nlm.nih.gov/pub/clinvar/vcf_GRCh38/clinvar.vcf.gz TCGA data was downloaded from https://api.gdc.cancer.gov/data/1c8cfe5f-e52d-41ba-94da-f15ea1337efc.


    Articles from PLoS Computational Biology are provided here courtesy of PLOS

    RESOURCES