Oliviero Carugo1,2*
Kristina Djinović-Carugo2,3,4*- 1Department of Chemistry, University of Pavia, Pavia, Italy
- 2Max Perutz Labs, Department of Structural and Computational Biology, University of Vienna, Vienna, Austria
- 3European Molecular Biology Laboratory (EMBL) Grenoble, Grenoble, France
- 4Department of Biochemistry, Faculty of Chemistry and Chemical Technology, University of Ljubljana, Ljubljana, Slovenia
Protein structure prediction and structural biology have entered a new era with an artificial intelligence-based approach encoded in the AlphaFold2 and the analogous RoseTTAfold methods. More than 200 million structures have been predicted by AlphaFold2 from their primary sequences and the models as well as the approach itself have naturally been examined from different points of view by experimentalists and bioinformaticians. Here, we assessed the degree to which these computational models can provide information on subtle structural details with potential implications for diverse applications in protein engineering and chemical biology and focused the attention on chalcogen bonds formed by disulphide bridges. We found that only 43% of the chalcogen bonds observed in the experimental structures are present in the computational models, suggesting that the accuracy of the computational models is, in the majority of the cases, insufficient to allow the detection of chalcogen bonds, according to the usual stereochemical criteria. High-resolution experimentally derived structures are therefore still necessary when the structure must be investigated in depth based on fine structural aspects.
Introduction
In 2021, sensational progress was made in protein structure prediction with AlphaFold2, the artificial intelligence system developed by DeepMind (Jumper et al., 2021). These predictions became freely available in the AlphaFold Protein Structure Database (AlphaFold DB), created by EMBL-EBI, which presently includes more than 200 million predictions (Tunyasuvunakool et al., 2021) (Varadi et al., 2022).
The reliability of these predictions is astonishing, and–even more critical–the reliability is estimated at the level of each single amino acid through the predicted local distance difference test (pLDDT), enabling users to identify structures’ moieties that might be uncertain, e.g., conformational disorder. The importance of this precise accuracy estimate has been documented recently in a survey of AlphaFold2 applications in structural and molecular biology (Akdel et al., 2022).
Understandably, these predictions have been scrutinized from different perspectives. Some may find them unsatisfactory because based on statistics and not on physics and chemistry first principles (Moore et al., 2022), others suggest that they cannot, at least for the moment, reach the accuracy of experimental structures (Shao et al., 2022). Others have observed that they are insufficient in dealing with structural disorder or aggregation (Pinhero et al., 2021) and with structural features independent of gene sequence, like, for example, structuration of disordered proteins upon ligand binding or protein solvation by membrane lipids (Azzaz and Fantini, 2022). It has also been observed that other prediction methodologies, particularly homology modeling, can give equally good results in many cases at a much lower computational cost (Lee et al., 2022). Akdel and colleagues observed that the impact of missense mutations on the thermodynamic stability of proteins can be predicted equally well by using experimental structures or AlphaFold2 models (Akdel et al., 2022), though AlphaFold2 does not seem to be appropriate to forecast the structure of mutated proteins (Buel and Walters, 2022) (Pak et al., 2021). Naturally, the next desired level of prediction is on protein-protein, protein-nucleic acid and protein-ligand interactions. Fine progress on prediction of protein-protein interactions and automatization of pipelines has been made with AlphaFold-Multimer and AlphaPullDown (Evans et al., 2022) (Bryant et al., 2022) (Humphreys et al., 2021) (Mosalaganti et al., 2022) (Yu et al., 2023), for protein-protein interactions and as well as on generation of models loaded with their ligands (Hekkelman et al., 2022). Recently, AlphaFold2 models have also been used for validation of experimental models (Sanchez Rodriguez et al., 2022), computational docking (Holcomb et al., 2023), and cryo-EM refinements (Terashi et al., 2023).
Here, we seek to assess the degree to which these computational models can provide information on subtle details that may be important in various applications in protein engineering, chemical biology, and biotechnology. As an example, we focus on chalcogen bonds (referred to as ChB according to (Aekeroy et al., 2019)) formed by disulphide bridges (Aekeroy et al., 2019) (Vogel et al., 2019). This is an interesting test case because chalcogen bonds are not yet parameterized in any molecular mechanics/dynamics force field, and consequently, their presence cannot be affected by energy minimization protocols. In other words, these moderate clashes can be tolerated if compensated by a good and native-like packing around them, involving attractive interactions like hydrogen bonds, van der Waals interactions etc.
A ChB is an attractive interaction similar to a hydrogen bond, where a nucleophilic atom is attracted by an element of group 16 heavier than oxygen (chalcogens; sulphur, selenium and tellurium). While in proteins the most abundant chalcogen atom is sulphur—selenium is very rare and tellurium absent—there are several nucleophiles—oxygen, sulphur, and aromatic rings (Aekeroy et al., 2019; Scilabra et al., 2019; Carugo et al., 2021).
In the interacting moiety (C,S)-S…Nu (Figure 1A), where Nu is a nucleophile, an electrostatic attraction between the positively charged region found along the prolongation of the C-S bond can stabilize the interaction (Pascoe et al., 2017); additionally a n→σ* orbital delocalization between the nucleophile lone pair and the anti-bonding orbital of C-S may occur (Pascoe et al., 2017). The strongest ChBs may compare to conventional H-bonds (Pascoe et al., 2017), though it has been shown that in proteins hydrogen bonds tend to prevail over ChBs (Carugo, 2023).
FIGURE 1. (A) Schematic representation of a chalcogen bond; the position of the nucleophilic atom, for example, a main-chain oxygen atom, relative to the sulfur atom is monitored with two variables, d, its distance from the sulfur atom, and α = 180 – θ, where θ is the angle defined by the nucleophile, the sulfur, and the atom covalently bound to the sulfur. (B) Distribution of the Delta-ds, the differences between the distances d observed in the predicted structures (Alpha Fold DB) and in the experimental structures (PDB). (C) Distribution of the Delta-αs, the differences between the angles α observed in the predicted structures (Alpha Fold DB) and in the experimental structures (PDB). (D) Scatter plot of the Delta-α versus the Delta-d values. Delta-d and Delta-α values are given in Å and degrees, respectively.
ChBs are an interesting test case because they are not yet parameterized in any molecular mechanics/dynamics force field, and consequently, their presence cannot be favoured by energy minimization protocols. On the contrary, they would be considered inter-atomic clashes and consequently disfavoured. In other words, these moderate clashes can be tolerated if compensated by a good and native-like packing around them, involving attractive interactions like hydrogen bonds, van der Waals interactions etc.
Materials and methods
Data selection
All experimental structural data were taken from the Protein Data Bank (PDB) (Bernstein et al., 1977) (Berman et al., 2000) (wwPDB Consortium, 2019). Only X-ray crystal structures refined at a resolution better than (or equal to) 1.5 Å and determined in the 90–110 K temperature range were retained. Care was taken to discard multi-model refinements and structures where more than 5% of the atoms are not protein or water atoms. Then, pairwise percentage of sequence identity was limited to 40% with CD-HIT (Li and Godzik, 2006) (Fu et al., 2012), to avoid redundancy.
Computational models were taken from the AlphaFold Protein Structure Database (Tunyasuvunakool et al., 2021) (Varadi et al., 2022). They were identified through the sequence database accession codes, reported in the DBREF of the PDB files, which allow to identify the computational model with exactly the same sequence of the experimental structure. In this way, we ensured to compare molecules that share the same chemical formula. Not all PDB files have a DBREF annotation, typically mutants which are not in UniProt (Wu et al., 2006) and in AlphaFold DB (Tunyasuvunakool et al., 2021) (Varadi et al., 2022).
ChBs detection
A ChB can be formed by a nucleophilic atom and a chalcogen atom that is covalently bound to another atom (Figure 1A). The nucleophilic atom must be positioned along the prolongation of the covalent bond, or along the prolongation of one of the two covalent bonds if the chalcogen is divalent. As a consequence, there are two parameters that must be monitored, the distance d between the nucleophilic and the chalcogen atom and the angle α (Figure 1A).
According to the IUPAC recommendations, the distance d must be shorter than the sum S of the van der Waals radii of the nucleophilic and chalcogen atoms (Aekeroy et al., 2019), despite the fact that the use of van der Waals radii in determining non-bonding interactions may need to be revised (Politzer et al., 2007). Here, to account for the lower accuracy of macromolecular structures relative to small molecule structures, we added a small margin to S and, consequently, a in a ChB d must not be larger than S + 0.1 Å.
The angle α, which is supplementary to the angle θ, must be as small as possible. In chemical crystallography and material science, a ChB is usually characterized by a value smaller than 20°. Here, to account for the lower accuracy of macromolecular structures, we increased this threshold value to 25°.
Similar settings were previously used (Carugo, 2023) (Carugo, 2023) and can be compared with estimated average positional standard errors of 0.046 Å, which imply estimate errors of about 0.06 Å on bond distances and of about 2° on bond angles.
Results and discussion
About one-half (43%) of the ChBs observed in the experimental structures are present in the computational models if the same stereochemical criteria are used. This means that about one-half of the ChBs observed experimentally in high resolution crystal structures are not observed in the models deposited in AlphaFold DB.
Does this indicate that these models are wrong? Not really. On the contrary, models available in AlphaFold DB are extremely similar to the experimental crystal structures.
In many cases, the chalcogen-nucleophile contacts cannot be recognized as ChB because they are slightly longer than the experimental ones. In fact, the predicted distances d and angles α are close to those observed experimentally, with the differences between predicted and experimental d (Delta-d) and α (Delta-α) are not very far from 0 (Å or °; Figures 1B,C). The average absolute values of Delta-d and Delta-α are equal to 0.28 ± 0.04 Å and 9.5° ± 1.3°, respectively. These values must be compared to the estimated positional standard errors (Dinesh Kumar et al., 2015), which are very small (0.046 ± 0.002 Å) as expected for high-resolution structures.
Furthermore, the average absolute value of Delta-d is about three times greater than that calculated on the contacts (shorter than 3.5 Å) between main-chain oxygen and nitrogen atoms involving the residues that form ChBs (0.106 ± 0.008 Å). This clearly reveals that, within the same structural region, ChB predictions are much less accurate than main-chain hydrogen bond predictions.
Figure 2A shows an example in which the ChB is detected in both the experimental structures and in the computational model. The sulfur-oxygen distance d is even shorter in the AlphaFold DB model and the angle α is even closer to 0° in the AlphaFold model. Figure 2B shown an example in which the ChB is detected in the experimental structure and not in the AlphaFold DB model. The local stereochemistry is quite well predicted but the sulfur-oxygen distance is slightly too long (the threshold is sum of the van der Waals radii, 1.52 Å for oxygen and 1.80 Å for sulfur, with and small positive tolerance of 0.1 Å, is 3.42 Å). This might seem a minor distortion, but in terms of chemical interactions is crucial.
FIGURE 2. Comparison between the experimental and computation ChBs in three selected examples. The experimental structure is represented with ball and sticks and the computational model only with sticks. In (A) the ChB is detectable in both structures; in (B), the ChB is detectable only in the experimental structures since the distance d is slightly too long in the computational model; in (C), the ChB is detected in the experimental structures and it cannot be detected in the computational model where the disulphide bond is absent–this is a region partially unstructured of the protein. Color code: nitrogen is blue, oxygen red, sulfur yellow, carbon light grey in the experimental structure and azure in the AlphaFold DB model. For each residue, the following information is given: name, sequence number and chain identifier. The figure was prepared with Chimera 1.16.
In principle, it would be possible to increase the threshold values of d and α that allow to automatically detect ChBs in such a way to increase the number of ChBs in the models of AlphaFold DB. However, the values of these thresholds strictly depend on the laws of chemistry and physics and nothing indicates here that this is justified. AlphaFold2 is a powerful tool for predicting protein three-dimensional structures.
There are only a few cases where the predicted structure is very different from the experimental one. For example, in ten cases with Delta-α > 30°, most of them have large Delta-ds (Figure 1D). However, in seven of them (PDB: 1vf8, 3b4n, 3om0, 3uci, 6ac5, 6h20, and 6jk4), the average pLDDT values of the residues bridged by the ChB are <90, indicating that side-chains might not be predicted reliably, or even <50, suggesting that predictions should be treated with caution. Only three predicted structures (PDB: 3soj, 4kl3, and 6ya1) have pLDDT >90, suggesting that models have high accuracy, despite Delta-α >30°.
Figure 2C shows one of the rare examples where AlphaFold DB models seem to be completely inadequate. The local stereochemistry–this a partially disordered part of the protein–is wrong, the cysteine 4 is misplaced and the disulphide bonds is broken. No surprisingly, the ChB is broken, too.
We conclude that computational models produced with AlphaFold2 and stored in AlphaFold DB are accurate–we note that for these proteins a high-resolution crystal structure is available in the PDB. In the majority of the cases, they show contacts between sulphur atoms of disulphide bridges and protein nucleophilic atoms that are comparable to the experimental ones. However, the accuracy of the computational models is, in the several cases, insufficient to allow the detection of ChBs, according to the usual stereochemical criteria.
This indicates that high-resolution structures are still necessary when the structure must be investigated in depth and when the importance of weak interactions, like ChBs, is assessed. While current AlphaFold2 models stored in AlphaFold DB still lack atomic resolution, they certainly provide useful information for a number of semiquantitative applications. However, in agreement with Shao and colleagues, it is reasonable to conclude that “experimentally determined crystal structures are more reliable than AlphaFold2-computed structure models and should be used preferentially whenever possible” (Shao et al., 2022).
Data availability statement
The original contributions presented in the study are included in the article/Supplementary Material, further inquiries can be directed to the corresponding authors.
Author contributions
OC and KD-C contributed to the conception and design of the study, OC performed the statistical analysis and wrote the first draft of the manuscript. All authors contributed to the article and approved the submitted version.
Conflict of interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Publisher’s note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
Supplementary material
The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fmolb.2023.1155629/full#supplementary-material
References
Aekeroy, C., Bryce, B. D., Desiraju, L. G., Frontera, R. A., Legon, A. C., Nicotra, F., et al. (2019). Definition of the chalcogen bond (IUPAC Recommendations 2019). Pure Appl. Chem. 91, 1889–1892. doi:10.1515/pac-2018-0713
Akdel, M., Pires, D. E. V., Pardo, E. P., Jänes, J., Zalevsky, A. O., Mészáros, B., et al. (2022). A structural biology community assessment of AlphaFold2 applications. Nat. Struct. Mol. Biol. 29, 1056–1067. doi:10.1038/s41594-022-00849-w
Azzaz, F., and Fantini, J. (2022). The epigenetic dimension of protein structure. Biomol. Concepts 13, 55–60. doi:10.1515/bmc-2022-0006
Berman, H. M., Westbrook, J., Feng, Z., Gilliland, G., Bhat, T. N., Weissig, H., et al. (2000). The protein Data Bank. Nucleic Acids Res. 28, 235–242. doi:10.1093/nar/28.1.235
Bernstein, F. C., Koetzle, T. F., Williams, G. J. B., Meyer, E. F. J., Brice, M. D., Rodgers, J. R., et al. (1977). The protein Data Bank: A computer-based archival file for macromolecular structures. J. Mol. Biol. 112, 535–542. doi:10.1016/s0022-2836(77)80200-3
Bryant, P., Pozzati, G., and Elofsson, A. (2022). Improved prediction of protein-protein interactions using AlphaFold2. Nat. Commun. 13, 1265. doi:10.1038/s41467-022-28865-w
Buel, G. R., and Walters, K. J. (2022). Can AlphaFold2 predict the impact of missense mutations on structure? Nat. Struct. Mol. Biol. 29, 1–2. doi:10.1038/s41594-021-00714-2
Carugo, O. (2023). Interplay between hydrogen and chalcogen bonds in cysteine. Proteins 91, 395–399. doi:10.1002/prot.26437
Carugo, O., Resnati, G., and Metrangolo, P. (2021). Chalcogen bonds involving selenium in protein structures. ACS Chem. Biol. 16, 1622–1627. doi:10.1021/acschembio.1c00441
Carugo, O. (2022). Survey of the Intermolecular disulfide bonds observed in protein crystal structures deposited in the protein data bank. Life (Basel) 12, 986.
Carugo, O. I. (2023). Chalcogen bonds formed by protein sulfur atoms in proteins. A survey of high-resolution structures deposited in the protein data bank. J. Biomol. Struct. Dyn. Online ahead of print. doi:10.1080/07391102.2022.2143427
Dinesh Kumar, K. S., Gurusaran, M., Satheesh, S. N., Radha, P., Pavithra, S., Helliwell, J. R., et al. (2015). Online_DPI: A web server to calculate the diffraction precision index for a protein structure. J. Appl. Cryst. 48, 939–942. doi:10.1107/s1600576715006287
Evans, R., O’Neill, M., Pritzel, A., Antropova, N., Senior, A., Green, T., et al. (2022) Protein complex prediction with AlphaFold-Multimer. bioRxiv, 2021.doi:10.1101/2021.10.04.463034
Fu, L., Niu, B., Zhu, Z., Wu, S., and Li, W. (2012). CD-HIT: Accelerated for clustering the next generation sequencing data. Bioinformatics 28, 3150–3152. doi:10.1093/bioinformatics/bts565
Hekkelman, M. L., de Vries, I., Joosten, R. P., and Perrakis, A. (2022). AlphaFill: Enriching AlphaFold models with ligands and cofactors. Nat. Methods 20, 205–213. doi:10.1038/s41592-022-01685-y
Holcomb, M., Chang, Y-T., Goodsell, D. S., and Forli, S. (2023). Evaluation of AlphaFold2 structures as docking targets. Protein Sci. 32, e4530. doi:10.1002/pro.4530
Humphreys, I. R., Pei, J., Baek, M., Krishnakumar, A., Anishchenko, I., Ovchinnikov, S., et al. (2021). Computed structures of core eukaryotic protein complexes. Science 374, eabm4805. doi:10.1126/science.abm4805
Jumper, J., Evans, R., Pritzel, A., Green, T., Figurnov, M., Ronneberger, O., et al. (2021). Highly accurate protein structure prediction with AlphaFold. Nature 596, 583–589. doi:10.1038/s41586-021-03819-2
Lee, C., Su, B. H., and Tseng, Y. J. (2022). Comparative studies of AlphaFold, RoseTTAFold and modeller: A case study involving the use of G-protein-coupled receptors. Brief. Bioinfo 23, bbac308–7. doi:10.1093/bib/bbac308
Li, W., and Godzik, A. (2006). Cd-Hit: A fast program for clustering and comparing large sets of protein or nucleotide sequences. Bioinformatics 22, 1658–1659. doi:10.1093/bioinformatics/btl158
Moore, P. B., Hendrickson, W. A., Henderson, R., and Brunger, A. T. (2022) The protein-folding problem: Not yet solved. Science 375(80), 507. doi:10.1126/science.abn9422
Mosalaganti, S., Obarska-Kosinska, A., Siggel, M., Taniguchi, R., Turoňová, B., Zimmerli, C. E., et al. (2022). AI-based structure prediction empowers integrative structural analysis of human nuclear pores. Science 376, eabm9506. doi:10.1126/science.abm9506
Pak, M. A., Markhieva, K. A., Novikova, M. S., Petrov, D. S., Vorobyev, I. S., Maksimova, E. S., et al. (2021). Using AlphaFold to predict the impact of single mutations on protein stability and function. Prepr. bioRxiv. Available at: https//www.biorxiv.org/content/101101/20210919460937v1
Pascoe, D. J., Ling, K. B., and Cockroft, S. L. (2017). The origin of chalcogen-bonding interactions. J. Am. Chem. Soc. 139, 15160–15167. doi:10.1021/jacs.7b08511
Pinhero, F., Santos, J., and Ventura, S. (2021). AlphaFold and the amyloid landspace. J. Mol. Biol. 433, 167059. doi:10.1093/bjs/znab183
Politzer, P., Concha, M. C., Ma, Y., and Murray, J. S. (2007). An overview of halogen bonding. J. Mol. Model 13, 305–311. doi:10.1007/s00894-006-0154-7
Sanchez Rodriguez, F., Chojnowski, G., Keegan, R. M., and Rigden, D. J. (2022). Using deep-learning predictions of inter-residue distances for model validation. Acta Cryst. D78, 1412–1427. doi:10.1107/S2059798322010415
Scilabra, P., Terraneo, G., and Resnati, G. (2019). The chalcogen bond in crystalline solids: A world parallel to halogen bond. Acc. Chem. Res. 52, 1313–1324. doi:10.1021/acs.accounts.9b00037
Shao, C., Bittrich, S., Wang, S., and Burley, S. K. (2022). Assessing PDB macromolecular crystal structure confidence at the individual amino acid residue level. Structure 30, 1385–1394.e3. doi:10.1016/j.str.2022.08.004
Terashi, G., Wang, X., and Kihara, D. (2023). Protein model refinement for cryo-EM maps using AlphaFold2 and the DAQ score. Acta Cryst. D79, 10–21. doi:10.1107/S2059798322011676
Tunyasuvunakool, K., Adler, J., Wu, Z., Green, T., Zielinski, M., Žídek, A., et al. (2021). Highly accurate protein structure prediction for the human proteome. Nature 596, 590–596. doi:10.1038/s41586-021-03828-1
Varadi, M., Anyango, S., Deshpande, M., Nair, S., Natassia, C., Yordanova, G., et al. (2022). AlphaFold protein structure database: Massively expanding the structural coverage of protein-sequence space with high-accuracy models. Nucl. Acids Res. 50, D439–D444. doi:10.1093/nar/gkab1061
Vogel, L., Wonner, P., and Huber, S. M. (2019). Chalcogen bonding: An overview. Angew. Chem. Int. Ed. Engl. 58, 1880–1891. doi:10.1002/anie.201809432
Wu, C. H., Apweiler, R., Bairoch, A., Natale, D. A., Barker, W. C., Boeckmann, B., et al. (2006). The universal protein resource (UniProt): An expanding universe of protein information. Nucleic Acids Res. 34, D187–D191. doi:10.1093/nar/gkj161
wwPDB Consortium (2019). Protein Data Bank: The single global archive for 3D macromolecular structure data. Nucleic Acids Res. 47, D520–D528. doi:10.1093/nar/gky949
Keywords: AlphaFold, chalcogen bond, 3D structure prediction, stereochemical criteria, experimental 3D structure
Citation: Carugo O and Djinović-Carugo K (2023) Automated identification of chalcogen bonds in AlphaFold protein structure database files: is it possible?. Front. Mol. Biosci. 10:1155629. doi: 10.3389/fmolb.2023.1155629
Received: 31 January 2023; Accepted: 26 June 2023;
Published: 06 July 2023.
Edited by:
Piero Andrea Temussi, University of Naples Federico II, ItalyReviewed by:
Esko Oksanen, European Spallation Source, SwedenAndrew Docker, University of Oxford, United Kingdom
Copyright © 2023 Carugo and Djinović-Carugo. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Oliviero Carugo, oliviero.carugo@univie.ac.at Kristina Djinović-Carugo, kristina.djinovic@univie.ac.at