Version Changes
Revised. Amendments from Version 1
We like to thank all reviewers for their insightful comments. The reviewers' comments and suggestions were incorporated into the revised manuscript. In brief, we have added a request that new polyclonal antibodies should get new catalogue numbers and old specificity data from one batch must not be transferred to the next. In this respect we added a reference to Voskuil (2014). We included a hint that the validation method should reflect the intended application of antibodies. We discuss the costs associated with improved quality control and now also refer to Bradbury & Plückthun (2015a and 2015b) when proposing a move away from polyclonal antibodies. Finally, we discuss the option to publish the sequences of recombinant affinity reagents to ensure long term reproducibility.
Abstract
Histone post-translational modification (PTM) antibodies are essential research reagents in chromatin biology. However, they suffer from variable properties and insufficient documentation of quality. Antibody manufacturers and vendors should provide detailed lot-specific documentation of quality, rendering further quality checks by end-customers unnecessary. A shift from polyclonal antibodies towards sustainable reagents like monoclonal or recombinant antibodies or histone binding domains would help to improve the reproducibility of experimental work in this field.
Keywords: histone modifications, antibodies, recombinant proteins, quality control
The lack of reproducibility is widely recognized as a serious issue in contemporary research (see (
Buck, 2015;
Freedman & Inglese, 2014;
Freedman
et al., 2015;
McNutt, 2014a;
McNutt, 2014b) and the Nature special “Challenges in irreproducible research” April 2, 2013). In molecular biology, the quality of antibodies has been identified and highlighted as one of the most recurring stumbling blocks that undermine the quality and validity of experimental results (
Baker, 2015;
Bordeaux
et al., 2010;
Bradbury & Plückthun, 2015a;
Bradbury & Plückthun, 2015b). This issue is even more pervasive in the field of molecular epigenetics and chromatin biology, where antibodies for various types of histone post translational modifications (PTMs) have been single-handedly used to translate the language of histone modifications into experimentally observable properties. Because of this, most of what we know about the distribution, role and function of histone modifications so far has been passed through an antibody as essential mediator.
Raising a specific histone modification antibody is not a trivial task; this is mostly due to the hypermodified state of the histone tail, coupled with the minute size and the chemical relatedness of many histone modifications and similarities in the amino acid sequence of the modified residues. The antibody has to be able to discriminate between the unmodified and the modified state of the targeted amino acid residue, as well as between different forms of modifications (e.g. acetylations of different lysine residues, mono-, di- and trimethylation of lysine residues, or symmetric and asymmetric methylation of arginine residues). Moreover, the presence of an adjacent modification might prevent binding of an antibody to the target modification, causing false negative results. In addition, the antibody should bind the modified amino acid residue only at defined modification sites on the target protein, which implies that not only the modification but also the amino acid sequence must be recognized. This is particularly difficult for some histone modifications such as methylation or acetylation of H3K9 and H3K27 which occur within an identical amino acid context (ARKS motif) and make the readout of the target peptide sequence outside of this central motif vital as well.
In spite of the intricate task of producing histone modification antibodies and their crucial role in chromatin biology, surprisingly, they remain insufficiently characterized. In line with this, numerous scientific groups have alarmingly raised concerns about the promiscuous behavior of some histone modification antibodies and undocumented effects of secondary modifications (
Bock
et al., 2011;
Egelhofer
et al., 2011;
Hattori
et al., 2013;
Kungulovski
et al., 2014;
Nishikori
et al., 2012;
Rothbart
et al., 2015). As mentioned above, the situation in chromatin biology is exceptional, because of the role of histone PTM antibodies as the sole research tool in this field. As a consequence, elaborate quality control criteria for histone PTM antibodies were put forward to ensure the integrity of research (
Egelhofer
et al., 2011;
Kungulovski
et al., 2015;
Landt
et al., 2012). To increase transparency, at least two databases for deposition of antibody quality data from researchers were put in place (
http://compbio.med.harvard.edu/antibodies/;
http://www.histoneantibodies.com/) (
Egelhofer
et al., 2011;
Rothbart
et al., 2015). However, in spite of being heroic attempts, these and similar databases have only a limited value, because most of the antibodies used in chromatin biology are polyclonal, and lab experience over the last years has demonstrated that the specificity data obtained for one batch of antibody do not necessarily reflect the properties of another one (
Kungulovski
et al., 2014), a caveat which is still often ignored by naïve end-users. Related to this the practice of some antibody manufactures of retaining catalog numbers for new polyclonal antibody lots is unacceptable and misleading as well as the practice to use historical data sheets for antibodies to which they do not apply (
Voskuil, 2014).
The necessary quality control steps for histone modification antibodies (
Egelhofer
et al., 2011;
Kungulovski
et al., 2015;
Landt
et al., 2012) currently burden the individual antibody user with high costs and workload. Given that antibodies are expensive reagents, which are of no use without appropriate quality documentation, these efforts must be redirected from the end-customer to the manufacturers of antibodies. Herein, we urgently ask the vendors and manufacturers of antibodies to provide the necessary product sheets for all types of antibodies on a regular basis, including quality control documentation for each batch of polyclonal and each catalog number of recombinant or monoclonal antibodies. Results of the following validation tests must be provided to enable the end-user finding the information, which is particularly relevant for the intended application of an antibody:
-
1.
Combinatorial profiling of specificity with peptide arrays or similar high-throughput methods. If possible, profiling of specificity with recombinant and semisynthetic nucleosomes harboring different modifications.
-
2.
Western blot results with native (as positive control) and recombinant histones (as negative control).
-
3.
Western blot results with native histones or nuclear extracts from cells where the responsible histone modifying enzyme has been deleted or depleted (mammalian cells) or mutant histones (yeast).
-
4.
Reproducibility of ChIP-seq data and high correlation with similar validated ChIP-seq datasets.
As proposed by others (
Bradbury & Plückthun, 2015a;
Bradbury & Plückthun, 2015b) end-users should consider boycotting companies not complying with this demand, or at least stay away from products lacking a proper lot-specific documentation. While one may expect that better quality control will increase the prices of commercial antibodies, end-customers will not be forced to conduct their own quality control and they will not waste money for non-functional antibodies, so that the overall final costs may not be much higher. Moreover, the value of the obtained data will increase massively with better antibody validation.
The batch-to-batch variability of critical properties like cross reactivity or inhibition by secondary marks makes the application of polyclonal antibodies intrinsically unsustainable, because experiments cannot be reproduced after the corresponding batch of an antibody is sold out. As a consequence of this, rigorously speaking, large data sets in chromatin biology exist in a “grey” area outside of natural science, since it is impossible to repeat the underlying experiments. In a long-term perspective, a shift away from polyclonal antibodies towards alternative reagents, which can be produced at constant quality, would help to reduce the necessary financial and workload efforts associated with quality control of polyclonal antibodies and ensure sustainability (
Bradbury & Plückthun, 2015a;
Bradbury & Plückthun, 2015b). This applies to high quality monoclonal antibodies, recombinant antibodies (
Hattori
et al., 2013) or analogous recombinant reading domains (
Kungulovski
et al., 2014). This will not only help to reduce costs in chromatin research in the long run (once obtained, the documentation will be valid for all lots) but also help to standardize the affinity reagents used and ease the lab-to-lab comparison of data. The recombinant reagents are particularly promising, because their sequences can be published, which ensures full transparency and reproducibility. Of note, in chromatin biology native reading domains designed by nature to specifically recognize relevant histone PTM marks are available as an alternative to antibodies (
Kungulovski
et al., 2014), which is an advantage over other fields, where recombinant production of antibodies is the only technical solution to the issue of reproducible performance and long term availability of these essential research reagents.
Funding Statement
Work in the authors’ lab has been supported by the DFG JE 252/26-1.
I confirm that the funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
[version 2; referees: 3 approved]
References
-
Baker M:
Reproducibility crisis: Blame it on the antibodies.
Nature.
2015;521(7552):274–276.
10.1038/521274a
[DOI] [PubMed] [Google Scholar]
-
Bock I, Dhayalan A, Kudithipudi S, et al. :
Detailed specificity analysis of antibodies binding to modified histone tails with peptide arrays.
Epigenetics.
2011;6(2):256–263.
10.4161/epi.6.2.13837
[DOI] [PMC free article] [PubMed] [Google Scholar]
-
Bordeaux J, Welsh A, Agarwal S, et al. :
Antibody validation.
Biotechniques.
2010;48(3):197–209.
10.2144/000113382
[DOI] [PMC free article] [PubMed] [Google Scholar]
-
Bradbury A, Plückthun A:
Reproducibility: Standardize antibodies used in research.
Nature.
2015a;518(7537):27–29.
10.1038/518027a
[DOI] [PubMed] [Google Scholar]
-
Bradbury AR, Plückthun A:
Getting to reproducible antibodies: the rationale for sequenced recombinant characterized reagents.
Protein Eng Des Sel.
2015b;28(10):303–305.
10.1093/protein/gzv051
[DOI] [PubMed] [Google Scholar]
-
Buck S:
Solving reproducibility.
Science.
2015;348(6242):1403.
10.1126/science.aac8041
[DOI] [PubMed] [Google Scholar]
-
Egelhofer TA, Minoda A, Klugman S, et al. :
An assessment of histone-modification antibody quality.
Nat Struct Mol Biol.
2011;18(1):91–93.
10.1038/nsmb.1972
[DOI] [PMC free article] [PubMed] [Google Scholar]
-
Freedman LP, Cockburn IM, Simcoe TS:
The Economics of Reproducibility in Preclinical Research.
PLoS Biol.
2015;13(6):e1002165.
10.1371/journal.pbio.1002165
[DOI] [PMC free article] [PubMed] [Google Scholar]
-
Freedman LP, Inglese J:
The increasing urgency for standards in basic biologic research.
Cancer Res.
2014;74(15):4024–4029.
10.1158/0008-5472.CAN-14-0925
[DOI] [PMC free article] [PubMed] [Google Scholar]
-
Hattori T, Taft JM, Swist KM, et al. :
Recombinant antibodies to histone post-translational modifications.
Nat Methods.
2013;10(10):992–995.
10.1038/nmeth.2605
[DOI] [PMC free article] [PubMed] [Google Scholar]
-
Kungulovski G, Kycia I, Tamas R, et al. :
Application of histone modification-specific interaction domains as an alternative to antibodies.
Genome Res.
2014;24(11):1842–1853.
10.1101/gr.170985.113
[DOI] [PMC free article] [PubMed] [Google Scholar]
-
Kungulovski G, Mauser R, Jeltsch A:
Affinity reagents for studying histone modifications and guidelines for their quality control.
Epigenomics.
2015; in press. [DOI] [PubMed] [Google Scholar]
-
Landt SG, Marinov GK, Kundaje A, et al. :
ChIP-seq guidelines and practices of the ENCODE and modENCODE consortia.
Genome Res.
2012;22(9):1813–1831.
10.1101/gr.136184.111
[DOI] [PMC free article] [PubMed] [Google Scholar]
-
McNutt M:
Journals unite for reproducibility.
Science.
2014a;346(6210):679.
10.1126/science.aaa1724
[DOI] [PubMed] [Google Scholar]
-
McNutt M:
Reproducibility.
Science.
2014b;343(6168):229.
10.1126/science.1250475
[DOI] [PubMed] [Google Scholar]
-
Nishikori S, Hattori T, Fuchs SM, et al. :
Broad ranges of affinity and specificity of anti-histone antibodies revealed by a quantitative peptide immunoprecipitation assay.
J Mol Biol.
2012;424(5):391–399.
10.1016/j.jmb.2012.09.022
[DOI] [PMC free article] [PubMed] [Google Scholar]
-
Rothbart SB, Dickson BM, Raab JR, et al. :
An Interactive Database for the Assessment of Histone Antibody Specificity.
Mol Cell.
2015;59(3):502–511.
10.1016/j.molcel.2015.06.022
[DOI] [PMC free article] [PubMed] [Google Scholar]
-
Voskuil J:
Commercial antibodies and their validation [version 2; referees: 3 approved].
F1000Res.
2014;3:232.
10.12688/f1000research.4966.2
[DOI] [PMC free article] [PubMed] [Google Scholar]
The authors concentrate on their core message for better characterization and documentation and for shifting toward renewable reagents. It is important to note that more characterization would be better but demanding the inclusion of assays of limited predictive power would increase the cost of antibodies without substantially benefiting the end users.
"Moreover, we are not convinced that the development of special conditions by each lab is an advisable development, because in many cases these may not be fully documented which - again - would undermine reproducibility. While it is self-evident that the researchers are ultimately responsible for the validity of all their results, lab internal quality certifications in our view are not the best way to proceed in an ever growing experimental field."
This is not what meant in my review. Instead, I mean that what an end user studies would always represents novel conditions (different cells, different culture conditions, different number of cells, etc.). So, strictly speaking, there is no guarantee that even a highly validated antibody functions in the actual experiment. The field would benefit greatly by establishing better internal controls that are included in each experiment, particularly for ChIP.
I have read this submission. I believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard.
The authors have addressed my concerns
I have read this submission. I believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard.
This paper succinctly reviews antibody-related problems that have been widely recognized in the biological and biomedical community, in a specific context of anti-histone posttranslational modification (PTM) antibodies and their uses in epigenetic research. The authors correctly emphasize the large negative impact of the batch-to-batch variation of anti-histone PTM antibodies and its consequence ('large data sets in chromatin biology exist in a “grey” area outside of natural science, since it is impossible to repeat the underlying experiments.'). I generally agree with the current challenges described in this paper, but it could be improved by addressing the following points.
An important omission in the paper is the limited recognition by users of potentially large effects of the mismatch between validation methods and real applications. We can perhaps agree that antibodies should ideally be validated in a manner that closely mimics how it is used in the actual application. Validation methods can be divided into two general types based on their formats: one in which antibodies are immobilized and captured antigens are detected ("immunoprecipation (IP) type") and the other in which antigens are immobilized and captured antibodies are detected ("blotting type"). Peptide arrays and Western blotting fall into the latter blotting-type validation methods, in which peptides or denatured proteins are localized, often at high density, on a solid support and binding of dilute antibody samples is detected. To state the obvious, IP-type methods are suited for validating antibodies for IP-type applications (IP, ChIP), whereas blotting-type methods are suited for validating antibodies for blotting-type applications (Western, immunostaining).
Potential problems arise when the validation format is different from the application format. It is not easy to predict whether antibodies validated using blotting-type methods perform well in IP-type applications such as ChIP, and vise versa. Egelhofer
et al. (2011) reported that more than 20% of antibodies that have been validated to be specific in peptide blots still fail in ChIP experiments. In typical IP applications where an antibody is immobilized on a solid support, antibody affinity is a critical parameter. In contrast, affinity is not critical in blotting type applications, because the bivalent format of the conventional antibody (i.e. two antigen-binding sites per molecule) helps boost binding (the so-called avidity effect). Indeed, it has been found that an antibody that looked good on peptide arrays performed poorly in IP and conversely another antibody that did not look good on peptide arrays performed exceedingly well in IP (Nishikori
et al., 2012). Similarly, an antibody (Active Motif 39156) performed well in IP validation using semi-synthetic nucleosomes ("IceChIP"), although it appeared cross-reactive in peptide-array validation and in Western blotting (Rothbart
et al., 2015). Further complications arise from the fact that spot intensities in array-type experiments are not quantitatively correlated with the strengths of the measured interactions (see, for examples, Stiffler
et al., 2006; Hause
et al. 2012).
Another omission is that validation and actual results depend on experimental conditions and accordingly an antibody validated under one set of conditions may not perform as well under a different set of conditions. Practitioners of immunoblotting are all familiar with the need for "optimizing" conditions for their own experiments. Similar optimizations are needed for other types of applications for which desired outcomes are less obvious. Furthermore, the abundance of the antigen of interest relative to off targets influences the outcome. Even a highly selective and potent antibody may not sufficiently enrich extremely rare antigens. Accordingly, for IP-type applications, mass spectroscopy-based validation using IP with input materials similar to those used in actual experiments (Peach
et al., 2012; Hattori
et al., 2013; Marcon
et al. 2015) and IP of semi-synthetic nucleosomes (Grzybowski
et al., 2015) are better suited as validation methods.
This paper should emphasize more that the end user must critically evaluate limitations of validation methods caused by format mismatches and/or variations in experimental conditions. I do not agree with this paper's recommendations that a single set of information be provided with any antibody regardless of its intended use.
I have read this submission. I believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard, however I have significant reservations, as outlined above.
References
-
1.
Egelhofer TA, Minoda A, Klugman S, Lee K, Kolasinska-Zwierz P, Alekseyenko AA, Cheung MS, Day DS, Gadel S, Gorchakov AA, Gu T, Kharchenko PV, Kuan S, Latorre I, Linder-Basso D, Luu Y, Ngo Q, Perry M, Rechtsteiner A, Riddle NC, Schwartz YB, Shanower GA, Vielle A, Ahringer J, Elgin SC, Kuroda MI, Pirrotta V, Ren B, Strome S, Park PJ, Karpen GH, Hawkins RD, Lieb JD:
An assessment of histone-modification antibody quality.
Nat Struct Mol Biol.2011;18(1) :
10.1038/nsmb.1972
91-3
10.1038/nsmb.1972
[DOI] [PMC free article] [PubMed] [Google Scholar]
-
2.
Nishikori S, Hattori T, Fuchs SM, Yasui N, Wojcik J, Koide A, Strahl BD, Koide S:
Broad ranges of affinity and specificity of anti-histone antibodies revealed by a quantitative peptide immunoprecipitation assay.
J Mol Biol.2012;424(5) :
10.1016/j.jmb.2012.09.022
391-9
10.1016/j.jmb.2012.09.022
[DOI] [PMC free article] [PubMed] [Google Scholar]
-
3.
Rothbart SB, Dickson BM, Raab JR, Grzybowski AT, Krajewski K, Guo AH, Shanle EK, Josefowicz SZ, Fuchs SM, Allis CD, Magnuson TR, Ruthenburg AJ, Strahl BD:
An Interactive Database for the Assessment of Histone Antibody Specificity.
Mol Cell.2015;59(3) :
10.1016/j.molcel.2015.06.022
502-11
10.1016/j.molcel.2015.06.022
[DOI] [PMC free article] [PubMed] [Google Scholar]
-
4.
Stiffler MA, Grantcharova VP, Sevecka M, MacBeath G:
Uncovering quantitative protein interaction networks for mouse PDZ domains using protein microarrays.
J Am Chem Soc.2006;128(17) :
10.1021/ja060943h
5913-22
10.1021/ja060943h
[DOI] [PMC free article] [PubMed] [Google Scholar]
-
5.
Hause RJ, Leung KK, Barkinge JL, Ciaccio MF, Chuu CP, Jones RB:
Comprehensive binary interaction mapping of SH2 domains via fluorescence polarization reveals novel functional diversification of ErbB receptors.
PLoS One.2012;7(9) :
10.1371/journal.pone.0044471
e44471
10.1371/journal.pone.0044471
[DOI] [PMC free article] [PubMed] [Google Scholar]
-
6.
Peach SE, Rudomin EL, Udeshi ND, Carr SA, Jaffe JD:
Quantitative assessment of chromatin immunoprecipitation grade antibodies directed against histone modifications reveals patterns of co-occurring marks on histone protein molecules.
Mol Cell Proteomics.2012;11(5) :
10.1074/mcp.M111.015941
128-37
10.1074/mcp.M111.015941
[DOI] [PMC free article] [PubMed] [Google Scholar]
-
7.
Hattori T, Taft JM, Swist KM, Luo H, Witt H, Slattery M, Koide A, Ruthenburg AJ, Krajewski K, Strahl BD, White KP, Farnham PJ, Zhao Y, Koide S:
Recombinant antibodies to histone post-translational modifications.
Nat Methods.2013;10(10) :
10.1038/nmeth.2605
992-5
10.1038/nmeth.2605
[DOI] [PMC free article] [PubMed] [Google Scholar]
-
8.
Marcon E, Jain H, Bhattacharya A, Guo H, Phanse S, Pu S, Byram G, Collins BC, Dowdell E, Fenner M, Guo X, Hutchinson A, Kennedy JJ, Krastins B, Larsen B, Lin ZY, Lopez MF, Loppnau P, Miersch S, Nguyen T, Olsen JB, Paduch M, Ravichandran M, Seitova A, Vadali G, Vogelsang MS, Whiteaker JR, Zhong G, Zhong N, Zhao L, Aebersold R, Arrowsmith CH, Emili A, Frappier L, Gingras AC, Gstaiger M, Paulovich AG, Koide S, Kossiakoff AA, Sidhu SS, Wodak SJ, Gräslund S, Greenblatt JF, Edwards AM:
Assessment of a method to characterize antibody selectivity and specificity for use in immunoprecipitation.
Nat Methods.2015;12(8) :
10.1038/nmeth.3472
725-31
10.1038/nmeth.3472
[DOI] [PubMed] [Google Scholar]
-
9.
Grzybowski AT, Chen Z, Ruthenburg AJ:
Calibrating ChIP-Seq with Nucleosomal Internal Standards to Measure Histone Modification Density Genome Wide.
Mol Cell.2015;58(5) :
10.1016/j.molcel.2015.04.022
886-99
10.1016/j.molcel.2015.04.022
[DOI] [PMC free article] [PubMed] [Google Scholar]
Antibody reliability in biomedical research is of utmost importance. The quality of these reagents in chromatin biology applications is of particular concern given their position as essential tools for most techniques characterizing the cellular abundance and genomic distribution of histone post-translational modifications (PTMs).
I agree with the Kungulovski and Jeltsch that increased accountability needs to be demanded from companies who sell histone PTM antibodies, and their four recommended quality control measures are reasonable expectations. In addition, it should also be noted that the practice of retaining catalog numbers for new polyclonal antibody lots is unacceptable and misleading.
Moreover, and particularly in light of the increased awareness of antibody concerns in the field, experimentalists and epigenome consortium leaders (e.g., ENCODE, BLUEPRINT) should be more rigorous in their own evaluation of histone PTM antibodies when choosing a reagent for their study. Antibody specificity data and lot numbers used should also be standard requests from journal editors and reviewers.
Accountability clearly needs to come from all parties if we are to continue benefiting from the use of these affinity tools in chromatin research.
I have read this submission. I believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard.
Paragraph 2 should also indicate that antibodies purportedly recognizing PTMs at specific sites, need to have their recognition specificity also tested against the same PTM at different sites, in the same protein, or others, and with the same core sequence or others. Many so-called specific phosphotyrosine antibodies actually recognize the phosphotyrosine modification independently of its sequence context.
"In spite of the intricate task of producing histone modification antibodies and their crucial role in chromatin biology, surprisingly, they remain to be insufficiently characterized" should be changed to "In spite of the intricate task of producing histone modification antibodies and their crucial role in chromatin biology, surprisingly, they remain insufficiently characterized"
"the specificity data obtained for one batch of antibody do not necessarily reflect the properties of another one" Voskuil (
Commercial
antibodies and their validation. Version 2. F1000Res. 2014 Oct 2 [revised 2014 Oct 15];3:232. doi: 10.12688/f1000research.4966.2. eCollection 2014) describes the relatively unknown practice of some antibody manufacturers to use historical data sheets for antibodies to which they do not apply. This should also be mentioned and cited.
The recommendations in paragraph 4 are commendable. However, if manufacturers are expected to carry this out on every lot they sell, the author must acknowledge that the cost of antibodies will have to increase.
"As proposed by others (
Bradbury & Pluckthun, 2015) end-users should consider boycotting companies not complying with this demand, or at least stay away from products lacking a proper lot-specific documentation." Actually, this was not our main proposal. Our main point (amplified in
Getting to reproducible antibodies: the rationale for sequenced recombinant characterized reagents.
Bradbury AR, Plückthun A. Protein Eng Des Sel. 2015 Oct;28(10):303-5. doi: 10.1093/protein/gzv051) was that we should move away from the use of polyclonal antibodies altogether and use only well characterized sequenced recombinant antibodies. Only in this way can we ensure antibody reproducibility.
In the last paragraph, the author indicates that recombinant antibodies (or other proteins) may solve this problem. However, this will only be the case if such binders can be unequivocally identified, which will only occur if sequences can be referred to unambiguously. Otherwise, as antibody companies are bought and sold, catalog numbers will change and it may become difficult to reproduce experiments, because it will not be clear which original antibody was used.
I have read this submission. I believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard, however I have significant reservations, as outlined above.