Abstract
Motivation: Many approaches have been proposed for the protein identification problem based on tandem mass spectrometry (MS/MS) data. In these experiments, proteins are digested into peptides and the resulting peptide mixture is subjected to mass spectrometry. Some interesting putative peptide features (peaks) are selected from the mass spectra. Following that, the precursor ions undergo fragmentation and are analyzed by MS/MS. The process of identification of peptides from the mass spectra and the constituent proteins in the sample is called protein identification from MS/MS data. There are many two-step protein identification procedures, reviewed in the literature, which first attempt to identify the peptides in a separate process and then use these results to infer the proteins. However, in recent years, there have been attempts to provide a one-step solution to protein identification, which simultaneously identifies the proteins and the peptides in the sample.
Results: In this review, we briefly introduce the most popular two-step protein identification procedure, PeptideProphet coupled with ProteinProphet. Following that, we describe the difficulties with two-step procedures and review some recently introduced one-step protein/peptide identification procedures that do not suffer from these issues. The focus of this review is on one-step procedures that are based on statistical likelihood-based models, but some discussion of other one-step procedures is also included. We report comparative performances of one-step and two-step methods, which support the overall superiorities of one-step procedures. We also cover some recent efforts to improve protein identification by incorporating other molecular data along with MS/MS data.
Keywords: protein identification, tandem mass spectrometry, one-step processes
Introduction
Identification of sensitive biomarker proteins from solid tissues and complex biological fluids such as saliva, urine, blood or serum plays a significant role in early detection of complex diseases such as cancer. Though mass spectrometry (MS) is one of the most widely used platforms for the discovery of biomarker proteins, there are several issues associated with protein identification and inference through this technique. There has been a lack of sufficient attention to determining proper statistical methods used in analyzing the data obtained from an MS experiment [1].
In a typical tandem mass spectrometry (MS/MS) experiment, the first step is to digest the mixture of proteins into smaller peptides, often by the enzyme trypsin. Each of these proteins can be digested into more than one peptide. As a result, peptide mixtures are usually more complex than protein mixtures. The sample peptides are then ionized and subjected to MS. Following that, the precursor ions undergo fragmentation and are then analyzed by MS/MS. The mass-to-charge ratios (m/z) of these smaller fragmented ion pieces and their relative abundances (intensities) are recorded as MS/MS spectra. These observed MS/MS spectra are matched against theoretical spectra predicted from individual peptides from a protein database using algorithms such as the SEQUEST scoring scheme [2] to identify the associated peptides. This is called the database search method. The peptides with the highest scores are considered as proper peptide identifications, which are further used for protein identifications. Modifications to SEQUEST that improve the speed of the process have been proposed in [3] and [4]. Other popular database search programs include X!TANDEM [5], Mascot [6], MS-Tag [7] and MS-GF+ [8, 9] available through Percolator [10]. The overall steps of a typical MS/MS experiment are illustrated in Figure 1. There are other methods of peptide identifications such as de novo sequencing and hybrid approaches.
Peptide and protein identifications from an MS/MS experiment are highly error-prone owing to experimental errors and lack of adequate search algorithms. In absence of proper filtering, even 80–90% of identified peptides may be incorrect [12, 13]. However, in recent years, there have been significant improvements in both of these areas. Several efforts have been made for developing powerful scoring mechanisms to identify the peptides accurately. These include scoring systems based on the number of shared peaks [2], incorporating stochastic modeling of the fragmentation process [14], the peak intensity [15], a Bayesian approach [16], Mowse scores [6], modeling the distribution of hits to the m/z values of a spectrum using the Hypergeometric distribution [17, 18], the Poisson distribution [17, 19] and regression models [20]. See Nesvizhskii et al. [21] for a detailed account of peptide identification processes. Also see [22] and [23] for other important reviews of two-step methods of protein identification following peptide scoring. Despite these diverse approaches, peptide and the subsequent protein identification is still not an easy task. This clearly indicates a need for statistical evaluation of the peptide and protein inferences.
In this review, we first describe two-step protein identification processes with a focus on the PeptideProphet and ProteinProphet combination. Following that, we explain the potential shortcomings of a two-step procedure. Next, we focus on more recently developed one-step procedures, which attempt to alleviate problems associated with two-step identification of peptides and proteins. We include summaries of results from analyses of various data sets in the literature, which compare one or more of the one-step procedures with the two-step procedure based on PeptideProphet and ProteinProphet combination and demonstrate that the one-step procedures that simultaneously identify the peptides and proteins generally perform better. Finally, we review recent methods of protein identification, which integrate data from other platforms outside the MS/MS experiment in an attempt to improve the performance of methods based only on the MS/MS experiment.
Methods for protein identifications
Two-step processes
Several statistical two-step procedures have been proposed, which first provide confidence to the peptide identifications followed by confidence measures for protein identifications. These measures include P-value or E-value [6, 17, 18, 24] or false discovery rate (FDR) [25–30]. Among these, the most popular method is PeptideProphet [28] coupled with ProteinProphet [29]. In the sequel, we will refer to this combined (two-step) procedure as ProteinProphet. To our knowledge, ProteinProphet is a highly regarded procedure in this field and the first protein identification method that is probabilistically motivated. Thus, ProteinProphet is a two-step process where peptides are identified first through PeptideProphet [28] and their corresponding confidences are estimated. The second step involves the estimation of probabilities for protein presence, assuming the assignments of the peptides to the observed spectra are correct. PeptideProphet is based on the expectation-maximization (EM) algorithm, which generates a probability-based mixture model of correct and incorrect peptide identifications from the data. The observed data, denoted by, includes scores, number of tryptic termini, number of missed cleavages and the mass difference of the observed precursor ion mass and the weight of the theoretical peptide. This information, in the observed data, is used to separate the correct (denoted by ) from the incorrect (denoted by ) peptide assignments. The probability of correct peptide assignment to a spectrum, given the data, is estimated using Bayes’ theorem:
where and are the proportions of correct and incorrect peptide assignments to an observed spectra in the population, respectively. The probabilities that a peptide, assigned to a spectrum, have information among correctly and incorrectly assigned peptides are denoted by and, respectively. It is to be noted that PeptideProphet assumes each peptide to spectrum matches (PSM) for MS/MS data in the context of the whole population of correct and incorrect PSMs. The other PSMs in the data set that identify the same peptide sequence are not taken into account. So, the statistical unit of posterior probability of PSM and the peptide sequence is the same in PeptideProphet. PeptideProphet calculates this posterior probability individually for each search engine output. Opposed to that, procedures such as iProphet [31] uses the evidence from multiple PSM database search engines and computes peptide-based probability by introducing grouping variables such as number of sibling searches, replicate spectra, sibling experiments, sibling ions and sibling modifications. For a detailed description of the iProphet procedure, please refer to Figure 1 of the above mentioned paper.
The identified peptides, along with their confidences from PeptideProphet, are then further used in ProteinProphet to estimate the protein confidences, assuming that the peptide assignments are correct. The probability that a protein is present in the sample is estimated by
where is the index for the peptide corresponding to the protein of interest and is the index for the assignment of peptide to a spectrum. The probability that the assignment of the peptide to a spectrum is correct is denoted by and the product in the expression for P is computed assuming the independence of the accuracy of the assignments for all peptides. Note that, while estimating the protein probabilities, this method considers only the maximum assignment score for each peptide instead of all assignment scores. ProteinProphet also incorporates grouping information of all assigned peptides according to their corresponding proteins in the database, under the assumption that correct peptide assignments are more likely to correspond to ‘multihit’ proteins than the incorrect peptide assignments. Applying iProphet along with the initial PeptideProphet results produces adjusted PSM probabilities at the unique peptide level, and applying ProteinProphet on this modified PSM probabilities with the additional adjustment of number of sibling peptides gives the final protein probabilities. It has been shown in [31] that the protein probabilities computed with the help of iProphet are more accurate than the standard PeptideProphet/ProteinProphet probabilities.
Although ProteinProphet is one of the most widely used methods for protein identifications, it has certain issues that need attention. Firstly, the fact that ProteinProphet considers the maximum assignment score for each peptide while estimating the protein probabilities may be overoptimistic as an incorrect peptide may, by chance, have a high score if it is assigned more than once. Also, in reality, the spectra are often subjected to noise, which may lead to incorrect peptide identifications and thus incorrect protein identifications. This problem with a two-step process is clear from Figure 1. Here, there are three parent proteins, namely, and , which generate the peptides and. The MS/MS spectra of the two peptides and incorrectly identify the peptides and, resulting in the incorrect identifications of the proteins and. The situation is more complicated when there is a presence of degenerate peptides, that is, the peptides that are generated by more than one protein. Additionally, from Figure 1 it is clear that if we know that peptide is present, then we know that protein is present and it will increase the likelihood of the presence of peptide. So, there is an indirect feedback from peptide to. It is clear that knowing the presence/absence of a peptide/protein influences the likelihood of the presence/absence of other peptides/proteins. Thus, a two-step process is inefficient in protein identifications in these situations, and construction of joint likelihood of peptides/proteins and identifying the uncertainties in both peptides/proteins in one step seems to be a logical step.
One-step processes
One-step methods involve simultaneous identification of which proteins are present and which peptides are identified correctly in a single step as opposed to the two-step process in ProteinProphet. One-step models incorporate a feedback loop between the proteins and their constituent peptides. The difference between a one-step process and a two-step process is shown graphically in Figure 2. As evident from Figure 2, in a two-step process there is no way of going back to update the peptide list (probabilities) after obtaining the protein list (probabilities). But, in a one-step process the peptide and protein lists are updated simultaneously through the feedback loop. Hence, unlike a two-step process, a one-step process can take into account the fact that the presence/absence of a peptide/protein can influence the likelihood of the presence/absence of other peptides/proteins.
In the current literature, there are only two published papers on one-step methods incorporating rigorous statistical joint likelihood models for the presence of proteins and peptides, namely, the hierarchical statistical model (HSM) by Shen et al. [11] and the nested mixture model (NMM) by Li et al. [32]. Additionally, our group is currently working on a one-step protein identification process using a Bayesian hierarchical model (BHM) and we have received some encouraging initial results. We include some of the results here.
There are other important one-step protein identification procedures, which follow different methodologies. For example, [33] proposes a two-dimensional target decoy method called ProteinsFirst, which can control the FDR of protein and peptide-to-spectrum match (PSM) levels simultaneously. They modify the PSM score depending on the confidence of the protein identification score (feedback). This algorithm and other such algorithms mentioned in [33] fall into the category of ‘protein-centric’ approaches. ProteinsFirst [33] provides comparative performances of ProteinsFirst with similar ‘protein-centric’ methods. However, no comparison is provided with ProteinProphet. Another approach is proposed in [34] using a Barista model, which represents the protein identification problem as a single optimization procedure of a tripartite graph with three different layers corresponding to the spectrum, peptide and protein levels using machine learning techniques. This method is compared with ProteinProphet at a wide range of fixed FDR levels using six data sets; for each data set, it identifies more true proteins than ProteinProphet (Figure 2 of [34]). Like any supervised learning method, the Barista model requires discrimination of training and test data to avoid overfitting, so the choice of the training set for real data may be a problem if suitable reference data is unavailable. Furthermore, a couple of methods [35, 36] have been proposed, which consider feedback from high-confidence proteins to the selection of peptides. The method proposed in [35] considers an iterative process to compute peptide and protein probabilities simultaneously. Unlike the other one-step methods described herein, it uses peptide confidence results from PeptideProphet as input. The method outperforms ProteinProphet in experimental results presented in [35]. However, this method may need more computational time and cost compared with the other one-step methods, as the iteration stops only if the protein list converges. Also, the method in [35] has not been tested on any real complex data set, and the authors have advised against direct implementation of this method for practical purposes. The method in [36] uses a feedback loop in a different way; it starts with peptide identification results from database search mechanisms to get an initial list of proteins, which in turn is used to derive a peptide adjacency matrix. This adjacency matrix is used to compute regularized scores of peptides, which are further used to calculate peptide identification probabilities through a logistic regression model. These peptide probabilities are then used to update the protein list and consequently the adjacency matrix between the peptides. Although the authors claimed that the feedback loop converged to a stable list of proteins in a few number of steps for the data they analyzed, no justification has been given for the guarantee of convergence or estimate of convergence time in general. Experimental results are presented in [36] to compare their proposed method with ProteinProphet. Overall, the method from [36] has more coverage in protein identification and produces better results in terms of identifying the number of true and false peptides/proteins at a given level of false positive rate.
The joint likelihood-based models of one-step protein identification are the main focus of this manuscript. As indicated earlier, the above one-step methods [33–36] do not exactly fall into the category of the joint likelihood modeling of the peptides and proteins unlike [11] and [32]. The HSM by Shen et al. [11] assumes that a protein can generate multiple peptides and a peptide can be generated by multiple proteins. Using this interdependence, HSM fits a hierarchical statistical model that consists of four connected layers that models the uncertainty of the identified peptides and proteins, given the peptide matching scores for all the peptides from MS/MS data. The joint likelihood of the data is then used to estimate the parameters of the model and find the protein-identification probability through an Empirical-Bayes [37] framework. To briefly describe the four connected layers, the following notations are introduced: is an indicator (binary) variable denoting the presence (given by) or absence (given by) status of the protein. is an indicator variable denoting the presence (given by ) or absence (given by ) status of the peptide in the sample. Next, is another binary variable taking value 1 (if the assignment of peptide is correct) or 0 (otherwise), with as the corresponding matching score. Also, is denoted as the number of proteins with at least one peptide hit and as the number of peptides assigned to at least one spectrum. These notations are used to define the following marginal/conditional models. In the first layer, the marginal distribution of is assumed to be Bernoulli, with being the proportion of truly identified proteins. The second layer consists of the conditional distribution of , given, which is denoted as. Given and are assumed to be independent. So, the conditional distribution of , given is considered in the third layer, denoted by. The fourth layer consists of the conditional probability density of scores given, denoted as. The likelihood of the presence of protein is also affected by the number of peptide hits involved. This fact leads to the modeling of the number of peptide hits through a binary random variable for protein, indicating whether the number of peptide hits is beyond a threshold. The conditional distribution of , given, is denoted by. Finally, the joint likelihood is obtained by integrating all the marginal and conditional models and is given by:
Here, denotes the distribution (density/probability) of the variable involved. HSM uses the EM algorithm to estimate the parameters involved in the joint likelihood. So, if denotes the vector containing all the model parameters, then the confidences of peptides and proteins are estimated by and, respectively.
The NMM [32] considers the nested structure owing to the fact that there is a subsequence relationship between lower-level elements (peptides) and higher-level elements (proteins), whereas the lower-level elements (peptides) are the ones that are usually observed. NMM incorporates the evidence feedback from proteins to peptides, as in HSM. This feature helps in the distinction of correctly identified peptides with low scores from incorrectly identified peptides with high scores. To describe the model, the following notations are introduced: is an indicator variable taking value 1 (or 0) if the protein is present (or absent) in the sample. are also indicator variables taking values 1 or 0 depending on whether the peptide on protein is correctly assigned. Assuming that there are protein identifications, is defined as where can be 0 or 1 and. Also, it is assumed that there are peptide identifications corresponding to protein, along with a score vector. NMM assumes that given the protein indicators, the peptide indicators are independent and identically distributed. Also, it is assumed that if the protein is absent in the sample, all its constituent peptides are incorrectly identified, while, if a protein is present, some of its constituent peptides may be correctly identified. NMM also models the number of peptide hits to a protein and scores for identified peptides. Based on all the assumptions, the joint likelihood for the proposed NMM is given by
As before, denotes the distribution (density/probability) of the variable involved. Let denote the vector containing all of the model parameters. Then is estimated by maximizing the likelihood using the EM algorithm, and the estimated parameters are used to obtain the confidences of peptide and protein identifications.
Although HSM and NMM both model the uncertainties of peptides and proteins simultaneously, these two methods differ in several aspects. HSM handles the issue of degeneracy (when a peptide is generated by multiple proteins or a protein generates multiple peptides) by assuming that a peptide will be present in the sample, provided at least one of the proteins containing that peptide generates it, and by assuming that the generation of the peptides are independent events. But the NMM admittedly did not account for degeneracy, which is an important consideration for estimating the protein confidences, especially, in high-level organisms. There are many other subtle differences in the assumptions of the two models, which we skip for the brevity of this review.
In our full Bayesian approach (BHM), we consider the fact that the proteins in the same biological pathway or in the same subcellular locations may not be independent. But both [11] and [32] assume independence of the proteins in the sample. In BHM, we incorporate the prior information by grouping functionally related proteins. Moreover, both [11] and [32] use the EM algorithm for the estimation of the peptide and protein confidences from the joint likelihood, which does not have any guarantee of convergence. In the BHM, the peptides and proteins are modeled simultaneously in the joint likelihood, and full posterior inference is carried out by applying a Gibbs sampling scheme.
Evaluations of HSM, NMM and BHM
These three models fall into the same category of statistical modeling and so they are collectively evaluated in this section. A comparison between the two-step process ProteinProphet and one-step processes (HSM and NMM) is given in [32], by applying all the methods on a standard protein mixture [38]. This data set consists of MS/MS spectra generated from a sample of stand-alone peptides and trypsin-digested proteins. SEQUEST is used to match the generated MS/MS spectra against a database containing both the sample peptides/proteins and proteins from Shewanella oneidensis as a decoy data set. A comparison between the empirical FDR and the estimated FDR at the peptide level, using all the methods, is shown in Figure 3. It should be noted that for PeptideProphet, FDR refers to the FDR of peptide identification, whereas for the rest it refers to the FDR of protein identification. As seen from this figure, PeptideProphet, ProteinProphet and HSM underestimate the FDR at lower values of the FDR, whereas NMM is conservative in estimating the FDR in the entire range.
Figure 4 compares the discriminating powers of all the methods at the peptide level through the receiver operating characteristic (ROC) curves using the same data. It can be seen from Figure 4 that at a given level of specificity, the one-step processes (HSM and NMM) have higher sensitivity compared with that of the two-step process ProteinProphet, with NMM showing the maximum discriminating power. Thus, overall, these figures show that both the one-step processes are performing better than ProteinProphet in terms of peptide identifications for these data.
As we are currently working on the full Bayesian model (BHM), we compared the performances of HSM and NMM with BHM using a yeast proteomics experiment where the true proteins are assumed to be known. The spectra scores of the yeast peptide fragments are obtained from a QSTAR mass spectrometer as done in [39]. The generated MS/MS spectra are matched, using SEQUEST, against a combined search database that contains both yeast proteins and proteins from Caenorhabditis elegans as a decoy data set. The number of true detected proteins against false positives is plotted at a fixed posterior threshold for the three one-step methods, which is shown in Figure 5. It is evident from Figure 5 that BHM picks up more true positives than HSM and NMM at each fixed number of false positives. Thus, a full Bayesian approach appears to perform better than the other two one-step processes in identifying the proteins from MS/MS data if we allow the number of false positives to go beyond eight.
We have also analyzed one more data set of Haemophilus influenzae (Hinf_Hum) data originally analyzed in [29] and compared the performances of NMM, BHM and ProteinProphet in Figure 6. Overall, BHM in this case performs better than ProteinProphet and NMM.
Integration of other platforms
Protein identification methods described so far only use MS/MS data and database search. Recently, efforts have been made to improve protein identification using additional data outside the MS/MS experiment. The method proposed by Shanmugan et al. [40] uses external information [RNA-seq transcript abundances and/or Global Proteome Machine Database (GPMDB) [41] identification frequencies] to adjust the estimated protein identification probabilities via Bayes’ theorem. Specifically, positive protein identification is made when the corresponding probability exceeds a specified FDR threshold; the FDRs are estimated using a target-decoy approach [42] with reverse decoy sequences.
Some other information used for protein identification in addition to just MS/MS data are microarray data [43], protein–protein interaction network data [44], gene functional network data [45] and RNA-seq abundance information [46]. This additional information is especially useful for samples with low to moderate proteome coverage. The values of the external variables for the decoy proteins must be carefully simulated from the distribution of proteins with lengths similar to the decoy protein, and conditional probabilities of bins of possible values for the external variable are computed, given the type of protein (decoy or forward identification). This method was applied to real MS/MS data from a human prostate cancer cell line VCaP [47], which included RNA-seq data obtained from the same lab as well as from MS/MS data on a human embryonic kidney cell line HEK293 [48, 49], which included RNA-seq data from a different source [50]. When applied to each full data set, a large number of positive protein identifications were obtained at 1% FDR, so subsets were sampled to assess the performance of the method under various levels of proteome coverage. It was found that the method is most effective at improving the percentage of positive protein identifications when there is low to moderate proteomic coverage. Each MS/MS data set was also analyzed with GPMDB frequencies instead of with RNA-seq abundances, and similar results were obtained, demonstrating that the method can be applied in the absence of matching RNA-seq data. In summary, including additional information from external sources along with the traditional protein identification process using MS/MS data can improve the sensitivity of the process especially for the low to medium coverage proteins.
Conclusion
This review summarizes the recent improvements on protein identification from MS/MS data. In particular, we promote the idea of using one-step protein identification. We echo the same sentiment as [34] that peptide- and protein-level tasks are cooperative and the optimal identification solution has to be made using both peptide- and protein-level information simultaneously. We provide performance comparisons of one-step methods with the best two-step procedure, ProteinProphet, when available. The Barista model [34] clearly demonstrates superiority over ProteinProphet in all the six data sets that they had analyzed. The other three one-step procedures with joint likelihood modeling ([11, 32] and work in progress in BHM) vary in terms of model complexities such as incorporation of degeneracies and dependencies of proteins and peptides. This partly explains why the performance of any one of them is not always uniformly better than the other two. In many situations they perform better than ProteinProphet (Fig 3–6). However, it really depends on the tuning parameters of the models and the complexity of the data set. We anticipate that these one-step models can be improved further to make them uniformly better than the two-step procedures. Additionally, incorporation of data from other platforms also will improve the task of protein identification. Generally speaking, availability of more and more complex real and simulated protein-mixture data and transparent software will lead to progressively accurate protein identification procedures using MS/MS data. We hope that this review will inspire other researchers to delve into this area of proteomics research for better protein identification from complex mixtures of proteins using MS/MS experiments.
Protein identification from MS/MS data is still a fertile area of research.
One-step protein-identification processes generally perform better than two-step processes.
Incorporating additional molecular information along with the MS/MS data may provide better protein identification.
Funding
This study was supported by the research funding from NCI/NIH grant CA 170091−01A1 to Susmita Datta.
References
- 1. Eckel-passow JE, Oberg AL, Therneau TM, et al. An insight into high-resolution mass-spectrometry data. Biostatistics 2009;10(3):481–500. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2. Eng JK, McCormack A, Yates JR. An approach to correlate tandem mass spectral data of peptides with amino acid sequences in a protein database. J Am Soc Mass Spectrom 1994;5(11):976–89. [DOI] [PubMed] [Google Scholar]
- 3. Eng JK, Fischer B, Grossmann J, et al. A fast SEQUEST cross correlation algorithm. J Proteome Res 2008;7(10):4598–602. [DOI] [PubMed] [Google Scholar]
- 4. Diament BJ, Noble WS. Faster SEQUEST searching for peptide identification from tandem mass spectra. J Proteome Res 2011;10(9):3871–9. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5. Craig R, Beavis RC. TANDEM: matching proteins with tandem mass spectra. Bioinformatics 2004;20(9):1466–7. [DOI] [PubMed] [Google Scholar]
- 6. Perkins DN, Pappin DJ, Creasy DM, et al. Probability-based protein identification by searching sequence databases using mass spectrometry data. Electrophoresis 1999;20(18):3551–67. [DOI] [PubMed] [Google Scholar]
- 7. Clauser KR, Baker P, Burlingame AL. Role of accurate mass measurement (+/- 10 ppm) in protein identification strategies employing MS or MS/MS and database searching. Anal Chem 1999;71(14):2871–82. [DOI] [PubMed] [Google Scholar]
- 8. Kim S, Gupta N, Pevzner P. Spectral probabilities and generating functions of tandem mass spectra: a strike against decoy databases. J Proteome Res 2008;7(8):3354−63. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9. Swaney DL, Wenger CD, Coon JJ. Value of using multiple proteases for large-scale mass spectrometry-based proteomics. J Proteome Res 2010;9(3):1323−9. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10. Granholm V, Kim S, Navarro JC, et al. Fast and accurate database searches with MS-GF+Percolator. J Proteome Res 2014;13(2):890−7. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11. Shen C, Wang Z, Shankar G, et al. A hierarchical statistical model to assess the confidence of peptides and proteins inferred from tandem mass spectrometry. Bioinformatics 2008;24(2):202–8. [DOI] [PubMed] [Google Scholar]
- 12. Keller A, Purvine S, Nesvizhskii AI, et al. Experimental protein mixture for validating tandem mass spectral analysis. Omics 2002;6(2):207–12. [DOI] [PubMed] [Google Scholar]
- 13. Nesvizhskii AI, Aebersold R. Analysis, statistical validation and dissemination of large-scale proteomics datasets generated by tandem MS. Drug Discov Today 2004;9(4):173–81. [DOI] [PubMed] [Google Scholar]
- 14. Bafna V, Edwards N. SCOPE: a probabilistic model for scoring tandem mass spectra against a peptide database. Bioinformatics 2001;17:S13–21. [DOI] [PubMed] [Google Scholar]
- 15. Havilio M, Haddad Y, Smilansky Z. Intensity-based statistical scorer for tandem mass spectrometry. Anal Chem 2003;75(3):435–44. [DOI] [PubMed] [Google Scholar]
- 16. Zhang N, Aebersold R, Schwikowski B. ProbID: a probabilistic algorithm to identify peptides through sequence database searching using tandem mass spectral data. Proteomics 2002;2(10):1406–12. [DOI] [PubMed] [Google Scholar]
- 17. Sadygov RG, Yates JR., 3rd A hypergeometric probability model for protein identification and validation using tandem mass spectral data and protein sequence databases. Anal Chem 2003;75(15):3792–8. [DOI] [PubMed] [Google Scholar]
- 18. Tabb DL, Fernando CG, Chambers MC. MyriMatch: highly accurate tandem mass spectral peptide identification by multivariate hypergeometric analysis. J Proteome Res 2007;6(2):654–61. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19. Geer LY, Markey SP, Kowalak JA, et al. Open mass spectrometry search algorithm. J Proteome Res 2004;3(5):958–64. [DOI] [PubMed] [Google Scholar]
- 20. Feng J, Naiman DQ, Cooper B. Probability model for assessing proteins assembled from peptide sequences inferred from tandem mass spectrometry data. Anal Chem 2007;79(10):3901–11. [DOI] [PubMed] [Google Scholar]
- 21. Nesvizhskii AI, Vitek O, Aebersold R. Analysis and validation of proteomic data generated by tandem mass spectrometry. Nat Methods 2007;4(10):787–97. [DOI] [PubMed] [Google Scholar]
- 22. Huang T, Wang J, Yu W, et al. Protein inference: a review. Brief Bioinform 2012;13(5):586–614. [DOI] [PubMed] [Google Scholar]
- 23. Serang O, Noble W. A review of statistical methods for protein identification using tandem mass spectrometry. Stat Interface 2012;5(1):3–20. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24. Fenyo D, Beavis RC. A method for assessing the statistical significance of mass spectrometry-based protein identifications using general scoring schemes. Anal Chem 2003;75(4):768–74. [DOI] [PubMed] [Google Scholar]
- 25. Benjamini Y, Hochberg Y. Controlling the false discovery rate: a practical and powerful approach to multiple testing. J R Stat Soc Ser B 1995;57(1):289–300. [Google Scholar]
- 26. Elias JE, Gygi SP. Target-decoy search strategy for increased confidence in large-scale protein identifications by mass spectrometry. Nat Methods 2007;4(3):207–14. [DOI] [PubMed] [Google Scholar]
- 27. Higgs RE, Knierman MD, Freeman AB, et al. Estimating the statistical significance of peptide identifications from shotgun proteomics experiments. J Proteome Res 2007;6(5):1758–67. [DOI] [PubMed] [Google Scholar]
- 28. Keller A, Nesvizhskii AI, Kolker E, et al. Empirical statistical model to estimate the accuracy of peptide identifications made by MS/MS and database search. Anal Chem 2002;74(20):5383–92. [DOI] [PubMed] [Google Scholar]
- 29. Nesvizhskii AI, Keller A, Kolker E, et al. A statistical model for identifying proteins by tandem mass spectrometry. Anal Chem 2003;75(17):4646–58. [DOI] [PubMed] [Google Scholar]
- 30. Qian WJ, Liu T, Monroe ME, et al. Probability-based evaluation of peptide and protein identifications from tandem mass spectrometry and SEQUEST analysis: the human proteome. J Proteome Res 2005;4(1):53–62. [DOI] [PubMed] [Google Scholar]
- 31. Shteynberg D, Deutsch EW, Lam H, et al. iProphet: multi-level integrative analysis of shotgun proteomic data improves peptide and protein identification rates and error estimates. Mol Cell Proteomics 2011;10(12):M111.007690. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32. Li Q, MacCoss MJ, Stephens M. A nested mixture model for protein identification using mass spectrometry. Ann Appl Stat 2010;4(2):962–87. [Google Scholar]
- 33. Bern MW, Kil YJ. Two-dimensional target decoy strategy for shotgun proteomics. J Proteome Res 2011;10(12):5296–301. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34. Spivak M, Weston J, Tomazela D, et al. Direct maximization of protein identifications from tandem mass spectra. Mol Cell Proteomics 2012;11(2):M111 012161. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 35. Shi J, Wu FX. A feedback framework for protein inference with peptides identified from tandem mass spectra. Proteome Sci 2012;10(1):68. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 36. Shi J, Chen B, Wu FX. Unifying protein inference and peptide identification with feedback to update consistency between peptides. Proteomics 2013;13(2):239–47. [DOI] [PubMed] [Google Scholar]
- 37. Casella G. An introduction to empirical bayes Data analysis. Am Stat 1985;39(2):83–7. [Google Scholar]
- 38. Purvine S, Picone AF, Kolker E. Standard mixtures for proteome studies. OMICS 2004;8(1):79–92. [DOI] [PubMed] [Google Scholar]
- 39. Elias JE, Haas W, Faherty BK, et al. Comparative evaluation of mass spectrometry platforms used in large-scale proteomics investigations. Nat Methods 2005;2(9):667–75. [DOI] [PubMed] [Google Scholar]
- 40. Shanmugam AK, Yocum AK, Nesvizhskii AI. Utility of RNA-seq and GPMDB protein observation frequency for improving the sensitivity of protein identification by tandem MS. J Proteome Res 2014;13(9):4113–9. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 41. Craig R, Cortens JP, Beavis RC. Open source system for analyzing, validating, and storing protein identification data. J Proteome Res 2004;3(6):1234–42. [DOI] [PubMed] [Google Scholar]
- 42. Elias JE, Gygi SP. Target-decoy search strategy for mass spectrometry-based proteomics. Methods Mol Biol 2010;604:55–71. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 43. Ramakrishnan SR, Vogel C, Prince JT, et al. Integrating shotgun proteomics and mRNA expression data to improve protein identification. Bioinformatics 2009;25(11):1397–403. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 44. Li J, Zimmerman LJ, Park BH, et al. Network-assisted protein identification and data interpretation in shotgun proteomics. Mol Syst Biol 2009;5:303. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 45. Ramakrishnan SR, Vogel C, Kwon T, et al. Mining gene functional networks to improve mass-spectrometry-based protein identification. Bioinformatics 2009;25(22):2955−61. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 46. Wang X, Slebos RJ, Wang D, et al. Protein identification using customized protein sequence databases derived from RNA-Seq data. J Proteome Res 2012;11(2):1009–17. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 47. Korenchuk S, Lehr JE, MClean L. VCaP, a cell-based model system of human prostate cancer. in vivo 2001;15(2):163−8. [PubMed] [Google Scholar]
- 48. Graham FL, Smiley J, Russell WC, et al. Characteristics of a human cell line transformed by DNA from human adenovirus type 5. J Gen Virol 1977;36(1):59−74. [DOI] [PubMed] [Google Scholar]
- 49. Fonslow BR, Stein BD, Webb KJ, et al. Digestion and depletion of abundant proteins improves proteomic coverage. Nat Methods 2013;10(1):54−6. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 50. Sultan M, Schulz MH, Richard H, et al. A global view of gene activity and alternative splicing by deep sequencing of the human transcriptome. Science 2008;321(5891):956−60. [DOI] [PubMed] [Google Scholar]