P-MartCancer-Interactive Online Software to Enable Analysis of Shotgun Cancer Proteomic Datasets

Abstract

P-MartCancer is an interactive web-based software environment that enables statistical analyses of peptide or protein data, quantitated from mass spectrometry-based global proteomics experiments, without requiring in-depth knowledge of statistical programming. P-MartCancer offers a series of statistical modules associated with quality assessment, peptide and protein statistics, protein quantification and exploratory data analyses driven by the user via customized workflows and interactive visualization. Currently, P-MartCancer offers access and the capability to analyze multiple cancer proteomic datasets generated through the Clinical Proteomics Tumor Analysis Consortium at the peptide, gene and protein levels. P-MartCancer is deployed as a web-service (https://pmart.labworks.org/cptac.html), alternatively available via Docker Hub (https://hub.docker.com/r/pnnl/pmart-web/).

The use of mass spectrometry (MS)-based technologies for global protein profiling of cancer-related tissues and bodily fluids has become a major focus in research centered on biomarker discovery to better detect and treat cancer. Global proteomic technologies are of interest in the field of cancer research because they provide a vital source of information regarding biological functions at the protein level(1–4). Global MS-based proteomics often allow hundreds of thousands of peptides mapping to tens of thousands of proteins to be measured, offering scientists an unprecedented view into processes involved in cancer development and progression. However, as with many newer high-throughput molecular technologies, the data are complex with multiple sources of variability (1), consequently, the post peptide identification and quantification (i.e., downstream) analyses of these datasets require significant specialized expertise due to inherent data challenges, such as missing values and isoform quantification(5–7). Data processing is generally performed via custom and unpublished scripts, leading to continued issues in reproducibility of results (8). Thus, challenges in both access to the data and statistical methods in an easy to understand format for biomedical researchers has led to underutilization of publicly available databases, such as those generated through the Clinical Proteomics Tumor Analysis Consortium (CPTAC) funded through the National Cancer Institute. The development of software that enables continued exploration and evaluation of existing data could increase the potential for new discovery from these comprehensive public datasets.

Existing software capabilities associated with CPTAC can broadly be placed in four categories for global MS-based data (https://proteomics.cancer.gov/resources/softwaretools); 1) spectral pre-processing, 2) peptide and protein identification, 3) specific methods for qualitative and quantitative differential statistics, and 4) network analyses. P-MartCancer broadly fits in the third category, however unlike these targeted analyses on data that has already been processed into a particular form, P-MartCancer offers a holistic approach to data analysis allowing all steps of analysis from quality control through pattern discovery to be performed in a workflow-based manner. In addition, the manner that P-Mart offers direct access to the data for statistical analysis at multiple levels (peptide, gene, and protein), with the clinical information aligned, is unique within the set of tools supporting CPTAC. P-MartCancer provides an open, web-based interactive platform for performing quality control processing, statistics, protein quantification and exploratory data analysis tasks in a manner that is reproducible (see Video 1).

Material and Methods

Software Development

P-MartCancer functions are developed in R or Rccp, Rserve (https://www.rforge.net/Rserve/) is used to communicate between R and the web-service, and the interface is developed in Java. A subset of the R functions are currently available via GitHub (https://github.com/pmartR/) and the web-service can also be installed via Docker Hub (https://hub.docker.com/r/pnnl/pmart-web/). Developed in this manner, adding functionality to P-MartCancer is straight-forward through a standardized pipeline.

Cancer Proteomics Data

P-MartCancer currently accesses multiple proteomic datasets generated through the CPTAC available on the Data Portal (https://cptac-data-portal.georgetown.edu/cptacPublic/). Data is available at the peptide, protein and/or gene levels where the protein and gene data is based on a defined Common Data Analysis Pipeline (CDAP)(9). P-MartCancer offers flexibility to the user to either perform statistical processing on the peptide data (before or after parsimony) with P-MartCancer functions for gene or protein quantitation, or to use the data as supplied by CPTAC via the CDAP. Currently various numbers of datasets are available for ovarian cancer and breast cancer(2), however; new datasets are being added as they become available. Each of these datasets contains meta-data about the experiment and the user selects the clinical variable of interest (e.g., vital status, tumor stage) for data processing allowing various hypotheses to be explored.

Results - P-MartCancer Analysis Modules

P-MartCancer is a modular workflow tool (Figure 1A) with four primary capabilities; 1) quality control processing, 2) gene or protein quantification, 3) statistics, and 4) exploratory data analysis. These are further divided into six key modules under which new functionality can be easily added through the R/Rserve to Java framework described previously. The modules and functions available depend upon the type of data being evaluated; peptide, protein or gene. Each function called is displayed visually either via tables or figures in sequential order highlighted by the green text on top of the P-MartCancer screen where the current module is blue (top Figure 1B). Finally, the entire process is documented for the user at the end of the workflow, Figure 1C, and all datasets and statistical results are available for download as .CSV files.

Figure 1.

Screenshots from P-MartCancer. (A) The user selects the workflow to be implemented based on the data type selected. (B) The exploratory evaluation capability allows users to find proteins or genes of interest and evaluate the associated data visually. (C) The log of all of the steps in the analysis performed by the user for use in publication or to facilitate reproducible analyses.

Quality Control Processing

A challenge with proteomics data is pre-processing in a manner that does not ignore the different sources of variability that contribute to the complexity of these datasets. For example, peptides are not uniformly identified for all samples and thus large quantities of missing values are common, due to both random and non-random mechanisms. P-MartCancer offers a suite of pre-processing capabilities that handle issues of peptide and protein coverage, as well as the identification of potential outlier samples(7,10,11). At the peptide level researchers can choose to 1) remove proteins with inadequate coverage (Peptide Filter); 2) remove samples with outlier behavior (Sample Outlier Filter)(10); 3) remove peptides too sparse for statistical analysis (Peptide Coverage Filter); 4) remove peptides with extremely high variability in the context of a Coefficient of Variation (CV Filter) and 5) perform normalization. The quality control processing generates a high-quality dataset for continued statistical analysis. The gene- and protein-level datasets will allow functions 2–4 above, evaluating outlier behavior and removing genes or proteins that are too sparse or variable to add value to downstream statistics.

Differential Statistics

Statistical analysis of peptide, gene or protein-level data is currently focused on quantitative analysis of variance (ANOVA)-based methods and qualitative G-test methods(11). The ANOVA method allows the comparison of any number of groups, performing a multiple test correction when more than two groups are compared (e.g., clinical variable ‘Tumor Residual Disease’ is separated into four categories by size). A Tukey adjustment is performed when the user compares all groups to one another and a Dunnett adjustment is performed when the user compares back to a single control group. Data is not imputed, statistical results are generated based only on the observed data to assure that accurate estimates of variance are being utilized for these tests. To identify qualitative changes, a G-test is also performed for each biomolecule to evaluate whether the number of non-missing observations in one group is more than expected by chance. Multiple test adjustments for the G-test are performed using a Holm-Bonferoni correction. The total significance is given in the context of a bar graph, and to facilitate exploratory data analysis capabilities a p-value threshold (default of 0.05) is used to move forward only a subset of the peptides, genes, or proteins for further evaluation.

Protein Quantification

There are numerous approaches to quantify proteins from the measured peptide-level data(12). P-MartCancer currently offers a standard reference-based approach that scales all peptides to the most abundant, or most reproducible, peptide and gives the median signal(13).

Exploratory Data Analysis

P-MartCancer offers two exploratory data analysis capabilities. The first is Probabilistic Principal Component Analysis (PPCA), which allows P-MartCancer to perform PCA without imputing missing values, demonstrated to be valuable in proteomics(7). The resulting scores are plotted using a standard scatter plot of the scores from the first two principal components that most cancer and biomedical researchers are accustomed to, allowing visual exploration of clustering across samples.

P-MartCancer also offers an interactive and customizable plotting capability called Trelliscope that allows sorting and querying across the peptides, genes or proteins, Figure 1B. Trelliscope uses the statistical results to plot each peptide, gene or protein via either a boxplot of differential abundance or a bar graph of the number of observations, to view quantitative and qualitative changes, respectively. The entire space of the biomolecules being explored can be reduced by selecting various thresholds, such as p-value or fold-change, or the user can search for specific genes or proteins of interest. For each plot, the gene and protein information can be selected and the associated information can be viewed in webpages, http://www.genecards.org sand http://www.uniprot.org, respectively. In the example in Figure 1B the user has searched for BRAF and rapidly views the associated protein-level quantified information based on the clinical variable selected, ‘Macroscopic Disease’, and other information, such as that BRAF has a p-value of ~0.04 for the specific comparison selected.

Discussion

P-MartCancer offers a new online platform to access CPTAC datasets to enable new analyses. There is a wealth of capabilities that could be extremely useful to the proteomics community, many of which are under active development. For example, proteoform discovery, that is the identification of proteins with multiple forms, is also an important component of protein quantification (6). Additional future work is focused on adding new capabilities in statistical testing, machine learning and gene set enrichment analysis, as well as the development of a user-upload capability to enable all researchers with MS-based peak-intensity data to create reproducible statistical downstream processing pipelines.