Graphical abstract
Keywords: Protein microarray, Normalisation, Background correction, Batch correction, Reproducibility
Abstract
Protein microarrays are versatile tools for high throughput study of the human proteome, but systematic and non-systematic sources of bias constrain optimal interpretation and the ultimate utility of the data. Published guidelines to limit technical variability whilst maintaining important biological variation favour DNA-based microarrays that often differ fundamentally in their experimental design. Rigorous tools to guide background correction, the quantification of within-sample variation, normalisation, and batch correction specifically for protein microarrays are limited, require extensive investigation and are not centrally accessible.
Here, we develop a generic one-stop-shop pre-processing suite for protein microarrays that is compatible with data from the major protein microarray scanners. Our graphical and tabular interfaces facilitate a detailed inspection of data and are coupled with supporting guidelines that enable users to select the most appropriate algorithms to systematically address bias arising in customized experiments. The localization and distribution of background signal intensities determine the optimal correction strategy. A novel function overcomes the limitations in the interpretation of the coefficient of variation when signal intensities are at the lower end of the detection threshold. We demonstrate essential considerations in the experimental design and their impact on a range of algorithms for normalization and minimization of batch effects.
Our user-friendly interactive web-based platform eliminates the need for prowess in programming. The open-source R interface includes illustrative examples, generates an auditable record, enables reproducibility, and can incorporate additional custom scripts through its online repository. This versatility will enhance its broad uptake in the infectious disease and vaccine development community.
1. Introduction
Protein microarray technology is increasingly utilised for vaccine candidate discovery among other range of applications in the ‘omics era’ with hundreds to thousands of antigen-specific antibodies analysed simultaneously [1], [2], [3], [4], [5]. Antibody data are correlated with infection or disease outcomes in experimental models and observational studies [6]. The platform is also useful for the dissection of variant-specific antibodies induced by polymorphic proteins [7].
Although multiple pipelines of the analysis of DNA microarrays are published [8], [9], they are not always suitable for proteins because of fundamental differences in the underlying experimental design. In the former, gene expression levels are typically compared by mixing test and control samples that are labelled with a pair of distinct fluorescent dyes. The emission signal at a defined locus in a test sample is expressed as a ratio, relative to its counterpart in the control. Normalization in this context factors in intrinsic differences between dyes and the relative efficiency of their incorporation into the samples under investigation. In contrast, standard protein microarrays (the reverse and forward phase microarrays) quantify the absolute fluorescent emission detected following antibody binding to a single protein, therefore other considerations for normalization become more important.
Similarly, although the concordance between replicates rises with increasing signal intensity (mean–variance dependence) for both DNA and protein microarrays, the respective normalization algorithms differ. An expectation of minimal variation in the majority of genes with the exception of the one(s) under investigation is the norm in standard DNA microarray experiments [10]. The exact opposite is true for experimental designs where important differences in antibody binding between individuals and proteins underpin the hypothesis [3]. Consequently, while scaling down variation for DNA microarrays serves the correct purpose, some algorithms may mask important biological variation in responses to proteins [10].
Tools to guide the rigorous processing of protein microarray data are limited [11], [12], [13], [14], some are time-consuming to optimize and not centralized [15]. Some of the available tools are Protein array web explorer (PAWER) [12], Protein Microarray Database (PMD) [14], Protein Microarray Analyser (PMA) [15], Prospector, Protein Array Analyser (PAA) [11]. Here, we provide a one-stop data-processing suite that empowers users to determine the most appropriate method for each data-handling step by comparing the different data handling techniques. A detailed comparison of the tools is documented in Supplementary-D. We systematically address background correction [16] within-sample variation [10], normalisation [17] and batch correction [18]. Our easy-to-use interactive web-based R interface [19] and illustrative examples enable wide utility.
2. Methods
The data processing suite incorporates a range of sequential statistical functions organized into an R package with accompanying guidance notes (Fig. 1).
We examine the performance of protGear using data from KILchip v1.0, a protein microarray chip designed to enable the simultaneous detection of antibodies against > 100 proteins in large cohort studies. Plasmodium falciparum proteins were printed in triplicate on a slide divided into mini-arrays, defined as the region allocated to a discrete sample and can be further divided into blocks [3].
2.1. Data extraction
Microarray image analysis software captures multiple parameters in relation to antibody intensity in a pre-prepared template mostly referred to as a “.gal” file. [Supplementary A]. Quantification softwares for estimating pixel intensities for example Proscanarray Express software (PerkinElmer) [1], QuantArray software (GSI Lumonics) and GenePix® Pro software (Molecular Devices) [20] generate data with similar parameters. Pixel intensities for each spot are typically reported as means or medians with respective standard deviations. We recommend the median as it is relatively insensitive to outliers. We created a versatile tool that can be adapted to load data output format from different quantification softwares mentioned above and this is highlighted in Supplementary A.
2.2. Background correction
Background intensity is the signal emitted by sources other than the sample under investigation [16], [21]. In microarrays, it arises either from the glass slide and/or from the non-specific binding of analytes and can vary within and between slides [10], [16], [21]. The foreground is the total spot intensity and includes the background.
The background is typically calculated using a circular region around the spot (Fig. 2). In GenePix® for example, this is estimated using a diameter three times that of the corresponding spot indicator [20]. We adapted subtraction and model-based functions for background correction using a combination of the GenePix® Pro [20] and Linear Models for and Microarray Data (Limma) [8)] with minor modifications respectively. When the background exceeds the foreground, we implement functions to enable mathematical computation as explained under moving minimum background and half moving minimum background correction [16], [22]. Prior to background correction, it is important to visually inspect the protein microarray data for any spatial biases. protGear provides two functionalities to visually inspect the slides, however, we recommend inspection of the scanned images [Fig. 2] since the data file might not record all the spatial artefacts. The dashboard includes a function to visualize the printing buffer spots which are used to monitor any background reactivity and detection of any potential protein carry over during printing [3].
protGear provides a range of background subtraction methods based on understanding the distribution of the artefacts in specific experiments and supported with graphical outputs. The local background is the signal detected in the immediate vicinity of a spot. Subtracting the median local background pixel intensities from the foreground is thought to give an unbiased estimator of the true signal intensity for that specific spot [16]. However, uneven variation in the local background across an entire slide may skew the data [23] and can be minimized by implementing a global background subtraction. This subtracts the median of all the local background intensities for a given slide from each spot on that slide. When artefacts are localized to a specific region of a slide often referred to as a block or mini-array, the moving minimum background or half moving minimum background correction options can be adopted [8]. The former restricts the subtraction of local backgrounds to the block within the slide. Since many spots may be affected within a block, it utilizes the minimum rather than the median local background. Zero or negative values are subsequently set to half the minimum of the positive corrected background intensities different from limma implementation that sets any intensity which is <0.5 after background subtraction to be equal to 0.5.
The normal and exponential model (normexp) method is recommended when the distribution of background intensities is normal, but that of the background-corrected data is exponential [24]. The background intensities are fitted as covariates in a convolution model and the expected signal given the observed foreground becomes the corrected intensity. This yields a smooth monotonic function of positive background-corrected intensities and replaces negative values on the entire slide with a single positive co-efficient [25].
The log-linear background correction method utilizes the range of positive background-corrected values on the slide to compute a log-linear smooth monotonic function from which negative values are interpolated [22]. It can be considered for data that do not fit the above distributions.
2.3. Coefficient of variation.
Technical replicates assess within-sample variability and help to quantify the reliability of the experimental procedures. They can minimize data loss when for example a single spot performs poorly, and others succeed. They are also utilized to detect sample-specific experimental variability linked to outliers or caused by specific reagents. Although many replicates are advantageous, this comes at a cost and may reduce experimental throughput.
A function to evaluate the extent of within-sample variability is implemented using the Coefficient of Variation (CV). This is a measure of accuracy expressed defined as; , where is the standard deviation divided by the mean , and expressed as a percentage [10]. Users can define a threshold (cut-off) for the CV using n-replicates and visualize those that do not meet this criterion. Replicate spots that are acceptable are averaged [26]. Additional functions enable the visualization and subtraction of signal intensities from purification tags, where applicable. Protein purification tags refer to specific amino acids or polypeptides fused to target proteins to facilitate their subsequent affinity purification. In the case of the datasets used here, the tags include the CD4 hexa-histidine, Maltose binding protein (MBP) and Glutathione S-transferase (GST) tags [3]. Purification-tag is specific to different experiments and designs, purification-tag subtraction step is optional as shown in Fig. 1.
2.4. Normalisation.
Data normalization minimizes the mean–variance dependence (MVD) that is common in microarray experiments and may mask true biological variability, Fig. 5A [9], [27]. Normalisation transforms the intensities to a scale where the variance, is independent of the mean, where MFI is the (Mean Fluorescent Intensity). Although many normalisation strategies have been proposed [28] we focus on five techniques applicable to protein microarrays.
2.4.1. Log2 normalisation
Log transformations reduce the bias in variance between high and low values by converting the data from a multiplicative to an additive distribution. Wider variance is typically observed for higher signal intensities. Log2 transformation is readily compatible with the doubling sample dilutions typically employed on the bench. The background-corrected values ; where is the estimate of the median background level and is the estimated intensity for a spot of protein feature in the mini-array on the slide. The transformation is defined as . However, is not defined for or for intensities where . Additionally, the asymptotic variance of is approximately constant for large but approaches infinity as . Log transformations are unsuitable for negative values, tend to be inflated for low values that are in the range of the background [17], and are not sensitive to other sources of MVD.
2.4.2. Cyclic loess normalization
This stabilizes the MVD between slides by applying a pairwise non-linear local regression (LOESS). It utilizes a pseudo Bland-Altman (MA) plot defined as the average [A] versus the difference [M] between the intensities on two independent slides, repeated for N number of slides [29]. It yields an ‘average’ array that is used as a reference to adjust the MVD across all slides. It can be applied to both raw and log-transformed data [30]. Cyclic loess performs a pairwise normalization on all distinct pairs of slides utilising the MA plot and LOESS smoothing. The MA plot in single-colour microarrays for a pair of arrays is the scatter plot of average the intensity values [A] from both arrays vs. difference in expression values [M] of the same arrays The intensity-dependent differences are first estimated and the differences subsequently regulated by centering the LOESS line to zero [26], [29].
Given for a given slide , and where are the spot intensities for a specific protein. A LOESS curve is then fitted for the MA differences and a normalised value for is generated. The spot for each specific protein intensities is normalized as follows and or the logarithm transformed equivalents [29], [31]. Here we use the LOESS method of Ballman et al. [8], [29].
The underlying assumption in cyclic loess is that there is minimal variation between individual arrays under the conditions being studied. Its application for protein microarray experiments designed to detect high levels of variation in different arrays may thus be limited. We recommend the randomization of samples during the design of the study to ensure there is minimal variation between the arrays.
2.4.3. Robust linear normalization (RLM).
This method stabilizes the mean–variance dependence (MVD) by using standardized control spots on each slide to adjust intensities across the entire experiment [10]. It assumes that the signal detected from control spots remains constant with the exception of technical differences within or between slides. It is the method of choice when a significant amount of variation between samples is anticipated.
Data from control spots are fitted to a robust statistical model using an iteratively reweighted least-squares procedure with a robust “sandwich estimator”, like the median. Fixed effects for each array or slide and positive control proteins are estimated from the statistical model. Sboner et al. recommended using a linear model applied to log-transformed intensities [10]. The model , is the background-corrected intensity for the spot of protein feature in the block on the slide. is the slide effect of the slide , is the block effect and is the effect of protein feature ; this helps account for the spotted protein amount and binding affinity of different protein features and is the error term. After estimating the best parameters, the transformed values are estimated as [10]. We recommend that the control antigens used for normalization are optimized to avoid saturation to facilitate the identification of true technical variation. We used human Ig (IgG and IgM) as controls in our experiments.
As with other logarithm transformations, RLM is not suitable for negative signals values. These are consequently replaced using the moving minimum positive approach (above).
2.4.4. Variance stabilization normalization (VSN)
The VSN method overcomes the limitations of log transformations by accommodating negative values and minimizing the inflated variance around low signal intensities. It calibrates between-feature variation through shifting and scaling mechanism in which all the data are adjusted.
Huber et al. and Durbin et al. independently proposed the VSN approach which is a variant of the log-transform (glog2). A two-component model to explain the proportional increase in the variance with the mean intensity of the proteins was proposed [9], [17], [27]; , where is the background signal and is the actual signal. and are the proportional error and background error respectively. However, with background corrected data this can be modelled as . A transformation is used to produce values such that is approximately independent of the mean, . In general, for a matrix, the function implemented fits a normalisation transformation where is the scaling parameter for array which is always ensured to be positive with a parameter transformation , is the background offset included if the data is not background corrected and is the generalised transformation . A robust variant of the maximum likelihood estimator for the 2 parameters is utilised [1]. Each slide is treated independently and slide to slide variation is not considered [10].
2.5. Batch Correction.
The processing of samples on separate days introduces batch-to-batch variations due to non-specific day to day differences in laboratory conditions or operators [18].
We implement a selection of tools to identify and visualize batch effects such as coloured scatter plots, hierarchical clustering or principal component analysis (PCA). Subsequent analyses can be adjusted to account for batch effects, but the majority are designed for large experiments of at least 25 batches [32]. We utilise the Empirical Bayes approach as it accommodates all batch sizes and can utilize both parametric and non-parametric data [18].
2.5.1. Empirical Bayes (EB) batch correction using ComBat
This uses the EB approach to estimate and correct batch effects. It can be applied to high-dimensional data even when the sample size is small. Suppose we have batches in the data containing samples within a batch for and a protein then a location and scale (L/S) adjustment model is assumed;. Then, the EB batch adjusted data is then calculated as follows [18] [Supplementary B for details]. To perform this, we utilise a wrapper to SVA’s function ComBat() for the batch adjustment that has both the parametric and non-parametric approaches [18].
3. Results
3.1. Implementation
protGear is an R based suite with a range of functions to facilitate protein microarray data pre-processing. It has a built-in user-friendly Shiny® dashboard [Supplementary C1 Fig. 1 and Supplementary C2] to assist in real-time processing, visualization and downstream analysis using heatmaps and Principal Component Analysis (PCA). It provides five sequential steps for handling a data table of fluorescent intensities. Importantly, the package enables the inclusion of additional functions that may be deemed useful. A detailed workflow is included in the protGear_vignette document in the supplementary or https://keniajin.github.io/protGear/.
3.2. Background correction
The protGear background_correct function implements five different techniques for background correction that are complemented by diagnostic plots. Fig. 3 shows the example of a background diagnostic plot produced by protGear. As shown in Fig. 3 similar local background values were observed across the different blocks. The correlation between the foreground and background intensities (medians) on the same array was also low. Therefore, a local background correction approach was selected and applied.
3.3. Within sample variation and purification tag subtraction
protGear provides a cv_estimation function that is applied to technical repeats to calculate and visualize within-sample variability utilizing a user-defined CV. A filtering algorithm identifies technical repeat spots meeting user-defined criteria e.g. CV < 20%. The function generates a flag variable to enable further scrutiny of non-performing spots. Fig. 4 illustrates graphics to monitor the CV before and after filtering. A folder is created to store the CV-corrected data in the working directory or the package function, respectively. An average of the replicates is calculated before the subtraction of the intensity measured against the purification tag (optional). Here, we kept 2 of 3 technical replicates with CVs<20% and excluded the outlier value.
3.4. Normalisation and batch correction
We tested four functions for normalization to identify the one that optimally reduced the MVD. We formally assessed this using the mean versus standard deviation plots (meanSdPlots) and coupled this to automatically derived Spearman correlation estimates (Rho) and Cox–Stuart or the Mann–Kendall trend tests. The latter quantifies the performance of the normalization. In the example below, we illustrate the versatility of the tool across four Methods for normalization. Using these approaches, the MVD reduction led to a drop in the Rho estimate from 0.93 to between 0.2 and 0.3 in this dataset as shown in Fig. 5 below. Implementation of the log2 approach led to an inflation of variance for the low MFI (Mean Fluorescent Intensity) values. The cyclic loess and
RLM were not optimal for the experimental design (discussed in the methods). Consequently, the VSN normalization approach was adopted (Fig. 5). We then proceeded to investigate batch effects using ComBat from the SVA package. The day-to-day dependence was noticeably reduced by ComBat batch correction [Supplementary B Fig. 1] for day m1 and m2.
4. Discussion
protGear is an open-source one-stop integrated data pre-processing suite specifically tailored to address the systematic and non-systematic sources of bias in high throughput protein microarray experiments. It can be adapted to a range of design formats and is compatible with the majority of commercial protein microarray platforms. It provides a choice of functions to address each major source of bias, outlines the theoretical background necessary to guide selection and generates custom graphical and tabular outputs to support data interrogation and interpretation. It is coupled with a user-friendly interactive web platform that eliminates the need for specialized programming skills. In line with other open-source platforms, protGear can be adapted to incorporate new functions either by adding custom scripts or contributing to its online repository.
The localization and distribution of background signal intensities guide the selection of the appropriate correction strategy [16], [21], [22]. Our experimental design comprised multiple mini-arrays and slides. We did not detect any significant background pattern within the mini-arrays or block and consequently selected the local background correction method. Although unmodified background intensities are subtracted from the foreground resulting in unbiased estimates [16], negative values are often generated, and the consistency of the results across different mini-arrays and slides needs to be assured. Additional methods including the novel half moving minimum we developed that overcome these limitations have been included [8].
The inclusion of two or more technical replicates is vital for the robust analysis of within-sample variability [15]. Caution in interpreting the CV is recommended as small differences in signal intensities between replicates at the lower end of the detection threshold can yield misleadingly high CVs. To overcome this, we implemented a novel function that enables users to set signal intensity thresholds below which high CVs can be ignored.
The importance of adopting an appropriate strategy for normalization is critical and requires the coupling of the experimental hypothesis with the mathematical assumptions underpinning the methods [33]. Key design issues to consider are the extent of sample biological variation anticipated under the conditions being investigated and technical considerations in the array design such as the inclusion of appropriate controls. Adopting the wrong method increases the probability of detecting false-negative and false positives.
The RLM normalisation approach that was specifically developed for protein microarrays [10] requires that the secondary control normalisation proteins yield constant signals across and within slides. These control proteins are expected to have a low CV and can be used for both normalizations and evaluating the slide variability [10]. Although the MVD was significantly reduced with all methods tested, the VSN method was optimal. protGear provides a novel powerful single platform that empowers users to sequentially interrogate all these options to determine the optimal solution for the data in question. The easy-to-use interface accommodates multiple data formats, saves enormous amounts of time and generates high-quality visual outputs that facilitate rapid decision making.
Batch effects create an additional unwelcome source of variation that could further reduce statistical power. These must be considered when data are processed at different times, by different users and on different instruments, among others [34]. An important consideration that particularly applies to large cohort studies is the random processing of samples to ensure that batch effects do not exaggerate pre-existing genuine biological variation. For example, in the context of malaria seroepidemiology, age and geographical location are critical determinants of antibody levels [35]. The processing of samples of young children at one time-point, and those of older children at another, could inadvertently lead to enhanced differences in either group that were unrelated to the true underlying biological variation. A similar effect could occur when samples from settings with differing malaria transmission intensity are analysed in the same experiment but at separate times.
A limited number of batch correction approaches have been proposed and these typically accommodate experimental designs with a minimum of 25 batches. We adopted the ComBat batch correction function from the “sva” package in R since it has been reported to be robust to outliers in small batch sizes [18].
protGear provides a state-of-the-art, one-stop adaptable workflow for protein microarray data pre-processing. It can be coupled to software such as Sweave or knitr [36] for report generation and sharing along with the raw data to promote data reproducibility. The user-friendly, interactive, web-based and graphical interface requires limited R-experience and will enhance broad uptake in the infectious disease and vaccine development community.
5. Availability and implementation
The protGear R package is publicly available in the GitHub repository (https://github.com/Keniajin/protGear).
Funding
This research was commissioned by the National Institute for Health Research (NIHR) Global Health Research programme (16/136/33) using UK aid from the UK Government. The views expressed in this publication are those of the author(s) and not necessarily those of the NIHR or the Department of Health and Social Care.
K.M, F.O, S.K are funded by NIHR Global Health Research Unit Tackling Infections to Benefit Africa (TIBA). F.O. is supported by a Sofja Kovalevskaja Award from the Alexander von Humboldt Foundation (3.2–1184811 - KEN - SKP) and an EDCTP Senior Fellowship (TMA 2015 SF1001) which is part of the EDCTP2 Programme supported by the European Union. S.K and E.M are supported by the DELTAS Africa Initiative under Initiative to Develop African Research Leaders (IDeAL) and DELTAS Sub-Saharan Africa Consortium for Advanced Biostatistics (SSACAB) respectively.
CRediT authorship contribution statement
Kennedy Mwai: Conceptualization, Methodology, Software, Writing - original draft, Writing - review & editing, Visualization. Nelson Kibinge: Conceptualization, Methodology, Software, Writing - original draft, Supervision, Writing - review & editing, Visualization. James Tuju: Conceptualization, Writing - original draft, Investigation, Supervision, Writing - review & editing. Gathoni Kamuyu: Literature search, Writing - original draft, Investigation, Writing - review & editing. Rinter Kimathi: Data curation, Literature search, Investigation. James Mburu: Methodology, Software, Visualization. Emily Chepsat: Data curation, Investigation. Lydia Nyamako: Data curation, Investigation, Project administration. Timothy Chege: Data curation, Investigation. Irene Nkumama: Data curation, Investigation. Samson Kinyanjui: Supervision, Funding acquisition, Writing - review & editing. Eustasius Musenge: Conceptualization, Methodology, Writing - original draft, Supervision, Writing - review & editing. Faith Osier: Conceptualization, Methodology, Writing - original draft, Supervision, Funding acquisition, Writing - review & editing.
Declaration of Competing Interest
The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.
Footnotes
Supplementary data to this article can be found online at https://doi.org/10.1016/j.csbj.2021.04.044.
Appendix A. Supplementary data
The following are the Supplementary data to this article:
References
- 1.Sundaresh S., Doolan D.L., Hirst S., Mu Y., Unal B., Davies D.H. Identification of humoral immune responses in protein microarrays using DNA microarray data analysis techniques. Bioinformatics. 2006;22(14):1760–1766. doi: 10.1093/bioinformatics/btl162. [DOI] [PubMed] [Google Scholar]
- 2.Doolan D.L., Mu Y., Unal B., Sundaresh S., Hirst S., Valdez C. Profiling humoral immune responses to P. falciparum infection with protein microarrays. Proteomics. 2008;8(22):4680–4694. doi: 10.1002/pmic.200800194. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.Kamuyu G., Tuju J., Kimathi R., Mwai K., Mburu J., Kibinge N. KILchip v1. 0: a novel Plasmodium falciparum merozoite protein microarray to facilitate malaria vaccine candidate prioritization. Front Immunol. 2018;9:2866. doi: 10.3389/fimmu.2018.02866. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.De Assis R.R., Jain A., Nakajima R., Jasinskas A., Felgner J., Obiero J.M. Analysis of SARS-CoV-2 antibodies in COVID-19 convalescent blood using a coronavirus antigen microarray. Nat Commun. 2021;12(1):1–9. doi: 10.1038/s41467-020-20095-2. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Duarte J.G., Blackburn J.M. Advances in the development of human protein microarrays. Expert Rev Proteomics. 2017;14(7):627–641. doi: 10.1080/14789450.2017.1347042. [DOI] [PubMed] [Google Scholar]
- 6.Mordmüller B., Surat G., Lagler H., Chakravarty S., Ishizuka A.S., Lalremruata A. Sterile protection against human malaria by chemoattenuated PfSPZ vaccine. Nature. 2017 Feb 23;542(7642):445–449. doi: 10.1038/nature21060. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Barry A.E., Trieu A., Fowkes F.J.I., Pablo J., Kalantari-Dehaghi M., Jasinskas A. The stability and complexity of antibody responses to the major surface antigen of Plasmodium falciparum are associated with age in a malaria endemic area. Mol Cell Proteomics. 2011;10(11) doi: 10.1074/mcp.M111.008326. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Ritchie M.E., Phipson B., Wu Di HuY., Law C.W., Shi W. Limma powers differential expression analyses for RNA-sequencing and microarray studies. Nucleic Acids Res. 2015;43(7):e47. doi: 10.1093/nar/gkv007. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Durbin B.P., Hardin J.S., Hawkins D.M., Rocke D.M. A variance-stabilizing transformation for gene-expression microarray data. Bioinformatics. 2002;18(suppl_1):S105–S110. doi: 10.1093/bioinformatics/18.suppl_1.s105. [DOI] [PubMed] [Google Scholar]
- 10.Sboner A., Karpikov A., Chen G., Smith M., Dawn M., Freeman-Cook L. Robust-linear-model normalization to reduce technical variability in functional protein microarrays. J Proteome Res. 2009;8(12):5451–5464. doi: 10.1021/pr900412k. [DOI] [PubMed] [Google Scholar]
- 11.Turewicz M., Ahrens M., May C., Marcus K., Eisenacher M. PAA: a R/bioconductor package for biomarker discovery with protein microarrays. Bioinformatics. 2016;32(10):1577–1579. doi: 10.1093/bioinformatics/btw037. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Fishman D., Kuzmin I., Adler P., Vilo J., Peterson H. PAWER: protein array web exploreR. BMC Bioinf. 2020;21(1):1–8. doi: 10.1186/s12859-020-03722-z. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Mannsperger H.A., Gade S., Henjes F., Beissbarth T., Korf U. RPPanalyzer: Analysis of reverse-phase protein array data. Bioinformatics. 2010;26(17):2202–2203. doi: 10.1093/bioinformatics/btq347. [DOI] [PubMed] [Google Scholar]
- 14.Xu Z., Huang L., Zhang H., Li Y., Guo S., Wang N. PMD: A resource for archiving and analyzing protein microarray data. Sci Rep. 2016;6(1):1–5. doi: 10.1038/srep19956. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Duarte J.D.G., Goosen R.W., Lawry P.J., Blackburn J.M. PMA: Protein Microarray Analyser, a user-friendly tool for data processing and normalization. BMC Res Notes. 2018;11(1):1–6. doi: 10.1186/s13104-018-3266-0. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Ritchie M.E., Silver J., Oshlack A., Holmes M., Diyagama D., Holloway A. A comparison of background correction methods for two-colour microarrays. Bioinformatics. 2007;23(20):2700–2707. doi: 10.1093/bioinformatics/btm412. [DOI] [PubMed] [Google Scholar]
- 17.Huber W., von Heydebreck A., Sultmann H., Poustka A., Vingron M. Variance stabilization applied to microarray data calibration and to the quantification of differential expression. Bioinformatics. 2002;18(Suppl. 1):S96–S104. doi: 10.1093/bioinformatics/18.suppl_1.s96. [DOI] [PubMed] [Google Scholar]
- 18.Johnson W.E., Li C., Rabinovic A. Adjusting batch effects in microarray expression data using empirical Bayes methods. Biostatistics. 2007;8(1):118–127. doi: 10.1093/biostatistics/kxj037. [DOI] [PubMed] [Google Scholar]
- 19.Team RC, others. R: A language and environment for statistical computing. Vienna, Austria; 2013.
- 20.GenePix. GenePix Pro 4.0 User Guide Rev. G. 2002 [Internet]. GenePix; 2002. Available from: https://ipmb.sinica.edu.tw/microarray/index.files/GenePix_Pro_4.1_Manual_RevG.pdf.
- 21.Silver J.D., Ritchie M.E., Smyth G.K. Microarray background correction: maximum likelihood estimation for the normal–exponential convolution. Biostatistics. 2009;10(2):352–363. doi: 10.1093/biostatistics/kxn042. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Edwards D. Non-linear normalization and background correction in one-channel cDNA microarray studies. Bioinformatics. 2003;19(7):825–833. doi: 10.1093/bioinformatics/btg083. [DOI] [PubMed] [Google Scholar]
- 23.Zhu X., Gerstein M., Snyder M. ProCAT: a data analysis approach for protein microarrays. Genome Biol. 2006;7(11):R110. doi: 10.1186/gb-2006-7-11-r110. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.Irizarry R.A., Hobbs B., Collin F., Beazer-Barclay Y.D., Antonellis K.J., Scherf U. Exploration, normalization, and summaries of high density oligonucleotide array probe level data. Biostatistics. 2003;4(2):249–264. doi: 10.1093/biostatistics/4.2.249. [DOI] [PubMed] [Google Scholar]
- 25.McGee M., Chen Z. Parameter estimation for the exponential-normal convolution model for background correction of affymetrix GeneChip data. Stat Appl Genet Mol Biol. 2006;5(1) doi: 10.2202/1544-6115.1237. [DOI] [PubMed] [Google Scholar]
- 26.Delfani P., Dexlin Mellby L., Nordström M., Holmér A., Ohlsson M., Borrebaeck C.A.K. Technical advances of the recombinant antibody microarray technology platform for clinical immunoproteomics. PLoS One. 2016;11(7) doi: 10.1371/journal.pone.0159138. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27.Sundaresh S., Randall A., Unal B., Petersen J.M., Belisle J.T., Hartley M.G. From protein microarrays to diagnostic antigen discovery: A study of the pathogen Francisella tularensis. Bioinformatics. 2007;23(13) doi: 10.1093/bioinformatics/btm207. [DOI] [PubMed] [Google Scholar]
- 28.Barbacioru C.C., Wang Y., Canales R.D., Sun Y.A., Keys D.N., Chan F. Effect of various normalization methods on Applied Biosystems expression array system data. BMC Bioinf. 2006;7:1–14. doi: 10.1186/1471-2105-7-533. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.Ballman K.V., Grill D.E., Oberg A.L., Therneau T.M. Faster cyclic loess: normalizing RNA arrays via linear models. Bioinformatics. 2004;20(16):2778–2786. doi: 10.1093/bioinformatics/bth327. [DOI] [PubMed] [Google Scholar]
- 30.Välikangas T., Suomi T., Elo L.L. A systematic evaluation of normalization methods in quantitative label-free proteomics. Brief Bioinform. 2018;19(1):1–11. doi: 10.1093/bib/bbw095. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.Do JH, Choi D-K. Normalization of Microarray Data: Single-labeled and Dual-labeled Arrays. Vol. 22, Mol. Cells. [PubMed]
- 32.Chen C., Grennan K., Badner J., Zhang D., Gershon E., Jin L. Removing batch effects in analysis of expression microarray data: an evaluation of six batch adjustment methods. PLoS One. 2011;6(2) doi: 10.1371/journal.pone.0017238. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33.Allison D.B., Cui X., Page G.P., Sabripour M. Microarray data analysis: From disarray to consolidation and consensus. Nat Rev Genet. 2006;7(1):55–65. doi: 10.1038/nrg1749. [DOI] [PubMed] [Google Scholar]
- 34.Nygaard V., Rødland E.A., Hovig E. Methods that remove batch effects while retaining group differences may lead to exaggerated confidence in downstream analyses. Biostatistics. 2016;17(1):29–39. doi: 10.1093/biostatistics/kxv027. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 35.Osier F.H.A., Fegan G., Polley S.D., Murungi L., Verra F., Tetteh K.K.A. Breadth and magnitude of antibody responses to multiple Plasmodium falciparum merozoite antigens are associated with protection from clinical malaria. Infect Immun. 2008;76(5):2240–2248. doi: 10.1128/IAI.01585-07. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 36.Xie Y. knitr: a comprehensive tool for reproducible research in R. Implement Reprod Comput Res. 2014:3–32. [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.