Skip to main content
PeerJ logoLink to PeerJ
. 2020 Apr 29;8:e9066. doi: 10.7717/peerj.9066

ECMPride: prediction of human extracellular matrix proteins based on the ideal dataset using hybrid features with domain evidence

Binghui Liu 1,#, Ling Leng 2,#, Xuer Sun 3, Yunfang Wang 3, Jie Ma 1,, Yunping Zhu 1,4,
Editor: Walter de Azevedo Jr
PMCID: PMC7195829  PMID: 32377454

Abstract

Extracellular matrix (ECM) proteins play an essential role in various biological processes in multicellular organisms, and their abnormal regulation can lead to many diseases. For large-scale ECM protein identification, especially through proteomic-based techniques, a theoretical reference database of ECM proteins is required. In this study, based on the experimentally verified ECM datasets and by the integration of protein domain features and a machine learning model, we developed ECMPride, a flexible and scalable tool for predicting ECM proteins. ECMPride achieved excellent performance in predicting ECM proteins, with appropriate balanced accuracy and sensitivity, and the performance of ECMPride was shown to be superior to the previously developed tool. A new theoretical dataset of human ECM components was also established by applying ECMPride to all human entries in the SwissProt database, containing a significant number of putative ECM proteins as well as the abundant biological annotations. This dataset might serve as a valuable reference resource for ECM protein identification.

Keywords: Extracellular matrix proteins, Proteomics, Prediction tool, Random forest, Under-sampling ensemble method

Introduction

The extracellular matrix (ECM) is a vital component of the cellular microenvironment, providing structural and functional support to surrounding cells (Bonnans, Chou & Werb, 2014; Theocharis et al., 2016). ECM proteins play crucial roles in regulating diverse functions of cells, including differentiation, proliferation, survival, and migration (Bonnans, Chou & Werb, 2014; Hynes, 2009), and their dysregulation can result in a wide range of diseases (Bateman, Boot-Handford & Lamandé, 2009; Liu et al., 2019; Tokhmafshan et al., 2017; Walker & Mojares, 2018). A better understanding of the composition and function of ECM proteins should contribute to useful therapeutic targets for related diseases.

The rapid development of multi-omics research has substantially benefited ECM identification and characterization. However, for large-scale ECM protein identification, especially for proteomics-based techniques, a general reference database of ECM proteins is required. Many strategies have been developed by the researchers to define the set of ECM proteins, including the molecular fishing method (Cain et al., 2009), the systematic curation method (Cromar et al., 2012), and the domain-based method (Naba et al., 2016). Besides, the Richard-Blum lab established the MatrixDB database, which is focused on the interactions established by extracellular proteins and polysaccharides and can provide interaction evidence for putative ECMs validation (Clerc et al., 2018). Domain architectures change during evolution (Apic, Huber & Teichmann, 2003), and proteins with the same domain architecture are frequently related (Bornberg-Bauer & Alba, 2013). By utilizing the domain-based structure of ECM proteins, Naba et al. used an in silico approach to define ECM components and, based on this, constructed the Matrisome database in 2012 (Naba et al., 2012). The Matrisome has become a general reference database for proteomics-based ECM research in recent years (Åhrman et al., 2018; Gopal et al., 2017; Lennon et al., 2014; Mayorca-Guiliani et al., 2017). Further, Naba et al. (2016) presented the first draft of the ECM atlas, which was established by integrating publicly available mass spectrometry data from studies explicitly designed to characterize the global composition of ECM proteins. However, when compared with Matrisome, there is relatively low overlap ∼51% (∼73% for Core matrisome and ∼42% for Matrisome-associated) between experimentally identified ECMs and theoretically predicted ones, which likely reflects the poor representation of insoluble matrix tissues in the experimental datasets used for comparison. Additionally, the in silico Matrisome was constructed via a semi-empirical and manual-assisted approach, so there are some difficulties for the database in dealing with the problems of constant updating and expansion to other species.

Several attempts have also been made by bioinformatics researchers to predict ECM proteins based on machine learning methods; specifically, a series of tools were developed, including ECMPP (Jung et al., 2010), EcmPred (Kandaswamy et al., 2013), PECM (Zhang et al., 2014), IECMP (Yang et al., 2015), ECMP-HybKNN (Ali & Hayat, 2016), BAMORF (Guan, Zhang & Xu, 2017), and TargetECMP (Kabir et al., 2018). Most tools were developed based on a generic pipeline, which uses different machine learning algorithms to build classification models on the extracted features and training datasets and can achieve automated prediction of ECM proteins. The most significant shortcoming of these tools is their lack of a connection with experimental biological features, especially concerning standard dataset construction and classification feature extraction (Article S1). In addition, there are no tools available other than EcmPred.

In summary, the Matrisome database presented by Naba et al. compiles in silico and in vivo data on ECM proteins, and the existing bioinformatics prediction tools for ECMs are robust in modeling. Thus, in this study, we proposed incorporating these advantages of both approaches and developed ECMPride, a flexible and scalable tool for predicting extracellular matrix proteins. Based on the experimentally verified ECM datasets, while integrating protein domain features and a machine learning model, ECMPride achieved better performance when compared with EcmPred. We also provide researchers with a comprehensive dataset of all putative human ECMs (named ECMPrideDB) by applying ECMPride to all human protein sequences in the SwissProt database (The UniProt Consortium, 2017), and this ECM dataset might serve as a valuable reference resource for future investigations.

Materials & Methods

Datasets

The standard training dataset consists of a positive dataset of ECM proteins and a negative dataset of non-ECM proteins (Table S1). The positive one consists of 521 human proteins whose ECM-related status is supported by Matrisome with further credible evidence (Naba et al., 2016) (Table S2). In contrast, the negative one consists of 11,336 human intracellular proteins from the Human Protein Atlas database developed by Thul et al. (2017).

The detailed process of generating positive and negative datasets, as well as the Matrisome categories of the positive dataset, can be found in Article S1.

Feature extraction

Three main classes and 167 features in total are introduced into ECMPride to represent the characteristics of ECM proteins, including ECM protein-related structural domains (from now on referred to as ECM domains) (Naba et al., 2012), physicochemical properties (Kandaswamy et al., 2013), and position-specific scoring matrix (PSSM) (Altschul et al., 1997) (all features are listed in Table S3).

ECM domains

We are the first to introduce domain into machine learning algorithms to predict ECM systematically. ECM proteins typically include multiple, independently folded domains whose sequences and arrangements are highly conserved (Hynes, 2009). Based on this hallmark, Naba et al. (2012) established a list of “inclusion domains” commonly found in ECM proteins and a list of “exclusion domains” whose presence ruled a protein out from being a part of the ECM. These two lists are first merged, and then, domains that are not in the version of InterPro 69.0 (Mitchell et al., 2018) or do not exist in any protein of the dataset are excluded. Finally, a list of 63 ECM domains is obtained (Table S3).

The score for i-th ECM domain Di of protein A is represented as follows:

Xi=0ifDiA1ifDiAi=1,2,,63

Here, the evidence of whether Di belongs to A comes from SwissProt (The UniProt Consortium, 2017).

Finally, a 63-D feature vector of ECM domains is constructed for every protein sequence.

Position-Specific Scoring Matrix (PSSM)

For protein evolution, sequences evolve via the substitution, insertion, or deletion of residues (Chou & Shen, 2007). After a long time, the accumulation of these changes slowly eliminates the similarities between the original protein and the final protein; however, some of the critical residues associated with the essential properties of the protein remain stable, which is referred to as evolutionary conservation (Zhang et al., 2014). Such conservation usually occurs in sequences with important biological functions (Zuo et al., 2014). Therefore, evolutionary information is critical to the prediction of protein structure and function (Ding et al., 2014).

PSSM is a matrix that can well reflect the evolution information of a protein. It is generated by running PSI-BLAST (Altschul et al., 1997) in the database of SwissProt through three iterations, with 0.001 as an E-value cut-off. As shown below, it consists of 20 × L elements, with L representing the length of the protein sequence.

PPSSM=E1,1E1,2E2,1E2,2E1,jE2,jE1,20E2,20Ei,1Ei,2Ei,jEi,20EL,1EL,2EL,jEL,20

Here, Ei,j represents the score of the amino acid mutation in the i-th position of the sequence to form the amino acid type j during evolution. Then, PSSM is converted into an 80-D vector by standardization and grey model theory (the detailed process of conversion could be found in Article S1) (Chou, 2001; Matsuda et al., 2005).

Physicochemical properties

The structure and function of proteins are defined by the physicochemical properties of the 20 amino acids, which have been the subject of a large number of experimental and theoretical studies. The physicochemical properties of the 20 amino acids can be represented by a set of 20 values of an amino acid index (AAIndex) (Kawashima et al., 2007). There is now a database exclusively dedicated to storing AAIndex values (UMBC AAindex Database).

Here, we use 24 physicochemical properties selected by Kandaswamy et al. (2013) from the UMBC AAindex Database (Table S4). The formula for calculating each physicochemical property of a protein is as follows:

PP=1Li=1LAAIndexi

where AAIndexi is the AAIndex value of the physicochemical property corresponding to the i-th amino acid in the protein sequence, and L is the length of the protein sequence. Finally, a 24-D feature vector of physicochemical properties is established for every protein sequence.

Feature selection

For feature selection, we first perform feature importance scoring. This involves scoring the importance of all of the extracted features by the Maximum Relevance Minimum Redundancy (mRMR) algorithm (Peng, Long & Ding, 2005) (the detailed process is shown in Article S1). The features are ranked according to the order of the scores from high to low.

Next, we adopt the Incremental Feature Selection (IFS) method to obtain the optimal feature subset based on the ranked feature set. The process begins with an empty feature set and adds features one by one in order of importance from high to low. Each time a feature is added, a new feature subset is generated so that n features will generate n feature subsets (Lin et al., 2013). The subset of features with better predictive performance and fewer features would be considered the optimal feature subset (Yang et al., 2015).

Prediction model and Performance evaluation

In this study, the Random forest model has been implemented in ECMPride for prediction. Developed by Breiman, the Random Forest algorithm is an integrated classifier consisting of numerous decision trees. It uses the bootstrap method to extract multiple identical samples from the original sample to generate a training set and then builds a decision tree with each sample in the training set. Finally, the final prediction result of the Random Forest model is obtained by voting on all decision tree prediction results (Breiman, 2001). Random Forests have high predictive accuracy, have good tolerance of outliers and noise, and are not prone to over-fitting. They can handle both continuous and discrete variables, making them advantageous and increasingly mature machine learning algorithms. Here we use the randomForest package of R to implement the classification of ECM and non-ECM components (Liaw & Wiener, 2002).

Ten-fold cross-validation is used to evaluate the predictive model, and the under-sampling ensemble method is implemented to overcome the imbalance of the training datasets. Meanwhile, we employed the following four parameters to evaluate the performance of the ECM prediction models: sensitivity (Sn), specificity (Sp), accuracy (Acc), and balanced accuracy (BAcc). These can be represented by four indicators: true positive (TP), false negative (FN), true negative (TN), and false positive (FP). The detailed model training and parameters calculation can be found in Article S1.

Results

Construction of ECMPride

We built ECMPride, a command-line based tool that allows users to predict ECM proteins. The tool is available and freely downloaded from the public repository GitHub: https://github.com/Binghui-Liu/ECMPride.git. The overall workflow of ECMPride is shown in Fig. 1. As a high-quality ECM prediction tool, ECMPride has several unique features. First, positive and negative standard datasets (Table S1) are constructed based on reliable experimental and theoretical sources, including the Matrisome, ECM Atlas (Naba et al., 2016), the Human Protein Atlas (Thul et al., 2017) and Gene Ontology annotation (The Gene Ontology Consortium, 2016), as well as a series of ECM proteomic studies (Table S2). Then, three main classes and 167 features in total are introduced into ECMPride to represent the characteristics of ECM proteins. In particular, the ECM domains proposed by Naba et al. are introduced into machine learning algorithms for the first time. In addition, the mRMR-IFS methods are implemented to reduce feature redundancy. Finally, to handle the classification problem of imbalanced datasets, the under-sampling ensemble method is employed for modeling (Table S5), and balanced accuracy is adopted as the essential criterion to evaluate the performance (Fig. S1). All details about the ECMPride pipeline construction can be found in Materials & Methods and Article S1.

Figure 1. Flowchart of the ECMPride pipeline.

Figure 1

ECMPride achieves good performance

ECMPride reduces feature redundancy to a certain extent via the feature selection step. All of the 167 features are scored and sorted by mRMR (Table S3), and the IFS method is used to generate 167 feature subsets and further generate 167 corresponding candidate models (Table S6). As shown in Fig. 2, when the top 151 features are selected as the feature subset, the model achieves the highest balanced accuracy of 0.9142, and the corresponding value is 0.9070 when all 167 features are used for prediction. Therefore, feature selection allows us to achieve better prediction with fewer features. In this context, ECMPride is established based on the top 151 features.

Figure 2. The feature selection curve of balanced accuracy for different feature subsets.

Figure 2

The 167 feature subsets were obtained by adding features one by one in order of importance from high to low. On the basis of each feature subset, the model was established with 10-fold cross-validation. The curve represents the relationship between the feature subset and its corresponding model’s balanced accuracy.

A series of tools had been developed by researchers to predict ECM proteins (Ali & Hayat, 2016; Guan, Zhang & Xu, 2017; Jung et al., 2010; Kabir et al., 2018; Kandaswamy et al., 2013; Yang et al., 2015; Zhang et al., 2014), so it’s necessary to compare ECMPride with these tools. As the datasets used by ECMPride differ from the datasets used for previous tools, it is meaningless to compare their performance directly. Meanwhile, most of the previously released tools are no longer available for a variety of reasons, so it is impossible to compare ECMPride with such tools in an independent dataset. As such, we here attempt to reproduce the previous tools by carefully reviewing the articles about them; only for the tool EcmPred can localization be implemented well (Kandaswamy et al., 2013). Therefore, we applied ECMPride’s and EcmPred’s methods to each other’s training dataset and compared their performance (Table 1). Using the same method (ECMPride or EcmPred), the model based on ECMPride’s dataset (D1 in Table 1) behaved higher balanced accuracy than that based on EcmPred’s dataset (D2 in Table 1), which means that the new training dataset is better than the old one. With the same dataset (D1 or D2 in Table 1), the model based on ECMPride’s method behaved higher balanced accuracy than that based on EcmPred’s method, which means that the method of ECMPride is better than that of EcmPred. Overall, ECMPride achieved better performance than EcmPred.

Table 1. Performance comparison of models with different methods and datasets.

Method Dataset Sensitivity Specificity Accuracy Balanced accuracy
ECMPride D1 0.8925 0.9360 0.9340 0.9142
D2 0.8783 0.8623 0.8638 0.8703
EcmPred D1 0.8462 0.9158 0.9145 0.8810
D2 0.6500 0.7700 0.8300 0.7100

Notes.

D1
Training dataset constructed in ECMPride’s model
D2
Training dataset constructed in EcmPred’s model

Construction of theoretical reference dataset of human ECM proteins

To obtained a comprehensive collection of theoretical human ECM proteins, we applied ECMPride to all human entries in the SwissProt database (The UniProt Consortium, 2017).

The proteins with a probability of being ECM higher than 0.7 are considered to be confidently predicted results. These proteins, together with the positive ECMs, are accepted as putative human ECM proteins and compose the theoretical reference dataset of human ECM proteins (named ECMPrideDB, Table S7). We also collected information on relevant databases to annotate genes in ECMPrideDB (Table S7), including Human Protein Atlas (Thul et al., 2017), ExoCarta (Keerthikumar et al., 2016) and GO (The Gene Ontology Consortium, 2016). Then, we compared ECMPrideDB with Matrisome (Naba et al., 2016), as well as two experimental datasets generated from the ECM-related biological samples (Table S8) (Åhrman et al., 2018; Naba et al., 2017). There are a total of 1,510 putative ECM proteins (1494 genes) in ECMPrideDB, and the official gene symbols were used for comparison with other datasets. Overall, most ECM components in Human Matrisome are included in ECMPrideDB (∼69.62%, Fig. 3A). Specifically, ECMPrideDB covers ∼92.33% of the Core matrisome and ∼61.35% of the Matrisome-associated components in Matrisome (Fig. 3B). Additionally, 779 more novel ECM components are found in ECMPrideDB. For the 21 Core matrisome components uniquely included in Matrisome, 15 of them were also predicted as potential ECMs by ECMPride but with relatively low confidence (probability < 0.7). None of them were annotated with extracellular matrix terms in GO. A similar situation also prevailed in the 291 Matrisome-associated components uniquely included in Matrisome, about half of them (153/291) were predicted as potential ECMs by ECMPride with low confidence (probability <0 .7), and a vast majority of them (275/291) were annotated without extracellular matrix annotations in GO, indicating that there might be insufficient evidence to support these proteins to be real ECMs and more biological or structural information need to be explored.

Figure 3. Comparison of the new ECM proteins with Human Matrisome and other experimental datasets.

Figure 3

The black, blue, and orange circles represent ECMPrideDB, Human Matrisome (dark blue for core Matrisome and light blue for Matrisome-associated), and two proteomics experimental datasets, respectively. (A) Overlap of ECMPrideDB and Matrisome. (B) Overlap of ECMPrideDB, core Matrisome, and Matrisome-associated. (C) Overlap of ECMPrideDB, Matrisome, and ECM proteomics dataset of Naba et al. (2016). (D) Overlap of ECMPrideDB, Matrisome, and ECM proteomics dataset of Åhrman et al. (2018).

For both proteomic experimental datasets, most of the identified proteins that overlap with Matrisome are also contained in ECMPrideDB, and considerable numbers of novel ECMs (96 and 127, respectively, Fig. 3C and Fig. 3D) are found in ECMPrideDB.

Validation of novel ECM components

To further validate the putative ECM proteins predicted by ECMPride, several analyses were implemented. Among the 779 putative ECMs uniquely identified in ECMPrideDB, 283 of them contain at least one of the protein domains proposed by Naba et al. as the specific features for Core Matrisome (Naba et al., 2016) (Table S7). It is due to the update of the underlying domain annotation that these newly predicted ECMs emerge. To an extent, it also proves the reliability of putative ECMs predicted by ECMPride. The presentation of experimental interactions with known ECM proteins could be supportive evidence for the new putative ECMs. Thus, the protein-protein interactions of the 779 putative ECMs with all ECMs in Matrisome are retrieved both from MatrixDB (Clerc et al., 2018) and STRING (Szklarczyk et al., 2018) database. It is found that 619 of 779 putative ECMs can interact with at least one known ECM in Matrisome. Finally, the detailed interactions, as well as the hyperlink of the Entrez gene summary, are provided with each putative ECM in ECMPrideDB in Table S7.

Further, we confirmed the expression of several potential novel ECM components in the top list of the ECMPrideDB by immunohistochemistry and immunofluorescence experiments, including stabilin family members STAB1 and STAB2, and the jagged canonical notch ligands JAG1 and JAG2 (Details refer to Article S1). Our results indicate that all four molecules are expressed in the extracellular space of epidermis and dermis (Fig. S2). Interestingly, STAB1, STAB2, and JAG1 are specifically located in the basement membrane of skin tissue, which is the epidermal stem cell niches (Figs. S2AS2C). And JAG2 is specifically located in the spinous, granular, and stratum corneum layers of the epidermis (Fig. S2D). Moreover, three new predicted ECM components (DLL4, LRP1, and FCGBP) are found expressed in the extracellular space of normal human liver and skin tissues, as well as RH-30 cell lines (Fig. S3). Although the current immunohistochemical and immunofluorescence experiments are not sufficient to verify that these proteins are ECM proteins, the results are nevertheless a useful preliminary validation, and more work remains to be done.

Discussion

More and more proteomics studies are applied for large-scale ECM protein identification, and the theoretical ECM database was used in these studies to identify ECM proteins and guide the biological analysis and experiments (Åhrman et al., 2018; Gopal et al., 2017; Lennon et al., 2014; Mayorca-Guiliani et al., 2017). Thus, the development of ECMs prediction methods and the construct of comprehensive ECM reference datasets are required and will benefit proteomics-based ECM researches.

In this study, we proposed a flexible and scalable tool ECMPride for predicting extracellular matrix proteins by incorporating the advantages of experiment-based features and robust prediction models. There are three classes of features implemented in ECMPride to represent the characteristics of ECM proteins, including ECM protein-related structural domains (63 features), physicochemical properties (24 features), and position-specific scoring matrix (PSSM, 80 features). The physicochemical properties and PSSM have been used in many models and tools for the prediction of protein structure and function for multi-species (Chen & Li, 2013; Du & Yu, 2013; Hayat & Khan, 2012; Lundegaard et al., 2008). While for the features of domains, ECM proteins are highly conserved among different species, not only in the sequences of specific domains but also in the arrangements of those domains (Hynes, 2009). Utilizing the conserved nature of domains across species, Naba et al. used the same list of domains to construct human and mouse ECM datasets, respectively (Naba et al., 2012). At present, we applied ECMPride to predict human ECM proteins, but we think ECMPride can be useful for ECM proteins prediction for other species.

Among all seven ECM prediction tools introduced in this study (ECMPP, EcmPred, PECM, IECMP, ECMP-HybKNN, BAMORF, and TargetECMP), four of them (ECMPP, EcmPred, PECM, and IECMP) were released with web-based applications. Unfortunately, none of these tools are currently available. Therefore, the maintenance and update of software tools are essential for public users. ECMPride is developed as an open-source and easy-to-use tool. To analyze the large datasets efficiently, we also designed a parallel version of ECMPride, which could perform the prediction of proteins with multi-threads mode. All the source codes of ECMPride with single-thread and multi-threads versions are publicly available from GitHub (https://github.com/Binghui-Liu/ECMPride.git). As the experimental validated ECM proteins and annotation database based features would keep updating, we will further improve the sensitivity and specificity of the prediction model and provide the continuously update service of the ECMPride tool. Based on ECMPride, we plan to develop a web-based database for reference ECM proteins for multi-species, which can provide a user-friendly web interface for browsing, searching, and downloading all putative ECM components, as well as the abundant biological annotations.

Conclusions

In this study, we developed ECMPride, a flexible and scalable tool for accurate and automatic prediction of ECM proteins. ECMPride can achieve excellent performance in predicting ECM proteins, with a relatively good balanced accuracy and sensitivity. By applying ECMPride to human protein sequences in SwissProt, a new dataset ECMPrideDB of all putative human ECM components was established. This dataset covers most known ECMs in Human Matrisome, and more potential ECM proteins are identified when using this dataset to annotate the experimental proteomics datasets. As ECMPride is developed based on the machine learning method, the robust of modeling makes it easy to deal with other species’ proteins sequences in a similar way, i.e., mouse, rat, and so on. Also, with the accumulation of publicly available ECM proteomics datasets, more experimentally verified ECMs can be added into the standard dataset and further improve the model’s prediction performance.

Supplemental Information

Table S1. Detailed list of the standard dataset used in ECMPride.

The standard training dataset consists of a positive dataset of 521 ECM proteins and a negative dataset of 11336 non-ECM proteins. For each protein, ”UniprotID” represents its Uniprot ID, “Class” represents its classification of ECM or non-ECM, and “FastaSequence” represents its fasta sequence.

DOI: 10.7717/peerj.9066/supp-1
Table S2. Detailed list of studies used to construct the positive dataset.

In addition to studies collected by ECM Atlas, more studies were collected to construct the positive dataset, and here is a list of collected studies.

DOI: 10.7717/peerj.9066/supp-2
Table S3. Detailed list of all 167 features used in ECMPride.

There are three classes and 167 features in total that introduced into ECMPride to represent the characteristics of ECM proteins, including ECM protein-related structural domains (63 features), physicochemical properties (24 features), and position-specific scoring matrix (PSSM, 80 features). Also, all features are scored using the mRMR method.

DOI: 10.7717/peerj.9066/supp-3
Table S4. Detailed list of Physicochemical properties used in ECMPride.

There are 24 physicochemical properties used in ECMPride. For each physicochemical property, the row from “A” to “V” represent its amino acid index (AAIndex) of 20 amino acids.

DOI: 10.7717/peerj.9066/supp-4
Table S5. Performance of the prediction model with or without the under-sampling ensemble method.

When the prediction model is built without the under-sampling ensemble method, the model gains a high specificity of 0.9995, but the sensitivity is very low, and also present a poor balanced accuracy of 0.7579. When the under-sampling ensemble method is used, the model achieves a balance between the specificity (0.9360) and sensitivity (0.8925) and gains a high balanced accuracy of 0.9142 as well. Therefore, the under-sampling ensemble method can solve the problem of imbalance of the dataset well and makes full use of the sample information at the same time.

DOI: 10.7717/peerj.9066/supp-5
Table S6. Performance of all 167 candidate prediction models using 167 different feature subsets.

All of the 167 features are ranked according to the order of the important scores from high to low. The IFS method is used to generate 167 feature subsets and further generate 167 corresponding candidate models.

DOI: 10.7717/peerj.9066/supp-6
Table S7. A comprehensive collection of theoretical human ECM proteins predicted by ECMPride.

For each ECM protein predicted by ECMPride, the information of six relevant databases (including Human Protein Atlas, ExoCarta, GO, MatrixDB, String, and EntreZ) is used for annotation. “label_HumanProteinAtlas” represents the location annotation from Human Protein Atlas (membrane, secreted, membrane&secreted, or intracellular). “label_ExoCarta” represents the exosome evidence provided by ExoCarta. “label_GO” shows the extracellular-relative Cellular Components annotation in GO, including “extracellular matrix”, “extracellular space”, “extracellular region” or “extracellular exosome”, also the corresponding GO term are listed in “label_GO_term”. “InterPro_core_Matrisome” shows domains that define the core Matrisome contained in the genes found only in ECMPrideDB. “–” represents this gene is both contained by ECMPrideDB and Matrisome. “Interaction_MatriDB” shows all Matrisome genes that interact with genes found only in ECMPrideDB (evidence from the MatrixDB database). “–” represents this gene is both contained by ECMPrideDB and Matrisome. “Interaction_String” shows all Matrisome genes that interact with genes found only in ECMPrideDB (evidence from the String database). “–” represents this gene is both contained by ECMPrideDB and Matrisome. “EntreZ link” provides the hyperlink to the corresponding entrez gene summary for each gene in ECMPrideDB.

DOI: 10.7717/peerj.9066/supp-7
Table S8. Raw data for Fig. 3.
DOI: 10.7717/peerj.9066/supp-8
Figure S1. Comparison of the performance assessment parameters on different imbalance datasets.

As the ratio of ECM to non-ECM samples in the training dataset is approximately 1:21, we decide to construct 21 training datasets, with the ratio of ECM cases to non-ECM cases from 1:1 to 1:21. In each dataset, ECM cases are the entire ECM dataset and non-ECM cases are randomly selected from the non-ECM dataset. Then, the prediction model is implemented on these 21 different imbalance datasets separately using 10-fold cross-validation, and four performance assessment parameters are calculated, including Sensitivity, Specificity, Accuracy and balanced Accuracy. The above process is repeated 10 times, and the average performance result of 10 times was taken as the final result. As the ratio of non-ECMs to ECMs increases, the specificity increases gradually, while the sensitivity decreases significantly, which indicates a declining trend of model performance. At the same time, the Balanced Accuracy decreases along with the increasing of imbalance ratio, indicates this parameter can better represent the model performance than Accuracy.

DOI: 10.7717/peerj.9066/supp-9
Figure S2. Biological validation of new ECM proteins.

Immunohistochemistry and immunofluorescence analysis of (A) STAB1, (B) STAB2, (C) JAG1 and (D) JAG2 on normal human skin tissues (scale bar: 100 μm). Black and white arrowheads pointed to the expressed locations of the new ECM proteins.

DOI: 10.7717/peerj.9066/supp-10
Figure S3. Biological validation of new ECM proteins predicted by ECMPride.

Immunohistochemistry analysis of (A) DLL4 and (B) LRP1 on human normal liver and skin tissues. (C) Immunofluorescence analysis of FCGBP on RH-30 cell lines. Black and white arrowheads pointed to the expressed locations of the new ECM proteins. The data comes from https://www.proteinatlas.org database website.

DOI: 10.7717/peerj.9066/supp-11
Article S1. A detailed description of the method in the main text.
DOI: 10.7717/peerj.9066/supp-12

Acknowledgments

We thank Dr. Cheng Chang and Dr. Mansheng Li at the National Center for Protein Sciences (Beijing) for helpful discussion.

Funding Statement

This work was supported by the National Key Research Program of China (No. 2016YFB0201702, No. 2016YFC0901601, No. 2017YFC0906602, and No. 2017YFA0505002). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

Contributor Information

Jie Ma, Email: majie729@163.com.

Yunping Zhu, Email: zhuyunping@gmail.com.

Additional Information and Declarations

Competing Interests

The authors declare there are no competing interests.

Author Contributions

Binghui Liu conceived and designed the experiments, performed the experiments, analyzed the data, prepared figures and/or tables, authored or reviewed drafts of the paper, and approved the final draft.

Ling Leng performed the experiments, prepared figures and/or tables, authored or reviewed drafts of the paper, and approved the final draft.

Xuer Sun performed the experiments, prepared figures and/or tables, and approved the final draft.

Yunfang Wang conceived and designed the experiments, authored or reviewed drafts of the paper, and approved the final draft.

Jie Ma conceived and designed the experiments, analyzed the data, prepared figures and/or tables, authored or reviewed drafts of the paper, and approved the final draft.

Yunping Zhu conceived and designed the experiments, authored or reviewed drafts of the paper, and approved the final draft.

Data Availability

The following information was supplied regarding data availability:

The code of ECMPride is available at GitHub: https://github.com/Binghui-Liu/ECMPride.git.

References

  • Åhrman et al. (2018).Åhrman E, Hallgren O, Malmström L, Hedström U, Malmström A, Bjermer L, Zhou X-H, Westergren-Thorsson G, Malmström J. Quantitative proteomic characterization of the lung extracellular matrix in chronic obstructive pulmonary disease and idiopathic pulmonary fibrosis. Journal of Proteomics. 2018;189:23–33. doi: 10.1016/j.jprot.2018.02.027. [DOI] [PubMed] [Google Scholar]
  • Ali & Hayat (2016).Ali F, Hayat M. Machine learning approaches for discrimination of Extracellular Matrix proteins using hybrid feature space. Journal of Theoretical Biology. 2016;403:30–37. doi: 10.1016/j.jtbi.2016.05.011. [DOI] [PubMed] [Google Scholar]
  • Altschul et al. (1997).Altschul SF, Madden TL, Schäffer AA, Zhang J, Zhang Z, Miller W, Lipman DJ. Gapped BLAST and PSI-BLAST: a new generation of protein database search programs. Nucleic Acids Research. 1997;25:3389–3402. doi: 10.1093/nar/25.17.3389. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • Apic, Huber & Teichmann (2003).Apic G, Huber W, Teichmann SA. Multi-domain protein families and domain pairs: comparison with known structures and a random model of domain recombination. Journal of Structural and Functional Genomics. 2003;4:67–78. doi: 10.1023/A:1026113408773. [DOI] [PubMed] [Google Scholar]
  • Bateman, Boot-Handford & Lamandé (2009).Bateman JF, Boot-Handford RP, Lamandé SR. Genetic diseases of connective tissues: cellular and extracellular effects of ECM mutations. Nature Reviews Genetics. 2009;10:173–183. doi: 10.1038/nrg2520. [DOI] [PubMed] [Google Scholar]
  • Bonnans, Chou & Werb (2014).Bonnans C, Chou J, Werb Z. Remodelling the extracellular matrix in development and disease. Nature Reviews Molecular Cell Biology. 2014;15:786–801. doi: 10.1038/nrm3904. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • Bornberg-Bauer & Alba (2013).Bornberg-Bauer E, Alba MM. Dynamics and adaptive benefits of modular protein evolution. Current Opinion in Structural Biology. 2013;23:459–466. doi: 10.1016/j.sbi.2013.02.012. [DOI] [PubMed] [Google Scholar]
  • Breiman (2001).Breiman L. Random forests. Machine Learning. 2001;45:5–32. doi: 10.1023/A:1010933404324. [DOI] [Google Scholar]
  • Cain et al. (2009).Cain SA, McGovern A, Small E, Ward LJ, Baldock C, Shuttleworth A, Kielty CM. Defining elastic fiber interactions by molecular fishing: an affinity purification and mass spectrometry approach. Molecular & Cellular Proteomics. 2009;8:2715–2732. doi: 10.1074/mcp.M900008-MCP200. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • Chen & Li (2013).Chen Y-K, Li K-B. Predicting membrane protein types by incorporating protein topology, domains, signal peptides, and physicochemical properties into the general form of Chou’s pseudo amino acid composition. Journal of Theoretical Biology. 2013;318:1–12. doi: 10.1016/j.jtbi.2012.10.033. [DOI] [PubMed] [Google Scholar]
  • Chou (2001).Chou KC. Prediction of protein cellular attributes using pseudo-amino acid composition. Proteins: Structure, Function, and Bioinformatics. 2001;43:246–255. doi: 10.1002/prot.1035. [DOI] [PubMed] [Google Scholar]
  • Chou & Shen (2007).Chou KC, Shen HB. Large-scale plant protein subcellular location prediction. Journal of Cellular Biochemistry. 2007;100:665–678. doi: 10.1002/jcb.21096. [DOI] [PubMed] [Google Scholar]
  • Clerc et al. (2018).Clerc O, Deniaud M, Vallet SD, Naba A, Rivet A, Perez S, Thierry-Mieg N, Ricard-Blum S. MatrixDB: integration of new data with a focus on glycosaminoglycan interactions. Nucleic Acids Research. 2018;47:D376–D381. doi: 10.1093/nar/gky1035. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • Cromar et al. (2012).Cromar GL, Xiong X, Chautard E, Ricard-Blum S, Parkinson J. Toward a systems level view of the ECM and related proteins: a framework for the systematic definition and analysis of biological systems. Proteins: Structure, Function, and Bioinformatics. 2012;80:1522–1544. doi: 10.1002/prot.24036. [DOI] [PubMed] [Google Scholar]
  • Ding et al. (2014).Ding S, Yan S, Qi S, Li Y, Yao Y. A protein structural classes prediction method based on PSI-BLAST profile. Journal of Theoretical Biology. 2014;353:19–23. doi: 10.1016/j.jtbi.2014.02.034. [DOI] [PubMed] [Google Scholar]
  • Du & Yu (2013).Du P, Yu Y. SubMito-PSPCP: predicting protein submitochondrial locations by hybridizing positional specific physicochemical properties with pseudoamino acid compositions. BioMed Research International. 2013;2013:263829. doi: 10.1155/2013/263829. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • Gopal et al. (2017).Gopal S, Veracini L, Grall D, Butori C, Schaub S, Audebert S, Camoin L, Baudelet E, Radwanska A, Beghelli-de la Forest Divonne S. Fibronectin-guided migration of carcinoma collectives. Nature Communications. 2017;8:14105. doi: 10.1038/ncomms14105. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • Guan, Zhang & Xu (2017).Guan L, Zhang S, Xu H. BAMORF: a novel computational method for predicting the extracellular matrix proteins. IEEE Access. 2017;5:18498–18505. doi: 10.1109/ACCESS.2017.2751499. [DOI] [Google Scholar]
  • Hayat & Khan (2012).Hayat M, Khan A. MemHyb: predicting membrane protein types by hybridizing SAAC and PSSM. Journal of Theoretical Biology. 2012;292:93–102. doi: 10.1016/j.jtbi.2011.09.026. [DOI] [PubMed] [Google Scholar]
  • Hynes (2009).Hynes RO. The extracellular matrix: not just pretty fibrils. Science. 2009;326:1216–1219. doi: 10.1126/science.1176009. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • Jung et al. (2010).Jung J, Ryu T, Hwang Y, Lee E, Lee D. Prediction of extracellular matrix proteins based on distinctive sequence and domain characteristics. Journal of Computational Biology. 2010;17:97–105. doi: 10.1089/cmb.2008.0236. [DOI] [PubMed] [Google Scholar]
  • Kabir et al. (2018).Kabir M, Ahmad S, Iqbal M, Swati ZNK, Liu Z, Yu D-J. Improving prediction of extracellular matrix proteins using evolutionary information via a grey system model and asymmetric under-sampling technique. Chemometrics and Intelligent Laboratory Systems. 2018;174:22–32. doi: 10.1016/j.chemolab.2018.01.004. [DOI] [Google Scholar]
  • Kandaswamy et al. (2013).Kandaswamy KK, Pugalenthi G, Kalies K-U, Hartmann E, Martinetz T. EcmPred: prediction of extracellular matrix proteins based on random forest with maximum relevance minimum redundancy feature selection. Journal of Theoretical Biology. 2013;317:377–383. doi: 10.1016/j.jtbi.2012.10.015. [DOI] [PubMed] [Google Scholar]
  • Kawashima et al. (2007).Kawashima S, Pokarowski P, Pokarowska M, Kolinski A, Katayama T, Kanehisa M. AAindex: amino acid index database, progress report 2008. Nucleic Acids Research. 2007;36:D202–D205. doi: 10.1093/nar/gkm998. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • Keerthikumar et al. (2016).Keerthikumar S, Chisanga D, Ariyaratne D, Saffar HAl, Anand S, Zhao K, Samuel M, Pathan M, Jois M, Chilamkurti N. ExoCarta: a web-based compendium of exosomal cargo. Journal of Molecular Biology. 2016;428:688–692. doi: 10.1016/j.jmb.2015.09.019. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • Lennon et al. (2014).Lennon R, Byron A, Humphries JD, Randles MJ, Carisey A, Murphy S, Knight D, Brenchley PE, Zent R, Humphries MJ. Global analysis reveals the complexity of the human glomerular extracellular matrix. Journal of the American Society of Nephrology. 2014;25:939–951. doi: 10.1681/ASN.2013030233. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • Liaw & Wiener (2002).Liaw A, Wiener M. Classification and regression by randomForest. R News. 2002;2:18–22. [Google Scholar]
  • Lin et al. (2013).Lin W-Z, Fang J-A, Xiao X, Chou K-C. iLoc-Animal: a multi-label learning classifier for predicting subcellular localization of animal proteins. Molecular BioSystems. 2013;9:634–644. doi: 10.1039/c3mb25466f. [DOI] [PubMed] [Google Scholar]
  • Liu et al. (2019).Liu N, Matsumura H, Kato T, Ichinose S, Takada A, Namiki T, Asakawa K, Morinaga H, Mohri Y, De Arcangelis A. Stem cell competition orchestrates skin homeostasis and ageing. Nature. 2019;568(7752):344–350. doi: 10.1038/s41586-019-1085-7. [DOI] [PubMed] [Google Scholar]
  • Lundegaard et al. (2008).Lundegaard C, Lamberth K, Harndahl M, Buus S, Lund O, Nielsen M. NetMHC-3.0: accurate web accessible predictions of human, mouse and monkey MHC class I affinities for peptides of length 8–11. Nucleic Acids Research. 2008;36:W509–W512. doi: 10.1093/nar/gkn202. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • Matsuda et al. (2005).Matsuda S, Vert JP, Saigo H, Ueda N, Toh H, Akutsu T. A novel representation of protein sequences for prediction of subcellular location using support vector machines. Protein Science. 2005;14:2804–2813. doi: 10.1110/ps.051597405. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • Mayorca-Guiliani et al. (2017).Mayorca-Guiliani AE, Madsen CD, Cox TR, Horton ER, Venning FA, Erler JT. ISDoT: in situ decellularization of tissues for high-resolution imaging and proteomic analysis of native extracellular matrix. Nature Medicine. 2017;23(7):890–898. doi: 10.1038/nm.4352. [DOI] [PubMed] [Google Scholar]
  • Mitchell et al. (2018).Mitchell AL, Attwood TK, Babbitt PC, Blum M, Bork P, Bridge A, Brown SD, Chang H-Y, El-Gebali S, Fraser MI. InterPro in 2019: improving coverage, classification and access to protein sequence annotations. Nucleic Acids Research. 2018;47:D351–D360. doi: 10.1093/nar/gky1100. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • Naba et al. (2016).Naba A, Clauser KR, Ding H, Whittaker CA, Carr SA, Hynes RO. The extracellular matrix: tools and insights for the omics era. Matrix Biology. 2016;49:10–24. doi: 10.1016/j.matbio.2015.06.003. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • Naba et al. (2012).Naba A, Clauser KR, Hoersch S, Liu H, Carr SA, Hynes RO. The matrisome: in silico definition and in vivo characterization by proteomics of normal and tumor extracellular matrices. Molecular & Cellular Proteomics. 2012;11:M111. doi: 10.1074/mcp.M111.014647. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • Naba et al. (2017).Naba A, Pearce OM, Del Rosario A, Ma D, Ding H, Rajeeve V, Cutillas PR, Balkwill FR, Hynes RO. Characterization of the extracellular matrix of normal and diseased tissues using proteomics. Journal of Proteome Research. 2017;16:3083–3091. doi: 10.1021/acs.jproteome.7b00191. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • Peng, Long & Ding (2005).Peng H, Long F, Ding C. Feature selection based on mutual information: criteria of max-dependency, max-relevance, and min-redundancy. IEEE Transactions on Pattern Analysis & Machine Intelligence. 2005:1226–1238. doi: 10.1109/TPAMI.2005.159. [DOI] [PubMed] [Google Scholar]
  • Szklarczyk et al. (2018).Szklarczyk D, Gable AL, Lyon D, Junge A, Wyder S, Huerta-Cepas J, Simonovic M, Doncheva NT, Morris JH, Bork P. STRING v11: protein–protein association networks with increased coverage, supporting functional discovery in genome-wide experimental datasets. Nucleic Acids Research. 2018;47:D607–D613. doi: 10.1093/nar/gky1131. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • The Gene Ontology Consortium (2016).The Gene Ontology Consortium Expansion of the gene ontology knowledgebase and resources. Nucleic Acids Research. 2016;45:D331–D338. doi: 10.1093/nar/gkw1108. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • The UniProt Consortium (2017).The UniProt Consortium UniProt: the universal protein knowledgebase. Nucleic Acids Research. 2017;45:D158–D169. doi: 10.1093/nar/gkw1099. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • Theocharis et al. (2016).Theocharis AD, Skandalis SS, Gialeli C, Karamanos NK. Extracellular matrix structure. Advanced Drug Delivery Reviews. 2016;97:4–27. doi: 10.1016/j.addr.2015.11.001. [DOI] [PubMed] [Google Scholar]
  • Thul et al. (2017).Thul PJ, Åkesson L, Wiking M, Mahdessian D, Geladaki A, Blal HA, Alm T, Asplund A, Björk L, Breckels LM. A subcellular map of the human proteome. Science. 2017;356(6340):eaal3321. doi: 10.1126/science.aal3321. [DOI] [PubMed] [Google Scholar]
  • Tokhmafshan et al. (2017).Tokhmafshan F, Brophy PD, Gbadegesin RA, Gupta IR. Vesicoureteral reflux and the extracellular matrix connection. Pediatric Nephrology. 2017;32:565–576. doi: 10.1007/s00467-016-3386-5. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • Walker & Mojares (2018).Walker C, Mojares E. Role of extracellular matrix in development and cancer progression. International Journal of Molecular Sciences. 2018;19:3028. doi: 10.3390/ijms19103028. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • Yang et al. (2015).Yang R, Zhang C, Gao R, Zhang L. An ensemble method with hybrid features to identify extracellular matrix proteins. PLOS ONE. 2015;10:e0117804. doi: 10.1371/journal.pone.0117804. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • Zhang et al. (2014).Zhang J, Sun P, Zhao X, Ma Z. PECM: prediction of extracellular matrix proteins using the concept of Chou’s pseudo amino acid composition. Journal of Theoretical Biology. 2014;363:412–418. doi: 10.1016/j.jtbi.2014.08.002. [DOI] [PubMed] [Google Scholar]
  • Zuo et al. (2014).Zuo Y-C, Peng Y, Liu L, Chen W, Yang L, Fan G-L. Predicting peroxidase subcellular location by hybridizing different descriptors of Chou’pseudo amino acid patterns. Analytical Biochemistry. 2014;458:14–19. doi: 10.1016/j.ab.2014.04.032. [DOI] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

Table S1. Detailed list of the standard dataset used in ECMPride.

The standard training dataset consists of a positive dataset of 521 ECM proteins and a negative dataset of 11336 non-ECM proteins. For each protein, ”UniprotID” represents its Uniprot ID, “Class” represents its classification of ECM or non-ECM, and “FastaSequence” represents its fasta sequence.

DOI: 10.7717/peerj.9066/supp-1
Table S2. Detailed list of studies used to construct the positive dataset.

In addition to studies collected by ECM Atlas, more studies were collected to construct the positive dataset, and here is a list of collected studies.

DOI: 10.7717/peerj.9066/supp-2
Table S3. Detailed list of all 167 features used in ECMPride.

There are three classes and 167 features in total that introduced into ECMPride to represent the characteristics of ECM proteins, including ECM protein-related structural domains (63 features), physicochemical properties (24 features), and position-specific scoring matrix (PSSM, 80 features). Also, all features are scored using the mRMR method.

DOI: 10.7717/peerj.9066/supp-3
Table S4. Detailed list of Physicochemical properties used in ECMPride.

There are 24 physicochemical properties used in ECMPride. For each physicochemical property, the row from “A” to “V” represent its amino acid index (AAIndex) of 20 amino acids.

DOI: 10.7717/peerj.9066/supp-4
Table S5. Performance of the prediction model with or without the under-sampling ensemble method.

When the prediction model is built without the under-sampling ensemble method, the model gains a high specificity of 0.9995, but the sensitivity is very low, and also present a poor balanced accuracy of 0.7579. When the under-sampling ensemble method is used, the model achieves a balance between the specificity (0.9360) and sensitivity (0.8925) and gains a high balanced accuracy of 0.9142 as well. Therefore, the under-sampling ensemble method can solve the problem of imbalance of the dataset well and makes full use of the sample information at the same time.

DOI: 10.7717/peerj.9066/supp-5
Table S6. Performance of all 167 candidate prediction models using 167 different feature subsets.

All of the 167 features are ranked according to the order of the important scores from high to low. The IFS method is used to generate 167 feature subsets and further generate 167 corresponding candidate models.

DOI: 10.7717/peerj.9066/supp-6
Table S7. A comprehensive collection of theoretical human ECM proteins predicted by ECMPride.

For each ECM protein predicted by ECMPride, the information of six relevant databases (including Human Protein Atlas, ExoCarta, GO, MatrixDB, String, and EntreZ) is used for annotation. “label_HumanProteinAtlas” represents the location annotation from Human Protein Atlas (membrane, secreted, membrane&secreted, or intracellular). “label_ExoCarta” represents the exosome evidence provided by ExoCarta. “label_GO” shows the extracellular-relative Cellular Components annotation in GO, including “extracellular matrix”, “extracellular space”, “extracellular region” or “extracellular exosome”, also the corresponding GO term are listed in “label_GO_term”. “InterPro_core_Matrisome” shows domains that define the core Matrisome contained in the genes found only in ECMPrideDB. “–” represents this gene is both contained by ECMPrideDB and Matrisome. “Interaction_MatriDB” shows all Matrisome genes that interact with genes found only in ECMPrideDB (evidence from the MatrixDB database). “–” represents this gene is both contained by ECMPrideDB and Matrisome. “Interaction_String” shows all Matrisome genes that interact with genes found only in ECMPrideDB (evidence from the String database). “–” represents this gene is both contained by ECMPrideDB and Matrisome. “EntreZ link” provides the hyperlink to the corresponding entrez gene summary for each gene in ECMPrideDB.

DOI: 10.7717/peerj.9066/supp-7
Table S8. Raw data for Fig. 3.
DOI: 10.7717/peerj.9066/supp-8
Figure S1. Comparison of the performance assessment parameters on different imbalance datasets.

As the ratio of ECM to non-ECM samples in the training dataset is approximately 1:21, we decide to construct 21 training datasets, with the ratio of ECM cases to non-ECM cases from 1:1 to 1:21. In each dataset, ECM cases are the entire ECM dataset and non-ECM cases are randomly selected from the non-ECM dataset. Then, the prediction model is implemented on these 21 different imbalance datasets separately using 10-fold cross-validation, and four performance assessment parameters are calculated, including Sensitivity, Specificity, Accuracy and balanced Accuracy. The above process is repeated 10 times, and the average performance result of 10 times was taken as the final result. As the ratio of non-ECMs to ECMs increases, the specificity increases gradually, while the sensitivity decreases significantly, which indicates a declining trend of model performance. At the same time, the Balanced Accuracy decreases along with the increasing of imbalance ratio, indicates this parameter can better represent the model performance than Accuracy.

DOI: 10.7717/peerj.9066/supp-9
Figure S2. Biological validation of new ECM proteins.

Immunohistochemistry and immunofluorescence analysis of (A) STAB1, (B) STAB2, (C) JAG1 and (D) JAG2 on normal human skin tissues (scale bar: 100 μm). Black and white arrowheads pointed to the expressed locations of the new ECM proteins.

DOI: 10.7717/peerj.9066/supp-10
Figure S3. Biological validation of new ECM proteins predicted by ECMPride.

Immunohistochemistry analysis of (A) DLL4 and (B) LRP1 on human normal liver and skin tissues. (C) Immunofluorescence analysis of FCGBP on RH-30 cell lines. Black and white arrowheads pointed to the expressed locations of the new ECM proteins. The data comes from https://www.proteinatlas.org database website.

DOI: 10.7717/peerj.9066/supp-11
Article S1. A detailed description of the method in the main text.
DOI: 10.7717/peerj.9066/supp-12

Data Availability Statement

The following information was supplied regarding data availability:

The code of ECMPride is available at GitHub: https://github.com/Binghui-Liu/ECMPride.git.


Articles from PeerJ are provided here courtesy of PeerJ, Inc

RESOURCES