Summary
COVID-19, caused by Severe Acute Respiratory Syndrome Coronavirus 2 (SARS-CoV-2), has quickly become a global health crisis since the first report of infection in December of 2019. However, the infection spectrum of SARS-CoV-2 and its comprehensive protein-level interactions with hosts remain unclear. There is a massive amount of underutilized data and knowledge about RNA viruses highly relevant to SARS-CoV-2 and proteins of their hosts. More in-depth and more comprehensive analyses of that knowledge and data can shed new light on the molecular mechanisms underlying the COVID-19 pandemic and reveal potential risks. In this work, we constructed a multi-layer virus-host interaction network to incorporate these data and knowledge. We developed a machine-learning-based method to predict virus-host interactions at both protein and organism levels. Our approach revealed five potential infection targets of SARS-CoV-2 and 19 highly possible interactions between SARS-CoV-2 proteins and human proteins in the innate immune pathway.
Keywords: coronavirus, COVID-19, SARS-CoV-2, machine learning, interaction prediction, protein-protein interaction, virus-host interaction network
Highlights
-
•
We built a virus-host interaction network with 7 human coronaviruses and 17 hosts
-
•
We developed an ML-based method to predict protein- and organism-level interactions
-
•
We revealed five potential infection targets of SARS-CoV-2
-
•
We predicted 19 highly possible interactions between SARS-CoV-2 and human proteins
The bigger picture
SARS-CoV-2, a novel single-stranded RNA coronavirus causing COVID-19, is mounting an unprecedented threat against our society and the world. Although tremendous efforts have been devoted into SARS-CoV-2 research, most of them either focused on a few proteins or only provided high-level overviews. Deeper and more comprehensive analyses are needed to shed new light onto the molecular mechanisms underlying the COVID-19 pandemic. Moreover, there is a massive amount of data and knowledge about highly relevant RNA viruses which have yet to be fully utilized.
In this work, we constructed a multi-layer virus-host interaction network to incorporate these data and knowledge. We developed a machine-learning-based method to predict virus-host interactions at both protein and organism levels. Our approach revealed five potential infection targets of SARS-CoV-2 and 19 highly possible interactions between SARS-CoV-2 proteins and human proteins in the innate immune pathway.
Given a new virus, our method can utilize existing knowledge and data about other highly relevant viruses to predict multi-scale interactions between the new virus and potential hosts.
Introduction
Severe Acute Respiratory Syndrome Coronavirus-2 (SARS-CoV-2), a novel virus causing the COVID-19 disease, was first reported in Wuhan, China, in December of 2019. Since then, it has quickly become a global health crisis1 with over 50 million people infected and over 1,250,000 deaths across 200 countries by November 2020.2 The impact of SARS-CoV-2 has significantly surpassed previous outbreaks of coronaviruses, such as Severe Acute Respiratory Syndrome Coronavirus (SARS-CoV) in 2003 and the Middle East Respiratory Syndrome Coronavirus (MERS-CoV) in 2012. Besides humans, SARS-CoV-2 has been confirmed to infect several other mammals closely related to human activities, including dogs,3 cats,4 tigers,5 rats,6 and golden Syrian hamsters.7 Also, there is a high possibility for infected animals to transmit and spread the virus to humans.8 It is important to identify a comprehensive set of such mammals because they can potentially serve as covert means to exacerbate the spread of COVID-19. Moreover, identifying interactions between SARS-CoV-2 proteins and host proteins can deepen our understanding of the viral invasion processes and may help design treatments and vaccines. In general, we want to promptly achieve the above two goals for new zoonotic viruses, which we believe can be done by leveraging the knowledge and data about known viruses highly relevant to the new ones.
The research community has accumulated a great deal of knowledge about several other human coronaviruses (including SARS-CoV,9, 10, 11, 12, 13, 14, 15, 16 HCoV-HKU1,14 HCoV-OC43,17,18 HCoV-NL63,19 and MERS-CoV)20, 21, 22, 23, 24 and has collected a large amount of data about them. For example, it was shown that human angiotensin-converting enzyme 2 (ACE2) was the primary host receptor used by the S protein (S-protein) of SARS-CoV-2 for the virus to gain entry into human cells25 (Figure S1). ACE2 is also the host receptor used by SARS-CoV13 and HCoV-NL63.19 The S-protein of SARS-CoV-2 binds significantly tighter to ACE2 than its counterpart in SARS-CoV.26 After the virus enters host cells, interferon-stimulated genes are essential for a host to defend against viral infection (Figure S2). This knowledge and data can be utilized to investigate the infection spectrum of SARS-CoV-2 and its interactions with hosts at the protein level. Using this information, we have built a virus-host interaction network of 7 viruses and 17 hosts that summarizes the existing protein-protein interaction (PPI) and infection relationships among them (Figure 1A; for more details, see Figures S3–S5 and Tables S1, S2, S3, and S4).
We have developed a network-based multi-level virus-host interaction modeling and prediction, termed infection mechanism and spectrum prediction (IMSP) (Figure 1B; for details, see experimental procedures), which uses machine-learning techniques to learn from the constructed virus-host interaction network and predict novel virus-host interactions at both the protein (i.e., Mechanism) and organism (i.e., Spectrum) levels. IMSP predicts that the SARS-CoV-2 S-protein can bind well with ACE2 receptors in five mammalian hosts, which have not been reported. Among those hosts, five are predicted to have high risks of being infected by SARS-CoV-2. Moreover, IMSP identifies 19 new interactions between SARS-CoV-2 proteins and human proteins in the innate immune pathway. To our best knowledge, our work is the first to apply machine-learning techniques for predicting virus-host interactions at both protein and organism levels. Previous works27,28 only focused on the relationships between SARS-CoV-2 proteins and human proteins and ignored other hosts that might be infected by SARS-CoV-2.
Results
Here we explain the structure of our virus-host interaction network, highlight the predicted interactions of SARS-CoV-2, and present the link prediction performance evaluation of our model IMSP. We built our network with two layers (an organism layer and a protein layer). The organism layer consisted of 7 human coronaviruses and 17 mammalian hosts. Those hosts are either close to human activities or proven to be infected by some human coronaviruses in our network. The protein layer contained 10 virus proteins and 13 host proteins. The proteins were selected based on two primary considerations: proteins involved in viral entry and the interferon (IFN) signaling pathway, both of which are critical to a successful virus infection. The virus needs to enter the host cells through the receptors on the membrane, and the binding ability between the S-protein of the virus and the host receptor determines the success of such viral entry. The suppression ability on the IFN signaling pathway of the virus negatively affects the efficiency and the effectiveness of the response of the innate immune system, which would allow the virus to rapidly replicate and spread among cells. IMSP performed a network-based representation learning to integrate information about virus-host infections, PPIs, organism-protein belongings, and similarities between protein homologs. This produced comprehensive representations and a neural-network-based classifier for accurately predicting novel viral infection and interactions between virus proteins and host proteins.
SARS-CoV-2-host multiple-type interaction predictions
We applied IMSP on SARS-CoV-2 and six other human coronaviruses to obtain high-confidence predictions of PPIs and infections. Figure S1 shows the mechanism of the binding of S-proteins and host receptor ACE2. Figure S2 shows the interactions between virus proteins and host proteins involved in the IFN pathway. Figure S3 shows the S-protein binding subnetwork. Figure S4 shows the innate immune pathway subnetwork. Figure S5 shows the organism layer. Tables S1 and S2 show the complete node and linkage information of the virus-host network. All infection predictions are shown in Table S3, and PPI predictions are presented in Table S4.
SARS-CoV-2 S-protein binding predictions
The binding ability of the S-protein of SARS-CoV-2 with the host ACE2 receptors is a key factor deciding the infection capability of SARS-CoV-2. IMSP predicted that the S-protein of SARS-CoV-2 could have a high probability of binding well with the ACE2 receptors in rats, sheep, camels, and squirrels (Figure 2A).
Rats were recognized to be susceptible to several other human coronaviruses, such as SARS-CoV,9 MERS-CoV,29 HCoV-OC43,18 and HCoV-HKU1.30,31 It is highly possible that rats could still be the potential host for SARS-CoV-2.
The overall similarity of ACE2 for the squirrel, sheep, and camel is 91.82%, 90.81%, and 92.42%, respectively compared with human ACE2. These predictions still require more practical research to determine the binding affinity between the S-protein of SARS-CoV-2 with ACE2s on these mammals. It was shown that ACE2 could tolerate up to seven amino acid changes out of 20 critical ones that contact with the S-protein without losing the functionality as the target receptor32 for SARS-CoV-2. This means that sequence similarity might not be the only factor that influences the binding affinity between the ACE2 receptor and the S-protein of SARS-CoV-2.
SARS-CoV-2 and human interferon pathway interactome prediction
The IFN pathway plays a critical role in the human immune response. After the virus infection is detected, the innate immune system will induce IFN signaling, and the expression of IFN genes will increase the cellular resistance to viral invasion. Viruses have developed various strategies to inhibit IFN signaling to facilitate successful viral invasion.33 SARS-CoV and MERS-CoV were studied quite comprehensively in terms of counteracting the IFN signaling responses compared with SARS-CoV-2. From IMSP, 19 interactions between SARS-CoV-2 proteins and human proteins in the innate immune pathway were identified, shown in Figures 2B–2D. These PPIs had a high probability of playing crucial roles in the suppression of the innate immune system response of the host.
Membrane (M) protein not only serves as the protein in virus to bind to all other structural proteins34 but also is found to inhibit IFN production in SARS-CoV35 and MERS-CoV.24 From IMSP prediction, it was highly possible that M protein in SARS-CoV-2 could interact with nuclear factor kappa-light-chain-enhancer of activated B (NF-κB), interferon regulatory factor 3 (IRF3), and retinoic acid-inducible gene I (RIG-I).
Open reading frame protein 6 (ORF6) and non-structural protein 15 (nsp15) in SARS-CoV-2 were discovered to be crucial viral IFN antagonists of SARS-CoV-2. From previous research, we knew that these two proteins inhibit the localization of IRF3 by interacting with RIG-I.36 A similar function was found for ORF6 in SARS-CoV.37 ORF6 and nsp15 in SARS-CoV were proved to interact with signal transducer and activator of transcription 1 (STAT1) and STAT2.38 From predictions made by IMSP (shown in Figures 2C and 2D), ORF6 and nsp15 in SARS-CoV-2 were suggested to have potential interactions with melanoma differentiation-associated protein 5 (MDA5), mitochondrial anti-viral-signaling protein (MAVS), STAT1, STAT2, NF-κB, IRF9, and TANK binding kinase 1 (TBK1). Since MAVS works as the adaptor molecule for MDA5,39 it is possible that a viral protein that interacts with either one of these two would also interact with the other. Besides these, ORF6 was also predicted to interact with protein kinase interferon-inducible double-stranded RNA-dependent activator (PRKRA) and IRF7. As nsp15 and ORF6 both function in nuclear transport machinery after viral entry,27 it is reasonable that, for these two proteins, similar interactions with innate immune pathways are predicted. Careful experiments should be conducted to identify the impact of nsp15 and ORF6 on the innate immune system.
SARS-CoV-2 infection prediction
Based on both the protein-level and organism-level interaction predictions, we concluded five highly possible infection predictions for SARS-CoV-2. These mammals were predicted to be susceptible to SARS-CoV-2 in the organism layer. They were also proved or predicted to have a successful spike-receptor binding between the S-protein of SARS-CoV-2 and their own ACE2 receptors. As shown in Figure 3, these animals included rats, sheep, camels, swine, and squirrels.
Rat was identified as a host for all beta-coronaviruses: SASR-CoV,9 MERS-CoV,29 HCoV-OC43,18 and HCoV-HKU1.30,31 SARS-CoV-2 also falls into the category of beta-coronavirus,40 which has a high possibility of infecting rats.
Swine's ACE2 was identified to be able to bind with the S-protein of SARS-CoV-2,41 and our model predicted that swine could be successfully infected after the receptor binding. This is also supported by recent research on swine.42
Camels are hosts for MERS-CoV.22 This means that camels can also be hosts for other coronaviruses. Camels, along with sheep and squirrels, are closely related to the human living environment or daily diet. They could be potential mammalian hosts that again transmit the virus back to human society. The investigation of these highly possible infections could potentially help identify the transition path of the virus and further control the transmission of SARS-CoV-2 from and between mammalian hosts. Further research on these potential hosts might be crucial to social health and safety.
Interaction prediction performance evaluation
Many machine-learning and graph-embedding methods have been developed and applied to various applications.43, 44, 45, 46, 47, 48 In this work, we compared IMSP with five other baseline models on our dataset in a 5-fold stratified cross-validation setting. The baseline models include two famous random-walk-based models (DeepWalk43 and Node2vec),45 two neural-network-based models (Large-scale Information Network Embedding [LINE]44 and Structural Deep Network Embedding [SDNE]),46 and a classical matrix-based model, Graph Factorization GF.49 For the stratified cross-validation experiment, we created a sampling strategy to ensure that the training subset in each cross-validation run can form a fully connected network. Such a fully connected network could ensure that our network structural embedding model embedded nodes into the same vector space. To ensure the balance of input data, we gathered negative (non-connected) edges in addition to positive (connected) edges that already existed in each fold. We sampled negative edges from two directions: known negatives (i.e., true negatives) and unknown negatives. We considered spike-receptor interactions demonstrated as nonexistent as known negatives, such as the one between the S-protein of SARS-CoV-2 and the host receptor dipeptidyl peptidase 4 (DPP4; the target host receptor of MERS-CoV). Since we still lacked a comparable amount of negative edges, we randomly selected non-connected node pairs as negative edges, which we assumed as not existing. We added these negative samples into each fold to match the number of positive samples. We then evaluated IMSP and other models under the 5-fold stratified cross-validation setting as described above. We repeated the cross-validation experiment for 30 independent runs. In each run, we generated a new 5-fold split. Finally, we performed a two-sample heteroscedastic t test at the 0.01 significance level to test the significance of our model's improvement against other models.
Table 1 shows the performance comparison measured in six common link prediction evaluation metrics. IMSP achieved an overall link prediction accuracy of 97.1% with a standard deviation (SD) of 0.005, which demonstrated a 7.7% gain compared with the second-best model. Our model also excelled in its weighted F1-score, achieving 0.971 with SD of 0.006, which exceeded the second-best model by 10.0%. The p values for these two metrics were all smaller than 0.01, which indicated significant improvement for our model. We also presented the performance on infection and PPI predictions (Figure 4). IMSP achieved an F1-score of 0.854 with a 0.090 SD for infection predictions, a 40.4% increase compared with the second-best model. The p value was smaller than 0.01, indicating a significant improvement in our model. For PPI predictions, our model achieved an F1-score of 0.867 with 0.034 SD, a 1.6% increment compared with the second-best model. The p value also demonstrated a significant improvement for IMSP under the 0.01 significance level. In conclusion, our model showed statistically significant improvements compared with all existing models in 11 of 12 evaluation metrics.
Table 1.
Model | Accuracy | Weighted precision | Weighted recall | Weighted F1-score | AUC macro | AUC weighted |
---|---|---|---|---|---|---|
GF49 | 0.879 ± 0.008 | 0.852 ± 0.011 | 0.879 ± 0.008 | 0.863 ± 0.009 | 0.913 ± 0.007 | 0.944 ± 0.006 |
Deepwalk43 | 0.894 ± 0.008 | 0.870 ± 0.010 | 0.894 ± 0.008 | 0.879 ± 0.009 | 0.926 ± 0.010 | 0.952 ± 0.007 |
LINE44 | 0.742 ± 0.026 | 0.727 ± 0.030 | 0.742 ± 0.026 | 0.732 ± 0.029 | 0.874 ± 0.021 | 0.881 ± 0.023 |
Node2vec45 | 0.902 ± 0.007 | 0.868 ± 0.007 | 0.902 ± 0.007 | 0.883 ± 0.007 | 0.896 ± 0.011 | 0.932 ± 0.010 |
SDNE46 | 0.820 ± 0.015 | 0.791 ± 0.019 | 0.820 ± 0.015 | 0.799 ± 0.017 | 0.904 ± 0.012 | 0.930 ± 0.011 |
IMSP | 0.971 ± 0.005 | 0.972 ± 0.006 | 0.971 ± 0.005 | 0.971 ± 0.006 | 0.997 ± 0.001 | 0.996 ± 0.001 |
AUC, area under the receiver-operating characteristic curve. This table presents six evaluation metrics regarding the link prediction performance of our model compared with five other baseline models. While evaluating performance, we followed 5-fold stratified cross-validation setting with shuffle enabled. This method preserved the percentage of samples for each class (i.e., type of edge) in each fold. We created a sampling strategy to ensure that the training subset in each cross-validation run can form a fully connected network. To ensure the balance of input data, we gathered negative (non-connected) edges in addition to positive (connected) edges that already existed in each fold. While sampling negative edges, we randomly selected some from known negative edges (i.e., true negatives), which consisted of spike-receptor interactions demonstrated as nonexistent. We randomly selected the remaining negative edges from other non-connected node pairs, which we assumed did not exist. These negative edges were then added to each fold to match the number of positive edges. We performed this 5-fold stratified cross-validation experiment for 30 runs. In each run, we would generate a new 5-fold split. We then performed two-sample heteroscedastic t tests for these six overall performance evaluation metrics to test the significance of IMSP improvement. Lastly, we reported the average with SD for each metric.
The high performance of IMSP might result from its ability to take full advantage of well-studied knowledge and data from previous biology research with protein-level variations. Thanks to the novel design of our virus-host interaction network, cross-organism information and multi-class linkage information can be well preserved. Another reason behind the performance improvement of IMSP is that it factors essential biological metadata for nodes into the learned representations of edges. This design substantially helped the classifier output a correct predicted class when formulating edge representations. However, around 10% of PPI predictions were unlikely predictions by our definition, i.e., PPIs between S-protein and non-receptor host proteins. To minimize unlikely predictions, we also utilized known negative edges (true negatives) in the protein layer to constitute part of the negative samples for training and testing. This finally reduced the unlikely PPI predictions to around 5%.
In conclusion, IMSP exhibited robust and stable performance in both top-level and detailed evaluation metrics, which was substantially improved compared with existing tools. When analyzing newly emerged viruses with limited available information, namely SARS-CoV-2, IMSP could provide reasonable and reliable predictions.
Discussion
This study assembled 260 nodes and 1,995 known edges. Each node represented a virus/virus protein/host/host protein, and each edge represented a virus-host infection/PPI/protein-homolog similarity/organism-protein belonging. Based on this network, we predicted the potential host for viruses and undiscovered PPIs. Among all currently known seven human coronaviruses, SARS-CoV and MERS-CoV were relatively well studied in terms of interactions (i.e., infection and PPI). However, interactions of HCoV-OC43, HCoV-NL63, HCov-HKU1, HCoV-229E, and the newly emerged SARS-CoV-2 remained relatively less discovered. Our model predicted 939 PPIs and 24 infections that were likely to happen. These predictions need further experiments for validation.
Established discoveries about the viral interactions with host proteins were scarce for SARS-CoV-2. However, SARS-CoV-2 was highly suspected of suppressing the innate immune response and reducing the production of IFN. Thus, the findings by IMSP could help discover the protein-level mechanism of virus invasion and host response to provide clues toward developing therapeutic strategies for the treatment of this disease. Some of our prediction results have been revealed as meaningful. It should be noted that, during the review period, two of our prediction results were validated in wet-lab experiments by independent labs,42,50 which demonstrated that swine is susceptible to SARS-CoV-2 and that the M protein of SARS-CoV-2 inhibits IFN production by targeting RIG-I/MDA-5 signaling.
More broadly, IMSP could be applied to any other analysis of the virus-host interaction network predictions. IMSP would build the network based on the information of the PPIs, protein-homolog similarities, virus-host infection relations, and related protein function knowledge if available. Based on such a network, IMSP could predict high-possibility PPIs and infections. We hope to use this pipeline as a guideline for investigating various similar viruses and their mechanisms with hosts on both organism level and protein level.
Limitations of the study
This section discusses the limitation of our work in terms of prediction validation, quality of data sources, model bias, and potential improvements. Concerning prediction validation, ideally wet-lab experiments should be conducted to validate our predictions, which require special facilities not commonly available. Thus, we were unable to validate our predictions through biological experiments. We collected protein sequences, infection relationships, and known PPIs from the best available data sources when carrying out this study. The quality, errors, and uncertainty of these data sources could affect the performance of our approach. This may harm the reliability of our predictions, and hence biologists should exercise extra caution when using our predictions to aid the design of experiments. Our approach may suffer from sampling bias, representation bias, and population bias.51 For example, we only included the proteins known to play crucial roles in viral entry and the IFN signaling pathway. It is possible that some related proteins were ignored, i.e., our model potentially carries sampling bias. Our model might also suffer from representation bias due to missing protein sequences, which could lead to non-uniform protein representation in different mammalian hosts in our network. Additionally, we could not include some mammals (e.g., rabbits and civets) because most of their protein sequences are either unavailable or of low quality in the National Center for Biotechnology Information (NCBI) database, which led to population bias. As more data become available, a more comprehensive network could be constructed by our IMSP model, which would substantially mitigate the model bias. Lastly, the model can also be improved by incorporating gene set enrichment and sequence motif analysis.
Experimental procedures
Resource availability
Lead contact
Further information and requests for code and data should be directed to and will be fulfilled by the lead contact, Hongfu Liu (hongfuliu@brandeis.edu).
Materials availability
This study did not generate any physical materials.
Data and code availability
All data and codes are available at Github repositories. IMSP model, its predictions, and performance evaluations can be found at https://github.com/hangyu98/IMSP; data and parsing code can be found at https://github.com/hangyu98/IMSP-Parser. Additional supplemental items are available from Mendeley Data at doi: 10.17632/3s2dr7y6s2.1.
Virus-host interaction network data selection
The virus-host interaction network consists of two layers (an organism layer and a protein layer). The organism layer contains a set of viruses (including SARS-CoV-2, SARS-CoV, HCoV-229E, HCoV-HKU1, HCoV-OC43, HCoV-NL63, and MERS-CoV) and a set of hosts (including human, mouse, rat, dog, cat, camel, squirrel, cattle, chimpanzee, red junglefowl, rabbit, horse, monkey, rat, sheep, swine, and golden Syrian hamster). At the protein layer, we focus on proteins that are known to be involved in viral invasion or immune system response and suppression. The network contains 13 host protein-homolog groups obtained from NCBI: ACE2, DPP4, IRF3, IRF7, IRF9, MAVS, MDA5, NF-κB, PRKRA, TBK1, RIG-I, STAT1, and STAT2. The virus proteins include homologs of S-protein, M protein, nucleocapsid protein, nsp1, nsp15, ORF3b, ORF4a, ORF4b, ORF6, and papain-like protease (PLpro). There are four types of edges in the network: PPI, virus-host infection, organism-protein belonging, and similarity relation between protein homologs. PPI and infection relationships are gathered from academic publications.9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24 Organism-protein belonging and protein-homolog similarity relation are innately connected. Detailed PPI data resources are presented in Table S5.
Infection mechanism and spectrum prediction
Our IMSP model requests three inputs: pairwise similarity matrices (parsed from percentage of positives from NCBI BLASTp result) for protein homologs, a set of known PPIs and infections, and protein function data. Given these three inputs, the model constructs a heterogeneous two-layer virus-host interaction network. IMSP then performs graph representation learning and combines the structural embeddings with the content embeddings to form edge representations. Lastly, in the link prediction phase, IMSP trains a neural-network-based Multi-layer Perceptron (MLP) classifier on learned representations to perform multi-class classification task. Along with post-process procedures, our model outputs high-possibility undiscovered PPIs and infections. In the following, we elaborate on the two main steps of IMSP in terms of virus-host interaction network construction and representation learning, and virus-host interaction prediction. To show the design of our model, we present the pseudocode sample in Alg. 1 in supplemental information. The time complexity is O and the space complexity is O. Please refer to Table 2 for notations.
Table 2.
Notation | Description |
---|---|
node i in the network | |
V | the set of all nodes |
edge between node i and node j | |
I | the set of all edges in the network |
structure embedding vector for node i | |
content embedding vector for node i | |
content embedding vector for edge | |
full edge embedding vector for edge | |
edge weight for edge | |
Euclidean distance between node i and node j | |
magnitude difference between vector and | |
TS-SS similarity between vector and |
Virus-host interaction network construction and representation learning
We utilized nodes to represent either organisms or proteins. Edges were used to represent PPI/infection/similarity/belonging relationships. To model the network, we constructed an undirected two-layer heterogeneous network using NetworkX.52 The network carried four groups of nodes: host, host protein, virus, and virus protein. We organized the virus group and the host group into the organism layer. Similarly, host protein groups and virus protein groups were put into the protein layer. By nature, the network held four types of edges: PPI (between virus protein groups and host protein groups), infection (between virus group and host group), protein-homolog similarity relation (between virus/host protein homologs in protein layer), and organism-protein belonging relation (between organism layer and protein layer). Protein-homolog similarity and organism-protein belonging relationships were innately connected. PPIs and infections were connected based on proven molecular level knowledge or infection data from existing research.3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24,53, 54, 55 After building the network, the virus-host interaction network contained 260 nodes and 1,995 edges. Intuitively, if there is an interaction edge (infection or PPI) between two nodes and , an edge with the same type (infection or PPI) is more likely to form between and another node with high biological similarity to . We therefore designed a method that assigns a weight to each relationship in the network. A structure embedding model45 was then applied to factor in such information into the node representations, which is later used in predicting interactions between nodes. To be more specific, if a relationship connects two protein homologs, its weight is equal to the similarity between their full-length sequences. For other relationships, we calculated its weight as the similarity between the text content of the connected nodes. The text content of a node includes the name and molecular functions if a node represents a protein. The text content is processed by Text2vec, a Word2vec56-based model, to obtain the node content embedding denoted as for . We then utilized the TS-SS similarity metric,57 a robust and reliable similarity measurement in the field of textual mining, to calculate as the TS-SS similarity between and . The technical details are explained below:
(Equation 1) |
where57 is defined as the magnitude difference between and , which is calculated as
(Equation 2) |
and is defined as
(Equation 3) |
Note that is increased by 10° to overcome the problem of overlapping vectors. is then calculated as
(Equation 4) |
where σ is the sigmoid function, and denotes the average of , for all , if and .
For graph representation learning, we captured the graph heterogeneity by adding the heterogeneous content information to its structural information. Specifically, we performed network structural embedding assuming the network is homogeneous. We then added the content embedding on top of structural embedding to model the heterogeneity.
First, for network structural embedding, we used a powerful network representation learning model, Node2vec,45 to learn the structural embedding for nodes. Node2vec is a state-of-the-art model for homogeneous network embedding. We took full advantage of the biased searching algorithm offered by Node2vec during our application. Precisely, the Node2vec model performed a biased fixed-length random walk for graph sampling, which takes edge weight into account. Let denote the mth node in walk with denoting the starting node of the current random walk. Nodes are generated by the following distribution:
(Equation 5) |
where , Z is the normalizing constant, and is the unnormalized transition probability between and , which is calculated as . Note that the edge weight is taken into consideration. Assume we have just transitioned from to and are now evaluating the transition probability leaving . Let represents the set of all neighbors of . , termed as search bias, is calculated as
(Equation 6) |
where denotes the shortest path between and .
In Equation 6, p (return hyperparameter) and q (in-out hyperparameter) are the two crucial hyperparameters of Node2vec. They can be adjusted to influence the probability of going back to after visiting and the probability of exploring the undiscovered components of the network. In this way, we were able to tune the hyperparameters of the structural embedding model, Node2vec, through a grid search algorithm to generate the structural embeddings.
Second, to generate edge content embeddings, i.e., for all possible , we combined the textualized node content (including name, group, layer, and function) of and with expected edge type such as PPI/infection/protein-homolog similarity/organism-protein belonging. We then input such text into Text2vec, a Word2vec56-based model, to generate edge content embeddings. The full edge representations that consider both structural and content information for edge are formulated as follows:
(Equation 7) |
Note that by the nature of Text2vec, the order of input document does not affect its output, meaning that is the same as . Upon finishing this step, we obtained all edge representations, , for all and and .
Virus-host interaction prediction
In the interaction prediction phase, we utilized a neural-network-based classification model, MLP classifier, provided by scikit-learn58 to perform multi-class classification. The classifier would classify edges into infection, PPI, no-interaction, organism-protein belongings, and similarity relations between protein homologs, using the learned edge representations. The predicted interactions (i.e., infection and PPI) would go through a post-processing step to eliminate unlikely interaction predictions. The processed result would be the output of IMSP.
Here we performed 5-fold stratified cross-validation. While splitting data into folds, we let each fold have roughly the same percentage of interactions in each interaction type. Besides, each fold has the same number of positive (i.e., known interactions) and negative (i.e., non-interaction) samples. It should be noted that the negatives consist of both validated non-interactions (e.g., the S-protein of SARS-CoV-2 is known not to bind well to the human ACE2 receptor) and other non-interactions that have yet to be validated experimentally. To mitigate the issue caused by sampling undiscovered true positive links as the negative training samples, we trained multiple independent MLP classifiers on different training sets, where the negative links were randomly sampled for each set. We then aggregated their edge classification results to pass to the post-processing step. We defined the following rules from both the computational and biological perspectives to remove unlikely predictions in the post-processing step. Computationally, since there exist two representations for , i.e., and , the prediction for is defined as a “strong” one if and only if both and are classified into the same interaction type (excluding the non-interaction type). Biologically, we assumed that the virus S-protein would only bind with its known target receptor.
Acknowledgments
This work was partially supported by NSF OAC 1920147.
Author contributions
Conceptualization, P.H. and H.L.; methodology, H.D., F.C., and H.L.; software, H.D.; formal analysis, H.D.; investigation, F.C. and H.D.; writing – original draft, F.C. and H.D.; writing – review & editing, all authors; visualization, F.C. and H.D.; supervision, H.L. and P.H.
Declaration of interests
The authors declare no competing interests.
Published: March 29, 2021
Footnotes
Supplemental information can be found online at https://doi.org/10.1016/j.patter.2021.100242.
Supplemental information
References
- 1.Li Q., Guan X., Wu P., Wang X., Zhou L., Tong Y., Ren R., Kathy S.M.L., Lau E.H.Y., Wong J.Y. Early transmission dynamics in wuhan, China, of novel coronavirus-infected pneumonia. N. Engl. J. Med. 2020;382:1199–1207. doi: 10.1056/NEJMoa2001316. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.World Health Organization WHO Coronavirus (COVID-19) Dashboard. World Health Organization. https://covid19.who.int/. Accessed April, 17, 2020.
- 3.Sit T.H.C., Brackman C.J., Ip S.M., Tam K.W.S., Law P.Y.T., To E.M.W., Veronica Y.T. Yu, Sims L.D., Tsang D.N.C., Chu D.K.W. Infection of dogs with SARS-CoV-2. Nature. 2020;586:776–778. doi: 10.1038/s41586-020-2334-5. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Halfmann P.J., Hatta M., Chiba S., Maemura T., Fan S., Takeda M., Kinoshita N., Hattori S.I., Sakai-Tagawa Y., Iwatsuki-Horimoto K. Transmission of SARS-CoV-2 in domestic cats. N. Engl. J. Med. 2020;383:592–594. doi: 10.1056/NEJMc2013400. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Wang L., Mitchell P.K., Calle P.P., Bartlett S.L., McAloose D., Killian M.L., Yuan F., Fang Y., Goodman L.B., Fredrickson R. Complete genome sequence of SARS-CoV-2 in a tiger from a US zoological collection. Microbiol. Resourc. Announce. 2020;9:e00468-20. doi: 10.1128/MRA.00468-20. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Schlottau K., Rissmann M., Graaf A., Schön J., Sehl J., Wylezich C., Höper D., Mettenleiter T.C., Balkema-Buschmann A., Harder T. SARS-CoV-2 in fruit bats, ferrets, pigs, and chickens: an experimental transmission study. Lancet Microbe. 2020;1:e218–e225. doi: 10.1016/S2666-5247(20)30089-6. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Sia S.F., Yan L.M., Chin A.W.H., Fung K., Choy K.T., Wong A.Y.L., Kaewpreedee P., Perera R.A.P.M., Poon L.L.M., Nicholls J.M. Pathogenesis and transmission of SARS-CoV-2 in golden hamsters. Nature. 2020;583:834–838. doi: 10.1038/s41586-020-2342-5. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Munnink B.B., Sikkema R.S., Nieuwenhuijse D.F., Molenaar R.J., Munger E., Molenkamp R., Van Der Spek A., Tolsma P., Rietveld A., Brouwer M. Jumping back and forth: anthropozoonotic and zoonotic transmission of SARS-Cov-2 on mink farms. bioRxiv. 2020 doi: 10.1101/2020.09.01.277152. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Channappanavar R., Fehr A.R., Vijay R., Mack M., Zhao J., Meyerholz D.K., Perlman S. Dysregulated type I interferon and inflammatory monocyte-macrophage responses cause lethal pneumonia in SARS-CoV-infected mice. Cell Host Microbe. 2016;19:181–193. doi: 10.1016/j.chom.2016.01.007. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Matthews K., Schäfer A., Pham A., Frieman M. The SARS coronavirus papain like protease can inhibit IRF3 at a post activation step that requires deubiquitination activity. Virol. J. 2014;11:209. doi: 10.1186/s12985-014-0209-9. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Hu Y., Li W., Gao T., Cui Y., Jin Y., Li P., Ma Q., Liu X., Cao C. SARS coronavirus nucleocapsid inhibits type I interferon production by interfering with TRIM25-mediated RIG-I ubiquitination. J. Virol. 2017;91:e02143-16. doi: 10.1128/JVI.02143-16. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Chen X., Yang X., Zheng Y., Yang Y., Xing Y., Chen Z. SARS coronavirus papain-like protease inhibits the type I interferon signaling pathway through interaction with the STING-TRAF3-TBK1 complex. Protein Cell. 2014;5:369–381. doi: 10.1007/s13238-014-0026-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Li W., Moore M.J., Vasilieva N., Sui J., Wong S.K., Berne M.A., Somasundaran M., Sullivan J.L., Luzuriaga K., Greenough T.C. Angiotensin-converting enzyme 2 is a functional receptor for the SARS coronavirus. Nature. 2003;426:450–454. doi: 10.1038/nature02145. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Lei Y., Moore C.B., Liesman R.M., O'Connor B.P., Bergstralh D.T., Chen Z.J., Pickles R.J., Ting J.P. MAVS-mediated apoptosis and its inhibition by viral proteins. PloS One. 2009;4:e5466. doi: 10.1371/journal.pone.0005466. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Haagmans B.L., Kuiken T., Martina B.E., Fouchier R.A., Rimmelzwaan G.F., van Amerongen G., van Riel D., de Jong T., Itamura S., Chan K.H. Pegylated interferon-α protects type 1 pneumocytes against SARS coronavirus infection in macaques. Nat. Med. 2004;10:290–293. doi: 10.1038/nm1001. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Dahl H., Linde A., Strannegård O. In vitro inhibition of SARS virus replication by human interferons. Scand. J. Infect. Dis. 2004;36:829–831. doi: 10.1080/00365540410021144. [DOI] [PubMed] [Google Scholar]
- 17.Szczepanski A., Owczarek K., Bzowska M., Gula K., Drebot I., Ochman M., Maksym B., Rajfur Z., Mitchell J.A., Pyrc K. Canine respiratory coronavirus, bovine coronavirus, and human coronavirus OC43: receptors and attachment factors. Viruses. 2019;11:328. doi: 10.3390/v11040328. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Niu J., Shen L., Huang B., Ye F., Zhao L., Wang H., Deng Y., Tan W. Non-invasive bioluminescence imaging of hCoV-OC43 infection and therapy in the central nervous system of live mice. Antivir. Res. 2020;173:104646. doi: 10.1016/j.antiviral.2019.104646. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Hofmann H., Pyrc K., van der Hoek L., Geier M., Berkhout B., Pöhlmann S. Human coronavirus NL63 employs the severe acute respiratory syndrome coronavirus receptor for cellular entry. Proc. Natl. Acad. Sci. U S A. 2005;102:7988–7993. doi: 10.1073/pnas.0409465102. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Haagmans B.L., Al Dhahiry S.H., Reusken C.B., Raj V.S., Galiano M., Myers R., Godeke G.J., Jonges M., Farag E., Diab A. Middle east respiratory syndrome coronavirus in dromedary camels: an outbreak investigation. Lancet Infect. Dis. 2014;14:140–145. doi: 10.1016/S1473-3099(13)70690-X. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Mou H., Raj V.S., van Kuppeveld F.J., Rottier P.J., Haagmans B.L., Bosch B.J. The receptor binding domain of the new Middle East respiratory syndrome coronavirus maps to a 231-residue region in the spike protein that efficiently elicits neutralizing antibodies. J. Virol. 2013;87:9379–9383. doi: 10.1128/JVI.01277-13. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Kandeil A., Gomaa M., Shehata M., El-Taweel A., Kayed A.E., Abiadh A., Jrijer J., Moatasim Y., Kutkat O., Bagato O. Middle East respiratory syndrome coronavirus infection in non-camelid domestic mammals. Emerg. Microbes Infect. 2019;8:103–108. doi: 10.1080/22221751.2018.1560235. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Bailey-Elkin B.A., Knaap R.C., Johnson G.G., Dalebout T.J., Ninaber D.K., van Kasteren P.B., Bredenbeek P.J., Snijder E.J., Kikkert M., Mark B.L. Crystal structure of the Middle East respiratory syndrome coronavirus (MERS-CoV) papain-like protease bound to ubiquitin facilitates targeted disruption of deubiquitinating activity to demonstrate its role in innate immune suppression. J. Biol. Chem. 2014;289:34667–34682. doi: 10.1074/jbc.M114.609644. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.Lui P.Y., Wong L.Y., Fung C.L., Siu K.L., Yeung M.L., Yuen K.S., Chan C.P., Woo P.C., Yuen K.Y., Jin D.Y. Middle East respiratory syndrome coronavirus m protein suppresses type I interferon expression through the inhibition of TBK1-dependent phosphorylation of IRF3. Emerg. Microbes Infect. 2016;5:e39. doi: 10.1038/emi.2016.33. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.Zhang H., Penninger J.M., Li Y., Zhong N., Slutsky A.S. Angiotensin-converting enzyme 2 (ACE2) as a SARS-CoV-2 receptor: molecular mechanisms and potential therapeutic target. Intensive Care Med. 2020;46:586–590. doi: 10.1007/s00134-020-05985-9. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Shang J., Ye G., Shi K., Wan Y., Luo C., Aihara H., Geng Q., Auerbach A., Li F. Structural basis of receptor recognition by SARS-CoV-2. Nature. 2020;581:221–224. doi: 10.1038/s41586-020-2179-y. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27.Gordon D.E., Jang G.M., Bouhaddou M., Xu J., Obernier K., White K.M., O'Meara M.J., Rezelj V.V., Guo J.Z., Swaney D.L. A SARS-CoV-2 protein interaction map reveals targets for drug repurposing. Nature. 2020;583:459–468. doi: 10.1038/s41586-020-2286-9. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.Messina F., Giombini E., Agrati C., Vairo F., Ascoli Bartoli T., Al Moghazi S., Piacentini M., Locatelli F., Kobinger G., Maeurer M. Covid-19: viral-host interactome analyzed by network based-approach model to study pathogenesis of SARS-CoV-2 infection. J. Transl. Med. 2020;18:233. doi: 10.1186/s12967-020-02405-w. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.Cockrell A.S., Yount B.L., Scobey T., Jensen K., Douglas M., Beall A., Tang X.C., Marasco W.A., Heise M.T., Baric R.S. A mouse model for MERS coronavirus-induced acute respiratory distress syndrome. Nat. Microbiol. 2016;2:16226. doi: 10.1038/nmicrobiol.2016.226. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30.Gorse G.J., O'Connor T.Z., Hall S.L., Vitale J.N., Nichol K.L. Human coronavirus and acute respiratory illness in older adults with chronic obstructive pulmonary disease. J. Infect. Dis. 2009;199:847–857. doi: 10.1086/597122. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.Lim Y.X., Ng Y.L., Tam J.P., Liu D.X. Human coronaviruses: a review of virus-host interactions. Diseases. 2016;4:26. doi: 10.3390/diseases4030026. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32.Zhai X., Sun J., Yan Z., Zhang J., Zhao J., Zhao Z., Gao Q., He W.T., Veit M., Su S. Comparison of severe acute respiratory syndrome coronavirus 2 spike protein binding to ACE2 receptors from human, pets, farm animals, and putative intermediate hosts. J. Virol. 2020;94 doi: 10.1128/JVI.00831-20. e00831–20. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33.Schulz K.S., Mossman K.L. Viral evasion strategies in type I IFN signaling—a summary of recent developments. Front. Immunol. 2016;7:498. doi: 10.3389/fimmu.2016.00498. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34.Thomas Sunil. The structure of the membrane protein of SARS-CoV-2 resembles the sugar transporter semisweet. Pathog. Immun. 2020;5:342. doi: 10.20411/pai.v5i1.377. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 35.Siu K.L., Kok K.H., Ng M.J., Poon V.K.M., Yuen K.Y., Zheng B.J., Jin D.Y. Severe acute respiratory syndrome coronavirus m protein inhibits type I interferon production by impeding the formation of TRAF3⋅ TANK⋅ TBK1/IKKε complex. J. Biol. Chem. 2009;284:16202–16209. doi: 10.1074/jbc.M109.008227. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 36.Yuen C.K., Lam J.Y., Wong W.M., Mak L.F., Wang X., Chu H., Cai J.P., Jin D.Y., To K.K., Chan J.F., Yuen K.Y., Kok K.H. SARS-CoV-2 nsp13, nsp14, nsp15 and orf6 function as potent interferon antagonists. Emerging Microbes Infect. 2020;9:1418–1428. doi: 10.1080/22221751.2020.1780953. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37.Kopecky-Bromberg S.A., Martínez-Sobrido L., Frieman M., Baric R.A., Palese P. Severe acute respiratory syndrome coronavirus open reading frame (ORF) 3b, ORF 6, and nucleocapsid proteins function as interferon antagonists. J. Virol. 2007;81:548–557. doi: 10.1128/JVI.01782-06. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 38.Frieman M., Yount B., Heise M., Kopecky-Bromberg S.A., Palese P., Baric R.S. Severe acute respiratory syndrome coronavirus ORF6 antagonizes stat1 function by sequestering nuclear import factors on the rough endoplasmic reticulum/Golgi membrane. J. Virol. 2007;81:9812–9824. doi: 10.1128/JVI.01012-07. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 39.Wu B., Hur S. How RIG-I like receptors activate MAVS. Curr. Opin. Virol. 2015;12:91–98. doi: 10.1016/j.coviro.2015.04.004. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 40.Lu R., Zhao X., Li J., Niu P., Yang B., Wu H., Wang W., Song H., Huang B., Zhu N. Genomic characterisation and epidemiology of 2019 novel coronavirus: implications for virus origins and receptor binding. Lancet. 2020;395:565–574. doi: 10.1016/S0140-6736(20)30251-8. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 41.Zhou P., Yang X.L., Wang X.G., Hu B., Zhang L., Zhang W., Si H.R., Zhu Y., Li B., Huang C.L. A pneumonia outbreak associated with a new coronavirus of probable bat origin. Nature. 2020;579:270–273. doi: 10.1038/s41586-020-2012-7. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 42.Pickering B.S., Smith G., Pinette M.M., Embury-Hyatt C., Moffat E., Marszal P., Lewis C.E. Susceptibility of domestic swine to experimental infection with severe acute respiratory syndrome coronavirus 2. Emerging Infect. Dis. 2021;27:104. doi: 10.3201/eid2701.203399. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 43.Perozzi B., Al-Rfou R., Skiena S. Proceedings of the 20th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. KDD ’14, ACM; 2014. DeepWalk: online learning of social representations; pp. 701–710. [Google Scholar]
- 44.Tang J., Qu M., Wang M., Zhang M., Yan J., Mei Q. Proceedings of the 24th International Conference on World Wide Web. ACM; 2015. Line: large-scale information network embedding; pp. 1067–1077. [Google Scholar]
- 45.Grover A., Leskovec J. Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. ACM; 2016. node2vec: scalable feature learning for networks; pp. 855–864. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 46.Wang D., Cui P., Zhu W. Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. KDD ’16 ACM; 2016. Structural deep network embedding; pp. 1225–1234. [Google Scholar]
- 47.Jiang X., Li P., Li Y., Zhen X. Graph neural based end-to-end data association framework for online multiple-object tracking. arXiv. 2019 1907.05315. [Google Scholar]
- 48.Li P., Wang Y., Zhao H., Hong P., Liu H. Proceedings of International Conference on Learning Representations. 2021. On dyadic fairness: exploring and mitigating bias in graph connections. [Google Scholar]
- 49.Ahmed A., Shervashidze N., Narayanamurthy S., Josifovski V., Smola A.J. Proceedings of the 22nd International Conference on World Wide Web. ACM; 2013. Distributed large-scale natural graph factorization; pp. 37–48. [Google Scholar]
- 50.Zheng Y., Zhuang M.W., Han L., Zhang J., Nan M.L., Zhan P., Kang D., Liu X., Gao C., Wang P.H. Severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) membrane (M) protein inhibits type I and III interferon production by targeting RIG-I/MDA-5 signaling. Signal Transduct. Targeted Ther. 2020;5:299. doi: 10.1038/s41392-020-00438-7. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 51.Mehrabi N., Morstatter F., Saxena N., Lerman K., Galstyan A. A survey on bias and fairness in machine learning. arXiv. 2019 1908.09635. [Google Scholar]
- 52.Hagberg A., Swart P., Chult D.S. Exploring network structure, dynamics, and function using networkx. In: Varoquaux G., Vaught T., Millman J., editors. Proceedings of the 7th Python in Science Conference. 2008. pp. 11–15. United States. [Google Scholar]
- 53.Li C.K., Xu X. Host immune responses to SARS coronavirus in humans. In: Lal S.K., editor. Molecular Biology of the SARS-Coronavirus. Springer; 2010. pp. 259–278. [Google Scholar]
- 54.Totura A.L., Baric R.S. SARS coronavirus pathogenesis: host innate immune responses and viral antagonism of interferon. Curr. Opin. Virol. 2012;2:264–275. doi: 10.1016/j.coviro.2012.04.004. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 55.Frieman M., Heise M., Baric R. SARS coronavirus and innate immunity. Virus Res. 2008;133:101–112. doi: 10.1016/j.virusres.2007.03.015. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 56.Mikolov T., Chen K., Corrado G., Dean J. Efficient estimation of word representations in vector space. arXiv. 2013 1301.3781. [Google Scholar]
- 57.Heidarian A., Dinneen M.J. Proceedings of the 2016 IEEE Second International Conference on Big Data Computing Service and Applications (BigDataService) 2016. A hybrid geometric approach for measuring similarity level among documents and document clustering; pp. 142–151. [Google Scholar]
- 58.Pedregosa F., Varoquaux G., Gramfort A., Michel V., Thirion B., Grisel O., Blondel M., Prettenhofer P., Weiss R., Dubourg V. Scikit-learn: machine learning in Python. J. Machine Learn. Res. 2011;12:2825–2830. [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
Data Availability Statement
All data and codes are available at Github repositories. IMSP model, its predictions, and performance evaluations can be found at https://github.com/hangyu98/IMSP; data and parsing code can be found at https://github.com/hangyu98/IMSP-Parser. Additional supplemental items are available from Mendeley Data at doi: 10.17632/3s2dr7y6s2.1.