Skip to main content
BioMed Research International logoLink to BioMed Research International
. 2018 Dec 2;2018:1425608. doi: 10.1155/2018/1425608

Drug-Target Interaction Prediction via Dual Laplacian Graph Regularized Matrix Completion

Minhui Wang 1, Chang Tang 2, Jiajia Chen 3,
PMCID: PMC6304580  PMID: 30627536

Abstract

Drug-target interactions play an important role for biomedical drug discovery and development. However, it is expensive and time-consuming to accomplish this task by experimental determination. Therefore, developing computational techniques for drug-target interaction prediction is urgent and has practical significance. In this work, we propose an effective computational model of dual Laplacian graph regularized matrix completion, referred to as DLGRMC briefly, to infer the unknown drug-target interactions. Specifically, DLGRMC transforms the task of drug-target interaction prediction into a matrix completion problem, in which the potential interactions between drugs and targets can be obtained based on the prediction scores after the matrix completion procedure. In DLGRMC, the drug pairwise chemical structure similarities and the target pairwise genomic sequence similarities are fully exploited to serve the matrix completion by using a dual Laplacian graph regularization term; i.e., drugs with similar chemical structure are more likely to have interactions with similar targets and targets with similar genomic sequence similarity are more likely to have interactions with similar drugs. In addition, during the matrix completion process, an indicator matrix with binary values which indicates the indices of the observed drug-target interactions is deployed to preserve the experimental confirmed interactions. Furthermore, we develop an alternative iterative strategy to solve the constrained matrix completion problem based on Augmented Lagrange Multiplier algorithm. We evaluate DLGRMC on five benchmark datasets and the results show that DLGRMC outperforms several state-of-the-art approaches in terms of 10-fold cross validation based AUPR values and PR curves. In addition, case studies also demonstrate that DLGRMC can successfully predict most of the experimental validated drug-target interactions.

1. Introduction

Identifying potential drug-target interactions (DTIs) is a challenging and meaningful step in precision medicine and biomedical research [18]; it is also crucial during drug discovery process. With predicted positive DTIs, one can find novel targets for existing drugs or identify targets for new drugs [912]. Although there are almost 30,000 human genes, only fewer than 400 of them could be used as drug targets in the treatment of diseases [13]. Therefore, identifying more DTIs is an extremely valuable task which can bring huge breakthrough in biopharmaceutical and biomedical research.

The mainly traditional and reliable methods for DTIs prediction are biochemical experiments, but these methods are very expensive and time-consuming. Thus, only a small amount of DTIs have been validated by experiments based methods. This motivates the development of computational methods for DTIs prediction. In addition, various experimental data of drugs and genes such as KEGG [14], DrugBank [15], and Genbank [16] also serve to develop computational techniques to infer the potential DTIs.

A wide variety of computational techniques for DTIs prediction have been proposed, and these techniques often rely on some machine learning models such as support vector machine (SVM) [1720], logistic regression [21, 22] and naive Bayesian classifiers [23], matrix factorization, and kernel learning, and network inference. Bai et al. [18] applied genetic algorithm to screen related compounds, the drug-target pairs with strong binding capacity were found with SVM and particle swarm optimization. Garcia-Sosa et al. [21, 23] used logistic regression and naive Bayesian classifiers for classification of compounds. In [24], the experimental validated targets are employed to train a SVM model and find potential proteins with similar structure. Matrix factorization based methods decompose the matrix which represents the drug-target network into multiple low-rank matrices. The decomposed matrices consisting of latent features are used to exploit the drug-target interactions. The Bayesian matrix factorization [25] and collaborative matrix factorization [26] are two typical methods. In [27], Ezzat et al. added a dual Laplacian graph regularization term to the matrix factorization model for learning a manifold on which the data are assumed to lie. The typical kernel leaning methods include the pair kernel method [28], net Laplacian regularized least squares [29], and the regularized least squares with Kronecker product kernel [30]. As to network inference methods, they usually formulate the drug-target interactions prediction as a graph leaning problem. Bleakley and Yamanishi [31] proposed a novel supervised inference method to predict unknown drug-target interactions by constructing a bipartite graph; the bipartite local model first predicts target proteins of a given drug and then predicts drugs targeting a given protein. As a improved version of the bipartite local model, Mei et al. [32] considered new drug candidates through its neighbors' interaction profiles. By considering the drug-drug similarities and target-target similarities, Chen et al. [33] developed a network-based random walk with restart on the heterogeneous network to predict potential drug-target interactions. Emig et al. [13] introduced a network-based approach which integrates disease gene expression signatures and a molecular interaction network. In order to enhance the similarity measures to include nonstructural information, Shi et al. [34] introduced a new concept named “super-target" to handle the problem of possibly missing interactions. Different to existing methods which are based on the single view data, Zhang et al. [11] integrated the drug and target data from different views and proposed a multiview DTIs prediction method based on clustering. Li and Cai [35] also extended the single view low-rank representation model to multiview low-rank embedding for DTIs prediction. In [36], Zhang et al. proposed a label propagation method with linear neighborhood information for predicting unobserved drug-target interactions; the drug-drug linear neighborhood similarities are used to rank the interaction scores. A brief review of DTIs prediction can be found in [9].

Although there are so many methods have been proposed for DTIs prediction, the results are far from satisfactory. The key issue of this problem is how to efficiently use the existing validated DTIs and exploit the useful information hidden among drugs or targets [37]. For most of existing methods, the drug-drug similarities and target-target similarities play important roles [2628, 31, 34, 38, 39]. Therefore, different ways for calculating drug-drug similarities have been proposed, such as cosine similarity, Gauss similarity, and Jaccard similarity. In this paper, we propose a Laplacian graph regularized matrix completion model for DTIs prediction, in which the drug-drug similarities are used to construct a similarity graph for regularizing that drugs with similar chemical structure are more likely to have interactions with similar targets and targets with similar genomic sequence similarity are more likely to have interactions with similar drugs. During the matrix completion process, the experimental validated interactions are preserved well by using an indicator matrix with binary values which indicates whether there exists validated interaction between a drug and a target. An alternative iterative strategy based on Augmented Lagrange Multiplier algorithm is developed to solve the constrained matrix completion problem. Extensive experiments on four benchmark datasets are conducted to validate the efficacy of the proposed Laplacian graph regularized matrix completion model (DLGRMC) for DTIs prediction. The architecture of our proposed method is shown in Figure 1.

Figure 1.

Figure 1

Overview of the proposed DTIs prediction method. The chemical structure similarity between drugs and the genomic sequence similarity between targets are used to serve the matrix completion. Meanwhile, the experimental validated DTIs are preserved by a binary indicator matrix.

2. Materials and Methods

2.1. Materials

In order to evaluate the DTIs prediction performance of the proposed DLGRMC, four small-scale benchmark datasets which correspond to four different target protein types and a large-scale dataset are used in our experiments, including nuclear receptors (NRs), G protein-coupled receptors (GPCRs), ion channels (ICs), enzymes (Es) [40], and DrugBank (DB) [41]. The former four datasets are publicly available at http://web.kuicr.kyoto-u.ac.jp/supp/yoshi/drugtarget/. The last DrugBank dataset is a unique bioinformatics and cheminformatics resource that combines detailed drug data with comprehensive drug-target information. The data used in this study was released on July 03, 2018 (version 5.1.1). The drugs and targets data were extracted from the DrugBank database website at http://www.drugbank.ca/. We only use the approved drug-target interactions in our experiments. Therefore, there are totally 1936 drugs and 1609 targets, respectively. The number of approved drug-target interactions is 7019. The approved drug structures and approved target sequences were downloaded from https://www.drugbank.ca/releases/latest#structures and https://www.drugbank.ca/releases/latest#target-sequences, respectively.

Table 1 summarizes the simple statistics of the four datasets. In Table 1, we present three types of information for each dataset, i.e., the experimental validated DTIs, the similarities between drugs, and the similarities between targets. Specifically, the validated DTIs are obtained from public datasets including BRENDA [42], KEGG BRITE [43], DrugBank [44], and SuperTarget [45]. The drug similarities are calculated via the chemical structures of the compounds, which are derived from the DRUG and COMPOUND sections in the KEGG LIGAND dataset [43]. The chemical structure similarities between compounds are computed by using SIMCOMP score [46], where SIMCOMP provides a global similarity score based on the size of the common substructures between two compounds using a graph alignment algorithm. The similarity between two compounds c and c′ is computed as S(c, c′) = |cc′ | /|cc′|. By applying this operation to all compound pairs, we can construct a drug similarity matrix. The target similarities are computed via the amino acid sequences of target proteins, which are obtained from the KEGG GENES dataset [43]. The sequence similarities between the proteins are computed by using a normalized version of Smith–Waterman scores [47]. The normalized SmithWaterman score between two proteins g and g′ is computed as S(g,g)=SW(g,g)/SW(g,g)SW(g,g), where SW(·, ·) means the original SmithWaterman score. By applying this operation to all protein pairs, we can construct a target similarity matrix.

Table 1.

The statistics of drugs, targets, and interactions in each dataset.

Datasets NRs GPCRs ICs Es DB
Drugs 54 223 210 445 1936
Targets 26 95 204 664 1609
Interactions 90 635 1476 2926 7019
Average No. of drugs per target 3.46 6.68 7.24 4.41 4.36
Average No. of targets per drug 1.67 2.85 7.03 6.58 3.63
Sparsity of the interaction matrix (%) 93.59 97.00 96.55 99.01 99.77
Percentage of drugs with only one interaction target (%) 72.22 47.53 38.57 39.78 75.20
Percentage of targets with only one interaction drug (%) 30.77 35.79 11.27 43.37 30.53

2.2. Problem Formulation of DTIs Prediction

In this work, we use two sets 𝒟 = {Di}i=1d and 𝒯 = {Ti}i=1t to denote d drugs and t targets, respectively. The experimentally validated DTIs are represented by a binary matrix M ∈ {0,1}d×t. If a drug Di has been experimentally validated to interact with a target Tj, then Mij = 1; otherwise, Mij = 0. The nonzero elements in M are called “known interaction” and can be regarded as positive observations, while the zero elements in M are called “unknown interaction” and can be regarded as negative observations. In addition, the drug similarities are denoted as DSd×d, and the target similarities are represented as TSt×t. The aim of DTIs prediction is to uncover the possible interactions from the negative observations by using certain prior information of drugs and targets. The candidate drug-target interactions will be chosen as predicted interactions according to their predicted probabilities in descending order.

2.3. Matrix Completion

Matrix completion aims to fill in the missing entries of a partially observed matrix M. One of the mostly used model of the matrix completion problem is to find the lowest rank matrix X which matches the matrix M, which we wish to recover, for all entries in the set E of observed entries. The basic mathematical formulation of this problem is as follows:

minXrankXs.t.Xij=Miji,jE. (1)

Due to the fact that problem (1) is nonconvex and no efficient solution can be obtained, (1) is usually transformed to the following convex problem by relaxing the rank function into the nuclear norm:

minXXs.t.Xij=Miji,jE. (2)

where ‖·‖ is the nuclear norm, which is equal to the sum of singular values of X. Equation (2) can be solved by using the singular value thresholding (SVT) algorithm [48].

2.4. Dual Laplacian Graph Regularized Matrix Completion (DLGRMC)

Supposing there are d drugs and t targets, if we use the matrix Md×t to denote the drug-target interactions and denote E as the validated interaction set, then (2) can be directly used for potential DTIs prediction. However, the drug-drug similarities and target-target similarities which have been demonstrated useful in previous works are not fully exploited to serve the matrix completion model. Thus, we believe that the two kinds of similarities can advantage the matrix completion model; of course, better DTIs prediction results can be expected. In this work, we present a new objective function through incorporation of the drug-drug similarities and target-target similarities into the standard matrix completion framework for DTIs prediction. We use a dual Laplacian graph regularization term to constrain that drugs with similar chemical structure are more likely to have connections with similar targets and targets with similar genomic sequence similarity are more likely to have interactions with similar drugs. The optimization problem of DLGRMC can be formulated as follows:

minXX+αXF2+βAXAF2+λi,j=1dxixj2DSi,j+p,q=1txpxq2TSi,j (3)

where xi and xj represent the i-th row and j-th row of X, respectively. xp and xq represent the p-th column and q-th column of X, respectively. α, β, and λ are three regularization parameters, and “∘" denotes the Hadamard product of two matrices. The Tikhonov regularization on X is used to ensure the smoothness of X. The third term aims to ensure that the experimental validated interactions can be well preserved after the matrix completion. A is an adjacency matrix with binary values which is defined to clearly describe the validated DTIs; i.e., if a specific drug Di is confirmed to be interacted with a target Tj, the entity A(i, j) is assigned 1 or otherwise 0. Thus, the adjacency matrix A is with size d × t. Since A is with 0 − 1 values, we use itself as the indicator matrix to indicate the indices of the observed DTIs. The forth term regularized by parameter λ constrains that drugs with similar chemical structure are more likely to be connected with similar targets and targets with similar genomic sequence similarity are forced to have interactions with similar drugs. DS(i, j) represents the chemical structure similarity between drugs Di and Dj, and TS(i, j) represents the genomic sequence similarity between targets Ti and Tj.

2.5. Optimization of DLGRMC

To solve the optimization problem in (3), we first transform it into the following form:

minXX+αXF2+βAXAF2+λtrXTLdX+trXLtXT, (4)

where Ldd×d is the drug Laplacian matrix with Ld = DdDS, Dd is the diagonal matrix with Dd(i, i) = ∑jDS(i, j), Ltt×t is the target Laplacian matrix with Lt = DtTS, and Dt is the diagonal matrix with Dt(p, p) = ∑qTS(p, q).

Since problem (4) contains Hadamard product of two matrices, it is hard to tackle it directly. Thus, we propose an alternative iterative algorithm to solve this problem based on Augmented Lagrange Multiplier (ALM) algorithm [4952]. We first introduce two auxiliary variables J and Z to make the objective function separable:

minX,J,ZJ+αXF2+βAZAF2+λtrXTLdX+trXLtXTs.t.X=J,X=Z. (5)

The corresponding augmented Lagrange function of (5) is

LX,J,Z,Y1,Y2,μ1,μ2=J+αXF2+βAZAF2+λtrXTLdX+trXLtXT+Y1,XJ+μ12XJF2+Y2,XZ+μ22XZF2, (6)

where Y1 and Y2 are the Lagrange multipliers, μ1 > 0 and μ2 > 0 control the penalties for violating the linear constraints, and 〈·, ·〉 represents the standard inner product of two matrices. Then the variables can be solved alternatively.

2.5.1. Solving J with Other Variables Fixed

The variable J can be solved by the following equation with other variables fixed:

minJJ+Y1,XJ+μ12XJF2=minJJ+μ12XJ+Y1μ1F2, (7)

where J can be solved by singular value thresholding (SVT) operator ([48]).

2.5.2. Solving Z with Other Variables Fixed

When other variables are fixed, Z can be solved by minimizing following function:

minZβAZAF2+Y2,XZ+μ22XZF2=minZβAZAF2+μ22XZ+Y2μ2F2. (8)

Setting the derivative of (8) with respect to Z to zero and using properties of the Hadamard and Kronecker products, it is easy to get that Z can be obtained as follows:

RvecZ=vecC, (9)

where R = 2β diag (vec⁡(A)) + μ2I, and C = 2β(AA) + μ2X + Y2. This is a simple linear system.

2.5.3. Solving X with Other Variables Fixed

We can solve X by dropping other unrelated variables as follows:

minXαXF2+λtrXTLdX+trXLtXT+μ12XJ+Y1μ1F2+μ22XZ+Y2μ2F2, (10)

By setting the derivative of (10) with respect to X to zero, we have

2αX+2λLdX+XLt+μ1XJ+μ2XZ+Y1+Y2=0. (11)

Equation (11) is a Sylvester equation [53]. Since 2α + 2λLd is strictly positive definite, (11) has stable solution for X.

2.5.4. Updating Multipliers

We update the multipliers by

Y1=Y1+μ1XJY2=Y2+μ2XZ. (12)

The variables J, Z, and X are iteratively updated until convergence. Finally, we obtain the predicted DTIs based on the completed entities in matrix X. In summary, the detailed steps for solving the proposed DLGRMC model can be described by Algorithm 1. After we recover X, the predicted DTIs can be obtained by sorting the element values of X in descending order.

Algorithm 1.

Algorithm 1

Iterative algorithm for solving DLGRMC.

3. Results

3.1. Evaluation Metrics

To quantitatively evaluate the performance of our method, computational experiments were conducted on the above five benchmark datasets. Similar to previous studies [27, 32, 54], the Area Under the Precision-Recall (AUPR) curve [55] and precision-recall (PR) curves were employed as the main metric for performance evaluation. AUPR can penalize the false positives more in evaluation, which is desirable here since we do not want incorrect predictions to be recommended by the prediction algorithms [55]. Before evaluating the performance of our proposed method, we give an intuitive showing of the imbalance ratio between interacting and noninteracting drug-target pairs of different datasets in Figure 2. As can be seen, the number of known drug-target interaction pairs is very small, which demonstrate the urgent need of predicting new drug-target interactions.

Figure 2.

Figure 2

An intuitive showing of the imbalance ratio between interacting and noninteracting drug-target pairs of different datasets.

3.2. Experiments Settings

In our experiments, five existing techniques including bipartite local model using neighbor-based interaction-profile inferring (BLMNII) [32], weighted nearest neighbor profile (WNN) [54], collaborative matrix factorization (CMF) [26], graph regularized matrix factorization (GRMF) [27], neighborhood regularized logistic matrix factorization (NRLMF) [56], and label propagation with linear neighborhood information (LPLNI) [36] were used to compare with our proposed DLGRMC. We adopted 5 repetitions of 10-fold cross validation (CV) for each of the methods on different datasets. In each repetition, the observed DTIs indicator matrix A was divided into 10 folds. Then each fold was left out as the test set while the remaining 9 folds were treated as the training set, and the final AUPR score was the average over 5 such repetitions.

As can be seen from (3), there are three parameters that need to be turned in our proposed DLGRMC model, i.e., α, β, and λ. In our experiments, we have chosen them from {0.001,0.01,0.1,1, 10,100,1000} by a grid search manner, and the best results with optimal parameters were reported. As to the Gaussian kernel function for calculating the drug chemical structure similarity, we set the number of nearest neighbors k to be 5 and the kernel width σ to be 0.1. For the other methods, we set the parameters to their optimal values as recommended in the references.

Similar to previous works [9, 26, 57], we conducted CV under three different settings as follows:

  1. CV1: CV on drug-target pairs–random entries in A (i.e., drug-target pairs) were selected for testing, this setting refers to the DTIs prediction for new (unknown) drug-target pairs.

  2. CV2: CV on drugs–random rows in A (i.e., drugs) were blinded for testing, this setting refers to the DTIs prediction for new drugs.

  3. CV3: CV on targets–random columns in A (i.e., targets) were blinded for testing, this setting refers to the DTIs prediction for new targets.

Under CV1, we used 90% of elements in A as training data and the remaining 10% of elements as test data in each round. Under CV2, we used 90% of rows in A as training data and the remaining 10% of rows as test data in each round. Under CV3, we used 90% of columns in A as training data and the remaining 10% of columns as test data in each round.

3.3. DTIs Prediction Results

Tables 24 show the predicted AUPR values of different methods on different datasets under different CV settings. As can be seen, our proposed DLGRMC performs better than other methods on all of the datasets. Since the drug discovery and development aim to serve the treatment of disease, in order to predict new targets which the drugs react, we plot the precision-recall (PR) curves of the results under CV3 for all of the datasets. The plots are shown in Figure 3; the results also show the superiority of our proposed DLGRMC. We will release the related datasets, codes, and figures of our algorithm for academic research with this paper.

Table 2.

Average AUPR values of different methods on different datasets under CV1 (the values following the symbol “±" are the standard deviations of 5 repetition results).

Methods NRs GPCRs Ics Es DB
BLM-NII 0.641±0.038 0.483±0.019 0.645±0.010 0.624±0.013 0.667±0.024
WNN 0.567±0.024 0.559±0.020 0.583±0.018 0.591±0.016 0.652±0.027
CMF 0.577±0.038 0.674±0.011 0.858±0.008 0.806±0.005 0.883±0.019
GRMF 0.592±0.025 0.679±0.012 0.367±0.015 0.324±0.014 0.704±0.029
NRLMF 0.675±0.034 0.687±0.017 0.889±0.010 0.847±0.007 0.902±0.030
LGRMC 0.696±0.022 0.701±0.014 0.899±0.013 0.874±0.009 0.921±0.016

Table 3.

Average AUPR values of different methods on different datasets under CV2 (the values following the symbol “±" are the standard deviations of 5 repetition results).

Methods NRs GPCRs Ics Es DB
BLM-NII 0.427±0.045 0.308±0.020 0.289±0.029 0.246±0.021 0.443±0.031
WNN 0.501±0.051 0.286±0.018 0.237±0.034 0.251±0.037 0.543±0.034
CMF 0.465±0.052 0.358±0.016 0.268±0.031 0.203±0.022 0.482±0.026
GRMF 0.481±0.056 0.357±0.017 0.284±0.027 0.252±0.018 0.507±0.024
NRLMF 0.540±0.052 0.361±0.019 0.348±0.031 0.345±0.033 0.575±0.027
LGRMC 0.572±0.054 0.377±0.018 0.364±0.028 0.373±0.020 0.601±0.030

Table 4.

Average AUPR values of different methods on different datasets under CV3 (the values following the symbol “±" are the standard deviations of 5 repetition results).

Methods NRs GPCRs Ics Es DB
BLM-NII 0.412±0.042 0.332±0.014 0.205±0.011 0.167±0.010 0.446±0.023
WNN 0.517±0.024 0.364±0.009 0.319±0.012 0.385±0.013 0.527±0.016
CMF 0.484±0.035 0.407±0.007 0.352±0.009 0.376±0.006 0.535±0.012
GRMF 0.517±0.026 0.367±0.010 0.343±0.017 0.346±0.010 0.539±0.018
NRLMF 0.491±0.048 0.409±0.042 0.358±0.016 0.395±0.014 0.550±0.029
LGRMC 0.527±0.023 0.415±0.012 0.362±0.015 0.410±0.012 0.574±0.019

Figure 3.

Figure 3

The PR curves of different methods on four datasets.

3.4. Case Study

In order to test the capacity of DLGRMC in potential DTIs prediction, we randomly chose one drug from each dataset and reported the top 10 predicted interactions of different methods under CV3. The results are shown in Tables 59. As can be seen, our proposed DLGRMC can successfully predict more of the experimental validated DTIs when compared with other methods, which indicates that DLGRMC is capable of predicting novel DTIs for drug development.

Table 5.

The top 10 interacting targets of drug “D00094" in dataset NRs predicted by different methods (“√" denotes experimental validated targets and “×" denotes nonvalidated targets).

Rank Targets predicted by different methods
BLM-NII WNN CMF GRMF NRLMF DLGRMC
1 hsa5914 (√) hsa190 (√) hsa6096 (√) hsa6257 (√) hsa5915 (√) hsa5914 (√)
2 hsa5915 (√) hsa6257 (√) hsa6257 (√) hsa5915 (√) hsa190 (√) hsa5915 (√)
3 hsa6257 (√) hsa5915 (√) hsa5915 (√) hsa6256 (√) hsa6096 (√) hsa190 (√)
4 hsa190 (√) hsa6256 (√) hsa190 (√) hsa190 (√) hsa5914 (√) hsa6096 (√)
5 hsa6258 (√) hsa190 (√) hsa6256 (√) hsa6258 (√) hsa6097 (√) hsa6257 (√)
6 hsa6097 (√) hsa6097 (√) hsa5916 (√) hsa5916 (√) hsa6258 (√) hsa6256 (√)
7 hsa2099 (×) hsa5916 (√) hsa2104 (×) hsa5915 (√) hsa5916 (√) hsa6258 (√)
8 hsa4306 (×) hsa2908 (×) hsa2421 (×) hsa2101 (×) hsa6257 (√) hsa5916 (√)
9 hsa5465 (×) hsa2104 (×) hsa4306 (×) hsa2104 (×) hsa367 (×) hsa2099 (×)
10 hsa2104 (×) hsa2421 (×) hsa9970 (×) hsa5465 (×) hsa4306 (×) hsa2908 (×)

Table 6.

The top 10 interacting targets of drug “D00255” in dataset GPCRs predicted by different methods (“√” denotes experimental validated targets and “×” denotes nonvalidated targets).

Rank Targets predicted by different methods
BLM-NII WNN CMF GRMF NRLMF DLGRMC
1 hsa147 (√) hsa150 (√) hsa151 (√) hsa155 (√) hsa155 (√) hsa147 (√)
2 hsa148 (√) hsa146 (√) hsa146 (√) hsa150 (√) hsa147 (√) hsa155 (√)
3 hsa146 (√) hsa155 (√) hsa147 (√) hsa151 (√) hsa146 (√) hsa151 (√)
4 hsa150 (√) hsa153 (√) hsa148 (√) hsa147 (√) hsa150 (√) hsa150 (√)
5 hsa1812 (×) hsa154 (√) hsa155 (√) hsa154 (√) hsa148 (√) hsa146 (√)
6 hsa2550 (×) hsa1234 (×) hsa154 (√) hsa1268 (×) hsa2550 (×) hsa154 (√)
7 hsa2913 (×) hsa1241 (×) hsa2911 (×) hsa135 (×) hsa3361 (×) hsa1128 (×)
8 hsa5739 (×) hsa3354 (×) hsa1241 (×) hsa2911 (×) hsa5729 (×) hsa2911 (×)
9 hsa7201 (×) hsa7201 (×) hsa3354 (×) hsa57105 (×) hsa9052 (×) hsa3269 (×)
10 hsa552 (×) hsa6751 (×) hsa6751 (×) hsa886 (×) hsa2911 (×) hsa3352 (×)

Table 7.

The top 10 interacting targets of drug “D00110" in dataset ICs predicted by different methods (“√" denotes experimental validated targets and “×" denotes nonvalidated targets).

Rank Targets predicted by different methods
BLM-NII WNN CMF GRMF NRLMF DLGRMC
1 hsa6336 (√) hsa11280 (√) hsa6530 (√) hsa6532 (√) hsa6529 (√) hsa6331 (√)
2 hsa6532 (√) hsa6530 (√) hsa6532 (√) hsa11280 (√) hsa6532 (√) hsa6336 (√)
3 hsa6530 (√) hsa6529 (√) hsa11280 (√) hsa6336 (√) hsa6336 (√) hsa6530 (√)
4 hsa11280 (√) hsa6331 (√) hsa6529 (√) hsa6336 (√) hsa6331 (√) hsa6532 (√)
5 hsa6529 (√) hsa6532 (√) hsa6331 (√) hsa6530 (√) hsa11280 (√) hsa11280 (√)
6 hsa2554 (×) hsa2554 (×) hsa6336 (√) hsa6529 (√) hsa9312 (×) hsa6529 (√)
7 hsa2901 (×) hsa9177 (×) hsa2901 (×) hsa1137 (×) hsa93589 (×) hsa1141 (×)
8 hsa3748 (×) hsa773 (×) hsa27012 (×) hsa9312 (×) hsa23704 (×) hsa1137 (×)
9 hsa1134 (×) hsa8514 (×) hsa8973 (×) hsa3762 (×) hsa2892 (×) hsa9312 (×)
10 hsa9177 (×) hsa9311 (×) hsa2560 (×) hsa1139 (×) hsa3756 (×) hsa93589 (×)

Table 8.

The top 10 interacting targets of drug “D00002" in dataset Es predicted by different methods (“√" denotes experimental validated targets and “×" denotes nonvalidated targets).

Rank Targets predicted by different methods
BLM-NII WNN CMF GRMF NRLMF DLGRMC
1 hsa216 (√) hsa108 (√) hsa1725 (×) hsa196883 (√) hsa191 (√) hsa191 (√)
2 hsa108 (√) hsa1725 (×) hsa108 (√) hsa191 (√) hsa196883 (√) hsa1725 (×)
3 hsa1725 (×) hsa191 (√) hsa2936 (√) hsa7498 (√) hsa108 (√) hsa196883 (√)
4 hsa2746 (√) hsa3939 (√) hsa2639 (√) hsa3033 (√) hsa3292 (√) hsa108 (√)
5 hsa196883 (√) hsa3292 (√) hsa115 (√) hsa108 (√) hsa3615 (√) hsa2936 (√)
6 hsa7015 (×) hsa349565 (√) hsa2597 (√) hsa7299 (×) hsa3939 (√) hsa3033 (√)
7 hsa4594 (×) hsa34 (×) hsa3156 (×) hsa84152 (×) hsa3818 (×) hsa349565 (√)
8 hsa3035 (×) hsa8435 (×) hsa51095 (×) hsa590 (×) hsa5536 (×) hsa339221 (×)
9 hsa306 (×) hsa51095 (×) hsa90 (×) hsa3156 (×) hsa34 (×) hsa3156 (×)
10 hsa8435 (×) hsa306 (×) hsa761 (×) hsa34 (×) hsa90 (×) hsa3991 (×)

Table 9.

The top 10 interacting targets of drug “DB00171" in dataset DB predicted by different methods (“√" denotes experimental validated targets and “×" denotes nonvalidated targets).

Rank Targets predicted by different methods
BLM-NII WNN CMF GRMF NRLMF DLGRMC
1 P10398 (√) P00519 (√) P36896 (√) P35626 (√) O95477 (√) Q09428 (√)
2 P36896 (√) P35626 (√) O43681 (√) Q08828 (√) P00519 (√) P49902 (√)
3 P42684 (√) Q9UM73 (√) Q07912 (√) Q9UM73 (√) P35626 (√) O95477 (√)
4 Q9UM73 (√) O43681 (√) P35626 (√) P10398 (√) P10398 (√) P00519 (√)
5 O43681 (√) P36896 (√) P49902 (√) P36896 (√) P42684 (√) P35626 (√)
6 Q07912 (√) Q16671 (√) Q08828 (√) O43681 (√) Q9UM73 (√) Q08828 (√)
7 O95477 (√) O95342 (√) Q9UM73 (√) Q07912 (√) P36896 (√) O14727 (√)
8 P31749 (×) Q13131 (×) P31749 (×) Q15822 (×) O43681 (√) Q9UM73 (√)
9 P20839 (×) P20839 (×) P20839 (×) P53985 (×) Q13131 (×) P10398 (√)
10 Q8NFJ5 (×) P31749 (×) P16219 (×) P31749 (×) O15270 (×) P31749 (×)

3.5. Parameter Sensitivity Analysis

As mentioned in Section 3.2, there are three parameters that need to be tuned for obtaining the best results. In this subsection, in order to analyse the parameter effect on the final prediction results, for each dataset, we show the AUPR values versus one of the parameters with the other two fixed. Figure 4 plots the AUPR values of DLGRMC with different parameters on different datasets under CV3. As can be seen, DLGRMC is more sensitive to β and λ than α, which demonstrates the importance of the Laplacian graph regularization and the preservation of observed DTIs.

Figure 4.

Figure 4

The AUPR values versus the parameter (a) α with β = λ = 1, (b) β with α = λ = 1, and (c) λ with α = β = 1 on different datasets.

4. Discussion

In this paper, we propose a drug-target interaction prediction model via Laplacian graph regularized matrix completion. In detail, we transformed the task of drug-target interaction prediction into a matrix completion problem, in which the potential interactions between drugs and targets can be obtained based on the prediction scores after the matrix completion procedure. The novelties of our proposed method line in two aspects. On the one hand, during the matrix completion, the pairwise chemical structure similarities between drugs and genomic sequence similarities between drugs are fully exploited to serve the matrix completion by using a Laplacian graph regularization term. On the other hand, an indicator matrix with binary values which indicates the indices of the observed drug-target interactions is deployed to preserve the experimental confirmed interactions. We developed an alternative iterative strategy to solve the constrained matrix completion problem based on Augmented Lagrange Multiplier algorithm. The final experimental results validate the efficacy of the proposed method, and case studies demonstrate that the proposed method owns the capacity to predict potential novel drug-target interactions.

Of course, experimental results also illustrate that there is still much room for improvement since there are also missed interactions in case studies. In our recent work, only one type of representation for drugs or targets is considered. Practically, each drug or target can have multiple representations. For example, a drug can be represented by its chemical structure or by its chemical response in different cells. A protein target can be represented by its sequence or by its gene expression values in different cells. In our future work, we aim to integrate these multiview representations for drug-target interaction prediction and we believe that the prediction results can be improved with a large margin.

Acknowledgments

This work was partly supported by the National Science Foundation of China (61701451) and the Fundamental Research Funds for the Central Universities, China University of Geosciences (Wuhan) (CUG170654).

Data Availability

The datasets used in this work are publicly available at http://web.kuicr.kyoto-u.ac.jp/supp/yoshi/drugtarget/ and https://www.drugbank.ca/.

Conflicts of Interest

The authors declare that there are no conflicts of interest regarding the publication of this article.

References

  • 1.Dive C., Hickman J. A. Drug-target interactions: only the first step in the commitment to a programmed cell death? British Journal of Cancer. 1991;64(1):192–196. doi: 10.1038/bjc.1991.269. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 2.Yildirim M. A., Goh K.-I., Cusick M. E., Barabási A.-L., Vidal M. Drug-target network. Nature Biotechnology. 2007;25(10):1119–1126. doi: 10.1038/nbt1338. [DOI] [PubMed] [Google Scholar]
  • 3.Meanwell N. A. Drug-target interactions that involve the replacement or displacement of magnesium ions. Bioorganic & Medicinal Chemistry Letters. 2017;27(24):5355–5372. doi: 10.1016/j.bmcl.2017.11.002. [DOI] [PubMed] [Google Scholar]
  • 4.Petrov R. A., Maklakova S. Y., Ivanenkov Y. A., et al. Synthesis and biological evaluation of novel mono- and bivalent ASGP-R-targeted drug-conjugates. Bioorganic & Medicinal Chemistry Letters. 2018;28(3):382–387. doi: 10.1016/j.bmcl.2017.12.032. [DOI] [PubMed] [Google Scholar]
  • 5.Ohnmacht S. A., Neidle S. Small-molecule quadruplex-targeted drug discovery. Bioorganic & Medicinal Chemistry Letters. 2014;24(12):2602–2612. doi: 10.1016/j.bmcl.2014.04.029. [DOI] [PubMed] [Google Scholar]
  • 6.Sun J., Zhao M., Fanous A. H., Zhao Z. Characterization of schizophrenia adverse drug interactions through a network approach and drug classification. BioMed Research International. 2013;2013:10. doi: 10.1155/2013/458989.458989 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.Li X., Qin G., Yang Q., Chen L., Xie L. Biomolecular Network-Based Synergistic Drug Combination Discovery. BioMed Research International. 2016;2016:11. doi: 10.1155/2016/8518945. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8.Cui H., Zhang M., Yang Q., et al. The Prediction of Drug-Disease Correlation Based on Gene Expression Data. BioMed Research International. 2018;2018:6. doi: 10.1155/2018/4028473.4028473 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9.Ding H., Takigawa I., Mamitsuka H., Zhu S. Similarity-basedmachine learning methods for predicting drug-target interactions: A brief review. Briefings in Bioinformatics. 2013;15(5):734–747. doi: 10.1093/bib/bbt056. [DOI] [PubMed] [Google Scholar]
  • 10.Peska L., Buza K., Koller J. Drug-target interaction prediction: A Bayesian ranking approach. Computer Methods and Programs in Biomedicine. 2017;152:15–21. doi: 10.1016/j.cmpb.2017.09.003. [DOI] [PubMed] [Google Scholar]
  • 11.Zhang X., Li L., Ng M. K., Zhang S. Drug–target interaction prediction by integrating multiview network data. Computational Biology and Chemistry. 2017;69:185–193. doi: 10.1016/j.compbiolchem.2017.03.011. [DOI] [PubMed] [Google Scholar]
  • 12.Hoang T., Liu J., Roughead E., Pratt N., Li J. Supervised signal detection for adverse drug reactions in medication dispensing data. Computer Methods and Programs in Biomedicine. 2018;161:25–38. doi: 10.1016/j.cmpb.2018.03.021. [DOI] [PubMed] [Google Scholar]
  • 13.Emig D., Ivliev A., Pustovalova O., et al. Drug target prediction and repositioning using an integrated network-based approach. PLoS ONE. 2013;8(4) doi: 10.1371/journal.pone.0060618.e60618 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.Kanehisa M., Goto S. KEGG: kyoto encyclopedia of genes and genomes. Nucleic Acids Research. 2000;28(1):27–30. doi: 10.1093/nar/28.1.27. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15.Knox C., Law V., Jewison T., et al. DrugBank 3.0: a comprehensive resource for “Omics” research on drugs. Nucleic Acids Research. 2011;39(1):D1035–D1041. doi: 10.1093/nar/gkq1126. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16.Wheeler D. L., Barrett T., Benson D. A., et al. Database resources of the National Center for Biotechnology Information. Nucleic Acids Research. 2008;36(1):D13–D21. doi: 10.1093/nar/gkm1000. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.Bhasin M., Raghava G. P. S. GPCRpred: an SVM-based method for prediction of families and subfamilies of G-protein coupled receptors. Nucleic Acids Research. 2004;32(supplement 2):W383–W389. doi: 10.1093/nar/gkh416. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18.Bai R., Teng Q. Z., Yang X. M., Yang S. Y. Prediction of combinative activity of drugs and human serum albumin by using svm and ga. Computer Engineering and Applications. 2009;45(12):226–229. [Google Scholar]
  • 19.Nagamine N., Sakakibara Y. Statistical prediction of protein - Chemical interactions based on chemical structure and mass spectrometry data. Bioinformatics. 2007;23(15):2004–2012. doi: 10.1093/bioinformatics/btm266. [DOI] [PubMed] [Google Scholar]
  • 20.Wang Y.-C., Yang Z.-X., Wang Y., Deng N.-Y. Computationally probing drug-protein interactions via support vector machine. Letters in Drug Design and Discovery. 2010;7(5):370–378. doi: 10.2174/157018010791163433. [DOI] [Google Scholar]
  • 21.García-Sosa A. T., Oja M., Hetényi C., Maran U. DrugLogit: logistic discrimination between drugs and nondrugs including disease-specificity by assigning probabilities based on molecular properties. Journal of Chemical Information and Modeling. 2012;52(8):2165–2180. doi: 10.1021/ci200587h. [DOI] [PubMed] [Google Scholar]
  • 22.Tabei Y., Pauwels E., Stoven V., Takemoto K., Yamanishi Y. Identification of chemogenomic features from drug-target interaction networks using interpretable classifiers. Bioinformatics. 2012;28(18):i487–i494. doi: 10.1093/bioinformatics/bts412. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 23.García-Sosa A. T., Maran U. Drugs, non-drugs, and disease category specificity: organ effects by ligand pharmacology. SAR and QSAR in Environmental Research. 2013;24(4):319–331. doi: 10.1080/1062936X.2013.773373. [DOI] [PubMed] [Google Scholar]
  • 24.Shang Z. W., Jin L. I., Jiang Y. S., Zhang M. M., Hong-Chao L. V., Zhang R. J. A method of drug target prediction based on svm and its application. Progress in Modern Biomedicine. 2012 [Google Scholar]
  • 25.Gönen M. Predicting drug-target interactions from chemical and genomic kernels using Bayesian matrix factorization. Bioinformatics. 2012;28(18):2304–2310. doi: 10.1093/bioinformatics/bts360. [DOI] [PubMed] [Google Scholar]
  • 26.Zheng X., Ding H., Mamitsuka H., Zhu S. Collaborative matrix factorization with multiple similarities for predicting drug-Target interactions. Proceedings of the 19th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, KDD 2013; August 2013; USA. pp. 1025–1033. [Google Scholar]
  • 27.Ezzat A., Zhao P., Wu M., Li X., Kwoh C. Drug-target interaction prediction with graph regularized matrix factorization. IEEE Transactions on Computational Biology and Bioinformatics. 2016;14(3):646–656. doi: 10.1109/TCBB.2016.2530062. [DOI] [PubMed] [Google Scholar]
  • 28.Jacob L., Vert J.-P. Protein-ligand interaction prediction: an improved chemogenomics approach. Bioinformatics. 2008;24(19):2149–2156. doi: 10.1093/bioinformatics/btn409. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 29.Xia Z., Wu L., Zhou X., Wong S. T. Semi-supervised drug-protein interaction prediction from heterogeneous biological spaces. BMC Systems Biology. 2010;4(Suppl 2):p. S6. doi: 10.1186/1752-0509-4-S2-S6. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 30.van Laarhoven T., Nabuurs S. B., Marchiori E. Gaussian interaction profile kernels for predicting drug-target interaction. Bioinformatics. 2011;27(21):3036–3043. doi: 10.1093/bioinformatics/btr500. [DOI] [PubMed] [Google Scholar]
  • 31.Bleakley K., Yamanishi Y. Supervised prediction of drug-target interactions using bipartite local models. Bioinformatics. 2009;25(18):2397–2403. doi: 10.1093/bioinformatics/btp433. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 32.Mei J.-P., Kwoh C.-K., Yang P., Li X.-L., Zheng J. Drug-target interaction prediction by learning from local information and neighbors. Bioinformatics. 2013;29(2):238–245. doi: 10.1093/bioinformatics/bts670. [DOI] [PubMed] [Google Scholar]
  • 33.Chen X., Liu M.-X., Yan G.-Y. Drug-target interaction prediction by random walk on the heterogeneous network. Molecular BioSystems. 2012;8(7):1970–1978. doi: 10.1039/c2mb00002d. [DOI] [PubMed] [Google Scholar]
  • 34.Shi J.-Y., Yiu S.-M., Li Y., Leung H. C. M., Chin F. Y. L. Predicting drug-target interaction for new drugs using enhanced similarity measures and super-target clustering. Methods. 2015;83:98–104. doi: 10.1016/j.ymeth.2015.04.036. [DOI] [PubMed] [Google Scholar]
  • 35.Li L., Cai M. Drug target prediction by multi-view low rank embedding. IEEE Transactions on Computational Biology and Bioinformatics. 2017 doi: 10.1109/TCBB.2017.2706267. [DOI] [PubMed] [Google Scholar]
  • 36.Zhang W., Chen Y., Li D. Drug-Target Interaction Prediction through Label Propagation with Linear Neighborhood Information. Molecules. 2017;22(12):p. 2056. doi: 10.3390/molecules22122056. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 37.Shen C., Ding Y., Tang J., Xu X., Guo F. An Ameliorated Prediction of Drug–Target Interactions Based on Multi-Scale Discrete Wavelet Transform and Network Features. International Journal of Molecular Sciences. 2017;18(8):p. 1781. doi: 10.3390/ijms18081781. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 38.Meng F.-R., You Z.-H., Chen X., Zhou Y., An J.-Y. Prediction of drug–target interaction networks from the integration of protein sequences and drug chemical structures. Molecules. 2017;22(7) doi: 10.3390/molecules22071119. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 39.Wang Z.-H., Li D.-D., Chen W.-L., You Q.-D., Guo X.-K. Targeting protein-protein interaction between MLL1 and reciprocal proteins for leukemia therapy. Bioorganic & Medicinal Chemistry. 2018;26(2):356–365. doi: 10.1016/j.bmc.2017.11.045. [DOI] [PubMed] [Google Scholar]
  • 40.Yamanishi Y., Araki M., Gutteridge A., Honda W., Kanehisa M. Prediction of drug-target interaction networks from the integration of chemical and genomic spaces. Bioinformatics. 2008;24(13):i232–i240. doi: 10.1093/bioinformatics/btn162. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 41.Wishart D. S., Feunang Y. D., Guo A. C., et al. DrugBank 5.0: A major update to the DrugBank database for 2018. Nucleic Acids Research. 2018;46(1):D1074–D1082. doi: 10.1093/nar/gkx1037. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 42.Schomburg I., Chang A., Ebeling C., et al. BRENDA, the enzyme database: updates and major new developments. Nucleic Acids Research. 2004;32:D431–D433. doi: 10.1093/nar/gkh081. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 43.Kanehisa M., Goto S., Hattori M., et al. From genomics to chemical genomics: new developments in KEGG. Nucleic Acids Research. 2006;34:D354–D357. doi: 10.1093/nar/gkj102. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 44.Wishart D. S., Knox C., Guo A. C., et al. DrugBank: a knowledgebase for drugs, drug actions and drug targets. Nucleic Acids Research. 2008;36:D901–D906. doi: 10.1093/nar/gkm958. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 45.Gnther S., Kuhn M., Dunkel M., et al. Supertarget and matador: resources for exploring drug-target relationships. Proceedings of the International Conference on Communication Systems and Network Technologies; 2008; pp. 550–553. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 46.Hattori M., Okuno Y., Goto S., Kanehisa M. Development of a chemical structure comparison method for integrated analysis of chemical and genomic information in the metabolic pathways. Journal of the American Chemical Society. 2003;125(39):11853–11865. doi: 10.1021/ja036030u. [DOI] [PubMed] [Google Scholar]
  • 47.Smith T. F., Waterman M. S. Identification of common molecular subsequences. Journal of Molecular Biology. 1981;147(1):195–197. doi: 10.1016/0022-2836(81)90087-5. [DOI] [PubMed] [Google Scholar]
  • 48.Cai J., Candès E. J., Shen Z. A singular value thresholding algorithm for matrix completion. SIAM Journal on Optimization. 2010;20(4):1956–1982. doi: 10.1137/080738970. [DOI] [Google Scholar]
  • 49.Lin Z., Liu R., Su Z. Advances in Neural Information Processing Systems. 2011. Linearized alternating directional method with adaptive penalty for low-rank representation; pp. 612–620. [Google Scholar]
  • 50.Tang C., Wang P., Zhang C., Li W. Salient object detection via weighted low rank matrix recovery. IEEE Signal Processing Letters. 2017;24(4):1–5. doi: 10.1109/LSP.2016.2620162. [DOI] [Google Scholar]
  • 51.Tang C., Liu X., Li M., et al. Robust unsupervised feature selection via dual self-representation and manifold regularization. Knowledge-Based Systems. 2018;145:109–120. doi: 10.1016/j.knosys.2018.01.009. [DOI] [Google Scholar]
  • 52.Tang C., Zhu X., Chen J., Wang P., Liu X., Tian J. Robust graph regularized unsupervised feature selection. Expert Systems with Applications. 2018;96:64–76. doi: 10.1016/j.eswa.2017.11.053. [DOI] [Google Scholar]
  • 53.Bartels R. H., Stewart G. W. Solution of the matrix equation AX + XB = C [F4] Communications of the ACM. 1972;15(9):820–826. doi: 10.1145/361573.361582. [DOI] [Google Scholar]
  • 54.van Laarhoven T., Marchiori E. Predicting Drug-Target Interactions for New Drug Compounds Using a Weighted Nearest Neighbor Profile. PLoS ONE. 2013;8(6) doi: 10.1371/journal.pone.0066952.e66952 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 55.Davis J., Goadrich M. The relationship between precision-recall and ROC curves. Proceedings of the 23rd International Conference on Machine Learning (ICML '06); June 2006; New York, NY, USA. ACM; pp. 233–240. [Google Scholar]
  • 56.Liu Y., Wu M., Miao C., Zhao P., Li X.-L. Neighborhood Regularized Logistic Matrix Factorization for Drug-Target Interaction Prediction. PLoS Computational Biology. 2016;12(2) doi: 10.1371/journal.pcbi.1004760.1004760 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 57.Pahikkala T., Airola A., Pietilä S., et al. Toward more realistic drug-target interaction predictions. Briefings in Bioinformatics. 2015;16(2):325–337. doi: 10.1093/bib/bbu010. [DOI] [PMC free article] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Data Availability Statement

The datasets used in this work are publicly available at http://web.kuicr.kyoto-u.ac.jp/supp/yoshi/drugtarget/ and https://www.drugbank.ca/.


Articles from BioMed Research International are provided here courtesy of Wiley

RESOURCES