Skip to main content
Download PDF
  • Research article
  • Open access
  • Published:

Multi-task learning for cross-platform siRNA efficacy prediction: an in-silico study

BMC Bioinformatics volume 11, Article number: 181 (2010) Cite this article

Abstract

Background

Gene silencing using exogenous small interfering RNAs (siRNAs) is now a widespread molecular tool for gene functional study and new-drug target identification. The key mechanism in this technique is to design efficient siRNAs that incorporated into the RNA-induced silencing complexes (RISC) to bind and interact with the mRNA targets to repress their translations to proteins. Although considerable progress has been made in the computational analysis of siRNA binding efficacy, few joint analysis of different RNAi experiments conducted under different experimental scenarios has been done in research so far, while the joint analysis is an important issue in cross-platform siRNA efficacy prediction. A collective analysis of RNAi mechanisms for different datasets and experimental conditions can often provide new clues on the design of potent siRNAs.

Results

An elegant multi-task learning paradigm for cross-platform siRNA efficacy prediction is proposed. Experimental studies were performed on a large dataset of siRNA sequences which encompass several RNAi experiments recently conducted by different research groups. By using our multi-task learning method, the synergy among different experiments is exploited and an efficient multi-task predictor for siRNA efficacy prediction is obtained. The 19 most popular biological features for siRNA according to their jointly importance in multi-task learning were ranked. Furthermore, the hypothesis is validated out that the siRNA binding efficacy on different messenger RNAs(mRNAs) have different conditional distribution, thus the multi-task learning can be conducted by viewing tasks at an "mRNA"-level rather than at the "experiment"-level. Such distribution diversity derived from siRNAs bound to different mRNAs help indicate that the properties of target mRNA have important implications on the siRNA binding efficacy.

Conclusions

The knowledge gained from our study provides useful insights on how to analyze various cross-platform RNAi data for uncovering of their complex mechanism.

Background

RNA interference (RNAi) is the process through which a double-stranded RNA (dsRNA) induces gene expression silencing, by either degradation of sequence-specific complementary mRNA or repression of translation [1]. Nowadays, RNAi has become an effective tool to inhibit gene expression, serving as a potential therapeutic strategy in viral diseases, drug target discovery and cancer therapy [2]. The key inhibition mechanism of RNAi is triggered by introducing a short interfering double-stranded RNA (siRNA,19~ 27 bp) into the cytoplasm, where the guide strand of siRNA (usually antisense strand) is incorporated into the RNA-induced silencing complex (RISC) that binds to its target mRNA and the expression of the target gene is blocked. How to design siRNAs with high efficacy and high specificity for their target genes is one of the critical research issues [3–7].

So far, considerable progress has been made in studying the silencing capacity of siRNAs (the siRNA binding efficacy). Some fundamental empirical guidelines for designing efficient siRNA molecules have been presented [8, 9]. Further investigations include the study of the RNAi mechanism itself as well as characteristics of siRNAs with either high or low silencing capacity [10–16]. In total, these studies have led to several advanced algorithms and tools that allow the selection of potent siRNAs or the prediction of the efficacy of siRNA for gene silencing [13, 17–26].

Computational models for siRNA efficacy prediction are often constructed in a training phase. The training data consist of a collection siRNA sequences and related inhibiting efficacy vis-a-vis their target genes. In the testing phase, trained models are applied to new instances, when potential characteristics related to siRNA efficacy are extracted from siRNA sequences or target mRNA and used for the prediction of siRNAs efficacy for new targets. This procedure is generally formulated as a classification or regression model [24]. Although various statistical and machine learning methods have been proposed in the last few years [24, 27, 28], there is limited success in predicting siRNA efficacy due to the diversity of data and limited sizes of available siRNA datasets. The problem caused by the differences in the training data pose difficulties for in-silico siRNA design. Typically, the RNAi data are provided by different research groups under different platforms/protocols in different experimental scenarios. This kind of data is refereed as "cross-platform" to emphasize the considerable diversity in such data. We observed that usually the observations (siRNA efficacy) from multiple platforms may not have an identical conditional distribution (i.e. the same residual variance) due to: First, a variety of assays/platforms/scales exist for measurements of the siRNA efficacy, such as different cell types (Hela, fibroblasts), test methods (Western Blotting, real-time PCR) or siRNA delivery methods (vectors method, synthetic oligos method). Second, there may exist very different concentrations of siRNAs used in different experiments. Finally, large differences can be found in sub-optimal time intervals between transfection and down-regulation measurement etc [24, 29].

As we show later in the experimental part, a naive integration of the data for siRNA efficacy prediction will only result in poor performance. This data distribution diversity problem has largely been ignored in many previous studies, such as the Pȧ l Sætrom data [24], a classical dataset for siRNA efficacy prediction. This dataset has been used as a benchmark for training and testing in several computational studies for siRNA efficacy prediction, but the issue of non-identical conditional distribution has not received sufficient attention [30, 31].

Since different RNAi experiments encompass siRNAs that are partially targeted on different mRNAs, how to jointly utilize different experimental datasets becomes a critical issue for large-scale RNAi screening analysis. Solutions to this problem are expected to provide new insights into the RNAi mechanism in a large-scale view. In our study, although cross-platform siRNA datasets may have different conditional distribution of their efficacy, they are related to a common biological problem and can be viewed as different prediction tasks under the same latent variables. This observation inspires us to exploit the possible synergies between different datasets, rather than combining them directly, to learn a multi-task predictor jointly and simultaneously for siRNA efficacy prediction. This predictor will allow different classification tasks to enhance each other during the training process, which eventually makes the efficacy prediction better than when the datasets are naively combined, or when the datasets are used separately.

In this paper, the cross-platform model construction issue was addressed by applying a simple, yet effective linear regression model based on the multi-task learning paradigm. This model was applied on multiple datasets for siRNA efficacy prediction. Recently, [32] presented a multi-task learning approach to learning drug combinations for drug design. In [33], a multi-task classification approach is applied on multiple platforms for finding out a small number of highly significant marker genes to aid in biological studies, where the emphasis is on feature selection across platforms. In [34], a novel transfer learning technique is applied to address such cross-platform siRNA efficacy prediction problem where the focus is on using the auxiliary domains to help improve the regression performance of a target class. To the best of our knowledge, our work is one of the first to apply the multi-task learning model for siRNA efficacy analysis for learning regression models.

To test our multi-task regression learning framework, extensive experiments were conducted to show that multi-task learning is naturally suitable for cross-platform siRNA efficacy prediction. The biological features were ranked to derive the most important common features for siRNA design across different experiments on this model. Furthermore, our experiments also validate the observation that the siRNA efficacy depends on the properties of the targeted mRNA, instead of merely on the properties of siRNA sequence. We also conjecture that continued computational siRNA efficacy study can be benefited greatly from the multi-task learning framework by focusing on a much smaller task level, where we can take, for example, each mRNA and its binding siRNAs as a task, rather than an entire experiment as a task.

Methods

Data source

Our study was performed on the siRNA efficacy dataset compiled by Shabalina et al., which contains 653 19-nt siRNAs targeted on 52 genes (no homology genes between them) from 14 cross-platform experiments [23]. The general description of this data source is given in Table 1, from which we can see that different experiments actually have different output label spaces in the evaluation of siRNA efficacy. It is reported that this is a mixture set of dataset including a broad range of siRNA concentrations, which, in distribution, is substantially biased towards the high end (over 300 siRNAs tested at 100 nM concentrations) in the evaluation of siRNA efficacy. The diversity in the data explains partly why the different measurement errors are non-trivial [23] [Additional file 1]. In addition, another two experiments with 32 siRNAs targeting on 10 distinct mRNAs are included in our study as two independent test sets [23]. The siRNA efficacy in these experiments was tested at very low concentrations to show that the effectiveness of our multi-task learning paradigm for predicting the efficacy of siRNAs is independent on concentrations.

Table 1 Description of the 14 cross-platform RNAi experiments as well as another 2 independent experiments performed at low siRNA concentrations.
Full size table

In our study, the same 19 parameter values were adopted for siRNA efficacy prediction as presented by Shabalina et al. [23] (see Table 2), since these parameters have covered most of the reported features that are significantly correlated with siRNA efficacy so far, such as nucleotide content of G, nucleotide content of U and position-dependent nucleotide etc. Under our multi-task learning paradigm, a quantitative evaluation of these 19 features will be provided to reveal the relevance of these 19 features to siRNA design, as shown in the next section.

Table 2 Feature weights for siRNA design derived from multi-task learning
Full size table

We should explain the reasons for why this particular data source is chosen: First, the data source contains nearly all the RNAi experiments with numerical siRNA efficacy values reported in recent studies, thus proven to be a complete dataset for training regression models for siRNA efficacy prediction. Second, the data source is a mixture dataset with cross-platform experiments stated in Pȧ l Sæ trom dataset, a dataset misused by several computational siRNA efficacy prediction models where its data diversity is not considered [30, 31]. We want to use the multi-task learning paradigm to address this cross-platform issue by comparing our test results with those of traditional studies. We noted that in the current study, we only focused on the regression model rather than the general classification models, since the siRNA efficacy values are in nature continuously valued under different experimental platforms and we don't want to waste any data information in using our model. Though our model is designed for regression problem, it's actually also suitable for the classification problem with categorical data as input. To support our argument, we applied our model in multi-task classification with the siRecords dataset [22], which normally standardized siRNA with consistent efficacy ratings across different platforms. The results are listed in the supplementary materials [Additional file 1], and they also indicate that our multi-task classification model is significantly better the single-task classification models.

Linear ridge regression model

Given a representation of siRNAs as feature vectors, a linear ridge regression model was applied [35] to predict the novel siRNA efficacy from a set of siRNAs with known efficacy. Linear ridge regression is a classical statistical technique that aims to find a linear function that models the dependencies between covariances in ℝdand response variables in ℝ, where d is the number of data features. The standard way to handle this problem is using the ordinary least square (OLS) method, which minimizes the squared loss:

(1)

However, due to limited training examples, the variance of the estimated w by OLS may be large, and thus the estimation is not reliable. An effective way to overcome this problem is to penalize the norm of w as in ridge regression. Instead of minimizing squared errors, ridge regression minimizes the following cost:

(2)

where λ is a fixed positive number. By introducing the regularization parameter λ, the ridge regression can reduce the estimated variance at the expense of increasing training errors. The regularization parameter λ controls the trade-off between the bias and variance of the estimate. In the linear ridge regression model, it is shown that the predicted label (i.e., wTx) of a new unlabeled example x is:

(3)

where K is the matrix of dot products of the vectors {x i , i = 1,2, ..., n} in the training set:

(4)

and κ is the vector of dot products of x and the vectors in the training set:

(5)

It should be noted that this model could be generalized to kernel ridge regression by using the kernel trick [36]. However, model selection is not our main focus here. Various regression models can be applied, but we choose the linear ridge regression as our regression model based on the following reasons: (1) The performance of linear ridge regression model is comparable to most of the state-of-art regression models on siRNA efficacy prediction, and it is simple enough in representation [29]. We applied the sophisticated support vector regression (SVR) with both linear kernel and radial basis function kernel in siRNA efficacy prediction, and we obtained nearly the same (even worse) prediction results as compared to linear ridge regression (See Results and Discussion). (2) We also want to exploit the feature importance across the platforms for better siRNA design. This goal cannot be achieved if we use a kernel regression model since it will map the input features as some non-meaningful high-dimensional representations.

In our experimental study, 5-fold cross-validation was applied to find the optimal regularization parameter that minimizes the cross-validation errors. For all the 14 experiments, 5-fold cross-validation is performed on 5 regularization parameter regions respectively, i.e. [0.001,0.1] with interval 0.001, [0.01,0.1] with interval 0.01, [0.1,1] with interval 0.1, [1, 10] with interval 1 and [10,100] with interval 10. Finally λ = 10 was obtained by evaluation of the total cross-validation errors in the 14 experiments. This parameter was kept the same throughout our study for consistent comparison.

Performance Measurement

In our experiments, the proposed multi-task learning and traditional single task learning were evaluated based on root mean squared error (RMSE) [35], which is usually used as a measurement of the prediction ability in the regression model. The residual e is the difference between the observed data and the fitted model, denoted as:

(6)

where y i is the observed siRNA efficacy and is the predicted siRNA efficacy. The root mean squared error is defined as follows:

(7)

where n is the number of predicted siRNA sequences. The smaller the RMSE is, the better the predict performance is.

Paired t-test for model comparison

In our study, the paired t-test and F-test is performed to compare multi-task learning versus single-task learning in siRNA efficacy prediction [37]. Paired t-test is proven to work well by machine learning community in measuring the significance of one model outperforming another model and it is suitable for the most common data distribution assumption (say, normal distribution, instead of specific chi-squared distribution, for example) when we don't know the exact data distribution. To be briefly, this test is trying to determine whether the mean of a set of samples, i.e., the cross-validation estimates for the various datasets (tasks) is significantly greater than, or significantly less than the mean of another, followed by the assumptions that the observed data are from a matched subject and are drawn from a population with nearly to normal distribution.

More specifically, given two paired sets X i and Y i of n measured values, which could be the error rates evaluated by RMSE for each experiments under the single-task learning model and multi-task learning model in out study, the paired t-test determines whether this two model differ from each other in a significant way under the assumptions that the paired prediction error rate differences for each experiment are independent and identically normally distributed.

To apply the paired t-test, let:

(8)
(9)

Then define t by:

(10)

where n- 1 is the statistic degrees of freedom. Once a t value is determined, a p-value can be found using a table of values from Student's t-distribution to determine the significance level at which two models differ.

Multi-task learning for siRNA efficacy prediction

Computational framework

Multi-task learning has been developed in machine learning research to situations where multiple related learning tasks are accomplished together [38–46]. It has been proven to be more effective than learning each task independently when there are explicit or hidden inter-relationship among the tasks that can be exploited [47]. The intuition underlying the framework is that the multiple related tasks can benefit each other by sharing the data and features across the tasks, which can often boost the learning performance of each single task. Such an advantage is especially evident when the number of labeled data in each task is limited, such that training on each single task with insufficient labeled data may not work well. Recently, researchers have begun to resort to the multi-task learning model to solve biological problems, such as medical diagnosis, tumor classification and drug screening [48–50]. However, applications of multitask learning in bioinformatics have just begun.

In this study, a comprehensive computational framework for cross-platform RNAi experiment analysis is presented. The workfellow of the framework is shown in Figure 1. Extensive experimental tests were conducted to thoroughly examine the performance of the multi-task learning framework.

Figure 1
figure 1

Computational framework in our study.

Full size image

Algorithm

In this section, we demonstrate how to formulate the cross-platform siRNA efficacy prediction problem as a multi-task learning problem. A critical issue is to learn a set of sparse (regression) functions across the tasks. In particular, l 1-norm regularization is used to control the number of learned features common for all the tasks, and the whole multi-task learning problem is equivalent to a convex optimization problem [47]. Consequently, the problem is solved iteratively until convergence, by alternately performing an unsupervised step and a supervised step. In the unsupervised step, the common representations shared by the tasks are learned and then in the supervised step, these representations are used to learn the regression functions for each each task. Detailed algorithm derivations can be found in supplementary file [Additional file 1]. A Matlab script package for such multi-task learning in siRNA efficacy prediction is provided, which is accessible freely on our website.

Feature selection across tasks

In this section, we show that the proposed multi-task learning provides us an efficient way to evaluate the feature importance in siRNA design across various platforms. Based on the parameter W that are derived from Equation (11), the optimal solution for matrix D is obtained, which can be used for feature selection. In our case, D is a diagonal matrix with D = diag [λ1, ..., λ d ], since U is defined as an identity matrix. Specifically, we have

(11)

If λ i ≠ 0, the ithfeature is the common feature; otherwise, the ithfeature is not useful in regression learning across the different tasks, since its regression weights are zeros for all the tasks. The value of λ i indicates the weight of the corresponding feature, which gives us a quantitative way to evaluate the importance of various features for siRNA design.

Results and Discussion

In this section, a number of experiments on multi-task learning for cross-platform siRNA efficacy prediction are performed. The siRNA efficacy prediction problem is formulated as a linear ridge regression model and the parameters of this model are tuned with a 5-fold cross-validation process. The root mean square error (RMSE) is adopted as the performance evaluation for different test results. To verify the statistical significance of our model over the baseline algorithms, the paired t-test on the experimental results is also conducted [37].

Multi-task learning for cross-platform siRNA efficacy prediction

STUDY 1: Single task learning

In this study, linear ridge regression was we first compared with SVR for single task siRNA efficacy prediction. As an overview, linear ridge regression was shown to achieve the same prediction results as SVR (see Table 3). As a result, linear ridge regression was taken as the chosen learning method in the following study. We show that the 14 cross-platform experiments that we use are indeed have different conditional distribution. We will see that simple combinational or normalization methods only provide very limited gain on the improvement of final siRNA efficacy prediction.

Table 3 Comparison between linear ridge regression and support vector regression for single task siRNA efficacy prediction.
Full size table

In our first test scenario (Test 1), we randomly selected 50% of the data from each experiment(or platform) as the training data to train a linear ridge regression model, and then tested it on the remaining 50% of the data in that experiment. We ran the test 10 times and reported the average RMSE for each experiment. The result of Test 1 was compared with another test scenario (Test 2), in which the same parameters are used under normalization process. In the normalization process, we scaled all the experimental labels (siRNA efficacy values) into [0,1] and pooled 50% of the data from each experiment together to train a general model. Finally, we tested the model on the remaining 50% of the data for each experiment, respectively. The final RMSE was calculated based on the re-scaled predicted and ground-truth labels. Results of these two tests are given in Table 4.

Table 4 Single task learning with direct combination and label scaling for siRNA efficacy prediction.
Full size table

From Table 4, we can clearly see that even if the training data labels are scaled to the same level, and the training data are pooled together to train a general model for individual task prediction, the prediction results are still not improving all the time. In fact, we observe worse results in half of the experiments under this general model. Statistical test evaluation on these two models has shown that there is no statistically significant difference between these two prediction results (p-value = 0.7043). It indicates that directly scaling the labels and increasing the number of training data by combining the data from cross-platform experiments only provides limited help in improving the prediction performance; in many cases the performance is degraded. All tests so far reveal that there exists a high-level of diversity across these 14 experiments, which motivates us to apply more sophisticated multi-task learning in this study.

STUDY 2: Multi-task learning

In this study, we show that multi-task learning is able to improve the prediction performance as compared to single-task learning. Multi-task learning is performed on the 14 cross-platform experiments with the same setting as Test 1 (50% training data as well as 50% testing data for each experiment). Furthermore, in order to examine the impact of the size of training set on the model's performance, we compared single task learning with multi-task learning trained with other different percentages of data from each experiment. That is, we trained the models with 10%, 30%, 70% and 90% of the whole data, respectively. The testing results are summarized in Table 4 and Figure 2 as Test 3.

Figure 2
figure 2

Comparison between multi-task learning and single task learning for siRNA efficacy prediction. Each model is trained with 10%, 30%, 50%, 70% and 90% of the data from each experiment, respectively. STL:Single task learning. MTL: Multi-task learning. RMSE: Root mean square error.

Full size image

From Table 5, it can be clearly seen that multi-task learning achieves better performance as compared to single task learning under various training data percentages for nearly all the experiments. An exception is for experiment 9, in which the two models obtained almost the same level of performance. Pair t-test evaluation indicated that multi-task learning is significantly superior to single task learning in siRNA efficacy prediction with all different percentages of training data (p-values are listed in Table 5), thanks to the joint learning strategy employed in the multi-task learning model. The prediction performance of most experiments is shown to be correlated to the size of training data, both for single task learning and for multi-task learning, as shown in Figure 2.

Table 5 Comparison between multi-task learning and single task learning for siRNA efficacy prediction.
Full size table

STUDY 3: Testing on independent experiments

Another two experiments [23] were also used as independent experiments in this study (Table 1). These experiments were tested in a very low siRNA concentration, including 6 mRNAs with 20 binding siRNAs and 4 mRNAs with 12 binding siRNAs, respectively. Two different tests were performed: (1) Single task learning was compared with multi-task learning on these two independent experiments (Test 4), and (2) Multi-task learning was performed on the two independent experiments together with the former 14 experiments, with a total of 16 experiments (Test 5). Each test kept 50% of the data as a training set as well as 50% of the data as a testing set for each experiment. The average over 10 RMSEs was compared specifically on two independent experiments under two test scenarios. The goal of these tests is to examine the influence of newly added tasks on the existing tasks under our multi-task learning model, and these newly added tasks may be generated in very different experimental conditions. Detailed test results are summarized in Table 6.

Table 6 Tests on two independent experiments.
Full size table

We make some observations from the results in Table 6: (1) Multi-task learning gives better performance as compared to single-task learning for the two independent experiments in the siRNA efficacy prediction, and (2) Multi-task learning with more tasks proved to be more helpful for siRNA efficacy prediction, as shown in Test 5. (3) The multi-task regression generalized well to new experimental conditions (and new mRNAs) of the two independent experiments. These conclusions indicate that multi-task learning provides an effective way to alleviate the data insufficiency problem of single task domains by exploiting the available synergy between different tasks. More tasks are expected to provide much more help from a joint learning procedure. Furthermore, with more tasks, multi-task learning can help more to improve the in-silico siRNA design targeted on new mRNAs.

Ranking features for cross platform siRNA efficacy prediction

Using our multi-task learning model, we compute the weights for each selected feature in the siRNA efficacy prediction across 14 cross-platform experiments, by considering the learned diagonal matrix D calculated in Equation (11). Multi-task learning in this case is also trained with 50% of the data for each experiment and randomly performed by 10 times. The features ranked with their weights are listed in order in Table 2. It can be seen that the position-dependent nucleotide consensus features and Δ G difference between positions 1 and 18 contribute greatly to the design of efficient siRNAs. This conclusion is consistent with the study on the siRNA design as reported in recent works [51, 52]. In addition, we can see that the feature of local target mRNA stability has a relatively high weight (0.07) in determining the siRNA efficacy, and this indicates that the properties of mRNA cannot be ignored in the design of potent siRNAs. We will further discuss this issue in the following section.

Hypothesis: shall we treat task in an "mRNA"-level ?

The impact of mRNA properties (especially the secondary structure of mRNA) on the siRNA binding efficacy has long been a controversial issue [24, 52–54]. Traditional studies suggested that it may not be critical to consider the target site's secondary structure in siRNA efficacy prediction. Several models have been presented based on the features merely derived from siRNA sequences to predict their efficacies [18, 24]. They show that the mRNA characteristics seem to offer little to the predictive strength of their models. On the other hand, several studies have shown that the properties of mRNA may play an important role in determining the binding efficacy of a siRNA [25, 55–57]. These reports motivate us to study the impact of mRNA properties on siRNA binding efficacy from a multi-task learning perspective.

We examine the possibility for siRNA efficacy prediction from a smaller multi-task level, i.e., we consider the task at "mRNA" level instead of the "experiment" level in the efficacy prediction. If the properties of mRNA influence siRNA efficacy, siRNAs that bind to the same mRNA should have some potential connections and thus be viewed as a task in the multi-task learning model. For example, it has been reported that sequence length of target mRNA has certain positive correlation with the activity of binding siRNAs [11]. We speculate that there should exist certain efficacy distribution diversity across siRNAs binding to different mRNAs while this efficacy distribution diversity should be weak within the siRNAs binding to the same mRNAs. Similar to the tests performed on multiple experiments, combining siRNAs targeted on different mRNAs may not benefit the final prediction results. If this is the case, it could be computationally validated that the properties of mRNA indeed have an important impact on the siRNA design.

In order to validate this hypothesis, we performed tests on our siRNA data by grouping the siRNAs binding to 55 mRNAs as 55 tasks. Among them, 20 mRNAs with their number of binding siRNAs in the experiments larger than 5 were selected, and those mRNAs with a very small number of binding siRNAs were removed as they have too few instances to be viewed as a task. Our final dataset includes 20 mRNAs/tasks with a total of 482 siRNA sequences binding to them. A Detailed description of this dataset is given in Table 7.

Table 7 Description of the RNAi dataset with viewing each mRNA and its binding siRNAs as a task.
Full size table

Similar studies like Test 1 - Test 3 were performed on this dataset, by viewing each mRNA and its binding siRNAs as a task. The new tests are denoted as Test 6 - Test 8 and summarized in Table 8. Table 8 shows that when the tasks were considered in a smaller "mRNA"-level, direct combination and scaling data label still provide limited help on the improvement of the prediction performance (p-value calculated by pair t-test was 0.5862). This indicates that there exists certain efficacy distribution diversity between different tasks. As expected, multi-task learning was superior to single task learning in 17 out of 20 tasks (p-value calculated by pair t-test was 0.0033).

Table 8 Comparison between multi-task learning and single task learning in a "mRNA" task level.
Full size table

We also designed a test to further examine the data characteristics of the siRNAs within one single task. The motivation of this test was discussed previously: since we hypothesized that there exists certain efficacy distribution diversity across different mRNAs/tasks in the siRNA efficacy prediction, little diversity should exist within the task. In this test, two tasks with a large number of siRNA instances were selected as the datasets (Task 1 and Task 2 with 89 and 90 siRNAs respectively). These two datasets (denoted as D1 and D2) are randomly split into 5 sub-tasks and similarly studied as Test 1 - Test 2 are performed on them respectively. Such a study is denoted as Test 9 and summarized in Table 9. It should be noted that for each dataset, since it is selected as a single mRNA with its binding siRNAs, there should be little data distribution diversity across the 5 sub-tasks. As shown in Table 9, the data combination and label scaling really work for two datasets in the improvement of efficacy prediction at this time. This is explained by saying that all siRNAs binding to one mRNA are actually homogenous in nature. The prediction performance can thus be improved by increasing the number of homogenous training data.

Table 9 Test on the efficacy prediction with siRNAs binding to single mRNA.
Full size table

In conclusion, in siRNA efficacy prediction, there indeed exists certain efficacy distribution diversity across the siRNAs binding to different mRNAs, and this distribution diversity seems to be weak within the siRNAs binding to the same mRNAs. This result helps validate the observation that the properties of mRNA indeed have influence on potent siRNA design, since certain data heterogeneity has been detected across the siRNAs binding to different mRNAs.

Conclusions

In this study, a multi-task learning paradigm for cross-platform siRNA efficacy prediction is presented. Extensive empirical tests have been conducted to demonstrate that multi-task learning provides an efficient way for the alleviation of data heterogeneity and insufficiency across multiple tasks. Our method was shown to achieve better prediction performance as compared to the traditional regression models on each individual task independently. This paradigm facilitates different tasks used to learn the hidden data patterns based on a common feature representation. In addition, our experiments validated that siRNA efficacy not only depends on the properties of siRNA, but also on the properties of its targeted mRNA.

Future research on siRNA design could be done to address the data heterogeneity issue further under the multi-task learning scheme. One approach is by taking each mRNA and its binding siRNAs as a task rather than taking each experiment as a task. Another important consideration is to address the issue on finding the major causes for such heterogeneity across different experimental conditions or mRNAs. Our multi-task learning paradigm can only reveal such heterogeneity. For experimental conditions, we wish to further find out what is important on the siRNA concentration, the knockdown assay, etc., in the siRNA design. Similarly, and more importantly, we wish to pursue the question of identifying the most important characteristics that determine the siRNA binding efficacy. Addressing these issues would help to shed new light on why certain genes seem to be easier to be knocked down by RNAi than others. We believe that a better understanding to such problems can be achieved when the amount of available data increases and more new features that influence siRNA-mediated RNA interference are identified.

Availability

A package of matlab scripts for cross-platform siRNA efficacy prediction under the proposed multi-task learning paradigm is presented. This package together with the datasets used in our manuscript is freely accessible at http://lifecenter.sgst.cn/RNAi/.

Appendix - Experimental setting for tests performed in our study

Test 1 : For 14 cross-platform experiments as 14 individual tasks, selected 50% of the data from each experiment to train a regression model, and tested the model on the remain 50% of the data of each experiment, respectively.

Test 2 : For 14 cross-platform experiments as 14 individual tasks, scaled all the experimental labels into [0,1] and pooling together 50% of the data from each experiment to train a general model, and tested the model on the remain 50% of the data of each experiment, respectively.

Test 3 : For 14 cross-platform experiments as 14 individual tasks, perform comparison between multi-task learning and single task learning for siRNA efficacy prediction, both trained with 10%, 30%, 50%, 70% and 90% of the data from each experiment, respectively.

Test 4 : For 2 independent experiments, perform comparison between single task learning and multi-task learning on them, both trained with 50% of the data from each experiment, respectively.

Test 5 : Multi-task learning on the two independent experiments together with the former 14 experiments, totally 16 experiments, trained with 50% of the data from each experiment, respectively.

Test 6 : For the 20 tasks in a "mRNA" level, selected 50% of the data from each experiment to train a regression model, and tested the model on the remain 50% of the data of each experiment, respectively.

Test 7 : For the 20 tasks in a "mRNA" level, scaled all the experimental labels into [0,1] and pooling together 50% of the data from each experiment to train a general model, and tested the model on the remain 50% of the data of each experiment, respectively.

Test 8 : For the 20 tasks in a "mRNA" level, perform multi-task learning for siRNA efficacy prediction, trained with 50% of the data from each experiment, respectively.

Test 9 : Two datasets (D1 and D2) with siRNAs binding to single mRNA are randomly split into 5 sub-tasks and similar study as Test 1-Test 2 are performed on them respectively.

References

  1. Fire A, Xu S, Montgomery M, Kostas S, Driver S, Mello C, et al.: Potent and specific genetic interference by double-stranded RNA in Caenorhabditis elegans. Nature 1998, 806–810. 10.1038/35888

    Google Scholar 

  2. Castanotto D, Rossi J: The promises and pitfalls of RNA-interference-based therapeutics. Nature 2009, 457(7228):426. 10.1038/nature07758

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  3. Yiu S, Wong P, Lam T, Mui Y, Kung H, Lin M, Cheung Y: Filtering of ineffective siRNAs and improved siRNA design tool. Bioinformatics 2005, 21(2):144–151. 10.1093/bioinformatics/bth498

    Article  CAS  PubMed  Google Scholar 

  4. Levenkova N, Gu Q, Rux JJ: Gene specific siRNA selector. Bioinformatics 2004, 20(3):430–432. 10.1093/bioinformatics/btg437

    Article  CAS  PubMed  Google Scholar 

  5. Gong W, Ren Y, Zhou H, Wang Y, Kang S, Li T: siDRM: an effective and generally applicable online siRNA design tool. Bioinformatics 2008, 24(20):2405–2406. 10.1093/bioinformatics/btn442

    Article  CAS  PubMed  Google Scholar 

  6. Yamada T, Morishita S: Accelerated off-target search algorithm for siRNA. Bioinformatics 2005, 21(8):1316–1324. 10.1093/bioinformatics/bti155

    Article  CAS  PubMed  Google Scholar 

  7. Wang L, Mu FY: A Web-based design center for vector-based siRNA and siRNA cassette. Bioinformatics 2004, 20(11):1818–1820. 10.1093/bioinformatics/bth164

    Article  CAS  PubMed  Google Scholar 

  8. Elbashir S, Lendeckel W, Tuschl T: RNA interference is mediated by 21-and 22-nucleotide RNAs. Genes & development 2001, 15(2):188–200.

    Article  CAS  Google Scholar 

  9. Tuschl T: Expanding small RNA interference. Nature Biotechnology 2002, 20: 446–448. 10.1038/nbt0502-446

    Article  CAS  PubMed  Google Scholar 

  10. Holen T, Amarzguioui M, Wiiger M, Babaie E, Prydz H: Positional effects of short interfering RNAs targeting the human coagulation trigger Tissue Factor. Nucleic Acids Research 2002, 30(8):1757. 10.1093/nar/30.8.1757

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  11. Jagla B, Aulner N, Kelly P, Song D, Volchuk A, Zatorski A, Shum D, Mayer T, De angelis D, Ouerfelli O, et al.: Sequence characteristics of functional siRNAs. RNA 2005, 11(6):864–872. 10.1261/rna.7275905

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  12. Khvorova A, Reynolds A, Jayasena S: Functional siRNAs and miRNAs exhibit strand bias. Cell 2003, 115(2):209–216. 10.1016/S0092-8674(03)00801-8

    Article  CAS  PubMed  Google Scholar 

  13. Reynolds A, Leake D, Boese Q, Scaringe S, Marshall W, Khvorova A: Rational siRNA design for RNA interference. Nature Biotechnology 2004, 22(3):326–330. 10.1038/nbt936

    Article  CAS  PubMed  Google Scholar 

  14. Schwarz D, Hutvágner G, Du T, Xu Z, Aronin N, Zamore P: Asymmetry in the assembly of the RNAi enzyme complex. Cell 2003, 115(2):199–208. 10.1016/S0092-8674(03)00759-1

    Article  CAS  PubMed  Google Scholar 

  15. Ui-Tei K, Naito Y, Takahashi F, Haraguchi T, Ohki-Hamazaki H, Juni A, Ueda R, Saigo K: Guidelines for the selection of highly effective siRNA sequences for mammalian and chick RNA interference. Nucleic Acids Research 2004, 32(3):936. 10.1093/nar/gkh247

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  16. Gong W, Ren Y, Xu Q, Wang Y, Lin D, Zhou H, Li T: Integrated siRNA design based on surveying of features associated with high RNAi effectiveness. BMC bioinformatics 2006, 7: 516. 10.1186/1471-2105-7-516

    Article  PubMed  PubMed Central  Google Scholar 

  17. Peek A: Improving model predictions for RNA interference activities that use support vector machine regression by combining and filtering features. BMC Bioinformatics 2007, 8: 182. 10.1186/1471-2105-8-182

    Article  PubMed  PubMed Central  Google Scholar 

  18. Vert J, Foveau N, Lajaunie C, Vandenbrouck Y: An accurate and interpretable model for siRNA efficacy prediction. BMC Bioinformatics 2006, 7: 520. 10.1186/1471-2105-7-520

    Article  PubMed  PubMed Central  Google Scholar 

  19. Huesken D, Lange J, Mickanin C, Weiler J, Asselbergs F, Warner J, Meloon B, Engel S, Rosenberg A, Cohen D, et al.: Design of a genome-wide siRNA library using an artificial neural network. Nature biotechnology 2005, 23: 995–1001. 10.1038/nbt1118

    Article  CAS  PubMed  Google Scholar 

  20. Jiang P, Wu H, Da Y, Sang F, Wei J, Sun X, Lu Z: RFRCDB-siRNA: Improved design of siRNAs by random forest regression model coupled with database searching. Computer Methods and Programs in Biomedicine 2007, 87(3):230–238. 10.1016/j.cmpb.2007.06.001

    Article  PubMed  Google Scholar 

  21. Ren Y, Gong W, Xu Q, Zheng X, Lin D, Wang Y, Li T: siRecords: an extensive database of mammalian siRNAs with efficacy ratings. Bioinformatics 2006, 22(8):1027–1028. 10.1093/bioinformatics/btl026

    Article  CAS  PubMed  Google Scholar 

  22. Ren Y, Gong W, Zhou H, Wang Y, Xiao F, Li T: siRecords: a database of mammalian RNAi experiments and efficacies. Nucleic Acids Research 2009, (37 Database):D146. 10.1093/nar/gkn817

    Google Scholar 

  23. Shabalina S, Spiridonov A, Ogurtsov A: Computational models with thermodynamic and composition features improve siRNA design. BMC Bioinformatics 2006, 7: 65. 10.1186/1471-2105-7-65

    Article  PubMed  PubMed Central  Google Scholar 

  24. Sætrom P, Snøve O: A comparison of siRNA efficacy predictors. Biochemical and Biophysical Research Communications 2004, 321: 247–253. 10.1016/j.bbrc.2004.06.116

    Article  PubMed  Google Scholar 

  25. Tafer H, Ameres S, Obernosterer G, Gebeshuber C, Schroeder R, Martinez J, Hofacker I: The impact of target site accessibility on the design of effective siRNAs. Nature Biotechnology 2008, 26(5):578–583. 10.1038/nbt1404

    Article  CAS  PubMed  Google Scholar 

  26. Takasaki S, Kawamura Y, Konagaya A: Selecting effective siRNA sequences by using radial basis function network and decision tree learning. BMC bioinformatics 2006, 7(Suppl 5):S22. 10.1186/1471-2105-7-S5-S22

    Article  PubMed  PubMed Central  Google Scholar 

  27. Li W, Cha L: Predicting siRNA efficiency. Cell Mol Life Sci 2007, 64: 1785–1792. 10.1007/s00018-007-7057-3

    Article  CAS  PubMed  Google Scholar 

  28. Pei Y, Tuschl T: On the art of identifying effective and specific siRNAs. Nature methods 2006, 3: 670–676. 10.1038/nmeth911

    Article  CAS  PubMed  Google Scholar 

  29. Klingelhoefer JW, Moutsianas L, Holmes C: Approximate Bayesian feature selection on a large meta-dataset offers novel insights on factors that effect siRNA potency. Bioinformatics 2009, 25: 1594–1601. 10.1093/bioinformatics/btp284

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  30. Jiang P, Sun X, Lu Z: Quantitative Estimation of siRNAs Gene Silencing Capability by Random Forest Regression Model. Bioinformatics and Biomedical Engineering 2007, 230–233. full_text

    Google Scholar 

  31. Frutiger W, Collins J, Hu W: Using Random Perturbation Method to Improve Efficacy Prediction of siRNA Sequences. International Conference on Bio Medical Engineering and Informatics 2008, 1: 194–199. full_text

    Google Scholar 

  32. Bickel S, Bogojeska J, Lengauer T, Scheffer T: Multi-task learning for HIV therapy screening. ICML 2008.

    Google Scholar 

  33. Xu Qian, Hannah QY, Xue Hong: Multi-Platform Gene Expression Mining and Marker Gene Analysis. International Journal of Data Mining and Bioinformatics 2010. to appear to appear

    Google Scholar 

  34. Shi XX, Liu Q, Fan W, Yang Q, SYu P: Predictive Modeling with Heterogeneous Sources. The 2010 SIAM International Conference on Data Mining (SDM'2010) 2010, in press.

    Google Scholar 

  35. Hoerl A, Kennard R: Ridge regression: Biased estimation for nonorthogonal problems. Technometrics 2000, 80–86. 10.2307/1271436

    Google Scholar 

  36. An S, Liu W, Venkatesh S: Face recognition using kernel ridge regression. IEEE Conference on Computer Vision and Pattern Recognition 2007, 1–7. full_text

    Google Scholar 

  37. Dietterich T: Approximate statistical tests for comparing supervised classification learning algorithms. Neural computation 1998, 10(7):1895–1923. 10.1162/089976698300017197

    Article  PubMed  Google Scholar 

  38. Allenby G, Rossi P: Marketing models of consumer heterogeneity. Journal of Econometircs 1999, 89: 57–78. 10.1016/S0304-4076(98)00055-4

    Article  Google Scholar 

  39. Arora AGN, Ginter J: Hierarchical Bayes Model of Primary and Secondary Demand. Marketing Science 1998, 17(1):29–44. 10.1287/mksc.17.1.29

    Article  Google Scholar 

  40. Bakker B, Heskes T: Task Clustering and Gating for Bayesian Multitask Learning. Journal of Machine Learning Research 2003, 4: 83–99. 10.1162/153244304322765658

    Google Scholar 

  41. Ando R, Zhang T: A Framework for Learning Predictive Structures from Multiple Tasks and Unlabeled Data. Marketing Science 2005, 6: 1817–1853.

    Google Scholar 

  42. Evgeniou T, Micchelli C, Pontil M: Learning multiple tasks with kernel methods. Journal of Machine Learning Research 2006, 6: 615.

    Google Scholar 

  43. Yu TVK, Schwaighofer A: Learning Gaussian processes from multiple tasks. ICML 2005.

    Google Scholar 

  44. Baxter J: A Model of Inductive Bias Learning. J Artif Intell Res 2000, 12: 149–198.

    Google Scholar 

  45. Ben-David S, Schuller R: Exploiting task relatedness for multiple task learning. Lecture notes in computer science 2003, 567–580.

    Google Scholar 

  46. Caruana R: Multitask Learning. Machine Learning 1997, 28(1):41–75. 10.1023/A:1007379606734

    Article  Google Scholar 

  47. Argyriou A, Evgeniou T, Pontil M: Multi-task feature learning. Advances in Neural Information Processing Systems: Proceedings of the 2006 Conference, MIT Press 2007, 41.

    Google Scholar 

  48. Bi J, Xiong T, Yu S, Dundar M, Rao R: An Improved Multi-task Learning Approach with Applications in Medical Diagnosis. Proceedings of the 2008 European Conference on Machine Learning and Knowledge Discovery in Databases-Part I, Springer 2008, 117–132.

    Google Scholar 

  49. Bickel S, Bogojeska J, Lengauer T, Scheffer T: Multi-task learning for HIV therapy screening. Proceedings of the 25th international conference on Machine learning, ACM New York, NY, USA 2008, 56–63. full_text

    Google Scholar 

  50. Yang J, Li G, Meng H, Yang M, Deng Y: Improving prediction accuracy of tumor classification by reusing genes discarded during gene selection. BMC genomics 2008, 9(Suppl 1):S3. 10.1186/1471-2164-9-S1-S3

    Article  Google Scholar 

  51. Ichihara M, Murakumo Y, Masuda A, Matsuura T, Asai N, Jijiwa M, Ishida M, Shinmi J, Yatsuya H, Qiao S, et al.: Thermodynamic instability of siRNA duplex is a prerequisite for dependable prediction of siRNA activities. Nucleic Acids Research 2007, e123. 10.1093/nar/gkm699

    Google Scholar 

  52. Patzel V: In silico selection of active siRNA. Drug Discovery Today 2007, 12(3–4):139–148. 10.1016/j.drudis.2006.11.015

    Article  CAS  PubMed  Google Scholar 

  53. Krueger U, Bergauer T, Kaufmann B, Wolter I, Pilk S, Heider-Fabian M, Kirch S, Artz-Oppitz C, Isselhorst M, Konrad J: Insights into effective RNAi gained from large-scale siRNA validation screening. Oligonucleotides 2007, 17(2):237–250. 10.1089/oli.2006.0065

    Article  CAS  PubMed  Google Scholar 

  54. Kurreck J: si RNA Efficiency: Structure or Sequence - That Is the Question. Journal of Biomedicine and Biotechnology 2006, 2006: 1–7. 10.1155/JBB/2006/83757

    Article  Google Scholar 

  55. Luo K, Chang D: The gene-silencing efficiency of siRNA is strongly dependent on the local structure of mRNA at the targeted region. Biochemical and Biophysical Research Communications 2004, 318: 303–310. 10.1016/j.bbrc.2004.04.027

    Article  CAS  PubMed  Google Scholar 

  56. Matveeva O, Nechipurenko Y, Rossi L, Moore B, Saetrom P, Ogurtsov A, Atkins J, Shabalina S: Comparison of approaches for rational siRNA design leading to a new efficient and transparent method. Nucleic Acids Research 2007, 35(8):e63. 10.1093/nar/gkm088

    Article  PubMed  PubMed Central  Google Scholar 

  57. Shao Y, Chan C, Maliyekkel A, Lawrence C, Roninson I, Ding Y: Effect of target secondary structure on RNAi efficiency. RNA 2007, 13(10):1631. 10.1261/rna.546207

    Article  CAS  PubMed  PubMed Central  Google Scholar 

Download references

Acknowledgements

This work was supported in part by Project HKUST-RPC06/07.EG09, Hong Kong University of Science and Technology. The authors would like to thank other members of Prof. Qiang Yang's research group at the Hong Kong University of Science and Technology for their helpful discussions and support. We also thank Prof. Argyriou A in University College London for sharing the multi-task learning scripts.

Author information

Authors and Affiliations

  1. College of Life Science and Biotechnology, Tongji University, China

    Qi Liu & Zhiwei Cao

  2. Department of Computer Science and Engineering, Hong Kong University of Science and Technology, Hong Kong

    Qi Liu, Qian Xu, Vincent W Zheng & Qiang Yang

  3. Department of Biochemistry, Hong Kong University of Science and Technology, Hong Kong

    Hong Xue

  4. Shanghai Center for Bioinformation Technology, China

    Zhiwei Cao

Authors
  1. Qi Liu
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Qian Xu
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Vincent W Zheng
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Hong Xue
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Zhiwei Cao
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Qiang Yang
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Qiang Yang.

Additional information

Authors' contributions

QL carried out the design and implementation of the specific computational framework for siRNA efficacy prediction and drafted the manuscript. QX modeled the cross-platform data analysis on biological data as a general multi-task learning scheme. WZ was responsible for the multi-task learning algorithm analysis from a data mining perspective. HX, ZC and QY guided the machine learning study and coordinated the required data analysis. All authors read and approved the final manuscript.

Electronic supplementary material

12859_2009_3638_MOESM1_ESM.DOC

Additional file 1: Supplementary materials for the manuscript. This file contains detailed explanation of multi-task learning algorithm, together with the description of the data used in our study (DOC 230 KB)

Authors’ original submitted files for images

Below are the links to the authors’ original submitted files for images.

Authors’ original file for figure 1

Authors’ original file for figure 2

Rights and permissions

Open Access This article is published under license to BioMed Central Ltd. This is an Open Access article is distributed under the terms of the Creative Commons Attribution License ( https://creativecommons.org/licenses/by/2.0 ), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Reprints and permissions

About this article

Cite this article

Liu, Q., Xu, Q., Zheng, V.W. et al. Multi-task learning for cross-platform siRNA efficacy prediction: an in-silico study. BMC Bioinformatics 11, 181 (2010). https://doi.org/10.1186/1471-2105-11-181

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/1471-2105-11-181

Keywords

BMC Bioinformatics

ISSN: 1471-2105

Contact us