• Top
• Abstract
• Background
• Results and Discussion
• Conclusion
• Methods
• Authors' contributions
• Acknowledgements
• References

Methodology article

A copula method for modeling directional dependence of genes

Jong-Min Kim¹ , Yoon-Sung Jung² , Engin A Sungur¹ , Kap-Hoon Han³ , Changyi Park⁴ and Insuk Sohn⁵

¹Division of Science and Mathematics, University of Minnesota, Morris, MN, 56267, USA

²Department of Statistics, Kansas State University, Manhattan, Kansas, 66506, USA

³Department of Pharmaceutical Engineering, Woosuk University, Wanju, Jeonbuk, 565-701, Republic of Korea

⁴Department of Statistics, University of Seoul, Seoul 136-743, Republic of Korea

⁵Department of Statistics, Korea University, Seoul 136-701, Republic of Korea

author email corresponding author email

BMC Bioinformatics 2008, 9:225doi:10.1186/1471-2105-9-225

The electronic version of this article is the complete one and can be found online at: http://www.biomedcentral.com/1471-2105/9/225

Received:	23 November 2007
Accepted:	1 May 2008
Published:	1 May 2008

© 2008 Kim et al; licensee BioMed Central Ltd.
This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Abstract

Background

Genes interact with each other as basic building blocks of life, forming a complicated network. The relationship between groups of genes with different functions can be represented as gene networks. With the deposition of huge microarray data sets in public domains, study on gene networking is now possible. In recent years, there has been an increasing interest in the reconstruction of gene networks from gene expression data. Recent work includes linear models, Boolean network models, and Bayesian networks. Among them, Bayesian networks seem to be the most effective in constructing gene networks. A major problem with the Bayesian network approach is the excessive computational time. This problem is due to the interactive feature of the method that requires large search space. Since fitting a model by using the copulas does not require iterations, elicitation of the priors, and complicated calculations of posterior distributions, the need for reference to extensive search spaces can be eliminated leading to manageable computational affords. Bayesian network approach produces a discretely expression of conditional probabilities. Discreteness of the characteristics is not required in the copula approach which involves use of uniform representation of the continuous random variables. Our method is able to overcome the limitation of Bayesian network method for gene-gene interaction, i.e. information loss due to binary transformation.

Results

We analyzed the gene interactions for two gene data sets (one group is eight histone genes and the other group is 19 genes which include DNA polymerases, DNA helicase, type B cyclin genes, DNA primases, radiation sensitive genes, repaire related genes, replication protein A encoding gene, DNA replication initiation factor, securin gene, nucleosome assembly factor, and a subunit of the cohesin complex) by adopting a measure of directional dependence based on a copula function. We have compared our results with those from other methods in the literature. Although microarray results show a transcriptional co-regulation pattern and do not imply that the gene products are physically interactive, this tight genetic connection may suggest that each gene product has either direct or indirect connections between the other gene products. Indeed, recent comprehensive analysis of a protein interaction map revealed that those histone genes are physically connected with each other, supporting the results obtained by our method.

Conclusion

The results illustrate that our method can be an alternative to Bayesian networks in modeling gene interactions. One advantage of our approach is that dependence between genes is not assumed to be linear. Another advantage is that our approach can detect directional dependence. We expect that our study may help to design artificial drug candidates, which can block or activate biologically meaningful pathways. Moreover, our copula approach can be extended to investigate the effects of local environments on protein-protein interactions. The copula mutual information approach will help to propose the new variant of ARACNE (Algorithm for the Reconstruction of Accurate Cellular Networks): an algorithm for the reconstruction of gene regulatory networks.

Background

Genes interact with each other as basic building blocks of life, forming a complicated network. The relationship between groups of genes with different functions can be represented as gene networks. Recent developments in microarray technology revolutionized research in the life sciences, allowing researchers to measure tens of thousands of genes simultaneously [1,2]. With the deposition of huge microarray data sets in public domains, study on gene networking is now possible. Reconstructing gene networks from the microarray data will facilitate cellular function dissection at the molecular level. Hence the study will have a profound impact on biomedical research, ranging from cancer research to disease prevention [3].

There has been an increasing interest in the reconstruction of gene networks from gene expression data. Recent works include linear models [4,5], Boolean network models [6], and Bayesian networks [3,7-10]. Bayesian networks seem to be very effective in the construction of gene networks. They can incorporate prior knowledge from biology into their models and handle missing data effectively. In particular, dynamic Bayesian networks can learn a gene network from time-course gene expressions. As noted in [9], a major problem with Bayesian networks is the computation problem. Our motivation is to overcome this limitation of Bayesian networks in gene interactions. For this purpose, we introduce a simple method for constructing gene networks based on copulas. Note that copulas can model a variety of interactions.

In statistical literature, the general way to describe dependence between correlated random variables is to use copulas [11]. Copulas are multivariate distribution functions whose one-dimensional margins are uniform on the [0, 1] interval [12]. Copulas are useful for constructing joint distributions, especially with nonnormal random variables. The design, features, and some implementation details of the R package copula can be easily extended in multivariate modeling in many fields [13]. In finance, copula functions are adopted to handle the interaction between the markets and risk factors in a flexible way [14]. In biology, a gaussian copula has been applied in quantitative trait linkage. Copulas play an important role in developing a unified likelihood framework to analyze discrete, continuous, and censored traits [15]. In principle, copulas can be used to model the joint distributions of any discrete or continuous gene and even mixed continuous and discrete genes. In [16], several measures of directional dependence in regression based on copula functions were proposed. Recently, a sieve maximum likelihood estimation procedure for semiparametric multivariate copula models has been proposed in [17]. The proposed estimation achieved efficiency gains in finite samples, especially when prior information of the marginal distribution is incorporated. In this paper, we adopt a measure of directional dependence to investigate the gene interactions for yeast cell cycle data. One advantage of our approach is that dependence between genes is not assumed to be linear. Moreover, our approach can detect directional dependence. Hence our approach can provide valuable biological information on the presence of directional dependence between genes.

Results and Discussion

In this section, we analyze yeast cell cycle regulation [18]. The data set is composed of measurements on 6221 genes observed at 80 time points. 800 genes regulated by cell cycle were identified. To compare our results with other results in the literature, we selected two groups of genes with known interaction patterns. Note that known interactions are still incomplete at present. The first group includes eight histone genes-HHT1, HHT2, HHF1, HHF2, HTA1, HTA2, HTB1 and HTB2. These eight genes encode for the four histones (H2A, H2B, H3 and H4). The histones are used to form the fundamental packaging unit of chromatin, called the code of nucleosome. Chromosomes, consisting of DNA and histones, need to be replicated before cell division. Expression of the histone genes should be regulated tightly for the proper functioning of the replication process. Figure 1 shows the time-series plot of genes in the histone group. It can be easily seen that the eight genes in the histone group are highly correlated with each other. Looking at Table 1 and Figure 2 for Group I dataset, we can find that those AIC values have pretty low values. It means that our copula method for group I dataset is appropriate. ¿From Figure 3 and [see Additional file 1] for Group II dataset, we also find that those AIC values have relatively inconsistent low values compared to Group I dataset. It still means that our copula method for group II dataset is also appropriate.

Because of the small number of gene data sets, the estimates of FGM parameters and proportions for directional dependence in Table 1 do not strongly support our claim that each pair of these 8 histone genes are dependent on each other in both directions. Figure 4 shows 3-dimensional and contour plots for HTA1 vs HTB2, HTA2 vs HTB1, HTA2 vs HTB2, and HTB1 vs HTB2. Irregularly shaped contours indicate the existence of directional dependence, i.e., the asymmetry of dependence. From the plots, we see that the asymmetry of dependence is not clear for each pair of genes. Contour plots for other pairs of histone genes show similar patterns. Figure 4 together with Table 1 tells us that the 3D and contour plots are relatively symmetric which means a weak directional dependence in this gene data set.

To further evaluate the performance of the FGM copula model, we selected another group (Group II) which is comparatively larger than the first group. This group consisted of 19 genes which include DNA polymerases (POL1, POL2, POL12, and POL30), DNA helicase (HPR5), type B cyclin genes (CLB5 and CLB6), DNA primases (PRI1 and PRI2), radiation sensitive genes (RAD53 and RAD54), repaire related genes (MSH2, MSH6, and PMS1), replication protein A encoding gene (RFA3), DNA replication initiation factor (CDC45), securin gene (PDS1), nucleosome assembly factor (ASF1), and a subunit of the cohesin complex (MCD1). These genes play important role in the process of cell cycle which conducts DNA replication initiation, DNA damage-induced checkpoint arrest, DNA damage repair, formation of mitotic spindle, and so on. However, similar to the histone genes, their expression is also strictly regulated for the normal cellular process [19]. The estimates of FGM parameters and proportions for directional dependence [see Additional file 1] clearly support our claim that each pair of 19 genes are dependent on each other in both directions, which is consistent with the observation from Figure 5 and Figure 6.

Note that the measures of dependence , , and have different scales from usual correlation coefficient. Since Pearson's correlation coefficient is based on the assumption of normality and linearity of random variables X and Y, the range of Pearson's correlation is usually wider than that of our measures of directional dependence. Furthermore, Pearson's correlation coefficient depends on random variables X and Y, while the measures of directional dependence depend on the joint function of their cumulative distribution functions. Therefore, depending on the copula function adopted, the scales of the measures can be different. Also, when we use the uniform distribution or exponential distribution for the transformation of the marginal cumulative distribution functions of X and Y, the measure of dependence can be smaller than Pearson's Correlation coefficient. For a comparison of the measure of dependence of our FGM copula model, we used the normal copula model which is one of the representative copula models. If we look at the FGM type and Normal type in Table 1 and [see Additional file 1], we find that depending on the gene data pair, the measures of dependence using the normal copula has more variation then the measures of dependence using our proposed FGM copula. In light of these facts, our results are valid and consistent. To support our results, we also provided the matematical derivations of our proposed FGM copula model in the method section.

The results from our method have been compared with those from other methods such as PathwayAssist and Chen's method [3]. PathwayAssist (version 3.0) is based on a comprehensive gene (or protein) interaction database compiled by a text mining tool from the entire PubMed [20]. Our method found 28 edges among these 8 genes. From Table 2, we find that a PathwayAssist search identified 13 edges and Chen's method identified 12 edges. However, because two copies of each core histone i.e., H2A, H2B, H3 and H4, are assembled into an octamer, all 8 core histones can interact with each other. The 28 edges we found indicate that each histone gene is connected with the remaining 7 histone genes. All possible pairs of interaction genes from the group II [see Additional file 2]. The reason is that by using the FGM copula model, we are better able to investigate the better directional interaction dependence compared to PathwayAssist and Chen's method [3].

Although microarray results show a transcriptional co-regulation pattern and do not imply that the gene products are physically interactive, this tight genetic connection may suggest that each gene product has either direct or indirect connections between the other gene products. Indeed, recent comprehensive analysis of a protein interaction map revealed that those histone genes are physically connected with each other [19], supporting the results obtained by our method. The findings of this study may help to design artificial drug candidates, which can block or activate biologically meaningful pathways. Furthermore, our copula approach can be extended to investigate the effects of local environments on protein-protein interactions. The copula mutual information approach will help to propose a new variant of ARACNE: an algorithm for the reconstruction of gene regulatory networks.

Conclusion

In this paper, we presented a new methodology for analyzing gene interactions based on copula functions. Our method is shown to be useful in the construction of gene networks through the analysis of yeast cell cycle data. Our method may be able to overcome the limitation of Bayesian network method for gene-gene interaction, i.e. information loss due to binary transformation. Since a copula represents a way of extracting the dependence structure of the random variables from the joint distribution function, it is a useful approach to understanding and modeling dependent structure for random variables. In our future works on gene directional dependence, we will develop hypothesis testing for directional dependence and formulate a network construction process using false discovery rate.

Methods

For presentation, let us consider a bivariate case. All the results in this section can be generalized to a multivariate case. Consider a bivariate copula C : [0, 1]²→ [0, 1] defined as

C(u, v) = Pr(U ≤ u, V ≤ v)

for 0 ≤ u, v ≤ 1 where U and V are uniform random variables. Let X and Y be random variables with marginal distribution functions F_X and F_Y . Then F_X (X) and F_Y (Y) have uniform distributions. By Sklar's Theorem, due to [21], there exits a copula C such that F (x, y) = C(F_X (x), F_Y (y)) for all x and y in the domain of F_X and F_Y, i.e. a bivariate distribution function can be represented as a function of its marginals joined by a bivariate copula. Hence different families of copula correspond to different types of dependence structure. An example is the Farlie – Gumbel – Morgenstern class defined as uv [1 + θ (1 - u)(1 - v)] with θ ≥ 0. See [12] for a general introduction to copulas.

Now we discuss the concept and measures of directional dependence briefly. One may consider two types of directional dependence between two random variables U and V in regression: r_V|U (u) = E[V|U = u] and r_U|V (v) = E[U|V = v] for the Rodrìguez-Lallena and Úbeda-Flores family of copula in the form of

C(u, v) = uv + f(u)g(v),(1)

where E[V|U = u] is the conditional expectation of V given that U = u [22]. Note that a specific functional form of f and g determines the corresponding family of bivariate distributions of (U, V). If f and g are different, then the copula is not symmetric, in which case the form of the regression functions for V and U will be different. Hence one might consider two types of directional dependence, i.e. one in the direction from U to V and the other in the direction from V to U. Since directional dependence can arise from marginal or joint behavior or both, one may consider the following general measure of directional dependence defined as

(2)

where is the proportion of the k-th central moment of Y explained by the regression of Y on X. For example, can be interpreted as the proportion of variation explained by the regression of Y on X with respect to total variation of Y. For more details, see [16].

Finally, let us introduce the FGM distributions and measures of directional dependence for our data analysis. We consider the following type of FGM distributions in the form of the Rodrìguez-Lallena and Úbeda-Flores copula family in (1):

C(u, v) = uv + θ uv(1 - u)^α (1 - v)^β for 0 ≤ u, v = 1 and α, β ≥ 1,(3)

where θ, α and β are parameters. C(u, v) defined in (3) is a copula function for θ satisfying

(4)

see [23].

Let X_i and Y_i be i.i.d. copies of X and Y for i = 1, ..., n. Then U_i = F_X (X_i) and V_i = F_Y (Y_i) are the empirical marginal distribution functions of F_X and F_Y. Note that U_i and V_i have uniform distributions on (0, 1). The empirical likelihood is

(5)

where U = (U₁, ..., U_n)' and V = (V₁, ..., V_n)'. From (3), the empirical likelihood function is

Solving

subject to α, β ≥ 1, one obtains the estimates of α and β denoted by and . Since log L(θ; u, v) is a linear function of θ with known and , there is no closed form solution for MLE from the partial derivative function with respect to θ. As an alternative, we used a grid search over the range of θ with α = and β = .

For (3), we have and . The directional dependence from U to V and from V to U are given as

and

where Beta(·,·) is the beta function defined by for a, b > 0.

By considering the proportion of variation for the directional dependence, two types of measure can be derived. From (2) with k = 2, we have

where Spearman's correlation coefficient, ρ_c, is

Also, the following is a good case of extracting dependence information from a bivariate normal distribution function with respect to ρ. The relation is

where

and

We consider a parameterized copula which has θ_* ϕ(Φ^-1 (u), Φ^-1 (v); α θ_*) instead of θ uv(1 - u)^α (1 - v)^β at (3).

The form is as follows:

C(u, v) = uv + θ_* ϕ(Φ^-1 (u), Φ^-1 (v); α θ_*) for 0 ≤ u, v ≤ 1,(6)

where θ_* is a parameter, α satisfies the following relation

and

¿From (6), the form of Spearman's correlation coefficient is

(7)

We use Akaike's information criterion (AIC) [24] for copula defined as

AIC = -2 log L (θ; u, v) + 2υ,

where υ is the number of parameters of the model provided in [25]. Akaike developed a decision-making strategy based on the Kullback-Leibler information measure, arguing that his measure provides a natural criterion for ordering alternative statistical models for data [24]. Instead of comparing plots or p-values for the methods, in the case of the parametric approach of maximum likelihood, we can compare the value of the negative log-likelihood functions. The value of AIC contains the information which estimator fits better. The lower the AIC, the better the model.

Authors' contributions

J–MK proposed the research project and wrote the manuscript. Y–SJ performed statistical analysis. EAS supported the directional dependence with copula. K–HH performed the biological analysis and wrote a part of the manuscript. CP supported the research and IS designed the experiments. All authors read and approved the final manuscript.

Acknowledgements

We are grateful to anonymous reviewers for their valuable comments. This research was supported by the Korea Research Foundation Grant funded by Korean Government (MOEHRD, Basic Research Promotion Fund) (KRF-2005-070-C00020).

References

1. Lipshutz RJ, Morris D, Chee M, Hubbell E, Kozal MJ, Shah N, Shen N, Yang R, Fodor SPA: Using oligonucleotide probe arrays to access genetic diversity.

   Biotechniques 1995, 19:442-447. PubMed Abstract

2. Schena M, Shalon D, Davis RW, Brown PO: Quantitative monitoring of gene expression patterns with a complementary DNA microarray.

   Science 1995, 270:467-470. PubMed Abstract | Publisher Full Text

3. Chen XW, Anatha G, Wang X: An effective structure learning method for constructing gene networks.

   Bioinformatics 2006, 22:1367-1374. PubMed Abstract | Publisher Full Text

4. Chen KC, Wang TY, Tseng HH, Huang CYF, Kao CY: A stochastic differential equation model for quantifying transcriptional regulartory network in Saccharomyces cerevisiae.

   Bioinformatics 2005, 21:2883-2890. PubMed Abstract | Publisher Full Text

5. Deng X, Geng H, Ali H: EXAMINE: a computational approach to reconstructing gene regulartory networks.

   Biosystems 2005, 81:125-136. PubMed Abstract | Publisher Full Text

6. Shmulevich I, Dougherty E, Kim S, Zhang W: Probabilistic Boolean Networks: a rule-based uncertainty model for gene regulartory networks.

   Bioinformatics 2002, 18:261-274. PubMed Abstract | Publisher Full Text

7. Bulashevska S, Eils R: Inferring genetic regulatory logic from expression data.

   Bioinformatics 2005, 21:2706-2713. PubMed Abstract | Publisher Full Text

8. Li H, Lu L, Manly KF, Chesler EJ, Bao L, Wang J, Zhou M, Williams RW, Cui Y: Inferring gene transcriptional modulatory relations: a genetical genomics approach.

   Human Molecular Genetics 2005, 14:1119-1125. PubMed Abstract | Publisher Full Text

9. Zou M, Conzen SD: A new dynamic Bayesian network (DBN) approach for identifying gene regulatory networks from time course microarray data.

   Bioinformatics 2005, 21:71-79. PubMed Abstract | Publisher Full Text

10. Missal K, Cross MA, Drasdo D: Gene network inference from incomplete expression data: transcriptional control of hematopoietic commitment.

    Bioinformatics 2006, 22:731-738. PubMed Abstract | Publisher Full Text

11. Sklar A: Functions de repartition a n dimensions et leurs marges.

    Publ Inst Stat Univ Paris 1959, 8:229-231.

12. Nelsen RB: An Introduction to Copulas. New York: Springer-Verlag; 1998.

13. Yan J: Enjoy the Joy of Copulas.

    Technical Report #365, Department of Statistics and Acturial Science, University of Iowa 2006.

14. Cherubini U, Luciano E, Vecchiato W: Copula Methods in Finance. New York: John Wiley & Sons; 2004.

15. Li M, Boehnke M, Abecasis GR, Song PXK: Quantitative Trait Linkage Analysis Using Gaussian Copulas.

    Genetics 2006, 173:2317-2327. PubMed Abstract | Publisher Full Text | PubMed Central Full Text

16. Sungur EA: A Note on Directional Dependence in Regression Setting.

    Communications in Statistics: Theory and Methodology 2005, 34:1957-1965. Publisher Full Text

17. Chen X, Fan Y, Tsyrennikov V: Efficient Estimation of Semiparametric Multivariate Copula Models.

    Journal of the American Statistical Association 2006, 101:1228-1240. Publisher Full Text

18. Spellman PT, Sherlock G, Zhang MQ, Iyer VR, Anders K, Eisen MB, Brown PO, Botstein D, Futcher B: Comprehensive identification of cell cycle-regulated genes of the yeast Saccharomyces cerevisiae by microarray hybridization.

    Molecular Biology of the Cell 1998, 9:3273-3297. PubMed Abstract | Publisher Full Text | PubMed Central Full Text

19. von Mering C, Krause R, Snel B, Cornell M, Oliver SG, Fields S, Bork P: Comparative assessment of large-scale datasets of protein-protein interactions.

    Nature 2002, 417:399-403. PubMed Abstract | Publisher Full Text

20. Nikitin A, Egorov S, Daraselia N, Mazo I: Pathway studio-the analysis and navigation of molecular networks.

    Bioinformatics 2003, 19:2155-2157. PubMed Abstract | Publisher Full Text

21. Sklar A: Random variables, joint distribution functions, and copulas.

    Kybernetika (Prague) 1973, 9:449-460.

22. Rodrìguez-Lallena JA, Úbeda Flores M: A new class of bivariate copulas.

    Statistics and Probability Letters 2004, 66:315-325. Publisher Full Text

23. Bairamov I, Kotz S, Bekçi M: New generalized Farlie-Gumbel-Morgenstern distributions and concomitants of order statistics.

    Journal of Applied Statistics 2001, 28:521-536. Publisher Full Text

24. Akaike H: A new look at the statistical model identification.

    IEEE Transactions on Automatic Control 1974, 19:716-723. Publisher Full Text

25. Matteis RD: Fitting copula to data. PhD thesis. Institute of Mathematics, University of Zurich; 2001.

Have something to say? Post a comment on this article!